[==========] Running 8 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 6 tests from LeaderRebalancerTest
[ RUN      ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20260709 12:22:38.444166  4821 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.181.126:34977
I20260709 12:22:38.445793  4821 env_posix.cc:2285] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260709 12:22:38.446900  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:38.464165  4828 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:38.464196  4830 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:38.464210  4827 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:39.585834  4829 instance_detector.cc:116] could not retrieve GCE instance metadata: Timed out: curl timeout: Timeout was reached: Connection time-out
I20260709 12:22:39.585935  4821 server_base.cc:1056] Not found: could not retrieve instance metadata: unable to detect cloud type of this node, probably running in non-cloud environment
I20260709 12:22:39.590173  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:39.590417  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:39.590633  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783599759590613 us; error 0 us; skew 500 ppm
I20260709 12:22:39.591424  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:39.597448  4821 webserver.cc:533] Webserver started at http://127.4.181.126:39849/ using document root <none> and password file <none>
I20260709 12:22:39.598282  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:39.598501  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:39.598927  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:39.604761  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/master-0-root/instance:
uuid: "3a8b07956ece4cc7aa43fd231423c1c5"
format_stamp: "Formatted at 2026-07-09 12:22:39 on dist-test-slave-k014"
I20260709 12:22:39.612798  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.007s	user 0.001s	sys 0.008s
I20260709 12:22:39.618518  4836 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:39.619791  4821 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:22:39.620118  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/master-0-root
uuid: "3a8b07956ece4cc7aa43fd231423c1c5"
format_stamp: "Formatted at 2026-07-09 12:22:39 on dist-test-slave-k014"
I20260709 12:22:39.620424  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:39.676846  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:39.678359  4821 env_posix.cc:2285] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260709 12:22:39.678810  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:39.747104  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.126:34977
I20260709 12:22:39.747175  4887 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.126:34977 every 8 connection(s)
I20260709 12:22:39.754982  4888 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:39.778061  4888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5: Bootstrap starting.
I20260709 12:22:39.783917  4888 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:39.785712  4888 log.cc:826] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5: Log is configured to *not* fsync() on all Append() calls
I20260709 12:22:39.790144  4888 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5: No bootstrap required, opened a new log
I20260709 12:22:39.810693  4888 raft_consensus.cc:359] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a8b07956ece4cc7aa43fd231423c1c5" member_type: VOTER }
I20260709 12:22:39.811251  4888 raft_consensus.cc:385] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:39.811455  4888 raft_consensus.cc:740] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3a8b07956ece4cc7aa43fd231423c1c5, State: Initialized, Role: FOLLOWER
I20260709 12:22:39.812263  4888 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a8b07956ece4cc7aa43fd231423c1c5" member_type: VOTER }
I20260709 12:22:39.812705  4888 raft_consensus.cc:399] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:22:39.812943  4888 raft_consensus.cc:493] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:22:39.813228  4888 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:39.817199  4888 raft_consensus.cc:515] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a8b07956ece4cc7aa43fd231423c1c5" member_type: VOTER }
I20260709 12:22:39.817843  4888 leader_election.cc:304] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3a8b07956ece4cc7aa43fd231423c1c5; no voters: 
I20260709 12:22:39.819425  4888 leader_election.cc:290] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:22:39.819736  4891 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:39.821740  4891 raft_consensus.cc:697] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [term 1 LEADER]: Becoming Leader. State: Replica: 3a8b07956ece4cc7aa43fd231423c1c5, State: Running, Role: LEADER
I20260709 12:22:39.822677  4891 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a8b07956ece4cc7aa43fd231423c1c5" member_type: VOTER }
I20260709 12:22:39.823649  4888 sys_catalog.cc:565] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:22:39.832046  4893 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3a8b07956ece4cc7aa43fd231423c1c5. Latest consensus state: current_term: 1 leader_uuid: "3a8b07956ece4cc7aa43fd231423c1c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a8b07956ece4cc7aa43fd231423c1c5" member_type: VOTER } }
I20260709 12:22:39.832775  4893 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:39.832584  4892 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3a8b07956ece4cc7aa43fd231423c1c5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3a8b07956ece4cc7aa43fd231423c1c5" member_type: VOTER } }
I20260709 12:22:39.833184  4892 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:22:39.836019  4899 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:22:39.847304  4899 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:22:39.849565  4821 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:22:39.866659  4899 catalog_manager.cc:1383] Generated new cluster ID: 5bc2fcf59f6a4b4f9ab1be96d9c7b2d5
I20260709 12:22:39.866937  4899 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:22:39.882637  4899 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:22:39.884234  4899 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:22:39.899530  4899 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5: Generated new TSK 0
I20260709 12:22:39.900472  4899 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:22:39.916357  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:39.924834  4910 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:39.925926  4911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:39.930955  4913 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:39.930998  4821 server_base.cc:1061] running on GCE node
I20260709 12:22:39.932013  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:39.932240  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:39.932403  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783599759932386 us; error 0 us; skew 500 ppm
I20260709 12:22:39.932973  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:39.937511  4821 webserver.cc:533] Webserver started at http://127.4.181.65:46457/ using document root <none> and password file <none>
I20260709 12:22:39.938447  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:39.938771  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:39.939164  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:39.940933  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-0-root/instance:
uuid: "eda50ab5b6bc429c866d526f072e6364"
format_stamp: "Formatted at 2026-07-09 12:22:39 on dist-test-slave-k014"
I20260709 12:22:39.948151  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.005s	sys 0.004s
I20260709 12:22:39.953771  4918 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:39.954636  4821 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:22:39.954953  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-0-root
uuid: "eda50ab5b6bc429c866d526f072e6364"
format_stamp: "Formatted at 2026-07-09 12:22:39 on dist-test-slave-k014"
I20260709 12:22:39.955253  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:39.985258  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:39.986696  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:39.989396  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:39.993981  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:39.994310  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:39.994604  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:39.994782  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:40.092494  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.65:41309
I20260709 12:22:40.092577  4980 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.65:41309 every 8 connection(s)
I20260709 12:22:40.100275  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:40.112108  4985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:40.115270  4986 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:40.119455  4821 server_base.cc:1061] running on GCE node
W20260709 12:22:40.120185  4988 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:40.121464  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:40.121747  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:40.121944  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783599760121925 us; error 0 us; skew 500 ppm
I20260709 12:22:40.122754  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:40.126012  4821 webserver.cc:533] Webserver started at http://127.4.181.66:44879/ using document root <none> and password file <none>
I20260709 12:22:40.126716  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:40.126969  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:40.127274  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:40.128583  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-1-root/instance:
uuid: "c04f380d906642a8b357085d67bf51ad"
format_stamp: "Formatted at 2026-07-09 12:22:40 on dist-test-slave-k014"
I20260709 12:22:40.134198  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.001s	sys 0.006s
I20260709 12:22:40.138821  4993 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:40.139906  4821 fs_manager.cc:730] Time spent opening block manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:22:40.140818  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-1-root
uuid: "c04f380d906642a8b357085d67bf51ad"
format_stamp: "Formatted at 2026-07-09 12:22:40 on dist-test-slave-k014"
I20260709 12:22:40.141126  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:40.144019  4981 heartbeater.cc:344] Connected to a master server at 127.4.181.126:34977
I20260709 12:22:40.144558  4981 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:40.145864  4981 heartbeater.cc:507] Master 127.4.181.126:34977 requested a full tablet report, sending...
I20260709 12:22:40.149859  4853 ts_manager.cc:194] Registered new tserver with Master: eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309)
I20260709 12:22:40.153502  4853 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33338
I20260709 12:22:40.167876  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:40.169381  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:40.171666  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:40.174814  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:40.175226  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:40.175539  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:40.175710  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:40.269088  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.66:33241
I20260709 12:22:40.269397  5055 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.66:33241 every 8 connection(s)
I20260709 12:22:40.275468  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:22:40.286158  5059 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:22:40.288973  5060 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:40.291131  4821 server_base.cc:1061] running on GCE node
I20260709 12:22:40.292191  5056 heartbeater.cc:344] Connected to a master server at 127.4.181.126:34977
I20260709 12:22:40.292548  5056 heartbeater.cc:461] Registering TS with master...
W20260709 12:22:40.293081  5062 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:22:40.293334  5056 heartbeater.cc:507] Master 127.4.181.126:34977 requested a full tablet report, sending...
I20260709 12:22:40.294248  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:22:40.294555  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:22:40.294775  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783599760294753 us; error 0 us; skew 500 ppm
I20260709 12:22:40.295491  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:22:40.295895  4853 ts_manager.cc:194] Registered new tserver with Master: c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:40.297674  4853 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33342
I20260709 12:22:40.298303  4821 webserver.cc:533] Webserver started at http://127.4.181.67:33599/ using document root <none> and password file <none>
I20260709 12:22:40.298908  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:22:40.299147  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:22:40.299453  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:22:40.300742  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-2-root/instance:
uuid: "4489f3ff50774e7989ffcb4488f37e43"
format_stamp: "Formatted at 2026-07-09 12:22:40 on dist-test-slave-k014"
I20260709 12:22:40.305475  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.002s
I20260709 12:22:40.308825  5067 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:40.309648  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.000s	sys 0.002s
I20260709 12:22:40.309921  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-2-root
uuid: "4489f3ff50774e7989ffcb4488f37e43"
format_stamp: "Formatted at 2026-07-09 12:22:40 on dist-test-slave-k014"
I20260709 12:22:40.310189  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1783599758264527-4821-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:22:40.323439  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:22:40.324713  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:22:40.327198  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:22:40.330156  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:22:40.330387  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:40.330689  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:22:40.330860  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:22:40.417163  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.67:38499
I20260709 12:22:40.417254  5129 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.67:38499 every 8 connection(s)
I20260709 12:22:40.434131  5130 heartbeater.cc:344] Connected to a master server at 127.4.181.126:34977
I20260709 12:22:40.434581  5130 heartbeater.cc:461] Registering TS with master...
I20260709 12:22:40.435331  5130 heartbeater.cc:507] Master 127.4.181.126:34977 requested a full tablet report, sending...
I20260709 12:22:40.437354  4853 ts_manager.cc:194] Registered new tserver with Master: 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:40.437956  4821 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013447779s
I20260709 12:22:40.439286  4853 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:33352
I20260709 12:22:40.487066  4853 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:33364:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:22:40.490716  4853 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:22:40.601126  5021 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed3bfe15f74464c8900fa1cb1cffa1c (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:40.602487  5095 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed3bfe15f74464c8900fa1cb1cffa1c (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:40.602974  5021 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed3bfe15f74464c8900fa1cb1cffa1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.606076  5095 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed3bfe15f74464c8900fa1cb1cffa1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.614822  5093 tablet_service.cc:1511] Processing CreateTablet for tablet e292b2dac8df4bba9fcfd4aeea800f47 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:40.610939  5016 tablet_service.cc:1511] Processing CreateTablet for tablet 56bf1d6abb78450bbecfc1b0eb763942 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:40.626713  5093 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e292b2dac8df4bba9fcfd4aeea800f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.625327  5089 tablet_service.cc:1511] Processing CreateTablet for tablet 63a8d8d586214f4f886ca4daf541909b (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:40.622835  5018 tablet_service.cc:1511] Processing CreateTablet for tablet 6ada5e49b1b04466b75d60c8bedf99f4 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:40.623886  5090 tablet_service.cc:1511] Processing CreateTablet for tablet 56bf1d6abb78450bbecfc1b0eb763942 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:40.627305  5020 tablet_service.cc:1511] Processing CreateTablet for tablet 661f727556cd4598838d829886293fb0 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:40.628593  5091 tablet_service.cc:1511] Processing CreateTablet for tablet e509a6d816734ae99c8943ad78b11da8 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:40.622437  5019 tablet_service.cc:1511] Processing CreateTablet for tablet e292b2dac8df4bba9fcfd4aeea800f47 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:40.624392  5092 tablet_service.cc:1511] Processing CreateTablet for tablet 6ada5e49b1b04466b75d60c8bedf99f4 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:40.630373  5018 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ada5e49b1b04466b75d60c8bedf99f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.624464  5094 tablet_service.cc:1511] Processing CreateTablet for tablet 661f727556cd4598838d829886293fb0 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:40.630373  5090 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56bf1d6abb78450bbecfc1b0eb763942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.622485  5017 tablet_service.cc:1511] Processing CreateTablet for tablet e509a6d816734ae99c8943ad78b11da8 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:40.626735  5015 tablet_service.cc:1511] Processing CreateTablet for tablet 63a8d8d586214f4f886ca4daf541909b (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:40.640434  5014 tablet_service.cc:1511] Processing CreateTablet for tablet 60143441eb3f4597b63bafb3a6e7ab55 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:40.642638  5091 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e509a6d816734ae99c8943ad78b11da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.644757  5094 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661f727556cd4598838d829886293fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.645714  5016 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56bf1d6abb78450bbecfc1b0eb763942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.646431  5089 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a8d8d586214f4f886ca4daf541909b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.648646  5092 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ada5e49b1b04466b75d60c8bedf99f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.655246  5088 tablet_service.cc:1511] Processing CreateTablet for tablet 60143441eb3f4597b63bafb3a6e7ab55 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:40.661469  5088 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60143441eb3f4597b63bafb3a6e7ab55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.661949  5020 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661f727556cd4598838d829886293fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.673702  4946 tablet_service.cc:1511] Processing CreateTablet for tablet 6ed3bfe15f74464c8900fa1cb1cffa1c (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:22:40.676259  5017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e509a6d816734ae99c8943ad78b11da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.684818  4946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ed3bfe15f74464c8900fa1cb1cffa1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.678036  4945 tablet_service.cc:1511] Processing CreateTablet for tablet 661f727556cd4598838d829886293fb0 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:22:40.683599  4944 tablet_service.cc:1511] Processing CreateTablet for tablet e292b2dac8df4bba9fcfd4aeea800f47 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:22:40.687219  4942 tablet_service.cc:1511] Processing CreateTablet for tablet e509a6d816734ae99c8943ad78b11da8 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:22:40.689709  4944 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e292b2dac8df4bba9fcfd4aeea800f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.688340  5014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60143441eb3f4597b63bafb3a6e7ab55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.691495  4941 tablet_service.cc:1511] Processing CreateTablet for tablet 56bf1d6abb78450bbecfc1b0eb763942 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:22:40.696084  4939 tablet_service.cc:1511] Processing CreateTablet for tablet 60143441eb3f4597b63bafb3a6e7ab55 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:22:40.698988  4942 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e509a6d816734ae99c8943ad78b11da8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.722136  4938 tablet_service.cc:1511] Processing CreateTablet for tablet 4fcb5348e22d40699ea2bde45add77b4 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:40.691599  4943 tablet_service.cc:1511] Processing CreateTablet for tablet 6ada5e49b1b04466b75d60c8bedf99f4 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:22:40.729195  5013 tablet_service.cc:1511] Processing CreateTablet for tablet 4fcb5348e22d40699ea2bde45add77b4 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:40.695134  4940 tablet_service.cc:1511] Processing CreateTablet for tablet 63a8d8d586214f4f886ca4daf541909b (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:22:40.731832  4945 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 661f727556cd4598838d829886293fb0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.734401  4938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fcb5348e22d40699ea2bde45add77b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.735366  4941 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56bf1d6abb78450bbecfc1b0eb763942. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.738169  4940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a8d8d586214f4f886ca4daf541909b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.738902  5015 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63a8d8d586214f4f886ca4daf541909b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.739821  4939 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 60143441eb3f4597b63bafb3a6e7ab55. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.741811  4943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6ada5e49b1b04466b75d60c8bedf99f4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.768898  5019 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e292b2dac8df4bba9fcfd4aeea800f47. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.778965  5013 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fcb5348e22d40699ea2bde45add77b4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:22:40.794260  5087 tablet_service.cc:1511] Processing CreateTablet for tablet 4fcb5348e22d40699ea2bde45add77b4 (DEFAULT_TABLE table=test-workload [id=27625cd0d0e54651a95a6b3dfeba7b89]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:22:40.796454  5087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fcb5348e22d40699ea2bde45add77b4. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:22:40.847410  4901 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:40.879302  5149 tablet_bootstrap.cc:492] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364: Bootstrap starting.
I20260709 12:22:40.892481  5148 tablet_bootstrap.cc:492] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43: Bootstrap starting.
I20260709 12:22:40.939103  5150 tablet_bootstrap.cc:492] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad: Bootstrap starting.
I20260709 12:22:40.954972  5149 tablet_bootstrap.cc:654] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:40.960516  5148 tablet_bootstrap.cc:654] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:40.971909  5148 tablet_bootstrap.cc:492] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43: No bootstrap required, opened a new log
I20260709 12:22:40.972492  5148 ts_tablet_manager.cc:1403] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43: Time spent bootstrapping tablet: real 0.094s	user 0.006s	sys 0.007s
I20260709 12:22:40.973959  5149 tablet_bootstrap.cc:492] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364: No bootstrap required, opened a new log
I20260709 12:22:40.974570  5149 ts_tablet_manager.cc:1403] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364: Time spent bootstrapping tablet: real 0.096s	user 0.011s	sys 0.006s
I20260709 12:22:40.976475  5148 raft_consensus.cc:359] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:40.977299  5148 raft_consensus.cc:385] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:40.977632  5148 raft_consensus.cc:740] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.978086  5149 raft_consensus.cc:359] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:40.978963  5149 raft_consensus.cc:385] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:40.978519  5148 consensus_queue.cc:260] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:40.979388  5150 tablet_bootstrap.cc:654] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:40.979444  5149 raft_consensus.cc:740] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.980500  5149 consensus_queue.cc:260] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:40.988037  5130 heartbeater.cc:499] Master 127.4.181.126:34977 was elected leader, sending a full tablet report...
I20260709 12:22:40.988529  5148 ts_tablet_manager.cc:1434] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.008s
I20260709 12:22:40.989674  5148 tablet_bootstrap.cc:492] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43: Bootstrap starting.
I20260709 12:22:40.989928  5150 tablet_bootstrap.cc:492] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad: No bootstrap required, opened a new log
I20260709 12:22:40.990398  5150 ts_tablet_manager.cc:1403] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad: Time spent bootstrapping tablet: real 0.052s	user 0.009s	sys 0.005s
I20260709 12:22:40.993301  5150 raft_consensus.cc:359] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:40.994029  5150 raft_consensus.cc:385] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:40.994340  5150 raft_consensus.cc:740] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:40.995091  5150 consensus_queue.cc:260] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:40.996614  5148 tablet_bootstrap.cc:654] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:40.999080  5150 ts_tablet_manager.cc:1434] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:22:40.999755  5056 heartbeater.cc:499] Master 127.4.181.126:34977 was elected leader, sending a full tablet report...
I20260709 12:22:41.000962  5150 tablet_bootstrap.cc:492] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad: Bootstrap starting.
I20260709 12:22:41.007477  5150 tablet_bootstrap.cc:654] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.019634  5150 tablet_bootstrap.cc:492] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad: No bootstrap required, opened a new log
I20260709 12:22:41.020182  5150 ts_tablet_manager.cc:1403] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad: Time spent bootstrapping tablet: real 0.020s	user 0.008s	sys 0.008s
I20260709 12:22:41.021693  5149 ts_tablet_manager.cc:1434] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364: Time spent starting tablet: real 0.047s	user 0.008s	sys 0.004s
I20260709 12:22:41.022547  4981 heartbeater.cc:499] Master 127.4.181.126:34977 was elected leader, sending a full tablet report...
I20260709 12:22:41.022775  5149 tablet_bootstrap.cc:492] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364: Bootstrap starting.
I20260709 12:22:41.023068  5150 raft_consensus.cc:359] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.023764  5150 raft_consensus.cc:385] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.024042  5150 raft_consensus.cc:740] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.024912  5150 consensus_queue.cc:260] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.027289  5150 ts_tablet_manager.cc:1434] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:22:41.028193  5150 tablet_bootstrap.cc:492] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad: Bootstrap starting.
W20260709 12:22:41.030870  5057 tablet.cc:2406] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:22:41.036640  5150 tablet_bootstrap.cc:654] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.077715  5149 tablet_bootstrap.cc:654] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.083410  5148 tablet_bootstrap.cc:492] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43: No bootstrap required, opened a new log
I20260709 12:22:41.084028  5148 ts_tablet_manager.cc:1403] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43: Time spent bootstrapping tablet: real 0.095s	user 0.032s	sys 0.051s
I20260709 12:22:41.085011  5150 tablet_bootstrap.cc:492] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad: No bootstrap required, opened a new log
I20260709 12:22:41.085386  5149 tablet_bootstrap.cc:492] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364: No bootstrap required, opened a new log
I20260709 12:22:41.085495  5150 ts_tablet_manager.cc:1403] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad: Time spent bootstrapping tablet: real 0.057s	user 0.023s	sys 0.026s
I20260709 12:22:41.085858  5149 ts_tablet_manager.cc:1403] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364: Time spent bootstrapping tablet: real 0.063s	user 0.010s	sys 0.000s
I20260709 12:22:41.087237  5148 raft_consensus.cc:359] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.088068  5148 raft_consensus.cc:385] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.088431  5148 raft_consensus.cc:740] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.088430  5150 raft_consensus.cc:359] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.088591  5149 raft_consensus.cc:359] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.089351  5150 raft_consensus.cc:385] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.089397  5149 raft_consensus.cc:385] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.089766  5150 raft_consensus.cc:740] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.089813  5149 raft_consensus.cc:740] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.089603  5148 consensus_queue.cc:260] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.090783  5149 consensus_queue.cc:260] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.090804  5150 consensus_queue.cc:260] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.092886  5148 ts_tablet_manager.cc:1434] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:22:41.093127  5150 ts_tablet_manager.cc:1434] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:41.093286  5149 ts_tablet_manager.cc:1434] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:22:41.093991  5148 tablet_bootstrap.cc:492] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43: Bootstrap starting.
I20260709 12:22:41.094163  5150 tablet_bootstrap.cc:492] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad: Bootstrap starting.
I20260709 12:22:41.094177  5149 tablet_bootstrap.cc:492] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364: Bootstrap starting.
I20260709 12:22:41.105422  5149 tablet_bootstrap.cc:654] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.107930  5150 tablet_bootstrap.cc:654] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.108733  5148 tablet_bootstrap.cc:654] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.120748  5150 tablet_bootstrap.cc:492] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad: No bootstrap required, opened a new log
I20260709 12:22:41.121225  5150 ts_tablet_manager.cc:1403] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad: Time spent bootstrapping tablet: real 0.027s	user 0.013s	sys 0.004s
I20260709 12:22:41.123051  5148 tablet_bootstrap.cc:492] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43: No bootstrap required, opened a new log
I20260709 12:22:41.123637  5148 ts_tablet_manager.cc:1403] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43: Time spent bootstrapping tablet: real 0.030s	user 0.015s	sys 0.003s
I20260709 12:22:41.123746  5150 raft_consensus.cc:359] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.124357  5150 raft_consensus.cc:385] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.124631  5150 raft_consensus.cc:740] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.125276  5150 consensus_queue.cc:260] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.126924  5148 raft_consensus.cc:359] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.127732  5148 raft_consensus.cc:385] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.127883  5150 ts_tablet_manager.cc:1434] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 12:22:41.128064  5148 raft_consensus.cc:740] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.129061  5150 tablet_bootstrap.cc:492] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad: Bootstrap starting.
I20260709 12:22:41.128898  5148 consensus_queue.cc:260] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.133565  5149 tablet_bootstrap.cc:492] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364: No bootstrap required, opened a new log
I20260709 12:22:41.134099  5149 ts_tablet_manager.cc:1403] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364: Time spent bootstrapping tablet: real 0.040s	user 0.008s	sys 0.010s
I20260709 12:22:41.136019  5150 tablet_bootstrap.cc:654] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.137048  5149 raft_consensus.cc:359] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.137825  5149 raft_consensus.cc:385] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.140282  5148 ts_tablet_manager.cc:1434] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:22:41.138149  5149 raft_consensus.cc:740] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.141271  5149 consensus_queue.cc:260] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.143455  5149 ts_tablet_manager.cc:1434] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:22:41.144409  5148 tablet_bootstrap.cc:492] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43: Bootstrap starting.
I20260709 12:22:41.147372  5154 raft_consensus.cc:493] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.148366  5150 tablet_bootstrap.cc:492] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad: No bootstrap required, opened a new log
I20260709 12:22:41.147931  5154 raft_consensus.cc:515] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.151430  5154 leader_election.cc:290] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:41.152407  5148 tablet_bootstrap.cc:654] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.157940  5149 tablet_bootstrap.cc:492] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364: Bootstrap starting.
I20260709 12:22:41.165670  5149 tablet_bootstrap.cc:654] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.152196  5150 ts_tablet_manager.cc:1403] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.001s
I20260709 12:22:41.170408  5150 raft_consensus.cc:359] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.171311  5150 raft_consensus.cc:385] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.171633  5150 raft_consensus.cc:740] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.172622  5150 consensus_queue.cc:260] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.175081  5150 ts_tablet_manager.cc:1434] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:22:41.176155  5150 tablet_bootstrap.cc:492] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad: Bootstrap starting.
I20260709 12:22:41.197731  5149 tablet_bootstrap.cc:492] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364: No bootstrap required, opened a new log
I20260709 12:22:41.198277  5149 ts_tablet_manager.cc:1403] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364: Time spent bootstrapping tablet: real 0.041s	user 0.014s	sys 0.004s
I20260709 12:22:41.198617  5150 tablet_bootstrap.cc:654] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.201051  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f727556cd4598838d829886293fb0" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad" is_pre_election: true
I20260709 12:22:41.201341  5149 raft_consensus.cc:359] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.202028  5149 raft_consensus.cc:385] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.201926  5031 raft_consensus.cc:2468] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 0.
I20260709 12:22:41.203987  4922 leader_election.cc:304] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c04f380d906642a8b357085d67bf51ad, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:41.202452  5149 raft_consensus.cc:740] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.206333  5148 tablet_bootstrap.cc:492] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43: No bootstrap required, opened a new log
I20260709 12:22:41.206532  5156 raft_consensus.cc:493] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.206849  5148 ts_tablet_manager.cc:1403] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43: Time spent bootstrapping tablet: real 0.063s	user 0.014s	sys 0.012s
I20260709 12:22:41.206722  5149 consensus_queue.cc:260] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.207113  5156 raft_consensus.cc:515] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:41.205876  5154 raft_consensus.cc:2804] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:41.208638  5154 raft_consensus.cc:493] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.208984  5154 raft_consensus.cc:3060] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.210271  5156 leader_election.cc:290] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:41.214017  5156 raft_consensus.cc:493] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.215927  5156 raft_consensus.cc:515] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.216965  5148 raft_consensus.cc:359] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:41.221701  5150 tablet_bootstrap.cc:492] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad: No bootstrap required, opened a new log
I20260709 12:22:41.223615  5149 ts_tablet_manager.cc:1434] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364: Time spent starting tablet: real 0.025s	user 0.009s	sys 0.004s
I20260709 12:22:41.218281  5148 raft_consensus.cc:385] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.237823  5156 leader_election.cc:290] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:41.233978  5150 ts_tablet_manager.cc:1403] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad: Time spent bootstrapping tablet: real 0.058s	user 0.006s	sys 0.009s
I20260709 12:22:41.229514  5148 raft_consensus.cc:740] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.247696  5148 consensus_queue.cc:260] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:41.249006  5149 tablet_bootstrap.cc:492] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364: Bootstrap starting.
I20260709 12:22:41.253217  5148 ts_tablet_manager.cc:1434] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 12:22:41.251708  5154 raft_consensus.cc:515] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.262609  5148 tablet_bootstrap.cc:492] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43: Bootstrap starting.
I20260709 12:22:41.269554  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f727556cd4598838d829886293fb0" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:41.270452  5031 raft_consensus.cc:3060] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.276214  5150 raft_consensus.cc:359] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.277000  5150 raft_consensus.cc:385] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.278033  5154 leader_election.cc:290] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 election: Requested vote from peers c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:41.277289  5150 raft_consensus.cc:740] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.279986  5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f727556cd4598838d829886293fb0" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43" is_pre_election: true
I20260709 12:22:41.282121  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f727556cd4598838d829886293fb0" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:41.288300  5153 raft_consensus.cc:493] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.288810  5153 raft_consensus.cc:515] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
W20260709 12:22:41.290314  4920 leader_election.cc:343] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.287889  5150 consensus_queue.cc:260] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.303319  5175 raft_consensus.cc:493] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.303894  5175 raft_consensus.cc:515] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.304481  5150 ts_tablet_manager.cc:1434] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad: Time spent starting tablet: real 0.063s	user 0.006s	sys 0.001s
I20260709 12:22:41.305799  5150 tablet_bootstrap.cc:492] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad: Bootstrap starting.
I20260709 12:22:41.306722  5175 leader_election.cc:290] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:41.309114  5149 tablet_bootstrap.cc:654] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364: Neither blocks nor log segments found. Creating new log.
W20260709 12:22:41.296746  4920 leader_election.cc:343] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.309276  5153 leader_election.cc:290] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:41.315536  5148 tablet_bootstrap.cc:654] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.319788  5153 raft_consensus.cc:493] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.320950  5153 raft_consensus.cc:515] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.325663  5153 leader_election.cc:290] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:41.356423  5150 tablet_bootstrap.cc:654] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.357038  5031 raft_consensus.cc:2468] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 1.
I20260709 12:22:41.360410  5154 raft_consensus.cc:493] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.361617  5154 raft_consensus.cc:515] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.367245  4922 leader_election.cc:304] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c04f380d906642a8b357085d67bf51ad, eda50ab5b6bc429c866d526f072e6364; no voters: 4489f3ff50774e7989ffcb4488f37e43
I20260709 12:22:41.365861  5154 leader_election.cc:290] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:41.369683  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad" is_pre_election: true
I20260709 12:22:41.370558  5031 raft_consensus.cc:2468] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 0.
I20260709 12:22:41.371074  5172 raft_consensus.cc:2804] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:41.371701  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43" is_pre_election: true
I20260709 12:22:41.371833  5172 raft_consensus.cc:697] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Becoming Leader. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:41.372327  5104 raft_consensus.cc:2468] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 0.
I20260709 12:22:41.374274  5154 raft_consensus.cc:493] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.376030  5154 raft_consensus.cc:515] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.373329  5172 consensus_queue.cc:237] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.377790  4920 leader_election.cc:304] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:41.383342  5154 leader_election.cc:290] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:41.389801  5154 raft_consensus.cc:2804] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:41.390185  5154 raft_consensus.cc:493] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.390524  5154 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.390620  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada5e49b1b04466b75d60c8bedf99f4" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43" is_pre_election: true
I20260709 12:22:41.395512  5104 raft_consensus.cc:2468] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 0.
I20260709 12:22:41.394574  5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43" is_pre_election: true
I20260709 12:22:41.407243  5149 tablet_bootstrap.cc:492] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364: No bootstrap required, opened a new log
I20260709 12:22:41.407860  5149 ts_tablet_manager.cc:1403] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364: Time spent bootstrapping tablet: real 0.171s	user 0.002s	sys 0.025s
I20260709 12:22:41.405792  5105 raft_consensus.cc:2468] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 0.
I20260709 12:22:41.406448  4920 leader_election.cc:304] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:41.417798  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcb5348e22d40699ea2bde45add77b4" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43" is_pre_election: true
I20260709 12:22:41.419324  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada5e49b1b04466b75d60c8bedf99f4" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad" is_pre_election: true
I20260709 12:22:41.422216  5172 raft_consensus.cc:2804] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:41.425573  5149 raft_consensus.cc:359] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.426293  4995 leader_election.cc:304] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad; no voters: 
I20260709 12:22:41.426501  5172 raft_consensus.cc:493] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.425318  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364" is_pre_election: true
I20260709 12:22:41.428678  5149 raft_consensus.cc:385] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.428267  4955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcb5348e22d40699ea2bde45add77b4" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364" is_pre_election: true
I20260709 12:22:41.426506  5031 raft_consensus.cc:2468] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 0.
I20260709 12:22:41.432741  5175 raft_consensus.cc:2804] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:41.431497  5172 raft_consensus.cc:3060] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.431226  5148 tablet_bootstrap.cc:492] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43: No bootstrap required, opened a new log
I20260709 12:22:41.431885  5149 raft_consensus.cc:740] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.433282  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bf1d6abb78450bbecfc1b0eb763942" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364" is_pre_election: true
W20260709 12:22:41.434567  4995 leader_election.cc:343] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.433466  5175 raft_consensus.cc:493] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.429829  5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bf1d6abb78450bbecfc1b0eb763942" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43" is_pre_election: true
W20260709 12:22:41.437311  4994 leader_election.cc:343] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.436829  5175 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.437377  5149 consensus_queue.cc:260] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.437435  5148 ts_tablet_manager.cc:1403] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43: Time spent bootstrapping tablet: real 0.183s	user 0.014s	sys 0.029s
W20260709 12:22:41.439610  4994 leader_election.cc:343] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.441425  5149 ts_tablet_manager.cc:1434] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:22:41.441794  4994 leader_election.cc:304] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c04f380d906642a8b357085d67bf51ad; no voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364
I20260709 12:22:41.442953  5156 raft_consensus.cc:2749] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:41.443569  5149 tablet_bootstrap.cc:492] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364: Bootstrap starting.
W20260709 12:22:41.443393  4994 leader_election.cc:343] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.450542  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada5e49b1b04466b75d60c8bedf99f4" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad" is_pre_election: true
W20260709 12:22:41.451020  4995 leader_election.cc:343] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.451191  5031 raft_consensus.cc:2468] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 0.
I20260709 12:22:41.443758  5154 raft_consensus.cc:515] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.452612  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada5e49b1b04466b75d60c8bedf99f4" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364" is_pre_election: true
I20260709 12:22:41.451501  4995 leader_election.cc:304] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c04f380d906642a8b357085d67bf51ad; no voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364
I20260709 12:22:41.452968  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e292b2dac8df4bba9fcfd4aeea800f47" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad" is_pre_election: true
I20260709 12:22:41.454062  5156 raft_consensus.cc:2749] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:41.448072  4852 catalog_manager.cc:5697] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 reported cstate change: term changed from 0 to 1, leader changed from <none> to eda50ab5b6bc429c866d526f072e6364 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "eda50ab5b6bc429c866d526f072e6364" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.454649  4955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e292b2dac8df4bba9fcfd4aeea800f47" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364" is_pre_election: true
I20260709 12:22:41.455274  4955 raft_consensus.cc:2468] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 0.
I20260709 12:22:41.454211  5150 tablet_bootstrap.cc:492] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad: No bootstrap required, opened a new log
I20260709 12:22:41.456244  5154 leader_election.cc:290] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 election: Requested vote from peers c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:41.457038  5150 ts_tablet_manager.cc:1403] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad: Time spent bootstrapping tablet: real 0.151s	user 0.027s	sys 0.018s
I20260709 12:22:41.456933  5068 leader_election.cc:304] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:41.458926  5153 raft_consensus.cc:2804] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:41.459316  5153 raft_consensus.cc:493] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.459903  5153 raft_consensus.cc:3060] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.461140  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:41.461741  5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:41.461978  5030 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.462280  5105 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.463172  5071 leader_election.cc:304] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad; no voters: 
I20260709 12:22:41.462998  5148 raft_consensus.cc:359] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.463771  5148 raft_consensus.cc:385] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.464386  5148 raft_consensus.cc:740] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.467192  5175 raft_consensus.cc:515] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:41.468313  5148 consensus_queue.cc:260] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.462191  5150 raft_consensus.cc:359] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.469308  5150 raft_consensus.cc:385] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.469669  5150 raft_consensus.cc:740] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.472896  4955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:41.472947  5150 consensus_queue.cc:260] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.475687  5175 leader_election.cc:290] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
W20260709 12:22:41.479398  4994 leader_election.cc:343] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.480108  5150 ts_tablet_manager.cc:1434] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad: Time spent starting tablet: real 0.022s	user 0.003s	sys 0.003s
I20260709 12:22:41.481339  5150 tablet_bootstrap.cc:492] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad: Bootstrap starting.
I20260709 12:22:41.477869  5149 tablet_bootstrap.cc:654] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.475171  5172 raft_consensus.cc:515] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.485426  4954 raft_consensus.cc:2393] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4489f3ff50774e7989ffcb4488f37e43 in current term 1: Already voted for candidate eda50ab5b6bc429c866d526f072e6364 in this term.
I20260709 12:22:41.486157  5172 leader_election.cc:290] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 election: Requested vote from peers c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:41.488111  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada5e49b1b04466b75d60c8bedf99f4" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:41.488747  5104 raft_consensus.cc:3060] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.501080  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada5e49b1b04466b75d60c8bedf99f4" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:41.501760  5031 raft_consensus.cc:3060] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.501816  5148 ts_tablet_manager.cc:1434] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43: Time spent starting tablet: real 0.060s	user 0.008s	sys 0.002s
I20260709 12:22:41.504894  5148 tablet_bootstrap.cc:492] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43: Bootstrap starting.
I20260709 12:22:41.502102  5153 raft_consensus.cc:515] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.517892  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e292b2dac8df4bba9fcfd4aeea800f47" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:41.518597  4954 raft_consensus.cc:3060] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:22:41.516887  5071 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:33241, user_credentials={real_user=slave}} blocked reactor thread for 55995.6us
I20260709 12:22:41.523190  5030 raft_consensus.cc:2468] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 1.
I20260709 12:22:41.523589  5153 leader_election.cc:290] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:41.525019  4922 leader_election.cc:304] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c04f380d906642a8b357085d67bf51ad, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:41.526108  5104 raft_consensus.cc:2468] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 1.
I20260709 12:22:41.526412  5172 raft_consensus.cc:2804] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:41.526961  5172 raft_consensus.cc:697] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Becoming Leader. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:41.527386  4920 leader_election.cc:304] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:41.527899  5031 raft_consensus.cc:2468] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 1.
I20260709 12:22:41.528193  5154 raft_consensus.cc:2804] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:41.530316  5148 tablet_bootstrap.cc:654] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.526973  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e292b2dac8df4bba9fcfd4aeea800f47" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:41.530615  5154 raft_consensus.cc:697] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Becoming Leader. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:41.522032  5105 raft_consensus.cc:2468] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 1.
I20260709 12:22:41.530874  5030 raft_consensus.cc:3060] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.531714  5154 consensus_queue.cc:237] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
W20260709 12:22:41.529426  5071 leader_election.cc:343] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.527854  5172 consensus_queue.cc:237] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.536459  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:41.537142  5104 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.539352  5150 tablet_bootstrap.cc:654] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.537834  4954 raft_consensus.cc:2468] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 1.
I20260709 12:22:41.544337  5068 leader_election.cc:304] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:41.545466  5153 raft_consensus.cc:2804] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:41.546051  5153 raft_consensus.cc:697] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 LEADER]: Becoming Leader. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Running, Role: LEADER
I20260709 12:22:41.546542  5188 raft_consensus.cc:2764] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:22:41.540053  5030 raft_consensus.cc:2468] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 1.
I20260709 12:22:41.551224  5153 consensus_queue.cc:237] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.549710  5104 raft_consensus.cc:2468] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 1.
I20260709 12:22:41.559387  4995 leader_election.cc:304] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad; no voters: eda50ab5b6bc429c866d526f072e6364
I20260709 12:22:41.560298  5175 raft_consensus.cc:2804] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:41.560808  5175 raft_consensus.cc:697] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Becoming Leader. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:41.562160  5175 consensus_queue.cc:237] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:41.567406  5149 tablet_bootstrap.cc:492] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364: No bootstrap required, opened a new log
I20260709 12:22:41.568027  5149 ts_tablet_manager.cc:1403] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364: Time spent bootstrapping tablet: real 0.125s	user 0.014s	sys 0.006s
I20260709 12:22:41.575140  5154 raft_consensus.cc:493] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.574808  5149 raft_consensus.cc:359] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.575619  5149 raft_consensus.cc:385] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.576007  5149 raft_consensus.cc:740] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.576843  5149 consensus_queue.cc:260] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.575649  5154 raft_consensus.cc:515] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.580508  5154 leader_election.cc:290] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:41.587673  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a8d8d586214f4f886ca4daf541909b" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad" is_pre_election: true
I20260709 12:22:41.587735  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a8d8d586214f4f886ca4daf541909b" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43" is_pre_election: true
I20260709 12:22:41.591109  5149 ts_tablet_manager.cc:1434] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364: Time spent starting tablet: real 0.023s	user 0.008s	sys 0.000s
W20260709 12:22:41.591380  4922 leader_election.cc:343] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.591898  5148 tablet_bootstrap.cc:492] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43: No bootstrap required, opened a new log
W20260709 12:22:41.593235  4920 leader_election.cc:343] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.593724  4920 leader_election.cc:304] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eda50ab5b6bc429c866d526f072e6364; no voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad
I20260709 12:22:41.604449  5148 ts_tablet_manager.cc:1403] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43: Time spent bootstrapping tablet: real 0.100s	user 0.011s	sys 0.005s
I20260709 12:22:41.604935  5172 raft_consensus.cc:2749] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:41.607836  5148 raft_consensus.cc:359] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.608698  5148 raft_consensus.cc:385] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.609010  5148 raft_consensus.cc:740] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.615272  5148 consensus_queue.cc:260] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.618191  5148 ts_tablet_manager.cc:1434] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:22:41.609758  5149 tablet_bootstrap.cc:492] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364: Bootstrap starting.
I20260709 12:22:41.620504  4853 catalog_manager.cc:5697] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad reported cstate change: term changed from 0 to 1, leader changed from <none> to c04f380d906642a8b357085d67bf51ad (127.4.181.66). New cstate: current_term: 1 leader_uuid: "c04f380d906642a8b357085d67bf51ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:41.625389  5150 tablet_bootstrap.cc:492] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad: No bootstrap required, opened a new log
I20260709 12:22:41.625779  5150 ts_tablet_manager.cc:1403] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad: Time spent bootstrapping tablet: real 0.145s	user 0.015s	sys 0.024s
I20260709 12:22:41.627096  5148 tablet_bootstrap.cc:492] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43: Bootstrap starting.
I20260709 12:22:41.637316  5149 tablet_bootstrap.cc:654] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.644292  4851 catalog_manager.cc:5697] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "4489f3ff50774e7989ffcb4488f37e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:41.649083  5150 raft_consensus.cc:359] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.649871  5150 raft_consensus.cc:385] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.650163  5150 raft_consensus.cc:740] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.651126  5150 consensus_queue.cc:260] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.654035  5150 ts_tablet_manager.cc:1434] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad: Time spent starting tablet: real 0.028s	user 0.007s	sys 0.000s
I20260709 12:22:41.654085  5148 tablet_bootstrap.cc:654] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.662705  5150 tablet_bootstrap.cc:492] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad: Bootstrap starting.
I20260709 12:22:41.672958  5150 tablet_bootstrap.cc:654] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.672907  5149 tablet_bootstrap.cc:492] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364: No bootstrap required, opened a new log
I20260709 12:22:41.676539  5149 ts_tablet_manager.cc:1403] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364: Time spent bootstrapping tablet: real 0.085s	user 0.006s	sys 0.035s
I20260709 12:22:41.675266  4853 catalog_manager.cc:5697] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 reported cstate change: term changed from 0 to 1, leader changed from <none> to eda50ab5b6bc429c866d526f072e6364 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "eda50ab5b6bc429c866d526f072e6364" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.678783  4853 catalog_manager.cc:5697] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 reported cstate change: term changed from 0 to 1, leader changed from <none> to eda50ab5b6bc429c866d526f072e6364 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "eda50ab5b6bc429c866d526f072e6364" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.680142  5149 raft_consensus.cc:359] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.683303  5149 raft_consensus.cc:385] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.683689  5149 raft_consensus.cc:740] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.685521  5148 tablet_bootstrap.cc:492] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43: No bootstrap required, opened a new log
I20260709 12:22:41.685309  5149 consensus_queue.cc:260] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.685875  5150 tablet_bootstrap.cc:492] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad: No bootstrap required, opened a new log
I20260709 12:22:41.686002  5148 ts_tablet_manager.cc:1403] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.000s
I20260709 12:22:41.686296  5150 ts_tablet_manager.cc:1403] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.004s
I20260709 12:22:41.687904  5149 ts_tablet_manager.cc:1434] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:22:41.688473  5148 raft_consensus.cc:359] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.688989  5148 raft_consensus.cc:385] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.689226  5149 tablet_bootstrap.cc:492] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364: Bootstrap starting.
I20260709 12:22:41.689215  5148 raft_consensus.cc:740] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.691808  5150 raft_consensus.cc:359] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.692458  5150 raft_consensus.cc:385] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.692818  5150 raft_consensus.cc:740] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.694622  5150 consensus_queue.cc:260] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.695693  5153 raft_consensus.cc:493] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.696264  5153 raft_consensus.cc:515] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.696897  5150 ts_tablet_manager.cc:1434] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:22:41.692497  5148 consensus_queue.cc:260] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.700034  5149 tablet_bootstrap.cc:654] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.700151  5148 ts_tablet_manager.cc:1434] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43: Time spent starting tablet: real 0.014s	user 0.003s	sys 0.004s
I20260709 12:22:41.701318  5148 tablet_bootstrap.cc:492] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43: Bootstrap starting.
I20260709 12:22:41.701483  5153 leader_election.cc:290] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:41.703270  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f727556cd4598838d829886293fb0" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364" is_pre_election: true
I20260709 12:22:41.704695  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f727556cd4598838d829886293fb0" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad" is_pre_election: true
I20260709 12:22:41.705562  5030 raft_consensus.cc:2393] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4489f3ff50774e7989ffcb4488f37e43 in current term 1: Already voted for candidate eda50ab5b6bc429c866d526f072e6364 in this term.
I20260709 12:22:41.712085  5172 raft_consensus.cc:493] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.712666  5172 raft_consensus.cc:515] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.713249  5148 tablet_bootstrap.cc:654] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.716984  5071 leader_election.cc:304] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43; no voters: c04f380d906642a8b357085d67bf51ad, eda50ab5b6bc429c866d526f072e6364
I20260709 12:22:41.718423  5153 raft_consensus.cc:3060] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.720111  5172 leader_election.cc:290] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:41.721012  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcb5348e22d40699ea2bde45add77b4" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad" is_pre_election: true
I20260709 12:22:41.721362  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcb5348e22d40699ea2bde45add77b4" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43" is_pre_election: true
I20260709 12:22:41.721684  5030 raft_consensus.cc:2468] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 0.
I20260709 12:22:41.722922  4922 leader_election.cc:304] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c04f380d906642a8b357085d67bf51ad, eda50ab5b6bc429c866d526f072e6364; no voters: 
W20260709 12:22:41.723946  4920 leader_election.cc:343] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.718396  5149 tablet_bootstrap.cc:492] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364: No bootstrap required, opened a new log
I20260709 12:22:41.725829  5149 ts_tablet_manager.cc:1403] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.005s
I20260709 12:22:41.726586  5172 raft_consensus.cc:2804] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:41.727253  5172 raft_consensus.cc:493] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.732088  5172 raft_consensus.cc:3060] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.743795  5172 raft_consensus.cc:515] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.746902  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcb5348e22d40699ea2bde45add77b4" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:41.747501  5030 raft_consensus.cc:3060] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.750300  5153 raft_consensus.cc:2749] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:41.753775  5030 raft_consensus.cc:2468] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 1.
I20260709 12:22:41.755111  4922 leader_election.cc:304] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c04f380d906642a8b357085d67bf51ad, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:41.755926  5154 raft_consensus.cc:2804] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:41.756450  5154 raft_consensus.cc:697] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Becoming Leader. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:41.757314  5154 consensus_queue.cc:237] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.757867  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcb5348e22d40699ea2bde45add77b4" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
W20260709 12:22:41.759315  4920 leader_election.cc:343] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:22:41.760114  5172 leader_election.cc:290] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 1 election: Requested vote from peers c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:41.766757  4852 catalog_manager.cc:5697] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 reported cstate change: term changed from 0 to 1, leader changed from <none> to eda50ab5b6bc429c866d526f072e6364 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "eda50ab5b6bc429c866d526f072e6364" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.769541  5149 raft_consensus.cc:359] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:41.770249  5149 raft_consensus.cc:385] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.770543  5149 raft_consensus.cc:740] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.771178  5149 consensus_queue.cc:260] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:41.773545  5149 ts_tablet_manager.cc:1434] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364: Time spent starting tablet: real 0.047s	user 0.003s	sys 0.003s
I20260709 12:22:41.774474  5149 tablet_bootstrap.cc:492] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364: Bootstrap starting.
I20260709 12:22:41.779812  5149 tablet_bootstrap.cc:654] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.784389  5148 tablet_bootstrap.cc:492] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43: No bootstrap required, opened a new log
I20260709 12:22:41.784788  5148 ts_tablet_manager.cc:1403] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43: Time spent bootstrapping tablet: real 0.084s	user 0.052s	sys 0.027s
I20260709 12:22:41.786689  5148 raft_consensus.cc:359] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.787356  5148 raft_consensus.cc:385] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.787607  5148 raft_consensus.cc:740] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.788194  5148 consensus_queue.cc:260] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.788424  5149 tablet_bootstrap.cc:492] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364: No bootstrap required, opened a new log
I20260709 12:22:41.788931  5149 ts_tablet_manager.cc:1403] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.001s
I20260709 12:22:41.789678  5148 ts_tablet_manager.cc:1434] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
I20260709 12:22:41.790602  5148 tablet_bootstrap.cc:492] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43: Bootstrap starting.
I20260709 12:22:41.791406  5149 raft_consensus.cc:359] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.792060  5149 raft_consensus.cc:385] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.792310  5149 raft_consensus.cc:740] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.793051  5149 consensus_queue.cc:260] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.795339  5149 ts_tablet_manager.cc:1434] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:22:41.796756  5148 tablet_bootstrap.cc:654] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43: Neither blocks nor log segments found. Creating new log.
I20260709 12:22:41.801810  5148 tablet_bootstrap.cc:492] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43: No bootstrap required, opened a new log
I20260709 12:22:41.802140  5148 ts_tablet_manager.cc:1403] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43: Time spent bootstrapping tablet: real 0.012s	user 0.010s	sys 0.000s
I20260709 12:22:41.804518  5148 raft_consensus.cc:359] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.805176  5148 raft_consensus.cc:385] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:22:41.805442  5148 raft_consensus.cc:740] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Initialized, Role: FOLLOWER
I20260709 12:22:41.806041  5148 consensus_queue.cc:260] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.808257  5148 ts_tablet_manager.cc:1434] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:22:41.838023  5175 raft_consensus.cc:493] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.838688  5175 raft_consensus.cc:515] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.840857  5175 leader_election.cc:290] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:41.841557  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a8d8d586214f4f886ca4daf541909b" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364" is_pre_election: true
I20260709 12:22:41.841931  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a8d8d586214f4f886ca4daf541909b" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43" is_pre_election: true
I20260709 12:22:41.842110  4954 raft_consensus.cc:2468] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 0.
I20260709 12:22:41.842583  5104 raft_consensus.cc:2468] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 0.
I20260709 12:22:41.843169  4994 leader_election.cc:304] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c04f380d906642a8b357085d67bf51ad, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:41.843995  5175 raft_consensus.cc:2804] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:41.844347  5175 raft_consensus.cc:493] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.844668  5175 raft_consensus.cc:3060] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.852020  5175 raft_consensus.cc:515] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
W20260709 12:22:41.853986  4901 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:22:41.854959  5175 leader_election.cc:290] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:41.855211  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a8d8d586214f4f886ca4daf541909b" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:41.855500  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a8d8d586214f4f886ca4daf541909b" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:41.855842  4954 raft_consensus.cc:3060] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.856015  5104 raft_consensus.cc:3060] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.862671  5104 raft_consensus.cc:2468] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 1.
I20260709 12:22:41.862671  4954 raft_consensus.cc:2468] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 1.
I20260709 12:22:41.864082  4995 leader_election.cc:304] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad; no voters: 
I20260709 12:22:41.864789  5175 raft_consensus.cc:2804] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:41.865165  5175 raft_consensus.cc:697] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Becoming Leader. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:41.865914  5175 consensus_queue.cc:237] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.874128  4853 catalog_manager.cc:5697] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad reported cstate change: term changed from 0 to 1, leader changed from <none> to c04f380d906642a8b357085d67bf51ad (127.4.181.66). New cstate: current_term: 1 leader_uuid: "c04f380d906642a8b357085d67bf51ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:41.875324  5153 raft_consensus.cc:493] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:41.875798  5153 raft_consensus.cc:515] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.877826  5153 leader_election.cc:290] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:41.878659  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bf1d6abb78450bbecfc1b0eb763942" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364" is_pre_election: true
I20260709 12:22:41.879282  4954 raft_consensus.cc:2468] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 0.
I20260709 12:22:41.879420  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bf1d6abb78450bbecfc1b0eb763942" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad" is_pre_election: true
I20260709 12:22:41.880007  5030 raft_consensus.cc:2468] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 0.
I20260709 12:22:41.881137  5068 leader_election.cc:304] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:41.881949  5153 raft_consensus.cc:2804] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:41.882299  5153 raft_consensus.cc:493] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:41.882650  5153 raft_consensus.cc:3060] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.888118  5153 raft_consensus.cc:515] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.890713  5153 leader_election.cc:290] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:41.891127  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bf1d6abb78450bbecfc1b0eb763942" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:41.891428  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bf1d6abb78450bbecfc1b0eb763942" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:41.891757  4954 raft_consensus.cc:3060] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.891990  5030 raft_consensus.cc:3060] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.898800  5154 consensus_queue.cc:1048] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:41.899564  4954 raft_consensus.cc:2468] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 1.
I20260709 12:22:41.900820  5068 leader_election.cc:304] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:41.901850  5153 raft_consensus.cc:2804] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:41.902084  5030 raft_consensus.cc:2468] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 1.
I20260709 12:22:41.902338  5153 raft_consensus.cc:697] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 LEADER]: Becoming Leader. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Running, Role: LEADER
I20260709 12:22:41.903266  5153 consensus_queue.cc:237] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:41.912786  4853 catalog_manager.cc:5697] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "4489f3ff50774e7989ffcb4488f37e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:41.915915  5154 consensus_queue.cc:1048] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:41.978114  4954 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:41.982432  5154 consensus_queue.cc:1048] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:41.986011  5153 consensus_queue.cc:1048] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:41.988399  5175 consensus_queue.cc:1048] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:42.012890  5172 consensus_queue.cc:1048] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.014892  5188 consensus_queue.cc:1048] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.015477  5175 raft_consensus.cc:493] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.015946  5175 raft_consensus.cc:515] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:42.016263  5156 consensus_queue.cc:1048] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.017937  5175 leader_election.cc:290] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:42.020653  5103 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60143441eb3f4597b63bafb3a6e7ab55" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43" is_pre_election: true
I20260709 12:22:42.021373  5103 raft_consensus.cc:2468] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 0.
I20260709 12:22:42.025729  4995 leader_election.cc:304] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad; no voters: 
I20260709 12:22:42.032243  5175 raft_consensus.cc:2804] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:22:42.033013  5175 raft_consensus.cc:493] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:22:42.034981  5175 raft_consensus.cc:3060] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.055385  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60143441eb3f4597b63bafb3a6e7ab55" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364" is_pre_election: true
I20260709 12:22:42.056797  4954 raft_consensus.cc:2468] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 0.
I20260709 12:22:42.057435  5188 raft_consensus.cc:493] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:22:42.057950  5188 raft_consensus.cc:515] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:42.058437  5175 raft_consensus.cc:515] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:42.060241  5188 leader_election.cc:290] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:42.061350  5175 leader_election.cc:290] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:42.062635  5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60143441eb3f4597b63bafb3a6e7ab55" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:42.062940  4955 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60143441eb3f4597b63bafb3a6e7ab55" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:42.063588  4955 raft_consensus.cc:3060] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.064122  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcb5348e22d40699ea2bde45add77b4" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c04f380d906642a8b357085d67bf51ad" is_pre_election: true
I20260709 12:22:42.065150  5030 raft_consensus.cc:2393] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4489f3ff50774e7989ffcb4488f37e43 in current term 1: Already voted for candidate eda50ab5b6bc429c866d526f072e6364 in this term.
I20260709 12:22:42.063501  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcb5348e22d40699ea2bde45add77b4" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eda50ab5b6bc429c866d526f072e6364" is_pre_election: true
I20260709 12:22:42.067232  5105 raft_consensus.cc:3060] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.071870  5068 leader_election.cc:304] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43; no voters: c04f380d906642a8b357085d67bf51ad, eda50ab5b6bc429c866d526f072e6364
I20260709 12:22:42.072736  5188 raft_consensus.cc:3060] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:22:42.074867  5105 raft_consensus.cc:2468] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 1.
I20260709 12:22:42.076275  4995 leader_election.cc:304] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad; no voters: 
I20260709 12:22:42.077253  4955 raft_consensus.cc:2468] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 1.
I20260709 12:22:42.077962  5175 raft_consensus.cc:2804] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:22:42.078598  5175 raft_consensus.cc:697] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Becoming Leader. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:42.080425  5175 consensus_queue.cc:237] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:42.082510  5154 consensus_queue.cc:1048] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.085240  5188 raft_consensus.cc:2749] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:22:42.097081  5172 consensus_queue.cc:1048] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.104552  4852 catalog_manager.cc:5697] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad reported cstate change: term changed from 0 to 1, leader changed from <none> to c04f380d906642a8b357085d67bf51ad (127.4.181.66). New cstate: current_term: 1 leader_uuid: "c04f380d906642a8b357085d67bf51ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.264227  5172 consensus_queue.cc:1048] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.278908  5154 consensus_queue.cc:1048] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.303687  5175 consensus_queue.cc:1048] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.316387  5156 consensus_queue.cc:1048] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.430414  5031 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c"
dest_uuid: "c04f380d906642a8b357085d67bf51ad"
mode: GRACEFUL
new_leader_uuid: "eda50ab5b6bc429c866d526f072e6364"
 from {username='slave'} at 127.0.0.1:48606
I20260709 12:22:42.431084  5031 raft_consensus.cc:606] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Received request to transfer leadership to TS eda50ab5b6bc429c866d526f072e6364
I20260709 12:22:42.451457  5105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e292b2dac8df4bba9fcfd4aeea800f47"
dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
mode: GRACEFUL
new_leader_uuid: "eda50ab5b6bc429c866d526f072e6364"
 from {username='slave'} at 127.0.0.1:51472
I20260709 12:22:42.452077  5105 raft_consensus.cc:606] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 LEADER]: Received request to transfer leadership to TS eda50ab5b6bc429c866d526f072e6364
I20260709 12:22:42.467569  5156 raft_consensus.cc:993] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad: : Instructing follower eda50ab5b6bc429c866d526f072e6364 to start an election
I20260709 12:22:42.468031  5175 raft_consensus.cc:1081] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Signalling peer eda50ab5b6bc429c866d526f072e6364 to start an election
I20260709 12:22:42.470333  5156 consensus_queue.cc:1048] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.471156  4955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c"
dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
 from {username='slave'} at 127.0.0.1:34278
I20260709 12:22:42.471783  4955 raft_consensus.cc:493] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:42.472155  4955 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.475426  4954 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8"
dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
mode: GRACEFUL
new_leader_uuid: "c04f380d906642a8b357085d67bf51ad"
 from {username='slave'} at 127.0.0.1:34292
I20260709 12:22:42.475939  4954 raft_consensus.cc:606] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Received request to transfer leadership to TS c04f380d906642a8b357085d67bf51ad
I20260709 12:22:42.479055  4955 raft_consensus.cc:515] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:42.481026  5105 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56bf1d6abb78450bbecfc1b0eb763942"
dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
mode: GRACEFUL
new_leader_uuid: "c04f380d906642a8b357085d67bf51ad"
 from {username='slave'} at 127.0.0.1:51472
I20260709 12:22:42.481640  5105 raft_consensus.cc:606] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 LEADER]: Received request to transfer leadership to TS c04f380d906642a8b357085d67bf51ad
I20260709 12:22:42.481999  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:42.482556  5104 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.482366  5031 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:42.483037  5031 raft_consensus.cc:3055] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:42.483378  5031 raft_consensus.cc:740] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:42.484285  5031 consensus_queue.cc:260] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:42.485594  5031 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.490721  5188 raft_consensus.cc:993] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43: : Instructing follower eda50ab5b6bc429c866d526f072e6364 to start an election
I20260709 12:22:42.491179  5188 raft_consensus.cc:1081] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 LEADER]: Signalling peer eda50ab5b6bc429c866d526f072e6364 to start an election
I20260709 12:22:42.492928  4954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e292b2dac8df4bba9fcfd4aeea800f47"
dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
 from {username='slave'} at 127.0.0.1:34282
I20260709 12:22:42.493597  4954 raft_consensus.cc:493] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:42.494019  4954 raft_consensus.cc:3060] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.496045  5104 raft_consensus.cc:2468] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 2.
I20260709 12:22:42.497222  4920 leader_election.cc:304] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:42.498131  5226 raft_consensus.cc:2804] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:42.498417  4953 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4fcb5348e22d40699ea2bde45add77b4"
dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
mode: GRACEFUL
new_leader_uuid: "4489f3ff50774e7989ffcb4488f37e43"
 from {username='slave'} at 127.0.0.1:34292
I20260709 12:22:42.498623  5226 raft_consensus.cc:697] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 2 LEADER]: Becoming Leader. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:42.499135  4953 raft_consensus.cc:606] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Received request to transfer leadership to TS 4489f3ff50774e7989ffcb4488f37e43
I20260709 12:22:42.499904  5226 consensus_queue.cc:237] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:42.492903  5031 raft_consensus.cc:2468] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 2.
I20260709 12:22:42.506408  4955 leader_election.cc:290] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 2 election: Requested vote from peers 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499), c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:42.512141  5218 consensus_queue.cc:1048] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.512943  4851 catalog_manager.cc:5697] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 reported cstate change: term changed from 1 to 2, leader changed from c04f380d906642a8b357085d67bf51ad (127.4.181.66) to eda50ab5b6bc429c866d526f072e6364 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "eda50ab5b6bc429c866d526f072e6364" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.520558  4954 raft_consensus.cc:515] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:42.522662  5153 consensus_queue.cc:1048] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.524652  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e292b2dac8df4bba9fcfd4aeea800f47" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:42.525228  5030 raft_consensus.cc:3060] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.533277  5030 raft_consensus.cc:2468] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 2.
I20260709 12:22:42.533567  5153 consensus_queue.cc:1048] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:22:42.534344  5028 raft_consensus.cc:1240] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Rejecting Update request from peer 4489f3ff50774e7989ffcb4488f37e43 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:42.536801  5153 consensus_queue.cc:1059] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:42.537460  4922 leader_election.cc:304] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c04f380d906642a8b357085d67bf51ad, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:42.537941  5187 raft_consensus.cc:3055] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:42.538316  5187 raft_consensus.cc:740] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Running, Role: LEADER
I20260709 12:22:42.539175  5187 consensus_queue.cc:260] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:42.540154  5187 raft_consensus.cc:3060] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.542646  5172 raft_consensus.cc:2804] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:42.543156  5172 raft_consensus.cc:697] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 2 LEADER]: Becoming Leader. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:42.543990  5172 consensus_queue.cc:237] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:42.558516  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e292b2dac8df4bba9fcfd4aeea800f47" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:42.561748  5188 raft_consensus.cc:993] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43: : Instructing follower c04f380d906642a8b357085d67bf51ad to start an election
I20260709 12:22:42.562225  5188 raft_consensus.cc:1081] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 LEADER]: Signalling peer c04f380d906642a8b357085d67bf51ad to start an election
I20260709 12:22:42.564147  5028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56bf1d6abb78450bbecfc1b0eb763942"
dest_uuid: "c04f380d906642a8b357085d67bf51ad"
 from {username='slave'} at 127.0.0.1:48596
I20260709 12:22:42.564707  5028 raft_consensus.cc:493] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:42.565062  5028 raft_consensus.cc:3060] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.568248  5104 raft_consensus.cc:2468] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 2.
I20260709 12:22:42.570340  4954 leader_election.cc:290] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 2 election: Requested vote from peers c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:42.573945  5028 raft_consensus.cc:515] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:42.577952  5030 raft_consensus.cc:1240] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Rejecting Update request from peer 4489f3ff50774e7989ffcb4488f37e43 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:42.578125  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bf1d6abb78450bbecfc1b0eb763942" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:42.578905  4954 raft_consensus.cc:3060] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.580826  5153 consensus_queue.cc:1059] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:42.581614  5153 raft_consensus.cc:3055] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:42.581914  5153 raft_consensus.cc:740] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Running, Role: LEADER
I20260709 12:22:42.582715  5153 consensus_queue.cc:260] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:42.583568  5153 raft_consensus.cc:3060] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.584903  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56bf1d6abb78450bbecfc1b0eb763942" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:42.585544  5028 leader_election.cc:290] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 2 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:42.585757  4954 raft_consensus.cc:2468] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 2.
I20260709 12:22:42.586938  4994 leader_election.cc:304] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c04f380d906642a8b357085d67bf51ad, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:42.587716  5218 raft_consensus.cc:2804] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:42.588462  5218 raft_consensus.cc:697] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 2 LEADER]: Becoming Leader. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:42.590124  5218 consensus_queue.cc:237] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:42.590212  4852 catalog_manager.cc:5697] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 reported cstate change: term changed from 1 to 2, leader changed from 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67) to eda50ab5b6bc429c866d526f072e6364 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "eda50ab5b6bc429c866d526f072e6364" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.594679  4956 raft_consensus.cc:1240] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Rejecting Update request from peer 4489f3ff50774e7989ffcb4488f37e43 for earlier term 1. Current term is 2. Ops: []
I20260709 12:22:42.599972  5104 raft_consensus.cc:2468] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 2.
I20260709 12:22:42.602977  4851 catalog_manager.cc:5697] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad reported cstate change: term changed from 1 to 2, leader changed from 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67) to c04f380d906642a8b357085d67bf51ad (127.4.181.66). New cstate: current_term: 2 leader_uuid: "c04f380d906642a8b357085d67bf51ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:42.671253  5154 raft_consensus.cc:993] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364: : Instructing follower 4489f3ff50774e7989ffcb4488f37e43 to start an election
I20260709 12:22:42.671761  5154 raft_consensus.cc:1081] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Signalling peer 4489f3ff50774e7989ffcb4488f37e43 to start an election
I20260709 12:22:42.673396  5104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4fcb5348e22d40699ea2bde45add77b4"
dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
 from {username='slave'} at 127.0.0.1:51454
I20260709 12:22:42.674015  5104 raft_consensus.cc:493] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:42.674382  5104 raft_consensus.cc:3060] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.678824  5104 raft_consensus.cc:515] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:42.680469  5104 leader_election.cc:290] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 2 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:42.681565  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcb5348e22d40699ea2bde45add77b4" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:42.681571  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fcb5348e22d40699ea2bde45add77b4" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:42.682257  4956 raft_consensus.cc:3055] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:42.682591  4956 raft_consensus.cc:740] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:42.682612  5028 raft_consensus.cc:3060] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.683483  4956 consensus_queue.cc:260] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:42.684589  4956 raft_consensus.cc:3060] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:42.688932  5028 raft_consensus.cc:2468] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 2.
I20260709 12:22:42.689985  5071 leader_election.cc:304] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad; no voters: 
I20260709 12:22:42.690654  5153 raft_consensus.cc:2804] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:42.691052  5153 raft_consensus.cc:697] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 LEADER]: Becoming Leader. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Running, Role: LEADER
I20260709 12:22:42.691989  5153 consensus_queue.cc:237] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:42.692533  4956 raft_consensus.cc:2468] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 2.
I20260709 12:22:42.699348  4852 catalog_manager.cc:5697] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 reported cstate change: term changed from 1 to 2, leader changed from eda50ab5b6bc429c866d526f072e6364 (127.4.181.65) to 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "4489f3ff50774e7989ffcb4488f37e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:42.944986  5105 raft_consensus.cc:1275] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Refusing update from remote peer eda50ab5b6bc429c866d526f072e6364: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:42.946326  5154 consensus_queue.cc:1048] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:42.956652  5028 raft_consensus.cc:1275] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Refusing update from remote peer eda50ab5b6bc429c866d526f072e6364: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:42.958214  5154 consensus_queue.cc:1048] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:42.982008  5105 raft_consensus.cc:1275] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Refusing update from remote peer eda50ab5b6bc429c866d526f072e6364: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:42.983435  5154 consensus_queue.cc:1048] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:42.991027  5028 raft_consensus.cc:1275] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Refusing update from remote peer eda50ab5b6bc429c866d526f072e6364: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:42.992925  5172 consensus_queue.cc:1048] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:43.004406  5172 raft_consensus.cc:993] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364: : Instructing follower c04f380d906642a8b357085d67bf51ad to start an election
I20260709 12:22:43.004884  5226 raft_consensus.cc:1081] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Signalling peer c04f380d906642a8b357085d67bf51ad to start an election
I20260709 12:22:43.006692  5028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8"
dest_uuid: "c04f380d906642a8b357085d67bf51ad"
 from {username='slave'} at 127.0.0.1:48582
I20260709 12:22:43.007241  5028 raft_consensus.cc:493] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:43.007520  5028 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.011996  5028 raft_consensus.cc:515] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:43.013556  5028 leader_election.cc:290] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 2 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:43.014503  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:43.014757  5105 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:43.015144  4956 raft_consensus.cc:3055] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:43.015261  5105 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.015493  4956 raft_consensus.cc:740] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:43.016292  4956 consensus_queue.cc:260] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:43.017494  4956 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:43.023802  5105 raft_consensus.cc:2468] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 2.
I20260709 12:22:43.024379  4956 raft_consensus.cc:2468] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 2.
I20260709 12:22:43.025272  4995 leader_election.cc:304] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad; no voters: 
I20260709 12:22:43.025972  5218 raft_consensus.cc:2804] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:43.026394  5218 raft_consensus.cc:697] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 2 LEADER]: Becoming Leader. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:43.027143  5218 consensus_queue.cc:237] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:43.033279  4851 catalog_manager.cc:5697] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad reported cstate change: term changed from 1 to 2, leader changed from eda50ab5b6bc429c866d526f072e6364 (127.4.181.65) to c04f380d906642a8b357085d67bf51ad (127.4.181.66). New cstate: current_term: 2 leader_uuid: "c04f380d906642a8b357085d67bf51ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:43.151283  5028 raft_consensus.cc:1275] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Refusing update from remote peer 4489f3ff50774e7989ffcb4488f37e43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:43.152633  5153 consensus_queue.cc:1048] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:43.160339  4956 raft_consensus.cc:1275] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Refusing update from remote peer 4489f3ff50774e7989ffcb4488f37e43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:43.161937  5153 consensus_queue.cc:1048] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:43.179888  5105 raft_consensus.cc:1275] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Refusing update from remote peer c04f380d906642a8b357085d67bf51ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:43.181252  5218 consensus_queue.cc:1048] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:43.190989  4956 raft_consensus.cc:1275] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Refusing update from remote peer c04f380d906642a8b357085d67bf51ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:43.192512  5218 consensus_queue.cc:1048] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:22:43.522929  5105 raft_consensus.cc:1275] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Refusing update from remote peer c04f380d906642a8b357085d67bf51ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:43.524250  5218 consensus_queue.cc:1048] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:43.532158  4956 raft_consensus.cc:1275] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Refusing update from remote peer c04f380d906642a8b357085d67bf51ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:43.534050  5156 consensus_queue.cc:1048] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:45.528090  4821 auto_leader_rebalancer-test.cc:294] The leader distribution is 
I20260709 12:22:45.528935  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:45.548055  4956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c"
dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
mode: GRACEFUL
new_leader_uuid: "4489f3ff50774e7989ffcb4488f37e43"
 from {username='slave'} at 127.0.0.1:34300
I20260709 12:22:45.548611  4956 raft_consensus.cc:606] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 2 LEADER]: Received request to transfer leadership to TS 4489f3ff50774e7989ffcb4488f37e43
I20260709 12:22:45.559667  5030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8"
dest_uuid: "c04f380d906642a8b357085d67bf51ad"
mode: GRACEFUL
new_leader_uuid: "4489f3ff50774e7989ffcb4488f37e43"
 from {username='slave'} at 127.0.0.1:48608
I20260709 12:22:45.560181  5030 raft_consensus.cc:606] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 2 LEADER]: Received request to transfer leadership to TS 4489f3ff50774e7989ffcb4488f37e43
I20260709 12:22:45.561424  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:22:45.561879  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:45.628080  5175 raft_consensus.cc:993] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad: : Instructing follower 4489f3ff50774e7989ffcb4488f37e43 to start an election
I20260709 12:22:45.628532  5246 raft_consensus.cc:1081] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 2 LEADER]: Signalling peer 4489f3ff50774e7989ffcb4488f37e43 to start an election
I20260709 12:22:45.630105  5104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8"
dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
 from {username='slave'} at 127.0.0.1:51464
I20260709 12:22:45.630620  5104 raft_consensus.cc:493] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:45.630911  5104 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:45.635295  5104 raft_consensus.cc:515] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:45.636868  5104 leader_election.cc:290] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 3 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:45.637811  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:45.638267  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:45.638429  4956 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:45.638842  5028 raft_consensus.cc:3055] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:45.639138  5028 raft_consensus.cc:740] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:45.639737  5028 consensus_queue.cc:260] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:45.640570  5028 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:45.643065  4956 raft_consensus.cc:2468] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 3.
I20260709 12:22:45.644101  5068 leader_election.cc:304] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:45.644745  5153 raft_consensus.cc:2804] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:45.645375  5028 raft_consensus.cc:2468] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 3.
I20260709 12:22:45.645926  5153 raft_consensus.cc:697] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 LEADER]: Becoming Leader. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Running, Role: LEADER
I20260709 12:22:45.646878  5153 consensus_queue.cc:237] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:45.652961  4851 catalog_manager.cc:5697] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 reported cstate change: term changed from 2 to 3, leader changed from c04f380d906642a8b357085d67bf51ad (127.4.181.66) to 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67). New cstate: current_term: 3 leader_uuid: "4489f3ff50774e7989ffcb4488f37e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:45.967855  5242 raft_consensus.cc:993] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364: : Instructing follower 4489f3ff50774e7989ffcb4488f37e43 to start an election
I20260709 12:22:45.968262  5242 raft_consensus.cc:1081] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 2 LEADER]: Signalling peer 4489f3ff50774e7989ffcb4488f37e43 to start an election
I20260709 12:22:45.969743  5104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c"
dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
 from {username='slave'} at 127.0.0.1:51454
I20260709 12:22:45.970234  5104 raft_consensus.cc:493] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:45.970569  5104 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:45.974943  5104 raft_consensus.cc:515] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:45.976732  5104 leader_election.cc:290] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 3 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:45.977620  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:45.977881  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:45.978267  4956 raft_consensus.cc:3055] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:45.978433  5028 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:45.978662  4956 raft_consensus.cc:740] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:45.979481  4956 consensus_queue.cc:260] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:45.980858  4956 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:45.985533  5028 raft_consensus.cc:2468] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 3.
I20260709 12:22:45.986821  5071 leader_election.cc:304] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad; no voters: 
I20260709 12:22:45.987267  4956 raft_consensus.cc:2468] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 3.
I20260709 12:22:45.987543  5153 raft_consensus.cc:2804] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:45.988031  5153 raft_consensus.cc:697] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 3 LEADER]: Becoming Leader. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Running, Role: LEADER
I20260709 12:22:45.988826  5153 consensus_queue.cc:237] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:45.995370  4851 catalog_manager.cc:5697] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 reported cstate change: term changed from 2 to 3, leader changed from eda50ab5b6bc429c866d526f072e6364 (127.4.181.65) to 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67). New cstate: current_term: 3 leader_uuid: "4489f3ff50774e7989ffcb4488f37e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:46.100329  4956 raft_consensus.cc:1275] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 3 FOLLOWER]: Refusing update from remote peer 4489f3ff50774e7989ffcb4488f37e43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:46.101804  5153 consensus_queue.cc:1048] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:46.112449  5028 raft_consensus.cc:1275] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Refusing update from remote peer 4489f3ff50774e7989ffcb4488f37e43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:46.114692  5258 consensus_queue.cc:1048] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:22:46.384986  5028 raft_consensus.cc:1275] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Refusing update from remote peer 4489f3ff50774e7989ffcb4488f37e43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:46.386296  5258 consensus_queue.cc:1048] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:46.395063  4956 raft_consensus.cc:1275] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 3 FOLLOWER]: Refusing update from remote peer 4489f3ff50774e7989ffcb4488f37e43: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:46.396790  5257 consensus_queue.cc:1048] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:46.562947  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:46.568147  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:46.568600  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:47.569556  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:47.574728  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:47.575143  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:48.576689  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:48.583401  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:48.583806  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:49.584859  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:49.590061  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:49.590637  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:50.591598  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:50.596482  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:50.596877  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:51.597877  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:51.602612  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:51.603016  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:52.604018  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:52.608971  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:52.609386  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:53.610344  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:53.615696  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:53.616110  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:54.671412  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:54.676170  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:54.676529  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:22:55.150300  4977 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7060 after lost signal to thread 4824
W20260709 12:22:55.151173  4977 debug-util.cc:398] Leaking SignalData structure 0x7b08000e7740 after lost signal to thread 4887
W20260709 12:22:55.151922  4977 debug-util.cc:398] Leaking SignalData structure 0x7b0800171460 after lost signal to thread 4980
W20260709 12:22:55.152573  4977 debug-util.cc:398] Leaking SignalData structure 0x7b080017f760 after lost signal to thread 5055
W20260709 12:22:55.153204  4977 debug-util.cc:398] Leaking SignalData structure 0x7b08001c5460 after lost signal to thread 5129
I20260709 12:22:55.707393  4821 auto_leader_rebalancer-test.cc:313] The leader distribution is 
I20260709 12:22:55.712899  5104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c"
dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
mode: GRACEFUL
new_leader_uuid: "c04f380d906642a8b357085d67bf51ad"
 from {username='slave'} at 127.0.0.1:51472
I20260709 12:22:55.713617  5104 raft_consensus.cc:606] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 3 LEADER]: Received request to transfer leadership to TS c04f380d906642a8b357085d67bf51ad
I20260709 12:22:55.719079  4956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "661f727556cd4598838d829886293fb0"
dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
mode: GRACEFUL
new_leader_uuid: "c04f380d906642a8b357085d67bf51ad"
 from {username='slave'} at 127.0.0.1:34292
I20260709 12:22:55.719532  4956 raft_consensus.cc:606] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Received request to transfer leadership to TS c04f380d906642a8b357085d67bf51ad
I20260709 12:22:55.724557  4956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e292b2dac8df4bba9fcfd4aeea800f47"
dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
mode: GRACEFUL
new_leader_uuid: "c04f380d906642a8b357085d67bf51ad"
 from {username='slave'} at 127.0.0.1:34292
I20260709 12:22:55.725090  4956 raft_consensus.cc:606] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 2 LEADER]: Received request to transfer leadership to TS c04f380d906642a8b357085d67bf51ad
I20260709 12:22:55.729854  4956 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ada5e49b1b04466b75d60c8bedf99f4"
dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
mode: GRACEFUL
new_leader_uuid: "c04f380d906642a8b357085d67bf51ad"
 from {username='slave'} at 127.0.0.1:34292
I20260709 12:22:55.730410  4956 raft_consensus.cc:606] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Received request to transfer leadership to TS c04f380d906642a8b357085d67bf51ad
I20260709 12:22:55.735419  5104 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8"
dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
mode: GRACEFUL
new_leader_uuid: "c04f380d906642a8b357085d67bf51ad"
 from {username='slave'} at 127.0.0.1:51472
I20260709 12:22:55.735957  5104 raft_consensus.cc:606] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 LEADER]: Received request to transfer leadership to TS c04f380d906642a8b357085d67bf51ad
I20260709 12:22:55.768841  5273 raft_consensus.cc:993] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43: : Instructing follower c04f380d906642a8b357085d67bf51ad to start an election
I20260709 12:22:55.769366  5270 raft_consensus.cc:1081] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 LEADER]: Signalling peer c04f380d906642a8b357085d67bf51ad to start an election
I20260709 12:22:55.770946  5028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8"
dest_uuid: "c04f380d906642a8b357085d67bf51ad"
 from {username='slave'} at 127.0.0.1:48596
I20260709 12:22:55.771387  5028 raft_consensus.cc:493] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:55.771692  5028 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:55.776422  5028 raft_consensus.cc:515] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:55.778081  5028 leader_election.cc:290] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 4 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:55.779322  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:55.779490  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:55.779946  5104 raft_consensus.cc:3055] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:55.780246  5104 raft_consensus.cc:740] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Running, Role: LEADER
I20260709 12:22:55.780200  4954 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:55.781061  5104 consensus_queue.cc:260] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:55.781999  5104 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:55.786052  5104 raft_consensus.cc:2468] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 4.
I20260709 12:22:55.787192  4995 leader_election.cc:304] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad; no voters: 
I20260709 12:22:55.787588  4954 raft_consensus.cc:2468] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 4.
I20260709 12:22:55.788015  5271 raft_consensus.cc:2804] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:55.789150  5271 raft_consensus.cc:697] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 4 LEADER]: Becoming Leader. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:55.789965  5271 consensus_queue.cc:237] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:55.801208  5276 raft_consensus.cc:993] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364: : Instructing follower c04f380d906642a8b357085d67bf51ad to start an election
I20260709 12:22:55.801851  5272 raft_consensus.cc:1081] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 2 LEADER]: Signalling peer c04f380d906642a8b357085d67bf51ad to start an election
I20260709 12:22:55.801512  4852 catalog_manager.cc:5697] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad reported cstate change: term changed from 3 to 4, leader changed from 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67) to c04f380d906642a8b357085d67bf51ad (127.4.181.66). New cstate: current_term: 4 leader_uuid: "c04f380d906642a8b357085d67bf51ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:55.803982  5028 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e292b2dac8df4bba9fcfd4aeea800f47"
dest_uuid: "c04f380d906642a8b357085d67bf51ad"
 from {username='slave'} at 127.0.0.1:48582
I20260709 12:22:55.804564  5028 raft_consensus.cc:493] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:55.804937  5028 raft_consensus.cc:3060] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:55.809206  5028 raft_consensus.cc:515] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:55.812251  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e292b2dac8df4bba9fcfd4aeea800f47" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:55.812520  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e292b2dac8df4bba9fcfd4aeea800f47" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:55.812951  4954 raft_consensus.cc:3055] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:55.813149  5104 raft_consensus.cc:3060] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:55.813438  4954 raft_consensus.cc:740] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:55.814299  4954 consensus_queue.cc:260] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:55.815356  4954 raft_consensus.cc:3060] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:55.820087  5104 raft_consensus.cc:2468] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 3.
I20260709 12:22:55.836017  4995 leader_election.cc:304] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad; no voters: 
I20260709 12:22:55.836974  5271 raft_consensus.cc:2804] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:55.823037  5272 raft_consensus.cc:993] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364: : Instructing follower c04f380d906642a8b357085d67bf51ad to start an election
I20260709 12:22:55.837955  5272 raft_consensus.cc:1081] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Signalling peer c04f380d906642a8b357085d67bf51ad to start an election
I20260709 12:22:55.826624  4954 raft_consensus.cc:2468] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 3.
I20260709 12:22:55.820536  5028 leader_election.cc:290] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 3 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:55.837440  5271 raft_consensus.cc:697] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 3 LEADER]: Becoming Leader. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:55.840819  5030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ada5e49b1b04466b75d60c8bedf99f4"
dest_uuid: "c04f380d906642a8b357085d67bf51ad"
 from {username='slave'} at 127.0.0.1:48582
I20260709 12:22:55.841370  5030 raft_consensus.cc:493] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:55.841184  5271 consensus_queue.cc:237] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:55.841776  5030 raft_consensus.cc:3060] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:55.848809  5030 raft_consensus.cc:515] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:55.851615  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada5e49b1b04466b75d60c8bedf99f4" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:55.852265  4954 raft_consensus.cc:3055] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:55.852684  4954 raft_consensus.cc:740] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:55.853667  4954 consensus_queue.cc:260] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:55.854821  4954 raft_consensus.cc:3060] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:55.855315  5030 leader_election.cc:290] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 2 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:55.855448  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada5e49b1b04466b75d60c8bedf99f4" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:55.856925  5104 raft_consensus.cc:3060] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:55.862812  4954 raft_consensus.cc:2468] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 2.
I20260709 12:22:55.863968  5104 raft_consensus.cc:2468] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 2.
I20260709 12:22:55.864370  4994 leader_election.cc:304] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c04f380d906642a8b357085d67bf51ad, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:55.865268  5271 raft_consensus.cc:2804] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:55.865720  5271 raft_consensus.cc:697] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 2 LEADER]: Becoming Leader. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:55.866011  4852 catalog_manager.cc:5697] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad reported cstate change: term changed from 2 to 3, leader changed from eda50ab5b6bc429c866d526f072e6364 (127.4.181.65) to c04f380d906642a8b357085d67bf51ad (127.4.181.66). New cstate: current_term: 3 leader_uuid: "c04f380d906642a8b357085d67bf51ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:55.866591  5271 consensus_queue.cc:237] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:55.879364  4852 catalog_manager.cc:5697] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad reported cstate change: term changed from 1 to 2, leader changed from eda50ab5b6bc429c866d526f072e6364 (127.4.181.65) to c04f380d906642a8b357085d67bf51ad (127.4.181.66). New cstate: current_term: 2 leader_uuid: "c04f380d906642a8b357085d67bf51ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:56.051195  5273 raft_consensus.cc:993] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43: : Instructing follower c04f380d906642a8b357085d67bf51ad to start an election
I20260709 12:22:56.051673  5270 raft_consensus.cc:1081] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 3 LEADER]: Signalling peer c04f380d906642a8b357085d67bf51ad to start an election
I20260709 12:22:56.053190  5030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c"
dest_uuid: "c04f380d906642a8b357085d67bf51ad"
 from {username='slave'} at 127.0.0.1:48596
I20260709 12:22:56.053679  5030 raft_consensus.cc:493] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:56.053960  5030 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:56.058748  5030 raft_consensus.cc:515] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:56.060647  5030 leader_election.cc:290] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 4 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:56.061465  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:56.061728  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:56.062184  4954 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:56.062307  5104 raft_consensus.cc:3055] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:22:56.062664  5104 raft_consensus.cc:740] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Running, Role: LEADER
I20260709 12:22:56.063280  5104 consensus_queue.cc:260] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:56.064122  5104 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:22:56.068400  5104 raft_consensus.cc:2468] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 4.
I20260709 12:22:56.069047  4954 raft_consensus.cc:2468] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 4.
I20260709 12:22:56.069401  4995 leader_election.cc:304] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad; no voters: 
I20260709 12:22:56.070251  5271 raft_consensus.cc:2804] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:22:56.070755  5271 raft_consensus.cc:697] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 4 LEADER]: Becoming Leader. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:56.071532  5271 consensus_queue.cc:237] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:56.079425  4852 catalog_manager.cc:5697] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad reported cstate change: term changed from 3 to 4, leader changed from 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67) to c04f380d906642a8b357085d67bf51ad (127.4.181.66). New cstate: current_term: 4 leader_uuid: "c04f380d906642a8b357085d67bf51ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:56.097201  5272 raft_consensus.cc:993] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364: : Instructing follower c04f380d906642a8b357085d67bf51ad to start an election
I20260709 12:22:56.097738  5276 raft_consensus.cc:1081] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Signalling peer c04f380d906642a8b357085d67bf51ad to start an election
I20260709 12:22:56.099382  5030 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "661f727556cd4598838d829886293fb0"
dest_uuid: "c04f380d906642a8b357085d67bf51ad"
 from {username='slave'} at 127.0.0.1:48582
I20260709 12:22:56.100060  5030 raft_consensus.cc:493] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:56.100428  5030 raft_consensus.cc:3060] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:56.105656  5030 raft_consensus.cc:515] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:56.108278  5030 leader_election.cc:290] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 2 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:56.108620  4954 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f727556cd4598838d829886293fb0" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:56.108982  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "661f727556cd4598838d829886293fb0" candidate_uuid: "c04f380d906642a8b357085d67bf51ad" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:56.109318  4954 raft_consensus.cc:3055] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:56.109948  5104 raft_consensus.cc:3060] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:56.109977  4954 raft_consensus.cc:740] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:56.111142  4954 consensus_queue.cc:260] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:56.112699  4954 raft_consensus.cc:3060] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:56.115624  5104 raft_consensus.cc:2468] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 2.
I20260709 12:22:56.116624  4995 leader_election.cc:304] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad; no voters: 
I20260709 12:22:56.117316  5271 raft_consensus.cc:2804] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:56.117735  5271 raft_consensus.cc:697] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [term 2 LEADER]: Becoming Leader. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:56.119267  5271 consensus_queue.cc:237] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:56.121181  4954 raft_consensus.cc:2468] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c04f380d906642a8b357085d67bf51ad in term 2.
I20260709 12:22:56.126904  4852 catalog_manager.cc:5697] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad reported cstate change: term changed from 1 to 2, leader changed from eda50ab5b6bc429c866d526f072e6364 (127.4.181.65) to c04f380d906642a8b357085d67bf51ad (127.4.181.66). New cstate: current_term: 2 leader_uuid: "c04f380d906642a8b357085d67bf51ad" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:56.176259  5104 raft_consensus.cc:1275] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 4 FOLLOWER]: Refusing update from remote peer c04f380d906642a8b357085d67bf51ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:56.177573  5271 consensus_queue.cc:1048] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:56.188696  4954 raft_consensus.cc:1275] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 4 FOLLOWER]: Refusing update from remote peer c04f380d906642a8b357085d67bf51ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:56.191620  5271 consensus_queue.cc:1048] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.002s
I20260709 12:22:56.223157  4954 raft_consensus.cc:1275] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 3 FOLLOWER]: Refusing update from remote peer c04f380d906642a8b357085d67bf51ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:56.224555  5271 consensus_queue.cc:1048] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:56.233500  5104 raft_consensus.cc:1275] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 FOLLOWER]: Refusing update from remote peer c04f380d906642a8b357085d67bf51ad: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:56.235291  5271 consensus_queue.cc:1048] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:56.321820  4954 raft_consensus.cc:1275] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Refusing update from remote peer c04f380d906642a8b357085d67bf51ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:56.323762  5274 consensus_queue.cc:1048] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:56.335006  5104 raft_consensus.cc:1275] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Refusing update from remote peer c04f380d906642a8b357085d67bf51ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:56.336660  5271 consensus_queue.cc:1048] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:56.450505  4954 raft_consensus.cc:1275] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 4 FOLLOWER]: Refusing update from remote peer c04f380d906642a8b357085d67bf51ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:56.452051  5271 consensus_queue.cc:1048] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:22:56.464986  5104 raft_consensus.cc:1275] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 4 FOLLOWER]: Refusing update from remote peer c04f380d906642a8b357085d67bf51ad: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:22:56.466580  5291 consensus_queue.cc:1048] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:22:56.614145  4954 raft_consensus.cc:1275] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Refusing update from remote peer c04f380d906642a8b357085d67bf51ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:56.615623  5291 consensus_queue.cc:1048] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:56.627030  5104 raft_consensus.cc:1275] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Refusing update from remote peer c04f380d906642a8b357085d67bf51ad: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:56.628506  5274 consensus_queue.cc:1048] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:58.777365  4821 auto_leader_rebalancer-test.cc:328] The leader distribution is 
I20260709 12:22:58.778211  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:58.786212  5030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "60143441eb3f4597b63bafb3a6e7ab55"
dest_uuid: "c04f380d906642a8b357085d67bf51ad"
mode: GRACEFUL
new_leader_uuid: "4489f3ff50774e7989ffcb4488f37e43"
 from {username='slave'} at 127.0.0.1:48608
I20260709 12:22:58.787133  5030 raft_consensus.cc:606] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Received request to transfer leadership to TS 4489f3ff50774e7989ffcb4488f37e43
I20260709 12:22:58.789716  5030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63a8d8d586214f4f886ca4daf541909b"
dest_uuid: "c04f380d906642a8b357085d67bf51ad"
mode: GRACEFUL
new_leader_uuid: "eda50ab5b6bc429c866d526f072e6364"
 from {username='slave'} at 127.0.0.1:48608
I20260709 12:22:58.790190  5030 raft_consensus.cc:606] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Received request to transfer leadership to TS eda50ab5b6bc429c866d526f072e6364
I20260709 12:22:58.792428  5030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ada5e49b1b04466b75d60c8bedf99f4"
dest_uuid: "c04f380d906642a8b357085d67bf51ad"
mode: GRACEFUL
new_leader_uuid: "eda50ab5b6bc429c866d526f072e6364"
 from {username='slave'} at 127.0.0.1:48608
I20260709 12:22:58.792893  5030 raft_consensus.cc:606] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 2 LEADER]: Received request to transfer leadership to TS eda50ab5b6bc429c866d526f072e6364
I20260709 12:22:58.794937  5030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c"
dest_uuid: "c04f380d906642a8b357085d67bf51ad"
mode: GRACEFUL
new_leader_uuid: "eda50ab5b6bc429c866d526f072e6364"
 from {username='slave'} at 127.0.0.1:48608
I20260709 12:22:58.795363  5030 raft_consensus.cc:606] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 4 LEADER]: Received request to transfer leadership to TS eda50ab5b6bc429c866d526f072e6364
I20260709 12:22:58.797390  5030 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8"
dest_uuid: "c04f380d906642a8b357085d67bf51ad"
mode: GRACEFUL
new_leader_uuid: "4489f3ff50774e7989ffcb4488f37e43"
 from {username='slave'} at 127.0.0.1:48608
I20260709 12:22:58.797856  5030 raft_consensus.cc:606] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 4 LEADER]: Received request to transfer leadership to TS 4489f3ff50774e7989ffcb4488f37e43
I20260709 12:22:58.798934  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:22:58.799360  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:22:58.926447  5274 raft_consensus.cc:993] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad: : Instructing follower eda50ab5b6bc429c866d526f072e6364 to start an election
I20260709 12:22:58.926970  5299 raft_consensus.cc:1081] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 4 LEADER]: Signalling peer eda50ab5b6bc429c866d526f072e6364 to start an election
I20260709 12:22:58.928333  4956 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c"
dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
 from {username='slave'} at 127.0.0.1:34278
I20260709 12:22:58.928766  4956 raft_consensus.cc:493] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:58.929050  4956 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:58.934693  4956 raft_consensus.cc:515] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:58.937021  4956 leader_election.cc:290] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 5 election: Requested vote from peers 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499), c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:58.938043  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:58.938311  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ed3bfe15f74464c8900fa1cb1cffa1c" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:58.938633  5104 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:58.938818  5030 raft_consensus.cc:3055] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:58.939106  5030 raft_consensus.cc:740] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:58.939882  5030 consensus_queue.cc:260] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:58.940837  5030 raft_consensus.cc:3060] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:58.943280  5104 raft_consensus.cc:2468] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 5.
I20260709 12:22:58.944451  4920 leader_election.cc:304] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:58.945914  5030 raft_consensus.cc:2468] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 5.
I20260709 12:22:58.946049  5301 raft_consensus.cc:2804] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:58.947204  5301 raft_consensus.cc:697] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 5 LEADER]: Becoming Leader. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:58.947963  5301 consensus_queue.cc:237] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } }
I20260709 12:22:58.954545  4852 catalog_manager.cc:5697] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 reported cstate change: term changed from 4 to 5, leader changed from c04f380d906642a8b357085d67bf51ad (127.4.181.66) to eda50ab5b6bc429c866d526f072e6364 (127.4.181.65). New cstate: current_term: 5 leader_uuid: "eda50ab5b6bc429c866d526f072e6364" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:59.076740  5299 raft_consensus.cc:993] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad: : Instructing follower 4489f3ff50774e7989ffcb4488f37e43 to start an election
I20260709 12:22:59.077131  5299 raft_consensus.cc:1081] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 4 LEADER]: Signalling peer 4489f3ff50774e7989ffcb4488f37e43 to start an election
I20260709 12:22:59.078612  5104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8"
dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
 from {username='slave'} at 127.0.0.1:51464
I20260709 12:22:59.079100  5104 raft_consensus.cc:493] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.079360  5104 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:59.083811  5104 raft_consensus.cc:515] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:59.085883  5104 leader_election.cc:290] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 5 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:59.086722  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:59.087261  4956 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:59.087253  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e509a6d816734ae99c8943ad78b11da8" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:59.087952  5030 raft_consensus.cc:3055] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:22:59.088276  5030 raft_consensus.cc:740] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 4 LEADER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:59.089233  5030 consensus_queue.cc:260] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:59.090723  5030 raft_consensus.cc:3060] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:22:59.094684  4956 raft_consensus.cc:2468] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 5.
I20260709 12:22:59.096297  5068 leader_election.cc:304] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:59.097476  5270 raft_consensus.cc:2804] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:22:59.097831  5030 raft_consensus.cc:2468] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 5.
I20260709 12:22:59.098757  5270 raft_consensus.cc:697] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 5 LEADER]: Becoming Leader. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Running, Role: LEADER
I20260709 12:22:59.099602  5270 consensus_queue.cc:237] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:59.107693  4852 catalog_manager.cc:5697] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 reported cstate change: term changed from 4 to 5, leader changed from c04f380d906642a8b357085d67bf51ad (127.4.181.66) to 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67). New cstate: current_term: 5 leader_uuid: "4489f3ff50774e7989ffcb4488f37e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:59.265447  5274 raft_consensus.cc:993] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad: : Instructing follower 4489f3ff50774e7989ffcb4488f37e43 to start an election
I20260709 12:22:59.266004  5299 raft_consensus.cc:1081] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Signalling peer 4489f3ff50774e7989ffcb4488f37e43 to start an election
I20260709 12:22:59.267654  5104 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "60143441eb3f4597b63bafb3a6e7ab55"
dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
 from {username='slave'} at 127.0.0.1:51464
I20260709 12:22:59.268179  5104 raft_consensus.cc:493] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.268541  5104 raft_consensus.cc:3060] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.271750  5299 raft_consensus.cc:993] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad: : Instructing follower eda50ab5b6bc429c866d526f072e6364 to start an election
I20260709 12:22:59.272281  5274 raft_consensus.cc:1081] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Signalling peer eda50ab5b6bc429c866d526f072e6364 to start an election
I20260709 12:22:59.274096  4954 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63a8d8d586214f4f886ca4daf541909b"
dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
 from {username='slave'} at 127.0.0.1:34278
I20260709 12:22:59.274619  4954 raft_consensus.cc:493] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.274890  4954 raft_consensus.cc:3060] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.274718  5104 raft_consensus.cc:515] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:59.276619  5104 leader_election.cc:290] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 2 election: Requested vote from peers eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309), c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241)
I20260709 12:22:59.277940  5030 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60143441eb3f4597b63bafb3a6e7ab55" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:59.278290  4956 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "60143441eb3f4597b63bafb3a6e7ab55" candidate_uuid: "4489f3ff50774e7989ffcb4488f37e43" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
I20260709 12:22:59.278604  5030 raft_consensus.cc:3055] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:59.278882  4956 raft_consensus.cc:3060] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.279070  5030 raft_consensus.cc:740] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:59.279884  5030 consensus_queue.cc:260] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:59.280999  5030 raft_consensus.cc:3060] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.281263  5274 raft_consensus.cc:993] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad: : Instructing follower eda50ab5b6bc429c866d526f072e6364 to start an election
I20260709 12:22:59.281322  4954 raft_consensus.cc:515] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:59.281782  5274 raft_consensus.cc:1081] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 2 LEADER]: Signalling peer eda50ab5b6bc429c866d526f072e6364 to start an election
I20260709 12:22:59.283636  4955 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6ada5e49b1b04466b75d60c8bedf99f4"
dest_uuid: "eda50ab5b6bc429c866d526f072e6364"
 from {username='slave'} at 127.0.0.1:34278
I20260709 12:22:59.284206  4955 raft_consensus.cc:493] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:22:59.284365  4954 leader_election.cc:290] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 2 election: Requested vote from peers c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:59.284600  4955 raft_consensus.cc:3060] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:59.284286  5028 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a8d8d586214f4f886ca4daf541909b" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:59.285305  5028 raft_consensus.cc:3055] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:22:59.285567  5028 raft_consensus.cc:740] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:59.286381  5028 consensus_queue.cc:260] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:59.287163  5030 raft_consensus.cc:2468] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 2.
I20260709 12:22:59.287452  5028 raft_consensus.cc:3060] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.288347  5071 leader_election.cc:304] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, c04f380d906642a8b357085d67bf51ad; no voters: 
I20260709 12:22:59.288513  4956 raft_consensus.cc:2468] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4489f3ff50774e7989ffcb4488f37e43 in term 2.
I20260709 12:22:59.289469  5270 raft_consensus.cc:2804] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:59.289506  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63a8d8d586214f4f886ca4daf541909b" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:59.290037  5270 raft_consensus.cc:697] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 LEADER]: Becoming Leader. State: Replica: 4489f3ff50774e7989ffcb4488f37e43, State: Running, Role: LEADER
I20260709 12:22:59.290083  5104 raft_consensus.cc:3060] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:22:59.291024  5270 consensus_queue.cc:237] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:59.291546  4955 raft_consensus.cc:515] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:59.295620  5029 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada5e49b1b04466b75d60c8bedf99f4" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c04f380d906642a8b357085d67bf51ad"
I20260709 12:22:59.296252  5029 raft_consensus.cc:3055] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:22:59.296576  5029 raft_consensus.cc:740] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c04f380d906642a8b357085d67bf51ad, State: Running, Role: LEADER
I20260709 12:22:59.297282  5104 raft_consensus.cc:2468] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 2.
I20260709 12:22:59.297380  5029 consensus_queue.cc:260] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:59.298615  5029 raft_consensus.cc:3060] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:59.299562  4920 leader_election.cc:304] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:59.299614  5104 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6ada5e49b1b04466b75d60c8bedf99f4" candidate_uuid: "eda50ab5b6bc429c866d526f072e6364" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4489f3ff50774e7989ffcb4488f37e43"
I20260709 12:22:59.300339  5104 raft_consensus.cc:3060] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:22:59.300513  5301 raft_consensus.cc:2804] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:22:59.300967  5301 raft_consensus.cc:697] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 2 LEADER]: Becoming Leader. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:59.301849  5301 consensus_queue.cc:237] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:59.303756  5028 raft_consensus.cc:2468] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 2.
I20260709 12:22:59.298578  4955 leader_election.cc:290] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 3 election: Requested vote from peers c04f380d906642a8b357085d67bf51ad (127.4.181.66:33241), 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67:38499)
I20260709 12:22:59.307467  5104 raft_consensus.cc:2468] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 3.
I20260709 12:22:59.308709  4920 leader_election.cc:304] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4489f3ff50774e7989ffcb4488f37e43, eda50ab5b6bc429c866d526f072e6364; no voters: 
I20260709 12:22:59.309935  5302 raft_consensus.cc:2804] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:22:59.311236  4852 catalog_manager.cc:5697] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 reported cstate change: term changed from 1 to 2, leader changed from c04f380d906642a8b357085d67bf51ad (127.4.181.66) to 4489f3ff50774e7989ffcb4488f37e43 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "4489f3ff50774e7989ffcb4488f37e43" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: HEALTHY } } }
I20260709 12:22:59.312044  5302 raft_consensus.cc:697] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 3 LEADER]: Becoming Leader. State: Replica: eda50ab5b6bc429c866d526f072e6364, State: Running, Role: LEADER
I20260709 12:22:59.313079  5302 consensus_queue.cc:237] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } }
I20260709 12:22:59.314121  5029 raft_consensus.cc:2468] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eda50ab5b6bc429c866d526f072e6364 in term 3.
I20260709 12:22:59.317127  4853 catalog_manager.cc:5697] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 reported cstate change: term changed from 1 to 2, leader changed from c04f380d906642a8b357085d67bf51ad (127.4.181.66) to eda50ab5b6bc429c866d526f072e6364 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "eda50ab5b6bc429c866d526f072e6364" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:59.328714  4853 catalog_manager.cc:5697] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 reported cstate change: term changed from 2 to 3, leader changed from c04f380d906642a8b357085d67bf51ad (127.4.181.66) to eda50ab5b6bc429c866d526f072e6364 (127.4.181.65). New cstate: current_term: 3 leader_uuid: "eda50ab5b6bc429c866d526f072e6364" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 } health_report { overall_health: UNKNOWN } } }
I20260709 12:22:59.584967  5104 raft_consensus.cc:1275] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 5 FOLLOWER]: Refusing update from remote peer eda50ab5b6bc429c866d526f072e6364: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:59.584995  5029 raft_consensus.cc:1275] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 5 FOLLOWER]: Refusing update from remote peer eda50ab5b6bc429c866d526f072e6364: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:59.589349  5301 consensus_queue.cc:1048] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:59.590003  5302 consensus_queue.cc:1048] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:59.624241  4955 raft_consensus.cc:1275] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 5 FOLLOWER]: Refusing update from remote peer 4489f3ff50774e7989ffcb4488f37e43: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:59.625427  5308 consensus_queue.cc:1048] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:59.634258  5029 raft_consensus.cc:1275] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 5 FOLLOWER]: Refusing update from remote peer 4489f3ff50774e7989ffcb4488f37e43: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:22:59.636216  5270 consensus_queue.cc:1048] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:22:59.682309  4955 raft_consensus.cc:1275] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Refusing update from remote peer 4489f3ff50774e7989ffcb4488f37e43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:59.683641  5270 consensus_queue.cc:1048] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eda50ab5b6bc429c866d526f072e6364" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 41309 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:59.693235  5029 raft_consensus.cc:1275] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Refusing update from remote peer 4489f3ff50774e7989ffcb4488f37e43: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:59.694846  5324 consensus_queue.cc:1048] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:22:59.761722  5104 raft_consensus.cc:1275] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Refusing update from remote peer eda50ab5b6bc429c866d526f072e6364: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:59.763072  5302 consensus_queue.cc:1048] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:59.772003  5029 raft_consensus.cc:1275] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Refusing update from remote peer eda50ab5b6bc429c866d526f072e6364: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:22:59.773304  5302 consensus_queue.cc:1048] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:22:59.797533  5104 raft_consensus.cc:1275] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 FOLLOWER]: Refusing update from remote peer eda50ab5b6bc429c866d526f072e6364: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:59.798619  5302 consensus_queue.cc:1048] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4489f3ff50774e7989ffcb4488f37e43" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 38499 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:59.807328  5029 raft_consensus.cc:1275] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Refusing update from remote peer eda50ab5b6bc429c866d526f072e6364: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:22:59.809378  5301 consensus_queue.cc:1048] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c04f380d906642a8b357085d67bf51ad" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 33241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:22:59.866405  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:22:59.871259  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:22:59.871639  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:23:00.399921  4884 debug-util.cc:398] Leaking SignalData structure 0x7b0800062060 after lost signal to thread 4824
W20260709 12:23:00.400862  4884 debug-util.cc:398] Leaking SignalData structure 0x7b0800062740 after lost signal to thread 4887
W20260709 12:23:00.401888  4884 debug-util.cc:398] Leaking SignalData structure 0x7b08001fa5a0 after lost signal to thread 4980
W20260709 12:23:00.402650  4884 debug-util.cc:398] Leaking SignalData structure 0x7b08001bf3e0 after lost signal to thread 5055
W20260709 12:23:00.403296  4884 debug-util.cc:398] Leaking SignalData structure 0x7b0800199e40 after lost signal to thread 5129
I20260709 12:23:00.872759  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:00.880064  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:00.880599  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:01.881631  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:01.887609  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:01.888029  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:02.889037  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:02.893998  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:02.894411  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:03.895448  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:03.900429  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:03.900897  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:04.901932  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:04.907691  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:04.908033  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:05.908931  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:05.913899  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:05.914249  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:06.915256  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:06.919924  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:06.920272  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:07.921142  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:07.926332  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:07.926769  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:08.955049  4821 auto_leader_rebalancer-test.cc:340] The leader distribution is 
I20260709 12:23:08.955855  4821 tablet_server.cc:179] TabletServer@127.4.181.65:0 shutting down...
I20260709 12:23:08.986971  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:08.987813  4821 tablet_replica.cc:333] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364: stopping tablet replica
I20260709 12:23:08.988621  4821 raft_consensus.cc:2243] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.989290  4821 raft_consensus.cc:2272] T 60143441eb3f4597b63bafb3a6e7ab55 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:08.991888  4821 tablet_replica.cc:333] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364: stopping tablet replica
I20260709 12:23:08.992427  4821 raft_consensus.cc:2243] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.992957  4821 raft_consensus.cc:2272] T 56bf1d6abb78450bbecfc1b0eb763942 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:08.994119  5068 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:23:08.995287  4821 tablet_replica.cc:333] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364: stopping tablet replica
I20260709 12:23:08.995992  4821 raft_consensus.cc:2243] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.996392  4821 raft_consensus.cc:2272] T 4fcb5348e22d40699ea2bde45add77b4 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:08.997402  5068 consensus_peers.cc:597] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 -> Peer eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309): Couldn't send request to peer eda50ab5b6bc429c866d526f072e6364. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:08.998437  4821 tablet_replica.cc:333] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364: stopping tablet replica
I20260709 12:23:08.998970  4821 raft_consensus.cc:2243] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:08.999346  4821 raft_consensus.cc:2272] T 661f727556cd4598838d829886293fb0 P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.000996  4821 tablet_replica.cc:333] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364: stopping tablet replica
I20260709 12:23:09.001447  4821 raft_consensus.cc:2243] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.002192  4821 raft_consensus.cc:2272] T 63a8d8d586214f4f886ca4daf541909b P eda50ab5b6bc429c866d526f072e6364 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.003844  4821 tablet_replica.cc:333] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364: stopping tablet replica
I20260709 12:23:09.004314  4821 raft_consensus.cc:2243] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.005007  4821 raft_consensus.cc:2272] T 6ed3bfe15f74464c8900fa1cb1cffa1c P eda50ab5b6bc429c866d526f072e6364 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.006564  4821 tablet_replica.cc:333] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364: stopping tablet replica
I20260709 12:23:09.007025  4821 raft_consensus.cc:2243] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.007515  4821 raft_consensus.cc:2272] T e509a6d816734ae99c8943ad78b11da8 P eda50ab5b6bc429c866d526f072e6364 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.009024  4821 tablet_replica.cc:333] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364: stopping tablet replica
I20260709 12:23:09.009464  4821 raft_consensus.cc:2243] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.010174  4821 raft_consensus.cc:2272] T 6ada5e49b1b04466b75d60c8bedf99f4 P eda50ab5b6bc429c866d526f072e6364 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.011884  4821 tablet_replica.cc:333] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364: stopping tablet replica
I20260709 12:23:09.012318  4821 raft_consensus.cc:2243] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.012691  4821 raft_consensus.cc:2272] T e292b2dac8df4bba9fcfd4aeea800f47 P eda50ab5b6bc429c866d526f072e6364 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.115919  4821 tablet_server.cc:196] TabletServer@127.4.181.65:0 shutdown complete.
I20260709 12:23:09.137176  4821 tablet_server.cc:179] TabletServer@127.4.181.66:0 shutting down...
I20260709 12:23:09.165714  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:09.166600  4821 tablet_replica.cc:333] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad: stopping tablet replica
I20260709 12:23:09.167280  4821 raft_consensus.cc:2243] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.167893  4821 raft_consensus.cc:2272] T 60143441eb3f4597b63bafb3a6e7ab55 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:09.169667  4994 consensus_peers.cc:597] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad -> Peer eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309): Couldn't send request to peer eda50ab5b6bc429c866d526f072e6364. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:41309: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:09.170392  4821 tablet_replica.cc:333] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad: stopping tablet replica
I20260709 12:23:09.171310  4821 raft_consensus.cc:2243] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.172271  4821 raft_consensus.cc:2272] T e292b2dac8df4bba9fcfd4aeea800f47 P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.174067  4821 tablet_replica.cc:333] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad: stopping tablet replica
I20260709 12:23:09.174628  4821 raft_consensus.cc:2243] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.175064  4821 raft_consensus.cc:2272] T 6ada5e49b1b04466b75d60c8bedf99f4 P c04f380d906642a8b357085d67bf51ad [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.176806  4821 tablet_replica.cc:333] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad: stopping tablet replica
I20260709 12:23:09.177323  4821 raft_consensus.cc:2243] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.177783  4821 raft_consensus.cc:2272] T 4fcb5348e22d40699ea2bde45add77b4 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.179644  4821 tablet_replica.cc:333] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad: stopping tablet replica
I20260709 12:23:09.180154  4821 raft_consensus.cc:2243] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.180917  4821 raft_consensus.cc:2272] T 56bf1d6abb78450bbecfc1b0eb763942 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.182904  4821 tablet_replica.cc:333] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad: stopping tablet replica
I20260709 12:23:09.183482  4821 raft_consensus.cc:2243] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.183939  4821 raft_consensus.cc:2272] T 6ed3bfe15f74464c8900fa1cb1cffa1c P c04f380d906642a8b357085d67bf51ad [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.185796  4821 tablet_replica.cc:333] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad: stopping tablet replica
I20260709 12:23:09.186273  4821 raft_consensus.cc:2243] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.186705  4821 raft_consensus.cc:2272] T e509a6d816734ae99c8943ad78b11da8 P c04f380d906642a8b357085d67bf51ad [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.188436  4821 tablet_replica.cc:333] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad: stopping tablet replica
I20260709 12:23:09.188890  4821 raft_consensus.cc:2243] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.189329  4821 raft_consensus.cc:2272] T 63a8d8d586214f4f886ca4daf541909b P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.190939  4821 tablet_replica.cc:333] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad: stopping tablet replica
I20260709 12:23:09.191372  4821 raft_consensus.cc:2243] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.192085  4821 raft_consensus.cc:2272] T 661f727556cd4598838d829886293fb0 P c04f380d906642a8b357085d67bf51ad [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.220371  4821 tablet_server.cc:196] TabletServer@127.4.181.66:0 shutdown complete.
I20260709 12:23:09.238878  4821 tablet_server.cc:179] TabletServer@127.4.181.67:0 shutting down...
I20260709 12:23:09.264022  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:09.265024  4821 tablet_replica.cc:333] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43: stopping tablet replica
I20260709 12:23:09.265789  4821 raft_consensus.cc:2243] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.266860  4821 raft_consensus.cc:2272] T 60143441eb3f4597b63bafb3a6e7ab55 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:09.268858  5068 consensus_peers.cc:597] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 -> Peer eda50ab5b6bc429c866d526f072e6364 (127.4.181.65:41309): Couldn't send request to peer eda50ab5b6bc429c866d526f072e6364. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:41309: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:09.269323  4821 tablet_replica.cc:333] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43: stopping tablet replica
I20260709 12:23:09.269846  4821 raft_consensus.cc:2243] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.270601  4821 raft_consensus.cc:2272] T 4fcb5348e22d40699ea2bde45add77b4 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.272312  4821 tablet_replica.cc:333] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43: stopping tablet replica
I20260709 12:23:09.272747  4821 raft_consensus.cc:2243] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.273113  4821 raft_consensus.cc:2272] T 63a8d8d586214f4f886ca4daf541909b P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.274767  4821 tablet_replica.cc:333] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43: stopping tablet replica
I20260709 12:23:09.275200  4821 raft_consensus.cc:2243] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.275561  4821 raft_consensus.cc:2272] T 661f727556cd4598838d829886293fb0 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.277078  4821 tablet_replica.cc:333] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43: stopping tablet replica
I20260709 12:23:09.277505  4821 raft_consensus.cc:2243] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.277899  4821 raft_consensus.cc:2272] T 56bf1d6abb78450bbecfc1b0eb763942 P 4489f3ff50774e7989ffcb4488f37e43 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.279438  4821 tablet_replica.cc:333] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43: stopping tablet replica
I20260709 12:23:09.279935  4821 raft_consensus.cc:2243] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.280663  4821 raft_consensus.cc:2272] T e509a6d816734ae99c8943ad78b11da8 P 4489f3ff50774e7989ffcb4488f37e43 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.282241  4821 tablet_replica.cc:333] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43: stopping tablet replica
I20260709 12:23:09.282732  4821 raft_consensus.cc:2243] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.283174  4821 raft_consensus.cc:2272] T 6ed3bfe15f74464c8900fa1cb1cffa1c P 4489f3ff50774e7989ffcb4488f37e43 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.284700  4821 tablet_replica.cc:333] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43: stopping tablet replica
I20260709 12:23:09.285109  4821 raft_consensus.cc:2243] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.285501  4821 raft_consensus.cc:2272] T e292b2dac8df4bba9fcfd4aeea800f47 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.287055  4821 tablet_replica.cc:333] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43: stopping tablet replica
I20260709 12:23:09.287456  4821 raft_consensus.cc:2243] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:09.288054  4821 raft_consensus.cc:2272] T 6ada5e49b1b04466b75d60c8bedf99f4 P 4489f3ff50774e7989ffcb4488f37e43 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.314822  4821 tablet_server.cc:196] TabletServer@127.4.181.67:0 shutdown complete.
I20260709 12:23:09.332154  4821 master.cc:562] Master@127.4.181.126:34977 shutting down...
I20260709 12:23:09.479672  4821 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:09.480335  4821 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:09.480686  4821 tablet_replica.cc:333] T 00000000000000000000000000000000 P 3a8b07956ece4cc7aa43fd231423c1c5: stopping tablet replica
I20260709 12:23:09.517738  4821 master.cc:584] Master@127.4.181.126:34977 shutdown complete.
4489f3ff50774e7989ffcb4488f37e43  1
c04f380d906642a8b357085d67bf51ad  4
eda50ab5b6bc429c866d526f072e6364  4
4489f3ff50774e7989ffcb4488f37e43  3
c04f380d906642a8b357085d67bf51ad  3
eda50ab5b6bc429c866d526f072e6364  3
4489f3ff50774e7989ffcb4488f37e43  1
c04f380d906642a8b357085d67bf51ad  8
eda50ab5b6bc429c866d526f072e6364  0
4489f3ff50774e7989ffcb4488f37e43  3
c04f380d906642a8b357085d67bf51ad  3
eda50ab5b6bc429c866d526f072e6364  3
[       OK ] LeaderRebalancerTest.FunctionalTestForDivided (31117 ms)
[ RUN      ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20260709 12:23:09.557811  4821 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.181.126:36569
I20260709 12:23:09.558965  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:09.564122  5343 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:09.564153  5344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:09.564921  5346 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:09.566529  4821 server_base.cc:1061] running on GCE node
I20260709 12:23:09.567495  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:09.567760  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:09.567936  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783599789567911 us; error 0 us; skew 500 ppm
I20260709 12:23:09.568466  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:09.571045  4821 webserver.cc:533] Webserver started at http://127.4.181.126:35447/ using document root <none> and password file <none>
I20260709 12:23:09.571532  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:09.571758  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:09.572113  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:09.573297  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/master-0-root/instance:
uuid: "5ab0048187fe465dbbb26b602056aba4"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-k014"
I20260709 12:23:09.577759  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.004s
I20260709 12:23:09.581439  5351 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.582293  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:09.582651  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/master-0-root
uuid: "5ab0048187fe465dbbb26b602056aba4"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-k014"
I20260709 12:23:09.582937  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:09.598026  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:09.599272  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:09.636876  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.126:36569
I20260709 12:23:09.636998  5402 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.126:36569 every 8 connection(s)
I20260709 12:23:09.641077  5403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:09.650991  5403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4: Bootstrap starting.
I20260709 12:23:09.655565  5403 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:09.659742  5403 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4: No bootstrap required, opened a new log
I20260709 12:23:09.661883  5403 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab0048187fe465dbbb26b602056aba4" member_type: VOTER }
I20260709 12:23:09.662328  5403 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:09.662564  5403 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5ab0048187fe465dbbb26b602056aba4, State: Initialized, Role: FOLLOWER
I20260709 12:23:09.663075  5403 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab0048187fe465dbbb26b602056aba4" member_type: VOTER }
I20260709 12:23:09.663506  5403 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:09.663708  5403 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:09.663923  5403 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:09.668435  5403 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab0048187fe465dbbb26b602056aba4" member_type: VOTER }
I20260709 12:23:09.668970  5403 leader_election.cc:304] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5ab0048187fe465dbbb26b602056aba4; no voters: 
I20260709 12:23:09.670131  5403 leader_election.cc:290] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:09.670446  5406 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:09.671777  5406 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [term 1 LEADER]: Becoming Leader. State: Replica: 5ab0048187fe465dbbb26b602056aba4, State: Running, Role: LEADER
I20260709 12:23:09.672482  5406 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab0048187fe465dbbb26b602056aba4" member_type: VOTER }
I20260709 12:23:09.672978  5403 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:09.676874  5407 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5ab0048187fe465dbbb26b602056aba4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab0048187fe465dbbb26b602056aba4" member_type: VOTER } }
I20260709 12:23:09.677615  5407 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:09.677939  5408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5ab0048187fe465dbbb26b602056aba4. Latest consensus state: current_term: 1 leader_uuid: "5ab0048187fe465dbbb26b602056aba4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5ab0048187fe465dbbb26b602056aba4" member_type: VOTER } }
I20260709 12:23:09.678594  5408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:09.681945  5412 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:09.688463  5412 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:09.692466  4821 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:09.697799  5412 catalog_manager.cc:1383] Generated new cluster ID: b6856d9f3fc342eaa936a44774c48559
I20260709 12:23:09.698081  5412 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:09.721448  5412 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:09.722808  5412 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:09.737922  5412 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4: Generated new TSK 0
I20260709 12:23:09.738584  5412 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:09.759402  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:09.767946  5424 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:09.769572  5425 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:09.772706  5427 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:09.774636  4821 server_base.cc:1061] running on GCE node
I20260709 12:23:09.775966  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:09.776254  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:09.776438  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783599789776422 us; error 0 us; skew 500 ppm
I20260709 12:23:09.777227  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:09.780159  4821 webserver.cc:533] Webserver started at http://127.4.181.65:39107/ using document root <none> and password file <none>
I20260709 12:23:09.780633  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:09.780823  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:09.781076  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:09.782392  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-0-root/instance:
uuid: "79826be02961412db821ebecdd7e04c9"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-k014"
I20260709 12:23:09.788805  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.001s	sys 0.005s
I20260709 12:23:09.793494  5432 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.794317  4821 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:23:09.794715  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-0-root
uuid: "79826be02961412db821ebecdd7e04c9"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-k014"
I20260709 12:23:09.795004  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:09.819056  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:09.820318  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:09.821789  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:09.824410  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:09.824642  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.824880  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:09.825047  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.863788  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.65:37257
I20260709 12:23:09.863898  5494 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.65:37257 every 8 connection(s)
I20260709 12:23:09.868501  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:09.875368  5499 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:09.878852  5500 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:09.880339  5502 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:09.881467  4821 server_base.cc:1061] running on GCE node
I20260709 12:23:09.882067  5495 heartbeater.cc:344] Connected to a master server at 127.4.181.126:36569
I20260709 12:23:09.882483  5495 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:09.882663  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:09.882896  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:09.883085  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783599789883066 us; error 0 us; skew 500 ppm
I20260709 12:23:09.883356  5495 heartbeater.cc:507] Master 127.4.181.126:36569 requested a full tablet report, sending...
I20260709 12:23:09.883816  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:09.885821  5368 ts_manager.cc:194] Registered new tserver with Master: 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257)
I20260709 12:23:09.886963  4821 webserver.cc:533] Webserver started at http://127.4.181.66:32923/ using document root <none> and password file <none>
I20260709 12:23:09.887624  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:09.887872  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:09.888154  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:09.888307  5368 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38094
I20260709 12:23:09.889583  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-1-root/instance:
uuid: "eeab06617abc467585ce23fb92498eea"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-k014"
I20260709 12:23:09.894126  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:23:09.897379  5507 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.898152  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:09.898442  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-1-root
uuid: "eeab06617abc467585ce23fb92498eea"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-k014"
I20260709 12:23:09.898772  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:09.914856  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:09.916024  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:09.917470  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:09.919667  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:09.919849  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.920133  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:09.920300  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.958055  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.66:38481
I20260709 12:23:09.958171  5569 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.66:38481 every 8 connection(s)
I20260709 12:23:09.962363  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:09.968581  5573 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:09.973757  5574 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:09.976611  5570 heartbeater.cc:344] Connected to a master server at 127.4.181.126:36569
I20260709 12:23:09.976999  5570 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:09.977643  4821 server_base.cc:1061] running on GCE node
W20260709 12:23:09.977927  5576 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:09.978001  5570 heartbeater.cc:507] Master 127.4.181.126:36569 requested a full tablet report, sending...
I20260709 12:23:09.979012  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:09.979252  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:09.979425  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783599789979406 us; error 0 us; skew 500 ppm
I20260709 12:23:09.979949  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:09.980146  5368 ts_manager.cc:194] Registered new tserver with Master: eeab06617abc467585ce23fb92498eea (127.4.181.66:38481)
I20260709 12:23:09.981492  5368 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38108
I20260709 12:23:09.982642  4821 webserver.cc:533] Webserver started at http://127.4.181.67:36405/ using document root <none> and password file <none>
I20260709 12:23:09.983112  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:09.983280  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:09.983522  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:09.984566  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-2-root/instance:
uuid: "87d38bda1e1347119f89092460bd01ac"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-k014"
I20260709 12:23:09.988862  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:23:09.992054  5581 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:09.992735  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:23:09.992995  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-2-root
uuid: "87d38bda1e1347119f89092460bd01ac"
format_stamp: "Formatted at 2026-07-09 12:23:09 on dist-test-slave-k014"
I20260709 12:23:09.993254  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1783599758264527-4821-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:10.002691  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:10.003865  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:10.005378  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:10.007917  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:10.008131  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:10.008363  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:10.008515  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:10.048806  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.67:39481
I20260709 12:23:10.048913  5643 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.67:39481 every 8 connection(s)
I20260709 12:23:10.063545  5644 heartbeater.cc:344] Connected to a master server at 127.4.181.126:36569
I20260709 12:23:10.063930  5644 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:10.064769  5644 heartbeater.cc:507] Master 127.4.181.126:36569 requested a full tablet report, sending...
I20260709 12:23:10.066779  5368 ts_manager.cc:194] Registered new tserver with Master: 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.067230  4821 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.015268164s
I20260709 12:23:10.068156  5368 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38114
I20260709 12:23:10.093976  5368 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38122:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:10.097160  5368 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:10.172714  5535 tablet_service.cc:1511] Processing CreateTablet for tablet 24c1040e22aa4b37a7d56d2a092acd05 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:10.174254  5535 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c1040e22aa4b37a7d56d2a092acd05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.174419  5532 tablet_service.cc:1511] Processing CreateTablet for tablet 1a15633927704078875dbd47c7207763 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:10.175917  5532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a15633927704078875dbd47c7207763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.179792  5533 tablet_service.cc:1511] Processing CreateTablet for tablet 63bf1bebff2041a6b95306b45a75100b (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:10.181283  5533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63bf1bebff2041a6b95306b45a75100b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.183645  5534 tablet_service.cc:1511] Processing CreateTablet for tablet 64b93dd9a23f4e108a87e047e94e0dbc (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:10.185247  5534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b93dd9a23f4e108a87e047e94e0dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.190279  5531 tablet_service.cc:1511] Processing CreateTablet for tablet ab78cc54b6b643dfb8b1f5f1a0c546f7 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:10.191905  5531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab78cc54b6b643dfb8b1f5f1a0c546f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.194516  5459 tablet_service.cc:1511] Processing CreateTablet for tablet 64b93dd9a23f4e108a87e047e94e0dbc (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:10.196153  5459 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b93dd9a23f4e108a87e047e94e0dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.195937  5456 tablet_service.cc:1511] Processing CreateTablet for tablet ab78cc54b6b643dfb8b1f5f1a0c546f7 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:10.197372  5456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab78cc54b6b643dfb8b1f5f1a0c546f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.199993  5460 tablet_service.cc:1511] Processing CreateTablet for tablet 24c1040e22aa4b37a7d56d2a092acd05 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:10.202101  5458 tablet_service.cc:1511] Processing CreateTablet for tablet 63bf1bebff2041a6b95306b45a75100b (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:10.194697  5457 tablet_service.cc:1511] Processing CreateTablet for tablet 1a15633927704078875dbd47c7207763 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:10.219372  5460 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c1040e22aa4b37a7d56d2a092acd05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.220505  5457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a15633927704078875dbd47c7207763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.222060  5455 tablet_service.cc:1511] Processing CreateTablet for tablet 11f55d2e6c1a4410bf4cbe687e775781 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:10.225073  5455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f55d2e6c1a4410bf4cbe687e775781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.227763  5458 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63bf1bebff2041a6b95306b45a75100b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.242652  5532 tablet_service.cc:1511] Processing CreateTablet for tablet 11f55d2e6c1a4410bf4cbe687e775781 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:10.243992  5532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f55d2e6c1a4410bf4cbe687e775781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.247113  5659 tablet_bootstrap.cc:492] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea: Bootstrap starting.
I20260709 12:23:10.252990  5609 tablet_service.cc:1511] Processing CreateTablet for tablet 24c1040e22aa4b37a7d56d2a092acd05 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:23:10.254379  5609 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 24c1040e22aa4b37a7d56d2a092acd05. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.256466  5608 tablet_service.cc:1511] Processing CreateTablet for tablet 64b93dd9a23f4e108a87e047e94e0dbc (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:23:10.258038  5608 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 64b93dd9a23f4e108a87e047e94e0dbc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.276926  5607 tablet_service.cc:1511] Processing CreateTablet for tablet 63bf1bebff2041a6b95306b45a75100b (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:23:10.278476  5607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 63bf1bebff2041a6b95306b45a75100b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.290177  5456 tablet_service.cc:1511] Processing CreateTablet for tablet e020422e23c8423884a3351c23bc6c96 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:10.291545  5456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e020422e23c8423884a3351c23bc6c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.292709  5534 tablet_service.cc:1511] Processing CreateTablet for tablet e020422e23c8423884a3351c23bc6c96 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:10.293989  5534 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e020422e23c8423884a3351c23bc6c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.293891  5605 tablet_service.cc:1511] Processing CreateTablet for tablet ab78cc54b6b643dfb8b1f5f1a0c546f7 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:23:10.295246  5605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ab78cc54b6b643dfb8b1f5f1a0c546f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.292729  5606 tablet_service.cc:1511] Processing CreateTablet for tablet 1a15633927704078875dbd47c7207763 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:23:10.302126  5604 tablet_service.cc:1511] Processing CreateTablet for tablet 11f55d2e6c1a4410bf4cbe687e775781 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:23:10.305959  5659 tablet_bootstrap.cc:654] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.307477  5606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a15633927704078875dbd47c7207763. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.309208  5660 tablet_bootstrap.cc:492] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9: Bootstrap starting.
I20260709 12:23:10.310817  5604 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f55d2e6c1a4410bf4cbe687e775781. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.321859  5603 tablet_service.cc:1511] Processing CreateTablet for tablet e020422e23c8423884a3351c23bc6c96 (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:23:10.323280  5603 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e020422e23c8423884a3351c23bc6c96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.328075  5661 tablet_bootstrap.cc:492] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac: Bootstrap starting.
I20260709 12:23:10.335412  5457 tablet_service.cc:1511] Processing CreateTablet for tablet d82eb1ccc08343928ef21d33b8133a5d (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:10.334412  5661 tablet_bootstrap.cc:654] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.338779  5533 tablet_service.cc:1511] Processing CreateTablet for tablet d82eb1ccc08343928ef21d33b8133a5d (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:10.340276  5533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82eb1ccc08343928ef21d33b8133a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.348747  5660 tablet_bootstrap.cc:654] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.350710  5457 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82eb1ccc08343928ef21d33b8133a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.360399  5607 tablet_service.cc:1511] Processing CreateTablet for tablet d82eb1ccc08343928ef21d33b8133a5d (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:23:10.361707  5455 tablet_service.cc:1511] Processing CreateTablet for tablet 600bf30d4f6541ee8c1c8ac91c14e1ec (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:10.362978  5659 tablet_bootstrap.cc:492] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea: No bootstrap required, opened a new log
I20260709 12:23:10.368405  5607 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d82eb1ccc08343928ef21d33b8133a5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.379411  5455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600bf30d4f6541ee8c1c8ac91c14e1ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.394620  5659 ts_tablet_manager.cc:1403] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea: Time spent bootstrapping tablet: real 0.148s	user 0.012s	sys 0.008s
I20260709 12:23:10.397909  5533 tablet_service.cc:1511] Processing CreateTablet for tablet 600bf30d4f6541ee8c1c8ac91c14e1ec (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:10.399245  5533 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600bf30d4f6541ee8c1c8ac91c14e1ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.397823  5659 raft_consensus.cc:359] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.399816  5659 raft_consensus.cc:385] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.400226  5659 raft_consensus.cc:740] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.404537  5659 consensus_queue.cc:260] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.415305  5456 tablet_service.cc:1511] Processing CreateTablet for tablet 19e8d4efc27540009075832925e9c9ba (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:10.416644  5456 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e8d4efc27540009075832925e9c9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.418228  5532 tablet_service.cc:1511] Processing CreateTablet for tablet 19e8d4efc27540009075832925e9c9ba (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:10.419497  5532 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e8d4efc27540009075832925e9c9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.420461  5660 tablet_bootstrap.cc:492] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9: No bootstrap required, opened a new log
I20260709 12:23:10.420954  5660 ts_tablet_manager.cc:1403] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9: Time spent bootstrapping tablet: real 0.112s	user 0.012s	sys 0.018s
I20260709 12:23:10.422825  5659 ts_tablet_manager.cc:1434] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.002s
I20260709 12:23:10.423664  5570 heartbeater.cc:499] Master 127.4.181.126:36569 was elected leader, sending a full tablet report...
I20260709 12:23:10.423996  5659 tablet_bootstrap.cc:492] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea: Bootstrap starting.
I20260709 12:23:10.423924  5660 raft_consensus.cc:359] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.430410  5659 tablet_bootstrap.cc:654] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.431048  5606 tablet_service.cc:1511] Processing CreateTablet for tablet 600bf30d4f6541ee8c1c8ac91c14e1ec (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:23:10.432246  5660 raft_consensus.cc:385] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.434873  5606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 600bf30d4f6541ee8c1c8ac91c14e1ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.434894  5660 raft_consensus.cc:740] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.436025  5660 consensus_queue.cc:260] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.440347  5661 tablet_bootstrap.cc:492] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac: No bootstrap required, opened a new log
I20260709 12:23:10.440891  5661 ts_tablet_manager.cc:1403] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac: Time spent bootstrapping tablet: real 0.113s	user 0.038s	sys 0.031s
I20260709 12:23:10.444185  5661 raft_consensus.cc:359] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.444947  5661 raft_consensus.cc:385] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.445246  5661 raft_consensus.cc:740] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.446178  5661 consensus_queue.cc:260] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.448668  5644 heartbeater.cc:499] Master 127.4.181.126:36569 was elected leader, sending a full tablet report...
I20260709 12:23:10.455811  5661 ts_tablet_manager.cc:1434] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:23:10.456827  5661 tablet_bootstrap.cc:492] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac: Bootstrap starting.
I20260709 12:23:10.460983  5606 tablet_service.cc:1511] Processing CreateTablet for tablet 19e8d4efc27540009075832925e9c9ba (DEFAULT_TABLE table=test-workload [id=481298e67700425db4da6014f7f1542c]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:23:10.462514  5606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19e8d4efc27540009075832925e9c9ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:10.469522  5660 ts_tablet_manager.cc:1434] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9: Time spent starting tablet: real 0.048s	user 0.015s	sys 0.023s
I20260709 12:23:10.470263  5495 heartbeater.cc:499] Master 127.4.181.126:36569 was elected leader, sending a full tablet report...
I20260709 12:23:10.470490  5661 tablet_bootstrap.cc:654] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.471720  5660 tablet_bootstrap.cc:492] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9: Bootstrap starting.
I20260709 12:23:10.470899  5659 tablet_bootstrap.cc:492] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea: No bootstrap required, opened a new log
I20260709 12:23:10.474087  5659 ts_tablet_manager.cc:1403] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.017s
I20260709 12:23:10.476967  5659 raft_consensus.cc:359] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.477674  5659 raft_consensus.cc:385] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.477948  5659 raft_consensus.cc:740] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.478375  5660 tablet_bootstrap.cc:654] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.478703  5659 consensus_queue.cc:260] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.480878  5659 ts_tablet_manager.cc:1434] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:10.481812  5659 tablet_bootstrap.cc:492] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea: Bootstrap starting.
I20260709 12:23:10.491683  5659 tablet_bootstrap.cc:654] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.494586  5660 tablet_bootstrap.cc:492] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9: No bootstrap required, opened a new log
I20260709 12:23:10.495111  5660 ts_tablet_manager.cc:1403] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.008s
I20260709 12:23:10.498314  5660 raft_consensus.cc:359] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.499135  5660 raft_consensus.cc:385] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.499454  5660 raft_consensus.cc:740] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.500705  5660 consensus_queue.cc:260] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.503340  5660 ts_tablet_manager.cc:1434] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.001s
I20260709 12:23:10.504398  5660 tablet_bootstrap.cc:492] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9: Bootstrap starting.
I20260709 12:23:10.511189  5660 tablet_bootstrap.cc:654] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.517542  5665 raft_consensus.cc:493] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.518108  5665 raft_consensus.cc:515] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.525420  5665 leader_election.cc:290] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.545957  5667 raft_consensus.cc:493] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.546691  5667 raft_consensus.cc:515] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.550189  5661 tablet_bootstrap.cc:492] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac: No bootstrap required, opened a new log
I20260709 12:23:10.550881  5661 ts_tablet_manager.cc:1403] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac: Time spent bootstrapping tablet: real 0.094s	user 0.033s	sys 0.037s
I20260709 12:23:10.556357  5661 raft_consensus.cc:359] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.557674  5665 raft_consensus.cc:493] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.559926  5665 raft_consensus.cc:515] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.560985  5667 leader_election.cc:290] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.562062  5665 leader_election.cc:290] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.562749  5661 raft_consensus.cc:385] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.563134  5661 raft_consensus.cc:740] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.567992  5659 tablet_bootstrap.cc:492] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea: No bootstrap required, opened a new log
I20260709 12:23:10.568521  5659 ts_tablet_manager.cc:1403] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea: Time spent bootstrapping tablet: real 0.087s	user 0.030s	sys 0.047s
I20260709 12:23:10.569489  5661 consensus_queue.cc:260] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.571518  5659 raft_consensus.cc:359] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.574558  5659 raft_consensus.cc:385] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.574887  5659 raft_consensus.cc:740] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.575103  5660 tablet_bootstrap.cc:492] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9: No bootstrap required, opened a new log
I20260709 12:23:10.574962  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac" is_pre_election: true
I20260709 12:23:10.575582  5660 ts_tablet_manager.cc:1403] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9: Time spent bootstrapping tablet: real 0.071s	user 0.031s	sys 0.022s
I20260709 12:23:10.575891  5619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c1040e22aa4b37a7d56d2a092acd05" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac" is_pre_election: true
I20260709 12:23:10.575762  5659 consensus_queue.cc:260] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
W20260709 12:23:10.577455  5508 leader_election.cc:343] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.577924  5659 ts_tablet_manager.cc:1434] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:10.578389  5660 raft_consensus.cc:359] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.575687  5618 raft_consensus.cc:2468] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 0.
I20260709 12:23:10.578999  5659 tablet_bootstrap.cc:492] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea: Bootstrap starting.
I20260709 12:23:10.579113  5660 raft_consensus.cc:385] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.579473  5660 raft_consensus.cc:740] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.580235  5660 consensus_queue.cc:260] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.582396  5660 ts_tablet_manager.cc:1434] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:23:10.586359  5659 tablet_bootstrap.cc:654] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.586975  5660 tablet_bootstrap.cc:492] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9: Bootstrap starting.
I20260709 12:23:10.589558  5508 leader_election.cc:304] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:10.590504  5665 raft_consensus.cc:2804] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.590883  5665 raft_consensus.cc:493] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.591228  5665 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.593446  5660 tablet_bootstrap.cc:654] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.595798  5661 ts_tablet_manager.cc:1434] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac: Time spent starting tablet: real 0.045s	user 0.001s	sys 0.005s
I20260709 12:23:10.604739  5660 tablet_bootstrap.cc:492] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9: No bootstrap required, opened a new log
I20260709 12:23:10.605711  5470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c1040e22aa4b37a7d56d2a092acd05" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9" is_pre_election: true
I20260709 12:23:10.609264  5660 ts_tablet_manager.cc:1403] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.002s
I20260709 12:23:10.609333  5470 raft_consensus.cc:2468] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 0.
I20260709 12:23:10.606645  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9" is_pre_election: true
I20260709 12:23:10.610126  5469 raft_consensus.cc:2468] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 0.
I20260709 12:23:10.611038  5509 leader_election.cc:304] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 87d38bda1e1347119f89092460bd01ac
I20260709 12:23:10.611281  5665 raft_consensus.cc:515] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.611757  5659 tablet_bootstrap.cc:492] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea: No bootstrap required, opened a new log
I20260709 12:23:10.612430  5660 raft_consensus.cc:359] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.613186  5660 raft_consensus.cc:385] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.613556  5660 raft_consensus.cc:740] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.614532  5665 leader_election.cc:290] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.614400  5660 consensus_queue.cc:260] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.615116  5665 raft_consensus.cc:2804] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.615296  5661 tablet_bootstrap.cc:492] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac: Bootstrap starting.
I20260709 12:23:10.615496  5665 raft_consensus.cc:493] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.615872  5665 raft_consensus.cc:3060] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.616956  5660 ts_tablet_manager.cc:1434] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:10.614852  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:10.612403  5659 ts_tablet_manager.cc:1403] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea: Time spent bootstrapping tablet: real 0.034s	user 0.021s	sys 0.010s
I20260709 12:23:10.618178  5618 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.621481  5659 raft_consensus.cc:359] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.618247  5660 tablet_bootstrap.cc:492] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9: Bootstrap starting.
I20260709 12:23:10.625921  5619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac" is_pre_election: true
I20260709 12:23:10.626559  5659 raft_consensus.cc:385] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.629616  5659 raft_consensus.cc:740] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.631119  5661 tablet_bootstrap.cc:654] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.629287  5660 tablet_bootstrap.cc:654] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.631203  5618 raft_consensus.cc:2468] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 1.
I20260709 12:23:10.632660  5508 leader_election.cc:304] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:10.631237  5665 raft_consensus.cc:515] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.630638  5659 consensus_queue.cc:260] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.637655  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c1040e22aa4b37a7d56d2a092acd05" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac"
W20260709 12:23:10.638979  5508 leader_election.cc:343] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.639420  5683 raft_consensus.cc:2804] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.641089  5659 ts_tablet_manager.cc:1434] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:23:10.642176  5659 tablet_bootstrap.cc:492] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea: Bootstrap starting.
I20260709 12:23:10.644025  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:10.644726  5469 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.648626  5659 tablet_bootstrap.cc:654] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.652122  5469 raft_consensus.cc:2468] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 1.
I20260709 12:23:10.654548  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c1040e22aa4b37a7d56d2a092acd05" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:10.655205  5469 raft_consensus.cc:3060] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.659998  5659 tablet_bootstrap.cc:492] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea: No bootstrap required, opened a new log
I20260709 12:23:10.660516  5659 ts_tablet_manager.cc:1403] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.001s
I20260709 12:23:10.660362  5545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeab06617abc467585ce23fb92498eea" is_pre_election: true
I20260709 12:23:10.660001  5665 leader_election.cc:290] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.661558  5683 raft_consensus.cc:697] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Becoming Leader. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:10.662427  5683 consensus_queue.cc:237] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.663305  5659 raft_consensus.cc:359] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.663962  5659 raft_consensus.cc:385] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.664251  5659 raft_consensus.cc:740] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.665024  5659 consensus_queue.cc:260] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.667142  5659 ts_tablet_manager.cc:1434] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:23:10.668094  5659 tablet_bootstrap.cc:492] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea: Bootstrap starting.
I20260709 12:23:10.668772  5661 tablet_bootstrap.cc:492] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac: No bootstrap required, opened a new log
I20260709 12:23:10.669255  5661 ts_tablet_manager.cc:1403] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac: Time spent bootstrapping tablet: real 0.054s	user 0.010s	sys 0.024s
I20260709 12:23:10.669451  5469 raft_consensus.cc:2468] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 1.
I20260709 12:23:10.672423  5509 leader_election.cc:304] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 87d38bda1e1347119f89092460bd01ac
I20260709 12:23:10.673115  5660 tablet_bootstrap.cc:492] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9: No bootstrap required, opened a new log
I20260709 12:23:10.673599  5660 ts_tablet_manager.cc:1403] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9: Time spent bootstrapping tablet: real 0.056s	user 0.016s	sys 0.028s
I20260709 12:23:10.673565  5665 raft_consensus.cc:2804] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.674283  5659 tablet_bootstrap.cc:654] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.674196  5665 raft_consensus.cc:697] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Becoming Leader. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:10.675194  5665 consensus_queue.cc:237] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.672254  5661 raft_consensus.cc:359] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.676172  5661 raft_consensus.cc:385] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.676561  5661 raft_consensus.cc:740] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.677417  5661 consensus_queue.cc:260] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.678169  5660 raft_consensus.cc:359] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.678939  5660 raft_consensus.cc:385] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.679222  5660 raft_consensus.cc:740] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.680019  5660 consensus_queue.cc:260] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.682200  5660 ts_tablet_manager.cc:1434] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.000s
I20260709 12:23:10.683557  5660 tablet_bootstrap.cc:492] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9: Bootstrap starting.
I20260709 12:23:10.683606  5435 leader_election.cc:304] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 79826be02961412db821ebecdd7e04c9; no voters: 87d38bda1e1347119f89092460bd01ac, eeab06617abc467585ce23fb92498eea
I20260709 12:23:10.684918  5667 raft_consensus.cc:2749] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.687007  5365 catalog_manager.cc:5697] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea reported cstate change: term changed from 0 to 1, leader changed from <none> to eeab06617abc467585ce23fb92498eea (127.4.181.66). New cstate: current_term: 1 leader_uuid: "eeab06617abc467585ce23fb92498eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:10.689697  5416 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:10.690224  5660 tablet_bootstrap.cc:654] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.692114  5661 ts_tablet_manager.cc:1434] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac: Time spent starting tablet: real 0.023s	user 0.006s	sys 0.001s
I20260709 12:23:10.693090  5661 tablet_bootstrap.cc:492] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac: Bootstrap starting.
I20260709 12:23:10.699205  5661 tablet_bootstrap.cc:654] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.701790  5659 tablet_bootstrap.cc:492] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea: No bootstrap required, opened a new log
I20260709 12:23:10.702322  5659 ts_tablet_manager.cc:1403] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea: Time spent bootstrapping tablet: real 0.034s	user 0.014s	sys 0.005s
I20260709 12:23:10.706534  5659 raft_consensus.cc:359] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.707320  5659 raft_consensus.cc:385] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.707616  5659 raft_consensus.cc:740] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.708549  5659 consensus_queue.cc:260] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.711233  5659 ts_tablet_manager.cc:1434] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:23:10.712399  5659 tablet_bootstrap.cc:492] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea: Bootstrap starting.
I20260709 12:23:10.715271  5660 tablet_bootstrap.cc:492] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9: No bootstrap required, opened a new log
I20260709 12:23:10.715903  5660 ts_tablet_manager.cc:1403] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9: Time spent bootstrapping tablet: real 0.033s	user 0.016s	sys 0.013s
I20260709 12:23:10.717361  5661 tablet_bootstrap.cc:492] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac: No bootstrap required, opened a new log
I20260709 12:23:10.717832  5661 ts_tablet_manager.cc:1403] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac: Time spent bootstrapping tablet: real 0.025s	user 0.008s	sys 0.012s
I20260709 12:23:10.718570  5659 tablet_bootstrap.cc:654] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.719115  5660 raft_consensus.cc:359] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.719964  5660 raft_consensus.cc:385] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.720311  5660 raft_consensus.cc:740] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.720590  5661 raft_consensus.cc:359] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.721316  5661 raft_consensus.cc:385] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.721736  5661 raft_consensus.cc:740] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.721187  5660 consensus_queue.cc:260] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.722626  5661 consensus_queue.cc:260] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.723968  5660 ts_tablet_manager.cc:1434] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:10.724901  5661 ts_tablet_manager.cc:1434] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:23:10.725060  5660 tablet_bootstrap.cc:492] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9: Bootstrap starting.
I20260709 12:23:10.726053  5661 tablet_bootstrap.cc:492] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac: Bootstrap starting.
I20260709 12:23:10.731719  5660 tablet_bootstrap.cc:654] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.731614  5665 raft_consensus.cc:493] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.732609  5661 tablet_bootstrap.cc:654] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.732285  5665 raft_consensus.cc:515] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.734484  5665 leader_election.cc:290] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.736526  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a15633927704078875dbd47c7207763" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9" is_pre_election: true
I20260709 12:23:10.737183  5469 raft_consensus.cc:2468] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 0.
I20260709 12:23:10.737208  5659 tablet_bootstrap.cc:492] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea: No bootstrap required, opened a new log
I20260709 12:23:10.737385  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a15633927704078875dbd47c7207763" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac" is_pre_election: true
I20260709 12:23:10.737898  5659 ts_tablet_manager.cc:1403] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea: Time spent bootstrapping tablet: real 0.026s	user 0.010s	sys 0.007s
I20260709 12:23:10.739223  5509 leader_election.cc:304] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
W20260709 12:23:10.740075  5508 leader_election.cc:343] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.740168  5665 raft_consensus.cc:2804] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.742934  5665 raft_consensus.cc:493] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.743353  5665 raft_consensus.cc:3060] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.751588  5659 raft_consensus.cc:359] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.752447  5659 raft_consensus.cc:385] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.752775  5659 raft_consensus.cc:740] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.753755  5659 consensus_queue.cc:260] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.758078  5659 ts_tablet_manager.cc:1434] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.002s
I20260709 12:23:10.760316  5665 raft_consensus.cc:515] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.763798  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a15633927704078875dbd47c7207763" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:10.764460  5469 raft_consensus.cc:3060] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.772336  5469 raft_consensus.cc:2468] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 1.
I20260709 12:23:10.773795  5509 leader_election.cc:304] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:10.774580  5683 raft_consensus.cc:493] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.775398  5684 raft_consensus.cc:2804] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.775166  5683 raft_consensus.cc:515] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.775902  5684 raft_consensus.cc:697] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Becoming Leader. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:10.776763  5684 consensus_queue.cc:237] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.777987  5660 tablet_bootstrap.cc:492] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9: No bootstrap required, opened a new log
I20260709 12:23:10.778602  5660 ts_tablet_manager.cc:1403] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9: Time spent bootstrapping tablet: real 0.054s	user 0.025s	sys 0.026s
I20260709 12:23:10.778668  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac" is_pre_election: true
I20260709 12:23:10.779382  5618 raft_consensus.cc:2468] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 0.
I20260709 12:23:10.780674  5659 tablet_bootstrap.cc:492] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea: Bootstrap starting.
I20260709 12:23:10.782009  5683 leader_election.cc:290] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.780845  5508 leader_election.cc:304] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:10.784823  5683 raft_consensus.cc:2804] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.785205  5683 raft_consensus.cc:493] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.785547  5683 raft_consensus.cc:3060] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.785826  5661 tablet_bootstrap.cc:492] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac: No bootstrap required, opened a new log
I20260709 12:23:10.786405  5661 ts_tablet_manager.cc:1403] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac: Time spent bootstrapping tablet: real 0.061s	user 0.028s	sys 0.027s
I20260709 12:23:10.786758  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a15633927704078875dbd47c7207763" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac"
W20260709 12:23:10.788255  5508 leader_election.cc:343] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.788499  5660 raft_consensus.cc:359] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.789427  5660 raft_consensus.cc:385] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.789317  5661 raft_consensus.cc:359] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.789768  5660 raft_consensus.cc:740] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.790031  5661 raft_consensus.cc:385] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.790515  5661 raft_consensus.cc:740] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.790550  5660 consensus_queue.cc:260] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.792829  5660 ts_tablet_manager.cc:1434] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:23:10.793875  5660 tablet_bootstrap.cc:492] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9: Bootstrap starting.
I20260709 12:23:10.782722  5665 leader_election.cc:290] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.795588  5680 raft_consensus.cc:493] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.791450  5661 consensus_queue.cc:260] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.796800  5680 raft_consensus.cc:515] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.799252  5680 leader_election.cc:290] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.801390  5470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f55d2e6c1a4410bf4cbe687e775781" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9" is_pre_election: true
I20260709 12:23:10.802024  5470 raft_consensus.cc:2468] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 0.
I20260709 12:23:10.802223  5659 tablet_bootstrap.cc:654] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.804171  5509 leader_election.cc:304] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:10.806727  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f55d2e6c1a4410bf4cbe687e775781" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac" is_pre_election: true
I20260709 12:23:10.807093  5661 ts_tablet_manager.cc:1434] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:23:10.807377  5618 raft_consensus.cc:2468] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 0.
I20260709 12:23:10.808676  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9" is_pre_election: true
I20260709 12:23:10.809278  5469 raft_consensus.cc:2468] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 0.
I20260709 12:23:10.811359  5661 tablet_bootstrap.cc:492] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac: Bootstrap starting.
I20260709 12:23:10.814240  5680 raft_consensus.cc:2804] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.814715  5680 raft_consensus.cc:493] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.815236  5680 raft_consensus.cc:3060] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.795902  5683 raft_consensus.cc:515] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.820228  5683 leader_election.cc:290] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.822692  5660 tablet_bootstrap.cc:654] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.828439  5661 tablet_bootstrap.cc:654] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.830883  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:10.830926  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:10.831557  5469 raft_consensus.cc:3060] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.831988  5618 raft_consensus.cc:3060] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.839596  5365 catalog_manager.cc:5697] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea reported cstate change: term changed from 0 to 1, leader changed from <none> to eeab06617abc467585ce23fb92498eea (127.4.181.66). New cstate: current_term: 1 leader_uuid: "eeab06617abc467585ce23fb92498eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.841053  5659 tablet_bootstrap.cc:492] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea: No bootstrap required, opened a new log
I20260709 12:23:10.841212  5469 raft_consensus.cc:2468] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 1.
I20260709 12:23:10.841547  5659 ts_tablet_manager.cc:1403] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea: Time spent bootstrapping tablet: real 0.082s	user 0.026s	sys 0.016s
I20260709 12:23:10.842305  5509 leader_election.cc:304] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:10.843591  5683 raft_consensus.cc:2804] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.844101  5683 raft_consensus.cc:697] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Becoming Leader. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:10.841813  5365 catalog_manager.cc:5697] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea reported cstate change: term changed from 0 to 1, leader changed from <none> to eeab06617abc467585ce23fb92498eea (127.4.181.66). New cstate: current_term: 1 leader_uuid: "eeab06617abc467585ce23fb92498eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.844975  5683 consensus_queue.cc:237] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.846776  5659 raft_consensus.cc:359] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.847385  5659 raft_consensus.cc:385] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.847653  5659 raft_consensus.cc:740] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.847659  5661 tablet_bootstrap.cc:492] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac: No bootstrap required, opened a new log
I20260709 12:23:10.848248  5661 ts_tablet_manager.cc:1403] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.003s
I20260709 12:23:10.848443  5659 consensus_queue.cc:260] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.850684  5659 ts_tablet_manager.cc:1434] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:10.850797  5660 tablet_bootstrap.cc:492] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9: No bootstrap required, opened a new log
I20260709 12:23:10.851300  5660 ts_tablet_manager.cc:1403] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9: Time spent bootstrapping tablet: real 0.058s	user 0.018s	sys 0.012s
I20260709 12:23:10.851584  5659 tablet_bootstrap.cc:492] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea: Bootstrap starting.
I20260709 12:23:10.846004  5618 raft_consensus.cc:2468] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 1.
I20260709 12:23:10.853883  5660 raft_consensus.cc:359] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.854532  5660 raft_consensus.cc:385] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.854800  5660 raft_consensus.cc:740] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.855402  5660 consensus_queue.cc:260] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.857200  5660 ts_tablet_manager.cc:1434] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:10.857357  5659 tablet_bootstrap.cc:654] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.851099  5661 raft_consensus.cc:359] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.842348  5680 raft_consensus.cc:515] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.860668  5680 leader_election.cc:290] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.857940  5661 raft_consensus.cc:385] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.861119  5661 raft_consensus.cc:740] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.861349  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f55d2e6c1a4410bf4cbe687e775781" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:10.861963  5660 tablet_bootstrap.cc:492] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9: Bootstrap starting.
I20260709 12:23:10.861936  5469 raft_consensus.cc:3060] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.862047  5661 consensus_queue.cc:260] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.864553  5661 ts_tablet_manager.cc:1434] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:23:10.865481  5661 tablet_bootstrap.cc:492] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac: Bootstrap starting.
I20260709 12:23:10.868441  5660 tablet_bootstrap.cc:654] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.869974  5469 raft_consensus.cc:2468] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 1.
I20260709 12:23:10.871060  5509 leader_election.cc:304] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:10.873440  5680 raft_consensus.cc:2804] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.873396  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f55d2e6c1a4410bf4cbe687e775781" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:10.874153  5618 raft_consensus.cc:3060] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.874487  5680 raft_consensus.cc:697] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Becoming Leader. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:10.875478  5680 consensus_queue.cc:237] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.881203  5661 tablet_bootstrap.cc:654] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.884478  5659 tablet_bootstrap.cc:492] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea: No bootstrap required, opened a new log
I20260709 12:23:10.884960  5659 ts_tablet_manager.cc:1403] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.013s
I20260709 12:23:10.887637  5659 raft_consensus.cc:359] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.881300  5618 raft_consensus.cc:2468] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 1.
I20260709 12:23:10.888294  5659 raft_consensus.cc:385] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.888609  5659 raft_consensus.cc:740] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.889319  5659 consensus_queue.cc:260] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.891388  5659 ts_tablet_manager.cc:1434] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:10.890681  5366 catalog_manager.cc:5697] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea reported cstate change: term changed from 0 to 1, leader changed from <none> to eeab06617abc467585ce23fb92498eea (127.4.181.66). New cstate: current_term: 1 leader_uuid: "eeab06617abc467585ce23fb92498eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.892146  5659 tablet_bootstrap.cc:492] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea: Bootstrap starting.
I20260709 12:23:10.892809  5366 catalog_manager.cc:5697] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea reported cstate change: term changed from 0 to 1, leader changed from <none> to eeab06617abc467585ce23fb92498eea (127.4.181.66). New cstate: current_term: 1 leader_uuid: "eeab06617abc467585ce23fb92498eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:10.897913  5660 tablet_bootstrap.cc:492] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9: No bootstrap required, opened a new log
I20260709 12:23:10.898417  5660 ts_tablet_manager.cc:1403] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.004s
I20260709 12:23:10.899501  5659 tablet_bootstrap.cc:654] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.900851  5660 raft_consensus.cc:359] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.901489  5660 raft_consensus.cc:385] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.901754  5660 raft_consensus.cc:740] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.898002  5661 tablet_bootstrap.cc:492] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac: No bootstrap required, opened a new log
I20260709 12:23:10.902566  5661 ts_tablet_manager.cc:1403] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac: Time spent bootstrapping tablet: real 0.037s	user 0.016s	sys 0.002s
I20260709 12:23:10.902398  5660 consensus_queue.cc:260] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.904420  5660 ts_tablet_manager.cc:1434] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:10.905332  5660 tablet_bootstrap.cc:492] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9: Bootstrap starting.
I20260709 12:23:10.905678  5661 raft_consensus.cc:359] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.906400  5661 raft_consensus.cc:385] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.906874  5661 raft_consensus.cc:740] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.907718  5661 consensus_queue.cc:260] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.909971  5661 ts_tablet_manager.cc:1434] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:10.910912  5661 tablet_bootstrap.cc:492] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac: Bootstrap starting.
I20260709 12:23:10.911593  5660 tablet_bootstrap.cc:654] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.913712  5668 raft_consensus.cc:493] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.914209  5668 raft_consensus.cc:515] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.917238  5661 tablet_bootstrap.cc:654] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.920904  5680 raft_consensus.cc:493] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.921790  5668 leader_election.cc:290] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), eeab06617abc467585ce23fb92498eea (127.4.181.66:38481)
I20260709 12:23:10.921568  5680 raft_consensus.cc:515] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.924516  5680 leader_election.cc:290] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.926623  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9" is_pre_election: true
W20260709 12:23:10.928530  5509 leader_election.cc:343] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.922243  5668 raft_consensus.cc:493] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.929342  5668 raft_consensus.cc:515] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.931332  5668 leader_election.cc:290] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), eeab06617abc467585ce23fb92498eea (127.4.181.66:38481)
I20260709 12:23:10.934450  5660 tablet_bootstrap.cc:492] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9: No bootstrap required, opened a new log
I20260709 12:23:10.934960  5660 ts_tablet_manager.cc:1403] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.012s
I20260709 12:23:10.935905  5667 raft_consensus.cc:493] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:10.936378  5667 raft_consensus.cc:515] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.937495  5660 raft_consensus.cc:359] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.938125  5660 raft_consensus.cc:385] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.938393  5660 raft_consensus.cc:740] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.938450  5667 leader_election.cc:290] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.939429  5659 tablet_bootstrap.cc:492] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea: No bootstrap required, opened a new log
I20260709 12:23:10.939102  5660 consensus_queue.cc:260] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.939953  5659 ts_tablet_manager.cc:1403] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.003s
I20260709 12:23:10.941097  5660 ts_tablet_manager.cc:1434] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:10.941365  5545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600bf30d4f6541ee8c1c8ac91c14e1ec" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeab06617abc467585ce23fb92498eea" is_pre_election: true
I20260709 12:23:10.941929  5545 raft_consensus.cc:2468] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 0.
I20260709 12:23:10.940124  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600bf30d4f6541ee8c1c8ac91c14e1ec" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac" is_pre_election: true
I20260709 12:23:10.943123  5435 leader_election.cc:304] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
W20260709 12:23:10.944638  5433 leader_election.cc:343] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.945077  5667 raft_consensus.cc:2804] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.945436  5667 raft_consensus.cc:493] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.945762  5667 raft_consensus.cc:3060] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.948652  5659 raft_consensus.cc:359] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.951339  5659 raft_consensus.cc:385] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.951625  5659 raft_consensus.cc:740] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.952368  5667 raft_consensus.cc:515] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.953374  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b93dd9a23f4e108a87e047e94e0dbc" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9" is_pre_election: true
I20260709 12:23:10.953999  5469 raft_consensus.cc:2468] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87d38bda1e1347119f89092460bd01ac in term 0.
I20260709 12:23:10.954315  5659 consensus_queue.cc:260] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.954430  5667 leader_election.cc:290] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 1 election: Requested vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:10.954813  5470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a15633927704078875dbd47c7207763" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9" is_pre_election: true
I20260709 12:23:10.956002  5470 raft_consensus.cc:2393] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87d38bda1e1347119f89092460bd01ac in current term 1: Already voted for candidate eeab06617abc467585ce23fb92498eea in this term.
I20260709 12:23:10.957209  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600bf30d4f6541ee8c1c8ac91c14e1ec" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac"
W20260709 12:23:10.958406  5433 leader_election.cc:343] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.958685  5659 ts_tablet_manager.cc:1434] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:23:10.960685  5583 leader_election.cc:304] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, 87d38bda1e1347119f89092460bd01ac; no voters: 
I20260709 12:23:10.961689  5709 raft_consensus.cc:2804] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:10.962116  5709 raft_consensus.cc:493] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:10.962443  5709 raft_consensus.cc:3060] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.966682  5545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600bf30d4f6541ee8c1c8ac91c14e1ec" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:10.967310  5545 raft_consensus.cc:3060] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.969349  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac" is_pre_election: true
I20260709 12:23:10.970355  5661 tablet_bootstrap.cc:492] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac: No bootstrap required, opened a new log
I20260709 12:23:10.970366  5709 raft_consensus.cc:515] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.970940  5661 ts_tablet_manager.cc:1403] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.022s
I20260709 12:23:10.972694  5709 leader_election.cc:290] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 1 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), eeab06617abc467585ce23fb92498eea (127.4.181.66:38481)
I20260709 12:23:10.974005  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b93dd9a23f4e108a87e047e94e0dbc" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:10.974627  5469 raft_consensus.cc:3060] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:10.974380  5661 raft_consensus.cc:359] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
W20260709 12:23:10.975003  5508 leader_election.cc:343] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:10.975373  5661 raft_consensus.cc:385] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:10.975461  5508 leader_election.cc:304] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: eeab06617abc467585ce23fb92498eea; no voters: 79826be02961412db821ebecdd7e04c9, 87d38bda1e1347119f89092460bd01ac
I20260709 12:23:10.975728  5661 raft_consensus.cc:740] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Initialized, Role: FOLLOWER
I20260709 12:23:10.976612  5680 raft_consensus.cc:2749] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:10.976673  5661 consensus_queue.cc:260] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.978844  5661 ts_tablet_manager.cc:1434] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:23:10.979676  5661 tablet_bootstrap.cc:492] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac: Bootstrap starting.
I20260709 12:23:10.981410  5469 raft_consensus.cc:2468] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87d38bda1e1347119f89092460bd01ac in term 1.
I20260709 12:23:10.982955  5583 leader_election.cc:304] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, 87d38bda1e1347119f89092460bd01ac; no voters: 
I20260709 12:23:10.983695  5709 raft_consensus.cc:2804] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.984467  5709 raft_consensus.cc:697] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 1 LEADER]: Becoming Leader. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Running, Role: LEADER
I20260709 12:23:10.985445  5709 consensus_queue.cc:237] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.987685  5545 raft_consensus.cc:2468] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 1.
I20260709 12:23:10.988248  5661 tablet_bootstrap.cc:654] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:10.989012  5435 leader_election.cc:304] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 87d38bda1e1347119f89092460bd01ac
I20260709 12:23:10.989989  5667 raft_consensus.cc:2804] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:10.990556  5667 raft_consensus.cc:697] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:10.991355  5667 consensus_queue.cc:237] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:10.998849  5545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b93dd9a23f4e108a87e047e94e0dbc" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeab06617abc467585ce23fb92498eea" is_pre_election: true
I20260709 12:23:10.999526  5545 raft_consensus.cc:2468] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 87d38bda1e1347119f89092460bd01ac in term 0.
I20260709 12:23:10.999614  5544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a15633927704078875dbd47c7207763" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeab06617abc467585ce23fb92498eea" is_pre_election: true
I20260709 12:23:11.000844  5543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b93dd9a23f4e108a87e047e94e0dbc" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:11.001353  5543 raft_consensus.cc:3060] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.003304  5366 catalog_manager.cc:5697] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79826be02961412db821ebecdd7e04c9 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "79826be02961412db821ebecdd7e04c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.007716  5584 leader_election.cc:304] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac; no voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea
I20260709 12:23:11.008320  5661 tablet_bootstrap.cc:492] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac: No bootstrap required, opened a new log
I20260709 12:23:11.008406  5709 raft_consensus.cc:3060] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.008829  5661 ts_tablet_manager.cc:1403] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac: Time spent bootstrapping tablet: real 0.029s	user 0.004s	sys 0.011s
I20260709 12:23:11.011915  5661 raft_consensus.cc:359] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.012620  5661 raft_consensus.cc:385] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.013002  5661 raft_consensus.cc:740] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.012377  5368 catalog_manager.cc:5697] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac reported cstate change: term changed from 0 to 1, leader changed from <none> to 87d38bda1e1347119f89092460bd01ac (127.4.181.67). New cstate: current_term: 1 leader_uuid: "87d38bda1e1347119f89092460bd01ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.014071  5543 raft_consensus.cc:2468] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87d38bda1e1347119f89092460bd01ac in term 1.
I20260709 12:23:11.013845  5661 consensus_queue.cc:260] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.016598  5661 ts_tablet_manager.cc:1434] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:11.017567  5661 tablet_bootstrap.cc:492] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac: Bootstrap starting.
I20260709 12:23:11.015491  5709 raft_consensus.cc:2749] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.022852  5661 tablet_bootstrap.cc:654] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:11.028046  5661 tablet_bootstrap.cc:492] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac: No bootstrap required, opened a new log
I20260709 12:23:11.028483  5661 ts_tablet_manager.cc:1403] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:23:11.030453  5661 raft_consensus.cc:359] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.031111  5661 raft_consensus.cc:385] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:11.031363  5661 raft_consensus.cc:740] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Initialized, Role: FOLLOWER
I20260709 12:23:11.031914  5661 consensus_queue.cc:260] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.033421  5661 ts_tablet_manager.cc:1434] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
W20260709 12:23:11.056581  5645 tablet.cc:2406] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:11.079767  5618 raft_consensus.cc:3060] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.086192  5680 consensus_queue.cc:1048] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:11.097422  5683 consensus_queue.cc:1048] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.116407  5683 raft_consensus.cc:493] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.116842  5683 raft_consensus.cc:515] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.119055  5683 leader_election.cc:290] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:11.119997  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e8d4efc27540009075832925e9c9ba" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9" is_pre_election: true
I20260709 12:23:11.120103  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e8d4efc27540009075832925e9c9ba" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac" is_pre_election: true
I20260709 12:23:11.120558  5469 raft_consensus.cc:2468] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 0.
I20260709 12:23:11.120599  5618 raft_consensus.cc:2468] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 0.
I20260709 12:23:11.121711  5508 leader_election.cc:304] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:11.122350  5683 raft_consensus.cc:2804] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.122709  5683 raft_consensus.cc:493] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.122964  5683 raft_consensus.cc:3060] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.123586  5680 raft_consensus.cc:493] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.124004  5680 raft_consensus.cc:515] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.125881  5680 leader_election.cc:290] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:11.126745  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e020422e23c8423884a3351c23bc6c96" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9" is_pre_election: true
I20260709 12:23:11.127446  5469 raft_consensus.cc:2468] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 0.
I20260709 12:23:11.127444  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e020422e23c8423884a3351c23bc6c96" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac" is_pre_election: true
I20260709 12:23:11.128257  5618 raft_consensus.cc:2468] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 0.
I20260709 12:23:11.128743  5509 leader_election.cc:304] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:11.129529  5680 raft_consensus.cc:2804] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.130143  5680 raft_consensus.cc:493] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.129602  5683 raft_consensus.cc:515] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.130666  5680 raft_consensus.cc:3060] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.132172  5683 leader_election.cc:290] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:11.133296  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e8d4efc27540009075832925e9c9ba" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:11.133296  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e8d4efc27540009075832925e9c9ba" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:11.133832  5618 raft_consensus.cc:3060] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.134289  5469 raft_consensus.cc:3060] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.138680  5680 raft_consensus.cc:515] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.139142  5618 raft_consensus.cc:2468] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 1.
I20260709 12:23:11.140861  5680 leader_election.cc:290] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:11.140937  5508 leader_election.cc:304] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:11.141366  5469 raft_consensus.cc:2468] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 1.
I20260709 12:23:11.142576  5680 raft_consensus.cc:2804] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.143181  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e020422e23c8423884a3351c23bc6c96" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:11.143326  5470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e020422e23c8423884a3351c23bc6c96" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:11.143843  5680 raft_consensus.cc:697] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Becoming Leader. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:11.144024  5470 raft_consensus.cc:3060] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.144470  5683 consensus_queue.cc:1048] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.144721  5680 consensus_queue.cc:237] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.148398  5683 consensus_queue.cc:1048] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.152087  5470 raft_consensus.cc:2468] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 1.
I20260709 12:23:11.153347  5618 raft_consensus.cc:3060] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.157788  5509 leader_election.cc:304] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:11.160194  5683 raft_consensus.cc:2804] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.160765  5683 raft_consensus.cc:697] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Becoming Leader. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:11.161409  5618 raft_consensus.cc:2468] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 1.
I20260709 12:23:11.161747  5683 consensus_queue.cc:237] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.162989  5368 catalog_manager.cc:5697] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea reported cstate change: term changed from 0 to 1, leader changed from <none> to eeab06617abc467585ce23fb92498eea (127.4.181.66). New cstate: current_term: 1 leader_uuid: "eeab06617abc467585ce23fb92498eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.183936  5368 catalog_manager.cc:5697] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea reported cstate change: term changed from 0 to 1, leader changed from <none> to eeab06617abc467585ce23fb92498eea (127.4.181.66). New cstate: current_term: 1 leader_uuid: "eeab06617abc467585ce23fb92498eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.186569  5683 consensus_queue.cc:1048] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.199666  5680 consensus_queue.cc:1048] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.238647  5667 raft_consensus.cc:493] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.239245  5667 raft_consensus.cc:515] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.240875  5667 leader_election.cc:290] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:11.241966  5543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeab06617abc467585ce23fb92498eea" is_pre_election: true
I20260709 12:23:11.242298  5619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac" is_pre_election: true
I20260709 12:23:11.242563  5543 raft_consensus.cc:2468] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 0.
I20260709 12:23:11.243008  5619 raft_consensus.cc:2468] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 0.
I20260709 12:23:11.243747  5435 leader_election.cc:304] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:11.244482  5667 raft_consensus.cc:2804] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:11.244747  5667 raft_consensus.cc:493] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:11.244997  5667 raft_consensus.cc:3060] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.249615  5667 raft_consensus.cc:515] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.251332  5667 leader_election.cc:290] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 1 election: Requested vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:11.252125  5543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:11.252390  5619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:11.252626  5543 raft_consensus.cc:3060] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.252928  5619 raft_consensus.cc:3060] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.257334  5543 raft_consensus.cc:2468] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 1.
I20260709 12:23:11.258287  5619 raft_consensus.cc:2468] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 1.
I20260709 12:23:11.258530  5435 leader_election.cc:304] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:11.259315  5667 raft_consensus.cc:2804] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:11.259760  5667 raft_consensus.cc:697] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 1 LEADER]: Becoming Leader. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:11.260394  5667 consensus_queue.cc:237] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.267701  5368 catalog_manager.cc:5697] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 79826be02961412db821ebecdd7e04c9 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "79826be02961412db821ebecdd7e04c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.338744  5680 consensus_queue.cc:1048] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.349237  5665 consensus_queue.cc:1048] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.364957  5665 consensus_queue.cc:1048] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.369949  5709 raft_consensus.cc:493] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:11.370438  5709 raft_consensus.cc:515] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.372452  5709 leader_election.cc:290] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), eeab06617abc467585ce23fb92498eea (127.4.181.66:38481)
I20260709 12:23:11.373515  5543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600bf30d4f6541ee8c1c8ac91c14e1ec" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eeab06617abc467585ce23fb92498eea" is_pre_election: true
I20260709 12:23:11.373710  5470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600bf30d4f6541ee8c1c8ac91c14e1ec" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "79826be02961412db821ebecdd7e04c9" is_pre_election: true
I20260709 12:23:11.374359  5543 raft_consensus.cc:2393] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 87d38bda1e1347119f89092460bd01ac in current term 1: Already voted for candidate 79826be02961412db821ebecdd7e04c9 in this term.
I20260709 12:23:11.376721  5583 leader_election.cc:304] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac; no voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea
I20260709 12:23:11.377974  5709 raft_consensus.cc:3060] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:11.385771  5709 raft_consensus.cc:2749] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:11.386336  5680 consensus_queue.cc:1048] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.405725  5543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "24c1040e22aa4b37a7d56d2a092acd05"
dest_uuid: "eeab06617abc467585ce23fb92498eea"
mode: GRACEFUL
new_leader_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:55400
I20260709 12:23:11.406266  5543 raft_consensus.cc:606] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Received request to transfer leadership to TS 79826be02961412db821ebecdd7e04c9
I20260709 12:23:11.420328  5619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "64b93dd9a23f4e108a87e047e94e0dbc"
dest_uuid: "87d38bda1e1347119f89092460bd01ac"
mode: GRACEFUL
new_leader_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:51200
I20260709 12:23:11.420929  5619 raft_consensus.cc:606] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 1 LEADER]: Received request to transfer leadership to TS 79826be02961412db821ebecdd7e04c9
I20260709 12:23:11.426581  5543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b"
dest_uuid: "eeab06617abc467585ce23fb92498eea"
mode: GRACEFUL
new_leader_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:55400
I20260709 12:23:11.427284  5543 raft_consensus.cc:606] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Received request to transfer leadership to TS 79826be02961412db821ebecdd7e04c9
I20260709 12:23:11.432335  5543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a15633927704078875dbd47c7207763"
dest_uuid: "eeab06617abc467585ce23fb92498eea"
mode: GRACEFUL
new_leader_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:55400
I20260709 12:23:11.432794  5543 raft_consensus.cc:606] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Received request to transfer leadership to TS 79826be02961412db821ebecdd7e04c9
I20260709 12:23:11.437326  5543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7"
dest_uuid: "eeab06617abc467585ce23fb92498eea"
mode: GRACEFUL
new_leader_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:55400
I20260709 12:23:11.437774  5543 raft_consensus.cc:606] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Received request to transfer leadership to TS 79826be02961412db821ebecdd7e04c9
I20260709 12:23:11.455161  5469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
mode: GRACEFUL
new_leader_uuid: "eeab06617abc467585ce23fb92498eea"
 from {username='slave'} at 127.0.0.1:59740
I20260709 12:23:11.455687  5469 raft_consensus.cc:606] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 1 LEADER]: Received request to transfer leadership to TS eeab06617abc467585ce23fb92498eea
I20260709 12:23:11.460563  5469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "600bf30d4f6541ee8c1c8ac91c14e1ec"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
mode: GRACEFUL
new_leader_uuid: "eeab06617abc467585ce23fb92498eea"
 from {username='slave'} at 127.0.0.1:59740
I20260709 12:23:11.461041  5469 raft_consensus.cc:606] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 1 LEADER]: Received request to transfer leadership to TS eeab06617abc467585ce23fb92498eea
I20260709 12:23:11.465783  5543 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19e8d4efc27540009075832925e9c9ba"
dest_uuid: "eeab06617abc467585ce23fb92498eea"
mode: GRACEFUL
new_leader_uuid: "87d38bda1e1347119f89092460bd01ac"
 from {username='slave'} at 127.0.0.1:55400
I20260709 12:23:11.466236  5543 raft_consensus.cc:606] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Received request to transfer leadership to TS 87d38bda1e1347119f89092460bd01ac
I20260709 12:23:11.500938  5709 consensus_queue.cc:1048] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.507292  5668 raft_consensus.cc:993] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac: : Instructing follower 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:11.508364  5668 raft_consensus.cc:1081] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 1 LEADER]: Signalling peer 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:11.509990  5470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "64b93dd9a23f4e108a87e047e94e0dbc"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:59732
I20260709 12:23:11.512537  5470 raft_consensus.cc:493] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.512962  5470 raft_consensus.cc:3060] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.513530  5709 consensus_queue.cc:1048] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.519304  5470 raft_consensus.cc:515] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.526499  5543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b93dd9a23f4e108a87e047e94e0dbc" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:11.526708  5619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "64b93dd9a23f4e108a87e047e94e0dbc" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:11.527330  5619 raft_consensus.cc:3055] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:11.527418  5543 raft_consensus.cc:3060] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.527693  5619 raft_consensus.cc:740] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Running, Role: LEADER
I20260709 12:23:11.528515  5619 consensus_queue.cc:260] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.529086  5470 leader_election.cc:290] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 2 election: Requested vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:11.529541  5619 raft_consensus.cc:3060] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.534927  5543 raft_consensus.cc:2468] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 2.
I20260709 12:23:11.535982  5619 raft_consensus.cc:2468] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 2.
I20260709 12:23:11.536139  5435 leader_election.cc:304] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:11.536899  5667 raft_consensus.cc:2804] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:11.537312  5667 raft_consensus.cc:697] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:11.537901  5667 consensus_queue.cc:237] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.544350  5368 catalog_manager.cc:5697] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 reported cstate change: term changed from 1 to 2, leader changed from 87d38bda1e1347119f89092460bd01ac (127.4.181.67) to 79826be02961412db821ebecdd7e04c9 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "79826be02961412db821ebecdd7e04c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.550796  5680 consensus_queue.cc:1048] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.557406  5665 raft_consensus.cc:993] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea: : Instructing follower 87d38bda1e1347119f89092460bd01ac to start an election
I20260709 12:23:11.557919  5684 raft_consensus.cc:1081] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Signalling peer 87d38bda1e1347119f89092460bd01ac to start an election
I20260709 12:23:11.561316  5617 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19e8d4efc27540009075832925e9c9ba"
dest_uuid: "87d38bda1e1347119f89092460bd01ac"
 from {username='slave'} at 127.0.0.1:51186
I20260709 12:23:11.561936  5617 raft_consensus.cc:493] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.562325  5617 raft_consensus.cc:3060] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.562556  5684 consensus_queue.cc:1048] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.567399  5683 consensus_queue.cc:1048] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.571723  5617 raft_consensus.cc:515] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.574662  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e8d4efc27540009075832925e9c9ba" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:11.575284  5469 raft_consensus.cc:3060] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.576860  5617 leader_election.cc:290] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 2 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), eeab06617abc467585ce23fb92498eea (127.4.181.66:38481)
I20260709 12:23:11.577014  5711 consensus_queue.cc:1048] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.581329  5544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19e8d4efc27540009075832925e9c9ba" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:11.581881  5544 raft_consensus.cc:3055] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:11.582195  5544 raft_consensus.cc:740] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:11.582989  5544 consensus_queue.cc:260] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.586012  5469 raft_consensus.cc:2468] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87d38bda1e1347119f89092460bd01ac in term 2.
I20260709 12:23:11.587538  5544 raft_consensus.cc:3060] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.587819  5665 consensus_queue.cc:1048] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.588989  5583 leader_election.cc:304] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, 87d38bda1e1347119f89092460bd01ac; no voters: 
I20260709 12:23:11.589272  5711 consensus_queue.cc:1048] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.589870  5709 raft_consensus.cc:2804] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:11.590358  5709 raft_consensus.cc:697] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [term 2 LEADER]: Becoming Leader. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Running, Role: LEADER
I20260709 12:23:11.591168  5709 consensus_queue.cc:237] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.599047  5684 raft_consensus.cc:993] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea: : Instructing follower 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:11.599520  5684 raft_consensus.cc:1081] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Signalling peer 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:11.601258  5544 raft_consensus.cc:2468] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87d38bda1e1347119f89092460bd01ac in term 2.
I20260709 12:23:11.602648  5667 raft_consensus.cc:993] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9: : Instructing follower eeab06617abc467585ce23fb92498eea to start an election
I20260709 12:23:11.603385  5711 raft_consensus.cc:1081] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 1 LEADER]: Signalling peer eeab06617abc467585ce23fb92498eea to start an election
I20260709 12:23:11.607828  5543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "600bf30d4f6541ee8c1c8ac91c14e1ec"
dest_uuid: "eeab06617abc467585ce23fb92498eea"
 from {username='slave'} at 127.0.0.1:55372
I20260709 12:23:11.608497  5543 raft_consensus.cc:493] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.608860  5543 raft_consensus.cc:3060] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.611840  5470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "24c1040e22aa4b37a7d56d2a092acd05"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:59720
I20260709 12:23:11.612432  5470 raft_consensus.cc:493] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.612828  5470 raft_consensus.cc:3060] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.616264  5680 raft_consensus.cc:993] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea: : Instructing follower 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:11.616696  5680 raft_consensus.cc:1081] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Signalling peer 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:11.618219  5367 catalog_manager.cc:5697] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac reported cstate change: term changed from 1 to 2, leader changed from eeab06617abc467585ce23fb92498eea (127.4.181.66) to 87d38bda1e1347119f89092460bd01ac (127.4.181.67). New cstate: current_term: 2 leader_uuid: "87d38bda1e1347119f89092460bd01ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:11.620784  5470 raft_consensus.cc:515] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.622676  5469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:59720
I20260709 12:23:11.622869  5470 leader_election.cc:290] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 2 election: Requested vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:11.623250  5469 raft_consensus.cc:493] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.623634  5469 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.623484  5545 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c1040e22aa4b37a7d56d2a092acd05" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:11.624106  5545 raft_consensus.cc:3055] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:11.624421  5545 raft_consensus.cc:740] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:11.624724  5543 raft_consensus.cc:515] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.625196  5545 consensus_queue.cc:260] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.626245  5545 raft_consensus.cc:3060] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.627568  5543 leader_election.cc:290] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 2 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:11.628314  5619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "24c1040e22aa4b37a7d56d2a092acd05" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:11.628575  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600bf30d4f6541ee8c1c8ac91c14e1ec" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:11.628943  5619 raft_consensus.cc:3060] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.629136  5618 raft_consensus.cc:3060] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.629491  5470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "600bf30d4f6541ee8c1c8ac91c14e1ec" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:11.630067  5470 raft_consensus.cc:3055] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:11.630434  5470 raft_consensus.cc:740] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:11.631384  5470 consensus_queue.cc:260] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.634127  5545 raft_consensus.cc:2468] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 2.
I20260709 12:23:11.635747  5618 raft_consensus.cc:2468] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 2.
I20260709 12:23:11.636234  5470 raft_consensus.cc:3060] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.636588  5435 leader_election.cc:304] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:11.636960  5508 leader_election.cc:304] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:11.637473  5743 raft_consensus.cc:2804] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:11.637945  5743 raft_consensus.cc:697] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:11.639202  5743 consensus_queue.cc:237] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.640096  5469 raft_consensus.cc:515] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.643064  5543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:11.643235  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:11.636727  5544 raft_consensus.cc:1240] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Rejecting Update request from peer 79826be02961412db821ebecdd7e04c9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:23:11.643759  5543 raft_consensus.cc:3055] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:11.643805  5618 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.643868  5470 raft_consensus.cc:2468] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 2.
I20260709 12:23:11.644337  5543 raft_consensus.cc:740] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:11.645187  5543 consensus_queue.cc:260] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.645673  5665 raft_consensus.cc:2804] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:11.646154  5665 raft_consensus.cc:697] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 2 LEADER]: Becoming Leader. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:11.646234  5543 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.646981  5665 consensus_queue.cc:237] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.651016  5619 raft_consensus.cc:2468] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 2.
I20260709 12:23:11.655934  5543 raft_consensus.cc:2468] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 2.
I20260709 12:23:11.656179  5368 catalog_manager.cc:5697] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea reported cstate change: term changed from 1 to 2, leader changed from 79826be02961412db821ebecdd7e04c9 (127.4.181.65) to eeab06617abc467585ce23fb92498eea (127.4.181.66). New cstate: current_term: 2 leader_uuid: "eeab06617abc467585ce23fb92498eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.657636  5618 raft_consensus.cc:2468] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 2.
I20260709 12:23:11.658823  5433 leader_election.cc:304] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, 87d38bda1e1347119f89092460bd01ac; no voters: 
I20260709 12:23:11.659934  5743 raft_consensus.cc:2804] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:11.660422  5743 raft_consensus.cc:697] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:11.661355  5469 leader_election.cc:290] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 2 election: Requested vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:11.661237  5743 consensus_queue.cc:237] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.661841  5366 catalog_manager.cc:5697] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 reported cstate change: term changed from 1 to 2, leader changed from eeab06617abc467585ce23fb92498eea (127.4.181.66) to 79826be02961412db821ebecdd7e04c9 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "79826be02961412db821ebecdd7e04c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.673084  5366 catalog_manager.cc:5697] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 reported cstate change: term changed from 1 to 2, leader changed from eeab06617abc467585ce23fb92498eea (127.4.181.66) to 79826be02961412db821ebecdd7e04c9 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "79826be02961412db821ebecdd7e04c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.752403  5684 raft_consensus.cc:993] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea: : Instructing follower 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:11.752890  5665 raft_consensus.cc:1081] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Signalling peer 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:11.753136  5743 consensus_queue.cc:1048] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.754416  5469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:59720
I20260709 12:23:11.755003  5469 raft_consensus.cc:493] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.755286  5469 raft_consensus.cc:3060] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.766739  5711 consensus_queue.cc:1048] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:11.769291  5469 raft_consensus.cc:515] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.771522  5469 leader_election.cc:290] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 2 election: Requested vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:11.772063  5544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:11.772639  5544 raft_consensus.cc:3055] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:11.772977  5544 raft_consensus.cc:740] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:11.773034  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:11.773784  5618 raft_consensus.cc:3060] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.773834  5544 consensus_queue.cc:260] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.775156  5544 raft_consensus.cc:3060] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.776743  5711 raft_consensus.cc:993] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9: : Instructing follower eeab06617abc467585ce23fb92498eea to start an election
I20260709 12:23:11.777158  5711 raft_consensus.cc:1081] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 1 LEADER]: Signalling peer eeab06617abc467585ce23fb92498eea to start an election
I20260709 12:23:11.778728  5543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d"
dest_uuid: "eeab06617abc467585ce23fb92498eea"
 from {username='slave'} at 127.0.0.1:55372
I20260709 12:23:11.779244  5543 raft_consensus.cc:493] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.779510  5543 raft_consensus.cc:3060] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.782274  5544 raft_consensus.cc:2468] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 2.
I20260709 12:23:11.782292  5618 raft_consensus.cc:2468] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 2.
I20260709 12:23:11.783499  5435 leader_election.cc:304] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:11.784240  5667 raft_consensus.cc:2804] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:11.784674  5667 raft_consensus.cc:697] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:11.785423  5667 consensus_queue.cc:237] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.786937  5543 raft_consensus.cc:515] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.787431  5684 raft_consensus.cc:993] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea: : Instructing follower 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:11.787874  5684 raft_consensus.cc:1081] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Signalling peer 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:11.789292  5543 leader_election.cc:290] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 2 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:11.789323  5469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a15633927704078875dbd47c7207763"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:59720
I20260709 12:23:11.789848  5470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:11.790053  5469 raft_consensus.cc:493] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:11.790383  5470 raft_consensus.cc:3055] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:11.790833  5470 raft_consensus.cc:740] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:11.790412  5469 raft_consensus.cc:3060] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.790970  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:11.791545  5618 raft_consensus.cc:3060] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.793112  5470 consensus_queue.cc:260] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.794369  5470 raft_consensus.cc:3060] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.794360  5366 catalog_manager.cc:5697] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 reported cstate change: term changed from 1 to 2, leader changed from eeab06617abc467585ce23fb92498eea (127.4.181.66) to 79826be02961412db821ebecdd7e04c9 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "79826be02961412db821ebecdd7e04c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.797494  5469 raft_consensus.cc:515] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.798619  5618 raft_consensus.cc:2468] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 2.
I20260709 12:23:11.799929  5508 leader_election.cc:304] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:11.800714  5684 raft_consensus.cc:2804] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:11.801028  5543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a15633927704078875dbd47c7207763" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:11.801270  5684 raft_consensus.cc:697] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 2 LEADER]: Becoming Leader. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:11.801602  5543 raft_consensus.cc:3055] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:11.801949  5543 raft_consensus.cc:740] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:11.802739  5543 consensus_queue.cc:260] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.803298  5470 raft_consensus.cc:2468] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 2.
I20260709 12:23:11.802157  5684 consensus_queue.cc:237] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.800702  5469 leader_election.cc:290] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 2 election: Requested vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:11.803747  5543 raft_consensus.cc:3060] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.806605  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a15633927704078875dbd47c7207763" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:11.807169  5618 raft_consensus.cc:3060] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:11.810617  5543 raft_consensus.cc:2468] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 2.
I20260709 12:23:11.811807  5435 leader_election.cc:304] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:11.812582  5667 raft_consensus.cc:2804] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:11.813043  5667 raft_consensus.cc:697] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:11.812342  5367 catalog_manager.cc:5697] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea reported cstate change: term changed from 1 to 2, leader changed from 79826be02961412db821ebecdd7e04c9 (127.4.181.65) to eeab06617abc467585ce23fb92498eea (127.4.181.66). New cstate: current_term: 2 leader_uuid: "eeab06617abc467585ce23fb92498eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.813787  5618 raft_consensus.cc:2468] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 2.
I20260709 12:23:11.813829  5667 consensus_queue.cc:237] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:11.822512  5366 catalog_manager.cc:5697] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 reported cstate change: term changed from 1 to 2, leader changed from eeab06617abc467585ce23fb92498eea (127.4.181.66) to 79826be02961412db821ebecdd7e04c9 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "79826be02961412db821ebecdd7e04c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:11.968603  5543 raft_consensus.cc:1275] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:11.969877  5667 consensus_queue.cc:1048] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:11.974817  5618 raft_consensus.cc:1275] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:11.976073  5743 consensus_queue.cc:1048] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.022320  5543 raft_consensus.cc:1275] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.023587  5743 consensus_queue.cc:1048] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.030686  5618 raft_consensus.cc:1275] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.032372  5711 consensus_queue.cc:1048] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.035264  5618 raft_consensus.cc:1275] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Refusing update from remote peer eeab06617abc467585ce23fb92498eea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.036839  5684 consensus_queue.cc:1048] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.045296  5469 raft_consensus.cc:1275] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Refusing update from remote peer eeab06617abc467585ce23fb92498eea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.046659  5684 consensus_queue.cc:1048] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.062130  5543 raft_consensus.cc:1275] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Refusing update from remote peer 87d38bda1e1347119f89092460bd01ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.063477  5736 consensus_queue.cc:1048] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.072530  5469 raft_consensus.cc:1275] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Refusing update from remote peer 87d38bda1e1347119f89092460bd01ac: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.073905  5709 consensus_queue.cc:1048] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.157344  5543 raft_consensus.cc:1275] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.158752  5711 consensus_queue.cc:1048] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.166874  5619 raft_consensus.cc:1275] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.168572  5743 consensus_queue.cc:1048] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.171793  5543 raft_consensus.cc:1275] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.173718  5743 consensus_queue.cc:1048] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.183472  5619 raft_consensus.cc:1275] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.185004  5711 consensus_queue.cc:1048] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.232617  5543 raft_consensus.cc:1275] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.234110  5711 consensus_queue.cc:1048] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.244884  5619 raft_consensus.cc:1275] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.246294  5667 consensus_queue.cc:1048] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.318113  5619 raft_consensus.cc:1275] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Refusing update from remote peer eeab06617abc467585ce23fb92498eea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.319326  5684 consensus_queue.cc:1048] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:12.326079  5469 raft_consensus.cc:1275] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Refusing update from remote peer eeab06617abc467585ce23fb92498eea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:12.327937  5683 consensus_queue.cc:1048] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:14.501466  4821 auto_leader_rebalancer-test.cc:365] The leader distribution is 
I20260709 12:23:14.502189  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:14.519795  5469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
mode: GRACEFUL
new_leader_uuid: "87d38bda1e1347119f89092460bd01ac"
 from {username='slave'} at 127.0.0.1:59746
I20260709 12:23:14.520309  5469 raft_consensus.cc:606] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Received request to transfer leadership to TS 87d38bda1e1347119f89092460bd01ac
I20260709 12:23:14.522948  5469 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
mode: GRACEFUL
new_leader_uuid: "87d38bda1e1347119f89092460bd01ac"
 from {username='slave'} at 127.0.0.1:59746
I20260709 12:23:14.523439  5469 raft_consensus.cc:606] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Received request to transfer leadership to TS 87d38bda1e1347119f89092460bd01ac
I20260709 12:23:14.524617  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:23:14.525084  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:14.887094  5756 raft_consensus.cc:993] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9: : Instructing follower 87d38bda1e1347119f89092460bd01ac to start an election
I20260709 12:23:14.887729  5667 raft_consensus.cc:1081] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Signalling peer 87d38bda1e1347119f89092460bd01ac to start an election
I20260709 12:23:14.889318  5619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7"
dest_uuid: "87d38bda1e1347119f89092460bd01ac"
 from {username='slave'} at 127.0.0.1:51190
I20260709 12:23:14.889923  5619 raft_consensus.cc:493] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:14.890234  5619 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.894948  5619 raft_consensus.cc:515] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:14.896782  5619 leader_election.cc:290] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 3 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), eeab06617abc467585ce23fb92498eea (127.4.181.66:38481)
I20260709 12:23:14.897595  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:14.897892  5543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:14.898181  5469 raft_consensus.cc:3055] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:14.898416  5543 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.898547  5469 raft_consensus.cc:740] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:14.899303  5469 consensus_queue.cc:260] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:14.900434  5469 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.905805  5543 raft_consensus.cc:2468] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87d38bda1e1347119f89092460bd01ac in term 3.
I20260709 12:23:14.906738  5469 raft_consensus.cc:2468] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87d38bda1e1347119f89092460bd01ac in term 3.
I20260709 12:23:14.907220  5584 leader_election.cc:304] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:14.907972  5752 raft_consensus.cc:2804] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:14.908398  5752 raft_consensus.cc:697] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 3 LEADER]: Becoming Leader. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Running, Role: LEADER
I20260709 12:23:14.909078  5752 consensus_queue.cc:237] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:14.916275  5367 catalog_manager.cc:5697] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac reported cstate change: term changed from 2 to 3, leader changed from 79826be02961412db821ebecdd7e04c9 (127.4.181.65) to 87d38bda1e1347119f89092460bd01ac (127.4.181.67). New cstate: current_term: 3 leader_uuid: "87d38bda1e1347119f89092460bd01ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:14.926275  5667 raft_consensus.cc:993] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9: : Instructing follower 87d38bda1e1347119f89092460bd01ac to start an election
I20260709 12:23:14.926848  5667 raft_consensus.cc:1081] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Signalling peer 87d38bda1e1347119f89092460bd01ac to start an election
I20260709 12:23:14.928521  5619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b"
dest_uuid: "87d38bda1e1347119f89092460bd01ac"
 from {username='slave'} at 127.0.0.1:51190
I20260709 12:23:14.929105  5619 raft_consensus.cc:493] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:14.929468  5619 raft_consensus.cc:3060] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.934154  5619 raft_consensus.cc:515] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:14.935952  5619 leader_election.cc:290] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 3 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), eeab06617abc467585ce23fb92498eea (127.4.181.66:38481)
I20260709 12:23:14.936715  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:14.936997  5543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:14.937278  5469 raft_consensus.cc:3055] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:14.937518  5543 raft_consensus.cc:3060] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.937615  5469 raft_consensus.cc:740] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:14.938329  5469 consensus_queue.cc:260] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:14.939447  5469 raft_consensus.cc:3060] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:14.943032  5543 raft_consensus.cc:2468] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87d38bda1e1347119f89092460bd01ac in term 3.
I20260709 12:23:14.944183  5584 leader_election.cc:304] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:14.944916  5469 raft_consensus.cc:2468] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87d38bda1e1347119f89092460bd01ac in term 3.
I20260709 12:23:14.945134  5752 raft_consensus.cc:2804] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:14.945753  5752 raft_consensus.cc:697] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 3 LEADER]: Becoming Leader. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Running, Role: LEADER
I20260709 12:23:14.946563  5752 consensus_queue.cc:237] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:14.953754  5367 catalog_manager.cc:5697] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac reported cstate change: term changed from 2 to 3, leader changed from 79826be02961412db821ebecdd7e04c9 (127.4.181.65) to 87d38bda1e1347119f89092460bd01ac (127.4.181.67). New cstate: current_term: 3 leader_uuid: "87d38bda1e1347119f89092460bd01ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:15.379987  5469 raft_consensus.cc:1275] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Refusing update from remote peer 87d38bda1e1347119f89092460bd01ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:15.381143  5752 consensus_queue.cc:1048] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:15.390874  5543 raft_consensus.cc:1275] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Refusing update from remote peer 87d38bda1e1347119f89092460bd01ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:15.392781  5752 consensus_queue.cc:1048] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:15.412798  5543 raft_consensus.cc:1275] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Refusing update from remote peer 87d38bda1e1347119f89092460bd01ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:15.413957  5765 consensus_queue.cc:1048] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:15.423305  5469 raft_consensus.cc:1275] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Refusing update from remote peer 87d38bda1e1347119f89092460bd01ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:15.424527  5765 consensus_queue.cc:1048] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:15.526069  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:15.531322  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:15.531688  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:16.532653  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:16.538830  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:16.539193  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:17.540023  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:17.545318  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:17.545670  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:18.546731  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:18.552485  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:18.552871  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:19.553918  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:19.560364  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:19.560777  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:20.561820  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:20.567786  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:20.568212  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:21.569109  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:21.575098  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:21.575626  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:22.576599  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:22.582157  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:22.582630  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:23.583525  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:23.589080  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:23.589478  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:24.622900  4821 auto_leader_rebalancer-test.cc:384] The leader distribution is 
I20260709 12:23:24.633255  5619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b"
dest_uuid: "87d38bda1e1347119f89092460bd01ac"
mode: GRACEFUL
new_leader_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:51200
I20260709 12:23:24.633949  5619 raft_consensus.cc:606] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 3 LEADER]: Received request to transfer leadership to TS 79826be02961412db821ebecdd7e04c9
I20260709 12:23:24.641703  5619 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7"
dest_uuid: "87d38bda1e1347119f89092460bd01ac"
mode: GRACEFUL
new_leader_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:51200
I20260709 12:23:24.642168  5619 raft_consensus.cc:606] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 3 LEADER]: Received request to transfer leadership to TS 79826be02961412db821ebecdd7e04c9
I20260709 12:23:24.646944  5544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11f55d2e6c1a4410bf4cbe687e775781"
dest_uuid: "eeab06617abc467585ce23fb92498eea"
mode: GRACEFUL
new_leader_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:55400
I20260709 12:23:24.647538  5544 raft_consensus.cc:606] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Received request to transfer leadership to TS 79826be02961412db821ebecdd7e04c9
I20260709 12:23:24.652817  5544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e020422e23c8423884a3351c23bc6c96"
dest_uuid: "eeab06617abc467585ce23fb92498eea"
mode: GRACEFUL
new_leader_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:55400
I20260709 12:23:24.653316  5544 raft_consensus.cc:606] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Received request to transfer leadership to TS 79826be02961412db821ebecdd7e04c9
I20260709 12:23:24.658087  5544 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d"
dest_uuid: "eeab06617abc467585ce23fb92498eea"
mode: GRACEFUL
new_leader_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:55400
I20260709 12:23:24.658608  5544 raft_consensus.cc:606] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 2 LEADER]: Received request to transfer leadership to TS 79826be02961412db821ebecdd7e04c9
I20260709 12:23:24.853672  5777 raft_consensus.cc:993] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac: : Instructing follower 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:24.854951  5777 raft_consensus.cc:1081] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 3 LEADER]: Signalling peer 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:24.855963  5778 raft_consensus.cc:993] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac: : Instructing follower 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:24.856391  5777 raft_consensus.cc:1081] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 3 LEADER]: Signalling peer 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:24.856798  5469 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:59732
I20260709 12:23:24.857358  5469 raft_consensus.cc:493] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:24.857667  5469 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:24.857942  5470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:59732
I20260709 12:23:24.858450  5470 raft_consensus.cc:493] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:24.858789  5470 raft_consensus.cc:3060] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:24.865018  5470 raft_consensus.cc:515] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:24.864943  5469 raft_consensus.cc:515] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:24.867314  5469 leader_election.cc:290] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 4 election: Requested vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:24.868119  5544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:24.868353  5619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:24.868875  5544 raft_consensus.cc:3060] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:24.867314  5470 leader_election.cc:290] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 4 election: Requested vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:24.869084  5543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:24.868952  5619 raft_consensus.cc:3055] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:24.869653  5543 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:24.869637  5619 raft_consensus.cc:740] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Running, Role: LEADER
I20260709 12:23:24.870483  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "63bf1bebff2041a6b95306b45a75100b" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:24.871189  5618 raft_consensus.cc:3055] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:24.870803  5619 consensus_queue.cc:260] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:24.871505  5618 raft_consensus.cc:740] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Running, Role: LEADER
I20260709 12:23:24.872280  5619 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:24.872349  5618 consensus_queue.cc:260] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:24.873767  5618 raft_consensus.cc:3060] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:24.876221  5543 raft_consensus.cc:2468] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 4.
I20260709 12:23:24.876428  5544 raft_consensus.cc:2468] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 4.
I20260709 12:23:24.877612  5435 leader_election.cc:304] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:24.878497  5774 raft_consensus.cc:2804] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:24.878492  5435 leader_election.cc:304] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:24.878926  5619 raft_consensus.cc:2468] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 4.
I20260709 12:23:24.881486  5618 raft_consensus.cc:2468] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 4.
I20260709 12:23:24.881629  5781 raft_consensus.cc:2804] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:24.882778  5781 raft_consensus.cc:697] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 4 LEADER]: Becoming Leader. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:24.882050  5774 raft_consensus.cc:697] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 4 LEADER]: Becoming Leader. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:24.883701  5781 consensus_queue.cc:237] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:24.883970  5774 consensus_queue.cc:237] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:24.892819  5366 catalog_manager.cc:5697] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 reported cstate change: term changed from 3 to 4, leader changed from 87d38bda1e1347119f89092460bd01ac (127.4.181.67) to 79826be02961412db821ebecdd7e04c9 (127.4.181.65). New cstate: current_term: 4 leader_uuid: "79826be02961412db821ebecdd7e04c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:24.908272  5366 catalog_manager.cc:5697] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 reported cstate change: term changed from 3 to 4, leader changed from 87d38bda1e1347119f89092460bd01ac (127.4.181.67) to 79826be02961412db821ebecdd7e04c9 (127.4.181.65). New cstate: current_term: 4 leader_uuid: "79826be02961412db821ebecdd7e04c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:24.929661  5776 raft_consensus.cc:993] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea: : Instructing follower 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:24.930047  5776 raft_consensus.cc:1081] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 2 LEADER]: Signalling peer 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:24.931372  5470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:59720
I20260709 12:23:24.931799  5470 raft_consensus.cc:493] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:24.932039  5470 raft_consensus.cc:3060] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:24.936242  5470 raft_consensus.cc:515] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:24.937613  5470 leader_election.cc:290] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 3 election: Requested vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:24.938441  5544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:24.938683  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:24.939049  5544 raft_consensus.cc:3055] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:24.939163  5618 raft_consensus.cc:3060] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:24.939452  5544 raft_consensus.cc:740] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:24.940284  5544 consensus_queue.cc:260] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:24.941510  5544 raft_consensus.cc:3060] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:24.946000  5618 raft_consensus.cc:2468] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 3.
I20260709 12:23:24.947786  5433 leader_election.cc:304] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, 87d38bda1e1347119f89092460bd01ac; no voters: 
I20260709 12:23:24.948390  5544 raft_consensus.cc:2468] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 3.
I20260709 12:23:24.948683  5781 raft_consensus.cc:2804] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:24.949329  5781 raft_consensus.cc:697] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 3 LEADER]: Becoming Leader. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:24.950246  5781 consensus_queue.cc:237] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:24.957355  5366 catalog_manager.cc:5697] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 reported cstate change: term changed from 2 to 3, leader changed from eeab06617abc467585ce23fb92498eea (127.4.181.66) to 79826be02961412db821ebecdd7e04c9 (127.4.181.65). New cstate: current_term: 3 leader_uuid: "79826be02961412db821ebecdd7e04c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:24.992168  5788 raft_consensus.cc:993] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea: : Instructing follower 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:24.992611  5776 raft_consensus.cc:1081] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Signalling peer 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:24.994033  5470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11f55d2e6c1a4410bf4cbe687e775781"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:59720
I20260709 12:23:24.994513  5470 raft_consensus.cc:493] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:24.994812  5470 raft_consensus.cc:3060] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:24.999243  5470 raft_consensus.cc:515] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:25.000819  5470 leader_election.cc:290] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 2 election: Requested vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:25.001586  5544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f55d2e6c1a4410bf4cbe687e775781" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:25.001858  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f55d2e6c1a4410bf4cbe687e775781" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:25.002242  5544 raft_consensus.cc:3055] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:25.002357  5618 raft_consensus.cc:3060] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.002642  5544 raft_consensus.cc:740] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:25.003520  5544 consensus_queue.cc:260] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:25.004782  5544 raft_consensus.cc:3060] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.008687  5618 raft_consensus.cc:2468] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 2.
I20260709 12:23:25.009786  5433 leader_election.cc:304] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, 87d38bda1e1347119f89092460bd01ac; no voters: 
I20260709 12:23:25.010538  5781 raft_consensus.cc:2804] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:25.010967  5544 raft_consensus.cc:2468] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 2.
I20260709 12:23:25.011135  5781 raft_consensus.cc:697] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:25.012100  5781 consensus_queue.cc:237] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:25.019177  5366 catalog_manager.cc:5697] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 reported cstate change: term changed from 1 to 2, leader changed from eeab06617abc467585ce23fb92498eea (127.4.181.66) to 79826be02961412db821ebecdd7e04c9 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "79826be02961412db821ebecdd7e04c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.242300  5788 raft_consensus.cc:993] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea: : Instructing follower 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:25.242750  5788 raft_consensus.cc:1081] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Signalling peer 79826be02961412db821ebecdd7e04c9 to start an election
I20260709 12:23:25.244185  5470 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e020422e23c8423884a3351c23bc6c96"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
 from {username='slave'} at 127.0.0.1:59720
I20260709 12:23:25.244606  5470 raft_consensus.cc:493] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:25.244858  5470 raft_consensus.cc:3060] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.249516  5470 raft_consensus.cc:515] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:25.251124  5470 leader_election.cc:290] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 2 election: Requested vote from peers eeab06617abc467585ce23fb92498eea (127.4.181.66:38481), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:25.252046  5544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e020422e23c8423884a3351c23bc6c96" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:25.252043  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e020422e23c8423884a3351c23bc6c96" candidate_uuid: "79826be02961412db821ebecdd7e04c9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:25.252584  5544 raft_consensus.cc:3055] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:23:25.252595  5618 raft_consensus.cc:3060] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.252957  5544 raft_consensus.cc:740] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:25.253643  5544 consensus_queue.cc:260] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:25.254593  5544 raft_consensus.cc:3060] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:25.257143  5618 raft_consensus.cc:2468] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 2.
I20260709 12:23:25.258121  5433 leader_election.cc:304] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 79826be02961412db821ebecdd7e04c9, 87d38bda1e1347119f89092460bd01ac; no voters: 
I20260709 12:23:25.258944  5781 raft_consensus.cc:2804] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:25.259362  5781 raft_consensus.cc:697] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Becoming Leader. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:25.259754  5544 raft_consensus.cc:2468] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 79826be02961412db821ebecdd7e04c9 in term 2.
I20260709 12:23:25.260107  5781 consensus_queue.cc:237] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:25.266589  5366 catalog_manager.cc:5697] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 reported cstate change: term changed from 1 to 2, leader changed from eeab06617abc467585ce23fb92498eea (127.4.181.66) to 79826be02961412db821ebecdd7e04c9 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "79826be02961412db821ebecdd7e04c9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:25.317812  5544 raft_consensus.cc:1275] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 4 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:25.319115  5781 consensus_queue.cc:1048] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:25.328552  5618 raft_consensus.cc:1275] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 4 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:25.330013  5774 consensus_queue.cc:1048] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:25.387238  5618 raft_consensus.cc:1275] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 4 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:25.388449  5774 consensus_queue.cc:1048] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:25.396786  5544 raft_consensus.cc:1275] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 4 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:25.399698  5781 consensus_queue.cc:1048] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:25.458527  5544 raft_consensus.cc:1275] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:25.459913  5781 consensus_queue.cc:1048] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:25.463348  5543 raft_consensus.cc:1275] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:25.464506  5781 consensus_queue.cc:1048] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:25.469377  5618 raft_consensus.cc:1275] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:25.471897  5781 consensus_queue.cc:1048] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:25.477728  5619 raft_consensus.cc:1275] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:25.480593  5780 consensus_queue.cc:1048] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:25.777911  5619 raft_consensus.cc:1275] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:25.779224  5780 consensus_queue.cc:1048] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:25.787599  5543 raft_consensus.cc:1275] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Refusing update from remote peer 79826be02961412db821ebecdd7e04c9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:23:25.789870  5781 consensus_queue.cc:1048] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:27.694227  4821 auto_leader_rebalancer-test.cc:399] The leader distribution is 
I20260709 12:23:27.694980  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:27.701869  5470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "11f55d2e6c1a4410bf4cbe687e775781"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
mode: GRACEFUL
new_leader_uuid: "87d38bda1e1347119f89092460bd01ac"
 from {username='slave'} at 127.0.0.1:59746
I20260709 12:23:27.702278  5470 raft_consensus.cc:606] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Received request to transfer leadership to TS 87d38bda1e1347119f89092460bd01ac
I20260709 12:23:27.704365  5470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1a15633927704078875dbd47c7207763"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
mode: GRACEFUL
new_leader_uuid: "eeab06617abc467585ce23fb92498eea"
 from {username='slave'} at 127.0.0.1:59746
I20260709 12:23:27.704754  5470 raft_consensus.cc:606] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Received request to transfer leadership to TS eeab06617abc467585ce23fb92498eea
I20260709 12:23:27.706524  5470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
mode: GRACEFUL
new_leader_uuid: "eeab06617abc467585ce23fb92498eea"
 from {username='slave'} at 127.0.0.1:59746
I20260709 12:23:27.706883  5470 raft_consensus.cc:606] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 4 LEADER]: Received request to transfer leadership to TS eeab06617abc467585ce23fb92498eea
I20260709 12:23:27.708570  5470 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d"
dest_uuid: "79826be02961412db821ebecdd7e04c9"
mode: GRACEFUL
new_leader_uuid: "87d38bda1e1347119f89092460bd01ac"
 from {username='slave'} at 127.0.0.1:59746
I20260709 12:23:27.708949  5470 raft_consensus.cc:606] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 3 LEADER]: Received request to transfer leadership to TS 87d38bda1e1347119f89092460bd01ac
I20260709 12:23:27.709712  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:23:27.710103  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:27.715642  5781 raft_consensus.cc:993] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9: : Instructing follower eeab06617abc467585ce23fb92498eea to start an election
I20260709 12:23:27.716050  5780 raft_consensus.cc:1081] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Signalling peer eeab06617abc467585ce23fb92498eea to start an election
I20260709 12:23:27.717322  5543 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1a15633927704078875dbd47c7207763"
dest_uuid: "eeab06617abc467585ce23fb92498eea"
 from {username='slave'} at 127.0.0.1:55372
I20260709 12:23:27.717715  5543 raft_consensus.cc:493] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:27.717937  5543 raft_consensus.cc:3060] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.721935  5543 raft_consensus.cc:515] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:27.723789  5543 leader_election.cc:290] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 3 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:27.724666  5470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a15633927704078875dbd47c7207763" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:27.724733  5619 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1a15633927704078875dbd47c7207763" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:27.725351  5619 raft_consensus.cc:3060] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.725335  5470 raft_consensus.cc:3055] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:27.725826  5470 raft_consensus.cc:740] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:27.726629  5470 consensus_queue.cc:260] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:27.727779  5470 raft_consensus.cc:3060] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:27.731736  5619 raft_consensus.cc:2468] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 3.
I20260709 12:23:27.732980  5508 leader_election.cc:304] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:27.733951  5470 raft_consensus.cc:2468] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 3.
I20260709 12:23:27.734599  5807 raft_consensus.cc:2804] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:27.735558  5807 raft_consensus.cc:697] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 3 LEADER]: Becoming Leader. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:27.736316  5807 consensus_queue.cc:237] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:27.742849  5366 catalog_manager.cc:5697] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea reported cstate change: term changed from 2 to 3, leader changed from 79826be02961412db821ebecdd7e04c9 (127.4.181.65) to eeab06617abc467585ce23fb92498eea (127.4.181.66). New cstate: current_term: 3 leader_uuid: "eeab06617abc467585ce23fb92498eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.017789  5781 raft_consensus.cc:993] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9: : Instructing follower 87d38bda1e1347119f89092460bd01ac to start an election
I20260709 12:23:28.018213  5780 raft_consensus.cc:1081] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 3 LEADER]: Signalling peer 87d38bda1e1347119f89092460bd01ac to start an election
I20260709 12:23:28.019735  5619 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d"
dest_uuid: "87d38bda1e1347119f89092460bd01ac"
 from {username='slave'} at 127.0.0.1:51190
I20260709 12:23:28.020120  5619 raft_consensus.cc:493] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:28.020375  5619 raft_consensus.cc:3060] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:28.023945  5781 raft_consensus.cc:993] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9: : Instructing follower 87d38bda1e1347119f89092460bd01ac to start an election
I20260709 12:23:28.024364  5780 raft_consensus.cc:1081] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Signalling peer 87d38bda1e1347119f89092460bd01ac to start an election
I20260709 12:23:28.025679  5618 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "11f55d2e6c1a4410bf4cbe687e775781"
dest_uuid: "87d38bda1e1347119f89092460bd01ac"
 from {username='slave'} at 127.0.0.1:51190
I20260709 12:23:28.025770  5619 raft_consensus.cc:515] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:28.026098  5618 raft_consensus.cc:493] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:28.026384  5618 raft_consensus.cc:3060] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.027693  5619 leader_election.cc:290] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 4 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), eeab06617abc467585ce23fb92498eea (127.4.181.66:38481)
I20260709 12:23:28.028565  5543 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:28.029076  5543 raft_consensus.cc:3060] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:28.029065  5470 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d82eb1ccc08343928ef21d33b8133a5d" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:28.029635  5470 raft_consensus.cc:3055] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:23:28.029903  5470 raft_consensus.cc:740] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:28.030601  5470 consensus_queue.cc:260] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:28.031061  5618 raft_consensus.cc:515] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:28.031680  5470 raft_consensus.cc:3060] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:23:28.032410  5618 leader_election.cc:290] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 3 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), eeab06617abc467585ce23fb92498eea (127.4.181.66:38481)
I20260709 12:23:28.033473  5544 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f55d2e6c1a4410bf4cbe687e775781" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "eeab06617abc467585ce23fb92498eea"
I20260709 12:23:28.033509  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "11f55d2e6c1a4410bf4cbe687e775781" candidate_uuid: "87d38bda1e1347119f89092460bd01ac" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:28.034157  5544 raft_consensus.cc:3060] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.034252  5469 raft_consensus.cc:3055] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:23:28.034698  5469 raft_consensus.cc:740] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:28.035012  5543 raft_consensus.cc:2468] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87d38bda1e1347119f89092460bd01ac in term 4.
I20260709 12:23:28.035418  5469 consensus_queue.cc:260] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:28.036509  5469 raft_consensus.cc:3060] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:23:28.038542  5470 raft_consensus.cc:2468] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87d38bda1e1347119f89092460bd01ac in term 4.
I20260709 12:23:28.039045  5584 leader_election.cc:304] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:28.039268  5544 raft_consensus.cc:2468] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87d38bda1e1347119f89092460bd01ac in term 3.
I20260709 12:23:28.039871  5777 raft_consensus.cc:2804] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:23:28.041312  5584 leader_election.cc:304] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:28.041502  5777 raft_consensus.cc:697] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 4 LEADER]: Becoming Leader. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Running, Role: LEADER
I20260709 12:23:28.042115  5814 raft_consensus.cc:2804] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:23:28.042755  5469 raft_consensus.cc:2468] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 87d38bda1e1347119f89092460bd01ac in term 3.
I20260709 12:23:28.042526  5777 consensus_queue.cc:237] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:28.043630  5814 raft_consensus.cc:697] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 3 LEADER]: Becoming Leader. State: Replica: 87d38bda1e1347119f89092460bd01ac, State: Running, Role: LEADER
I20260709 12:23:28.044530  5814 consensus_queue.cc:237] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:28.051090  5366 catalog_manager.cc:5697] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac reported cstate change: term changed from 3 to 4, leader changed from 79826be02961412db821ebecdd7e04c9 (127.4.181.65) to 87d38bda1e1347119f89092460bd01ac (127.4.181.67). New cstate: current_term: 4 leader_uuid: "87d38bda1e1347119f89092460bd01ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:28.063201  5366 catalog_manager.cc:5697] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac reported cstate change: term changed from 2 to 3, leader changed from 79826be02961412db821ebecdd7e04c9 (127.4.181.65) to 87d38bda1e1347119f89092460bd01ac (127.4.181.67). New cstate: current_term: 3 leader_uuid: "87d38bda1e1347119f89092460bd01ac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:28.131700  5781 raft_consensus.cc:993] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9: : Instructing follower eeab06617abc467585ce23fb92498eea to start an election
I20260709 12:23:28.132210  5780 raft_consensus.cc:1081] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 4 LEADER]: Signalling peer eeab06617abc467585ce23fb92498eea to start an election
I20260709 12:23:28.133651  5544 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7"
dest_uuid: "eeab06617abc467585ce23fb92498eea"
 from {username='slave'} at 127.0.0.1:55372
I20260709 12:23:28.134245  5544 raft_consensus.cc:493] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:23:28.134615  5544 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:28.139519  5544 raft_consensus.cc:515] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:28.141408  5544 leader_election.cc:290] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 5 election: Requested vote from peers 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257), 87d38bda1e1347119f89092460bd01ac (127.4.181.67:39481)
I20260709 12:23:28.142158  5469 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "79826be02961412db821ebecdd7e04c9"
I20260709 12:23:28.142535  5618 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ab78cc54b6b643dfb8b1f5f1a0c546f7" candidate_uuid: "eeab06617abc467585ce23fb92498eea" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "87d38bda1e1347119f89092460bd01ac"
I20260709 12:23:28.142769  5469 raft_consensus.cc:3055] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:23:28.143059  5469 raft_consensus.cc:740] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 79826be02961412db821ebecdd7e04c9, State: Running, Role: LEADER
I20260709 12:23:28.143044  5618 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:28.143819  5469 consensus_queue.cc:260] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:28.144680  5469 raft_consensus.cc:3060] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:23:28.148290  5618 raft_consensus.cc:2468] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 5.
I20260709 12:23:28.148826  5469 raft_consensus.cc:2468] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eeab06617abc467585ce23fb92498eea in term 5.
I20260709 12:23:28.149478  5508 leader_election.cc:304] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87d38bda1e1347119f89092460bd01ac, eeab06617abc467585ce23fb92498eea; no voters: 
I20260709 12:23:28.150439  5807 raft_consensus.cc:2804] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:23:28.150868  5807 raft_consensus.cc:697] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 5 LEADER]: Becoming Leader. State: Replica: eeab06617abc467585ce23fb92498eea, State: Running, Role: LEADER
I20260709 12:23:28.151629  5807 consensus_queue.cc:237] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } }
I20260709 12:23:28.159255  5366 catalog_manager.cc:5697] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea reported cstate change: term changed from 4 to 5, leader changed from 79826be02961412db821ebecdd7e04c9 (127.4.181.65) to eeab06617abc467585ce23fb92498eea (127.4.181.66). New cstate: current_term: 5 leader_uuid: "eeab06617abc467585ce23fb92498eea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:28.164528  5618 raft_consensus.cc:1275] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Refusing update from remote peer eeab06617abc467585ce23fb92498eea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:28.165956  5807 consensus_queue.cc:1048] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:28.179440  5469 raft_consensus.cc:1275] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Refusing update from remote peer eeab06617abc467585ce23fb92498eea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:28.181290  5807 consensus_queue.cc:1048] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:28.434664  5544 raft_consensus.cc:1275] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 4 FOLLOWER]: Refusing update from remote peer 87d38bda1e1347119f89092460bd01ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:28.436007  5814 consensus_queue.cc:1048] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:28.443993  5469 raft_consensus.cc:1275] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 4 FOLLOWER]: Refusing update from remote peer 87d38bda1e1347119f89092460bd01ac: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:23:28.445386  5777 consensus_queue.cc:1048] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:28.498378  5469 raft_consensus.cc:1275] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Refusing update from remote peer 87d38bda1e1347119f89092460bd01ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:28.499750  5777 consensus_queue.cc:1048] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:28.508217  5544 raft_consensus.cc:1275] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Refusing update from remote peer 87d38bda1e1347119f89092460bd01ac: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:23:28.509846  5814 consensus_queue.cc:1048] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [LEADER]: Connected to new peer: Peer: permanent_uuid: "eeab06617abc467585ce23fb92498eea" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:28.543735  5619 raft_consensus.cc:1275] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 5 FOLLOWER]: Refusing update from remote peer eeab06617abc467585ce23fb92498eea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:23:28.544796  5807 consensus_queue.cc:1048] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "87d38bda1e1347119f89092460bd01ac" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39481 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:28.553341  5469 raft_consensus.cc:1275] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 5 FOLLOWER]: Refusing update from remote peer eeab06617abc467585ce23fb92498eea: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:23:28.554555  5808 consensus_queue.cc:1048] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [LEADER]: Connected to new peer: Peer: permanent_uuid: "79826be02961412db821ebecdd7e04c9" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:23:28.711304  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:28.717722  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:28.718149  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:29.719156  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:29.724613  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:29.725016  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:30.725885  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:30.732959  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:30.733453  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:31.734485  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:31.739823  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:31.740262  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:32.741135  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:32.746304  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:32.746762  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:33.747761  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:33.753651  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:33.754025  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:34.755025  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:34.761052  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:34.761528  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:35.762652  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:35.768828  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:35.769227  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:36.770103  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:23:36.775672  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:23:36.776095  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:23:37.808121  4821 auto_leader_rebalancer-test.cc:410] The leader distribution is 
I20260709 12:23:37.808617  4821 tablet_server.cc:179] TabletServer@127.4.181.65:0 shutting down...
I20260709 12:23:37.832501  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:37.833343  4821 tablet_replica.cc:333] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9: stopping tablet replica
I20260709 12:23:37.834044  4821 raft_consensus.cc:2243] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.834704  4821 raft_consensus.cc:2272] T d82eb1ccc08343928ef21d33b8133a5d P 79826be02961412db821ebecdd7e04c9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.837088  4821 tablet_replica.cc:333] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9: stopping tablet replica
I20260709 12:23:37.837634  4821 raft_consensus.cc:2243] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.838421  4821 raft_consensus.cc:2272] T e020422e23c8423884a3351c23bc6c96 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.840808  4821 tablet_replica.cc:333] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9: stopping tablet replica
I20260709 12:23:37.841547  4821 raft_consensus.cc:2243] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.841970  4821 raft_consensus.cc:2272] T 11f55d2e6c1a4410bf4cbe687e775781 P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.844018  4821 tablet_replica.cc:333] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9: stopping tablet replica
I20260709 12:23:37.844476  4821 raft_consensus.cc:2243] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.845189  4821 raft_consensus.cc:2272] T 63bf1bebff2041a6b95306b45a75100b P 79826be02961412db821ebecdd7e04c9 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.846971  4821 tablet_replica.cc:333] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9: stopping tablet replica
I20260709 12:23:37.847416  4821 raft_consensus.cc:2243] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.847781  4821 raft_consensus.cc:2272] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.849424  4821 tablet_replica.cc:333] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9: stopping tablet replica
I20260709 12:23:37.849845  4821 raft_consensus.cc:2243] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.850206  4821 raft_consensus.cc:2272] T 19e8d4efc27540009075832925e9c9ba P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.851778  4821 tablet_replica.cc:333] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9: stopping tablet replica
I20260709 12:23:37.852255  4821 raft_consensus.cc:2243] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.852622  4821 raft_consensus.cc:2272] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 79826be02961412db821ebecdd7e04c9 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.854246  4821 tablet_replica.cc:333] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9: stopping tablet replica
I20260709 12:23:37.854887  4821 raft_consensus.cc:2243] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.855319  4821 raft_consensus.cc:2272] T 1a15633927704078875dbd47c7207763 P 79826be02961412db821ebecdd7e04c9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.856923  4821 tablet_replica.cc:333] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9: stopping tablet replica
I20260709 12:23:37.857352  4821 raft_consensus.cc:2243] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.858089  4821 raft_consensus.cc:2272] T 64b93dd9a23f4e108a87e047e94e0dbc P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.859858  4821 tablet_replica.cc:333] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9: stopping tablet replica
I20260709 12:23:37.860255  4821 raft_consensus.cc:2243] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.860965  4821 raft_consensus.cc:2272] T 24c1040e22aa4b37a7d56d2a092acd05 P 79826be02961412db821ebecdd7e04c9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:23:37.872822  5583 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 2 similar messages]
W20260709 12:23:37.876457  5583 consensus_peers.cc:597] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac -> Peer 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257): Couldn't send request to peer 79826be02961412db821ebecdd7e04c9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.883720  4821 tablet_server.cc:196] TabletServer@127.4.181.65:0 shutdown complete.
I20260709 12:23:37.902947  4821 tablet_server.cc:179] TabletServer@127.4.181.66:0 shutting down...
W20260709 12:23:37.909341  5584 consensus_peers.cc:597] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac -> Peer eeab06617abc467585ce23fb92498eea (127.4.181.66:38481): Couldn't send request to peer eeab06617abc467585ce23fb92498eea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.925561  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:37.926167  4821 tablet_replica.cc:333] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea: stopping tablet replica
I20260709 12:23:37.926829  4821 raft_consensus.cc:2243] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.927297  4821 raft_consensus.cc:2272] T e020422e23c8423884a3351c23bc6c96 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.929042  4821 tablet_replica.cc:333] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea: stopping tablet replica
I20260709 12:23:37.929522  4821 raft_consensus.cc:2243] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.929944  4821 raft_consensus.cc:2272] T d82eb1ccc08343928ef21d33b8133a5d P eeab06617abc467585ce23fb92498eea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.931630  4821 tablet_replica.cc:333] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea: stopping tablet replica
I20260709 12:23:37.932077  4821 raft_consensus.cc:2243] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.932451  4821 raft_consensus.cc:2272] T 11f55d2e6c1a4410bf4cbe687e775781 P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.934453  4821 tablet_replica.cc:333] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea: stopping tablet replica
I20260709 12:23:37.935134  4821 raft_consensus.cc:2243] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.935483  4821 raft_consensus.cc:2272] T 64b93dd9a23f4e108a87e047e94e0dbc P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.936959  4821 tablet_replica.cc:333] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea: stopping tablet replica
I20260709 12:23:37.937394  4821 raft_consensus.cc:2243] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.937803  4821 raft_consensus.cc:2272] T 63bf1bebff2041a6b95306b45a75100b P eeab06617abc467585ce23fb92498eea [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.939307  4821 tablet_replica.cc:333] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea: stopping tablet replica
I20260709 12:23:37.939736  4821 raft_consensus.cc:2243] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.940100  4821 raft_consensus.cc:2272] T 19e8d4efc27540009075832925e9c9ba P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.941545  4821 tablet_replica.cc:333] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea: stopping tablet replica
I20260709 12:23:37.941936  4821 raft_consensus.cc:2243] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.942652  4821 raft_consensus.cc:2272] T 600bf30d4f6541ee8c1c8ac91c14e1ec P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.944232  4821 tablet_replica.cc:333] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea: stopping tablet replica
I20260709 12:23:37.944660  4821 raft_consensus.cc:2243] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.945292  4821 raft_consensus.cc:2272] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P eeab06617abc467585ce23fb92498eea [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.946930  4821 tablet_replica.cc:333] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea: stopping tablet replica
I20260709 12:23:37.947329  4821 raft_consensus.cc:2243] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:37.947952  4821 raft_consensus.cc:2272] T 1a15633927704078875dbd47c7207763 P eeab06617abc467585ce23fb92498eea [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.949455  4821 tablet_replica.cc:333] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea: stopping tablet replica
I20260709 12:23:37.949828  4821 raft_consensus.cc:2243] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:37.950169  4821 raft_consensus.cc:2272] T 24c1040e22aa4b37a7d56d2a092acd05 P eeab06617abc467585ce23fb92498eea [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:37.978116  4821 tablet_server.cc:196] TabletServer@127.4.181.66:0 shutdown complete.
W20260709 12:23:37.989084  5583 consensus_peers.cc:597] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac -> Peer 79826be02961412db821ebecdd7e04c9 (127.4.181.65:37257): Couldn't send request to peer 79826be02961412db821ebecdd7e04c9. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:37257: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:37.998214  4821 tablet_server.cc:179] TabletServer@127.4.181.67:0 shutting down...
I20260709 12:23:38.024056  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:23:38.024710  4821 tablet_replica.cc:333] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac: stopping tablet replica
I20260709 12:23:38.025301  4821 raft_consensus.cc:2243] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:23:38.026064  4821 raft_consensus.cc:2272] T d82eb1ccc08343928ef21d33b8133a5d P 87d38bda1e1347119f89092460bd01ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.027859  4821 tablet_replica.cc:333] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac: stopping tablet replica
I20260709 12:23:38.028337  4821 raft_consensus.cc:2243] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.028764  4821 raft_consensus.cc:2272] T e020422e23c8423884a3351c23bc6c96 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.030400  4821 tablet_replica.cc:333] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac: stopping tablet replica
I20260709 12:23:38.030939  4821 raft_consensus.cc:2243] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.031319  4821 raft_consensus.cc:2272] T 24c1040e22aa4b37a7d56d2a092acd05 P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.032755  4821 tablet_replica.cc:333] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac: stopping tablet replica
I20260709 12:23:38.033195  4821 raft_consensus.cc:2243] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:23:38.033870  4821 raft_consensus.cc:2272] T 11f55d2e6c1a4410bf4cbe687e775781 P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.035527  4821 tablet_replica.cc:333] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac: stopping tablet replica
I20260709 12:23:38.035992  4821 raft_consensus.cc:2243] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.036377  4821 raft_consensus.cc:2272] T 64b93dd9a23f4e108a87e047e94e0dbc P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.037827  4821 tablet_replica.cc:333] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac: stopping tablet replica
I20260709 12:23:38.038264  4821 raft_consensus.cc:2243] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:23:38.038995  4821 raft_consensus.cc:2272] T 19e8d4efc27540009075832925e9c9ba P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.040663  4821 tablet_replica.cc:333] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac: stopping tablet replica
I20260709 12:23:38.041103  4821 raft_consensus.cc:2243] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.041471  4821 raft_consensus.cc:2272] T 600bf30d4f6541ee8c1c8ac91c14e1ec P 87d38bda1e1347119f89092460bd01ac [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.043079  4821 tablet_replica.cc:333] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac: stopping tablet replica
I20260709 12:23:38.043514  4821 raft_consensus.cc:2243] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.043921  4821 raft_consensus.cc:2272] T 1a15633927704078875dbd47c7207763 P 87d38bda1e1347119f89092460bd01ac [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.045430  4821 tablet_replica.cc:333] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac: stopping tablet replica
I20260709 12:23:38.045876  4821 raft_consensus.cc:2243] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.046274  4821 raft_consensus.cc:2272] T ab78cc54b6b643dfb8b1f5f1a0c546f7 P 87d38bda1e1347119f89092460bd01ac [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.047914  4821 tablet_replica.cc:333] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac: stopping tablet replica
I20260709 12:23:38.048328  4821 raft_consensus.cc:2243] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:38.048717  4821 raft_consensus.cc:2272] T 63bf1bebff2041a6b95306b45a75100b P 87d38bda1e1347119f89092460bd01ac [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.079505  4821 tablet_server.cc:196] TabletServer@127.4.181.67:0 shutdown complete.
I20260709 12:23:38.101052  4821 master.cc:562] Master@127.4.181.126:36569 shutting down...
I20260709 12:23:38.126978  4821 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:23:38.127527  4821 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:38.127858  4821 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5ab0048187fe465dbbb26b602056aba4: stopping tablet replica
I20260709 12:23:38.148149  4821 master.cc:584] Master@127.4.181.126:36569 shutdown complete.
79826be02961412db821ebecdd7e04c9  5
87d38bda1e1347119f89092460bd01ac  1
eeab06617abc467585ce23fb92498eea  4
79826be02961412db821ebecdd7e04c9  3
87d38bda1e1347119f89092460bd01ac  3
eeab06617abc467585ce23fb92498eea  4
79826be02961412db821ebecdd7e04c9  8
87d38bda1e1347119f89092460bd01ac  1
eeab06617abc467585ce23fb92498eea  1
79826be02961412db821ebecdd7e04c9  4
87d38bda1e1347119f89092460bd01ac  3
eeab06617abc467585ce23fb92498eea  3
[       OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28638 ms)
[ RUN      ] LeaderRebalancerTest.AddTserver
I20260709 12:23:38.196281  4821 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.181.126:41341
I20260709 12:23:38.197369  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:38.202921  5841 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:38.203091  5842 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:38.205022  5844 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:38.205807  4821 server_base.cc:1061] running on GCE node
I20260709 12:23:38.207042  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:38.207243  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:38.207403  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783599818207388 us; error 0 us; skew 500 ppm
I20260709 12:23:38.207921  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:38.210412  4821 webserver.cc:533] Webserver started at http://127.4.181.126:34543/ using document root <none> and password file <none>
I20260709 12:23:38.211218  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:38.211380  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:38.211614  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:38.212781  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/master-0-root/instance:
uuid: "5def43035e3245068dbad43bca95206c"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-k014"
I20260709 12:23:38.217548  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:23:38.221311  5849 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.222113  4821 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.000s
I20260709 12:23:38.222388  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/master-0-root
uuid: "5def43035e3245068dbad43bca95206c"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-k014"
I20260709 12:23:38.222689  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:38.239720  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:38.241113  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:38.283134  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.126:41341
I20260709 12:23:38.283275  5900 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.126:41341 every 8 connection(s)
I20260709 12:23:38.287040  5901 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:38.296896  5901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Bootstrap starting.
I20260709 12:23:38.302232  5901 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:38.307228  5901 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: No bootstrap required, opened a new log
I20260709 12:23:38.309478  5901 raft_consensus.cc:359] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5def43035e3245068dbad43bca95206c" member_type: VOTER }
I20260709 12:23:38.309917  5901 raft_consensus.cc:385] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:38.310158  5901 raft_consensus.cc:740] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5def43035e3245068dbad43bca95206c, State: Initialized, Role: FOLLOWER
I20260709 12:23:38.310719  5901 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5def43035e3245068dbad43bca95206c" member_type: VOTER }
I20260709 12:23:38.311161  5901 raft_consensus.cc:399] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:23:38.311394  5901 raft_consensus.cc:493] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:23:38.311714  5901 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:38.316322  5901 raft_consensus.cc:515] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5def43035e3245068dbad43bca95206c" member_type: VOTER }
I20260709 12:23:38.316874  5901 leader_election.cc:304] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5def43035e3245068dbad43bca95206c; no voters: 
I20260709 12:23:38.318008  5901 leader_election.cc:290] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:23:38.318424  5904 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:38.319770  5904 raft_consensus.cc:697] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [term 1 LEADER]: Becoming Leader. State: Replica: 5def43035e3245068dbad43bca95206c, State: Running, Role: LEADER
I20260709 12:23:38.320495  5904 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5def43035e3245068dbad43bca95206c" member_type: VOTER }
I20260709 12:23:38.320832  5901 sys_catalog.cc:565] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:23:38.323675  5906 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5def43035e3245068dbad43bca95206c. Latest consensus state: current_term: 1 leader_uuid: "5def43035e3245068dbad43bca95206c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5def43035e3245068dbad43bca95206c" member_type: VOTER } }
I20260709 12:23:38.324326  5906 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:38.323571  5905 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5def43035e3245068dbad43bca95206c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5def43035e3245068dbad43bca95206c" member_type: VOTER } }
I20260709 12:23:38.325166  5905 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [sys.catalog]: This master's current role is: LEADER
I20260709 12:23:38.327875  5910 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:23:38.333163  5910 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:23:38.335955  4821 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:23:38.342952  5910 catalog_manager.cc:1383] Generated new cluster ID: 4c81dc7e99f748d4a82c82d82bb8b13a
I20260709 12:23:38.343267  5910 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:23:38.392082  5910 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:23:38.393366  5910 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:23:38.410656  5910 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Generated new TSK 0
I20260709 12:23:38.411382  5910 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:23:38.470115  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:38.476349  5922 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:38.477075  5923 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:38.478634  5925 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:38.479271  4821 server_base.cc:1061] running on GCE node
I20260709 12:23:38.480116  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:38.480302  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:38.480456  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783599818480436 us; error 0 us; skew 500 ppm
I20260709 12:23:38.480948  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:38.483304  4821 webserver.cc:533] Webserver started at http://127.4.181.65:40725/ using document root <none> and password file <none>
I20260709 12:23:38.483740  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:38.483909  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:38.484176  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:38.485216  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/instance:
uuid: "f1bb8e63c2b448cdafd51f05d277c741"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-k014"
I20260709 12:23:38.489723  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.003s
I20260709 12:23:38.493112  5930 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.493837  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:38.494127  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root
uuid: "f1bb8e63c2b448cdafd51f05d277c741"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-k014"
I20260709 12:23:38.494406  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:38.511010  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:38.512312  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:38.513988  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:38.516316  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:38.516497  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.516686  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:38.516824  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.555076  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.65:42981
I20260709 12:23:38.555169  5992 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.65:42981 every 8 connection(s)
I20260709 12:23:38.559571  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:38.566980  5997 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:38.569618  5998 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:38.572325  4821 server_base.cc:1061] running on GCE node
W20260709 12:23:38.572417  6000 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:38.573828  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:38.574028  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:38.574225  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783599818574205 us; error 0 us; skew 500 ppm
I20260709 12:23:38.574764  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:38.577291  5993 heartbeater.cc:344] Connected to a master server at 127.4.181.126:41341
I20260709 12:23:38.577414  4821 webserver.cc:533] Webserver started at http://127.4.181.66:36075/ using document root <none> and password file <none>
I20260709 12:23:38.577658  5993 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:38.577957  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:38.578181  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:38.578420  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:38.578426  5993 heartbeater.cc:507] Master 127.4.181.126:41341 requested a full tablet report, sending...
I20260709 12:23:38.579871  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/instance:
uuid: "0557a7246c8945b99e5215c99d4ddf9c"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-k014"
I20260709 12:23:38.580581  5866 ts_manager.cc:194] Registered new tserver with Master: f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:23:38.582238  5866 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59632
I20260709 12:23:38.584422  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:23:38.587723  6005 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.588400  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:23:38.588657  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root
uuid: "0557a7246c8945b99e5215c99d4ddf9c"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-k014"
I20260709 12:23:38.588912  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:38.601186  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:38.602358  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:38.603789  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:38.605861  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:38.606047  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.606266  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:38.606410  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.668645  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.66:45473
I20260709 12:23:38.668753  6068 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.66:45473 every 8 connection(s)
I20260709 12:23:38.675151  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:38.683627  6072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:38.684831  6073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:38.687659  4821 server_base.cc:1061] running on GCE node
W20260709 12:23:38.688189  6075 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:38.689180  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:38.689455  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:38.689384  6069 heartbeater.cc:344] Connected to a master server at 127.4.181.126:41341
I20260709 12:23:38.689787  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783599818689767 us; error 0 us; skew 500 ppm
I20260709 12:23:38.689906  6069 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:38.690364  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:38.690717  6069 heartbeater.cc:507] Master 127.4.181.126:41341 requested a full tablet report, sending...
I20260709 12:23:38.693297  4821 webserver.cc:533] Webserver started at http://127.4.181.67:45667/ using document root <none> and password file <none>
I20260709 12:23:38.693293  5866 ts_manager.cc:194] Registered new tserver with Master: 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:38.693980  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:38.694232  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:38.694578  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:38.695250  5866 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59640
I20260709 12:23:38.696102  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/instance:
uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-k014"
I20260709 12:23:38.701253  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:23:38.704624  6080 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.705493  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:23:38.705802  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root
uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
format_stamp: "Formatted at 2026-07-09 12:23:38 on dist-test-slave-k014"
I20260709 12:23:38.706075  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:38.732157  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:38.733472  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:38.734814  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:38.737133  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:38.737346  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.737576  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:38.737747  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:38.778391  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.67:39787
I20260709 12:23:38.778523  6142 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.67:39787 every 8 connection(s)
I20260709 12:23:38.793035  6143 heartbeater.cc:344] Connected to a master server at 127.4.181.126:41341
I20260709 12:23:38.793390  6143 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:38.794112  6143 heartbeater.cc:507] Master 127.4.181.126:41341 requested a full tablet report, sending...
I20260709 12:23:38.796083  5866 ts_manager.cc:194] Registered new tserver with Master: 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:38.796274  4821 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014738481s
I20260709 12:23:38.797528  5866 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:59648
I20260709 12:23:38.823951  5866 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:59656:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:23:38.830682  5866 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:23:39.036604  6108 tablet_service.cc:1511] Processing CreateTablet for tablet 4783d1a7790a4be2a959bd61e6f21947 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:39.038439  5958 tablet_service.cc:1511] Processing CreateTablet for tablet 4783d1a7790a4be2a959bd61e6f21947 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:39.039685  5957 tablet_service.cc:1511] Processing CreateTablet for tablet c357e710ee044329b93321405ae76071 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:39.040206  5958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4783d1a7790a4be2a959bd61e6f21947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.039824  6107 tablet_service.cc:1511] Processing CreateTablet for tablet c357e710ee044329b93321405ae76071 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:39.041703  5956 tablet_service.cc:1511] Processing CreateTablet for tablet c087bb99e3b64274863f583bf7ae435f (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:39.042492  6106 tablet_service.cc:1511] Processing CreateTablet for tablet c087bb99e3b64274863f583bf7ae435f (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:39.043252  5956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c087bb99e3b64274863f583bf7ae435f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.045115  6105 tablet_service.cc:1511] Processing CreateTablet for tablet 39cca9184e5b4b468627eb290d029f68 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:39.045389  5955 tablet_service.cc:1511] Processing CreateTablet for tablet 39cca9184e5b4b468627eb290d029f68 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:39.046768  5955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cca9184e5b4b468627eb290d029f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.047833  6104 tablet_service.cc:1511] Processing CreateTablet for tablet cf28639931bb43a58703f0afd043e166 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:39.050181  6103 tablet_service.cc:1511] Processing CreateTablet for tablet 1d97a0d1272049469a8fe2111554686a (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:39.051683  5954 tablet_service.cc:1511] Processing CreateTablet for tablet cf28639931bb43a58703f0afd043e166 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:39.052531  6102 tablet_service.cc:1511] Processing CreateTablet for tablet 68476262e38a4c15a51c80b96e7d58a6 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:39.053061  5954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf28639931bb43a58703f0afd043e166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.056887  6108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4783d1a7790a4be2a959bd61e6f21947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.057653  6106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c087bb99e3b64274863f583bf7ae435f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.057711  5952 tablet_service.cc:1511] Processing CreateTablet for tablet 68476262e38a4c15a51c80b96e7d58a6 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:39.059226  6105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cca9184e5b4b468627eb290d029f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.059894  6107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c357e710ee044329b93321405ae76071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.059798  5953 tablet_service.cc:1511] Processing CreateTablet for tablet 1d97a0d1272049469a8fe2111554686a (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:39.060549  6103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d97a0d1272049469a8fe2111554686a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.061138  6102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68476262e38a4c15a51c80b96e7d58a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.061733  6104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf28639931bb43a58703f0afd043e166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.059177  5952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68476262e38a4c15a51c80b96e7d58a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.066668  6032 tablet_service.cc:1511] Processing CreateTablet for tablet c357e710ee044329b93321405ae76071 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:23:39.068174  6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c357e710ee044329b93321405ae76071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.067919  6033 tablet_service.cc:1511] Processing CreateTablet for tablet 4783d1a7790a4be2a959bd61e6f21947 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:23:39.069362  6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4783d1a7790a4be2a959bd61e6f21947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.071520  6031 tablet_service.cc:1511] Processing CreateTablet for tablet c087bb99e3b64274863f583bf7ae435f (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:23:39.071791  5951 tablet_service.cc:1511] Processing CreateTablet for tablet b46c3c3bcf5c4016bb6bab0051ff3094 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:39.073140  5951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b46c3c3bcf5c4016bb6bab0051ff3094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.073872  6030 tablet_service.cc:1511] Processing CreateTablet for tablet 39cca9184e5b4b468627eb290d029f68 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:23:39.075625  6101 tablet_service.cc:1511] Processing CreateTablet for tablet b46c3c3bcf5c4016bb6bab0051ff3094 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:39.077030  6101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b46c3c3bcf5c4016bb6bab0051ff3094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.077147  6029 tablet_service.cc:1511] Processing CreateTablet for tablet cf28639931bb43a58703f0afd043e166 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:23:39.079784  6028 tablet_service.cc:1511] Processing CreateTablet for tablet 1d97a0d1272049469a8fe2111554686a (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:23:39.081691  5950 tablet_service.cc:1511] Processing CreateTablet for tablet e3ef3cb064eb4a1597f89e040fce3c7e (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:39.082320  6027 tablet_service.cc:1511] Processing CreateTablet for tablet 68476262e38a4c15a51c80b96e7d58a6 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:23:39.083173  5950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ef3cb064eb4a1597f89e040fce3c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.083624  6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf28639931bb43a58703f0afd043e166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.083926  6100 tablet_service.cc:1511] Processing CreateTablet for tablet e3ef3cb064eb4a1597f89e040fce3c7e (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:39.085930  5953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d97a0d1272049469a8fe2111554686a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.087370  5949 tablet_service.cc:1511] Processing CreateTablet for tablet afdcf44718954edea3bd3aa8ada58035 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:39.088773  5957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c357e710ee044329b93321405ae76071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.089697  6099 tablet_service.cc:1511] Processing CreateTablet for tablet afdcf44718954edea3bd3aa8ada58035 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:39.091250  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afdcf44718954edea3bd3aa8ada58035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.096560  6099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afdcf44718954edea3bd3aa8ada58035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.100858  6026 tablet_service.cc:1511] Processing CreateTablet for tablet b46c3c3bcf5c4016bb6bab0051ff3094 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:23:39.102356  6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b46c3c3bcf5c4016bb6bab0051ff3094. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.109768  6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39cca9184e5b4b468627eb290d029f68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.114996  6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c087bb99e3b64274863f583bf7ae435f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.116662  6025 tablet_service.cc:1511] Processing CreateTablet for tablet e3ef3cb064eb4a1597f89e040fce3c7e (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:23:39.118515  6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ef3cb064eb4a1597f89e040fce3c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.119135  6100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ef3cb064eb4a1597f89e040fce3c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.122148  6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 68476262e38a4c15a51c80b96e7d58a6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.127012  6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d97a0d1272049469a8fe2111554686a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.129081  6024 tablet_service.cc:1511] Processing CreateTablet for tablet afdcf44718954edea3bd3aa8ada58035 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:23:39.130630  6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afdcf44718954edea3bd3aa8ada58035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.202574  6159 tablet_bootstrap.cc:492] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:39.222132  5955 tablet_service.cc:1511] Processing CreateTablet for tablet 07996c0296b04a39b1b151e8885389e2 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:39.223505  5955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07996c0296b04a39b1b151e8885389e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.246028  6108 tablet_service.cc:1511] Processing CreateTablet for tablet 38df61ba407240499023581d9f885037 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:39.247619  6108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38df61ba407240499023581d9f885037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.266587  6100 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2d24cb0978411e851e8ff35955bf2e (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:39.268190  6100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2d24cb0978411e851e8ff35955bf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.269387  5951 tablet_service.cc:1511] Processing CreateTablet for tablet 38df61ba407240499023581d9f885037 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:39.272171  6159 tablet_bootstrap.cc:654] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.276345  6105 tablet_service.cc:1511] Processing CreateTablet for tablet b1c2c76afb3f4fb2911e84592dd6b52b (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:39.277694  6105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c2c76afb3f4fb2911e84592dd6b52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.279700  6103 tablet_service.cc:1511] Processing CreateTablet for tablet a0b00ef9114f441baff2557bc164b4d7 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:39.281023  6103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b00ef9114f441baff2557bc164b4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.258131  6101 tablet_service.cc:1511] Processing CreateTablet for tablet 07996c0296b04a39b1b151e8885389e2 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:39.245745  6032 tablet_service.cc:1511] Processing CreateTablet for tablet 38df61ba407240499023581d9f885037 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:23:39.283489  6101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07996c0296b04a39b1b151e8885389e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.283720  6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38df61ba407240499023581d9f885037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.262161  6099 tablet_service.cc:1511] Processing CreateTablet for tablet 6b70d6df693140769deef828413df1ba (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:39.287457  6099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b70d6df693140769deef828413df1ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.292488  5953 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2d24cb0978411e851e8ff35955bf2e (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:39.294013  5953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2d24cb0978411e851e8ff35955bf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.295746  6024 tablet_service.cc:1511] Processing CreateTablet for tablet 07996c0296b04a39b1b151e8885389e2 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:23:39.297209  6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07996c0296b04a39b1b151e8885389e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.300231  6028 tablet_service.cc:1511] Processing CreateTablet for tablet 6b70d6df693140769deef828413df1ba (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:39.300961  5957 tablet_service.cc:1511] Processing CreateTablet for tablet b1c2c76afb3f4fb2911e84592dd6b52b (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:39.302234  5957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c2c76afb3f4fb2911e84592dd6b52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.306929  5951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38df61ba407240499023581d9f885037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.310645  6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b70d6df693140769deef828413df1ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.312850  6025 tablet_service.cc:1511] Processing CreateTablet for tablet b1c2c76afb3f4fb2911e84592dd6b52b (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:23:39.313387  6030 tablet_service.cc:1511] Processing CreateTablet for tablet 4f2d24cb0978411e851e8ff35955bf2e (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:23:39.322804  6029 tablet_service.cc:1511] Processing CreateTablet for tablet d7b7660ead3b4a4da081b0199f44037f (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:39.327536  5956 tablet_service.cc:1511] Processing CreateTablet for tablet 6b70d6df693140769deef828413df1ba (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:23:39.328862  5956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b70d6df693140769deef828413df1ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.327402  6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1c2c76afb3f4fb2911e84592dd6b52b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.330914  6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2d24cb0978411e851e8ff35955bf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.331491  6107 tablet_service.cc:1511] Processing CreateTablet for tablet d7b7660ead3b4a4da081b0199f44037f (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
W20260709 12:23:39.331869  5914 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:39.332508  6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7b7660ead3b4a4da081b0199f44037f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.332692  6107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7b7660ead3b4a4da081b0199f44037f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.333141  6027 tablet_service.cc:1511] Processing CreateTablet for tablet a0b00ef9114f441baff2557bc164b4d7 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:39.334334  6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b00ef9114f441baff2557bc164b4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.337808  5950 tablet_service.cc:1511] Processing CreateTablet for tablet a0b00ef9114f441baff2557bc164b4d7 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:23:39.339134  5950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b00ef9114f441baff2557bc164b4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.343529  5958 tablet_service.cc:1511] Processing CreateTablet for tablet d7b7660ead3b4a4da081b0199f44037f (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:23:39.344866  5958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7b7660ead3b4a4da081b0199f44037f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.349524  5949 tablet_service.cc:1511] Processing CreateTablet for tablet 0636290fb57e4842995ddf9549f0c721 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:39.350265  6031 tablet_service.cc:1511] Processing CreateTablet for tablet 0636290fb57e4842995ddf9549f0c721 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:39.350827  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0636290fb57e4842995ddf9549f0c721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.359254  6160 tablet_bootstrap.cc:492] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:39.363250  6158 tablet_bootstrap.cc:492] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:39.363878  6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0636290fb57e4842995ddf9549f0c721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.365496  6160 tablet_bootstrap.cc:654] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.393452  5951 tablet_service.cc:1511] Processing CreateTablet for tablet d24ea63f22cb4977ad36707d9d0fffea (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:39.394799  5951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24ea63f22cb4977ad36707d9d0fffea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.396874  6099 tablet_service.cc:1511] Processing CreateTablet for tablet 0636290fb57e4842995ddf9549f0c721 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:23:39.406759  6102 tablet_service.cc:1511] Processing CreateTablet for tablet d24ea63f22cb4977ad36707d9d0fffea (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:39.407815  5952 tablet_service.cc:1511] Processing CreateTablet for tablet 0ad617c44395493f82e992b73a4295ad (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:39.409230  5952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ad617c44395493f82e992b73a4295ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.429498  6099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0636290fb57e4842995ddf9549f0c721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.429942  6159 tablet_bootstrap.cc:492] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:39.430505  6159 ts_tablet_manager.cc:1403] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.228s	user 0.009s	sys 0.014s
I20260709 12:23:39.430994  6102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24ea63f22cb4977ad36707d9d0fffea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.433030  6159 raft_consensus.cc:359] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:39.433758  6159 raft_consensus.cc:385] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.434072  6159 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.437989  6100 tablet_service.cc:1511] Processing CreateTablet for tablet 0ad617c44395493f82e992b73a4295ad (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:39.439280  6100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ad617c44395493f82e992b73a4295ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.439419  6029 tablet_service.cc:1511] Processing CreateTablet for tablet 0ad617c44395493f82e992b73a4295ad (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:23:39.440675  6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ad617c44395493f82e992b73a4295ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.447463  6030 tablet_service.cc:1511] Processing CreateTablet for tablet d24ea63f22cb4977ad36707d9d0fffea (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:23:39.448869  6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24ea63f22cb4977ad36707d9d0fffea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.434892  6159 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:39.453361  6158 tablet_bootstrap.cc:654] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.466450  5953 tablet_service.cc:1511] Processing CreateTablet for tablet bc02451d94184328a520860e40f6b77c (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:39.466727  6024 tablet_service.cc:1511] Processing CreateTablet for tablet bc02451d94184328a520860e40f6b77c (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:39.467818  5953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc02451d94184328a520860e40f6b77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.468024  6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc02451d94184328a520860e40f6b77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.470008  5955 tablet_service.cc:1511] Processing CreateTablet for tablet ba1e2d6430774a629131a0953161507b (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:39.471268  5955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1e2d6430774a629131a0953161507b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.481331  6027 tablet_service.cc:1511] Processing CreateTablet for tablet ba1e2d6430774a629131a0953161507b (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:39.483448  6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1e2d6430774a629131a0953161507b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.484251  5951 tablet_service.cc:1511] Processing CreateTablet for tablet 1c1322bdafce4b389254f08a59254d2e (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:39.485637  5951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c1322bdafce4b389254f08a59254d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.485435  6028 tablet_service.cc:1511] Processing CreateTablet for tablet 1c1322bdafce4b389254f08a59254d2e (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:39.486878  6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c1322bdafce4b389254f08a59254d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.511656  6143 heartbeater.cc:499] Master 127.4.181.126:41341 was elected leader, sending a full tablet report...
I20260709 12:23:39.512293  5957 tablet_service.cc:1511] Processing CreateTablet for tablet 117509103bb449868a97cf0ba4fdda89 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:39.513311  5957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117509103bb449868a97cf0ba4fdda89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.515231  6105 tablet_service.cc:1511] Processing CreateTablet for tablet ba1e2d6430774a629131a0953161507b (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:23:39.516165  6105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1e2d6430774a629131a0953161507b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.518877  6108 tablet_service.cc:1511] Processing CreateTablet for tablet bc02451d94184328a520860e40f6b77c (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:23:39.519585  6107 tablet_service.cc:1511] Processing CreateTablet for tablet 1c1322bdafce4b389254f08a59254d2e (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:23:39.520078  6108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc02451d94184328a520860e40f6b77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.520870  6107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1c1322bdafce4b389254f08a59254d2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.524528  6163 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.522131  6031 tablet_service.cc:1511] Processing CreateTablet for tablet 117509103bb449868a97cf0ba4fdda89 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:39.525101  6163 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:39.526252  6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117509103bb449868a97cf0ba4fdda89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.527817  6163 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:39.541846  6160 tablet_bootstrap.cc:492] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:39.542366  6160 ts_tablet_manager.cc:1403] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.183s	user 0.036s	sys 0.014s
I20260709 12:23:39.542176  5952 tablet_service.cc:1511] Processing CreateTablet for tablet 5744a277c5a3409b95831573168daf3f (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:39.543444  5952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5744a277c5a3409b95831573168daf3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.545092  6160 raft_consensus.cc:359] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:39.546300  6160 raft_consensus.cc:385] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.546679  6159 ts_tablet_manager.cc:1434] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.116s	user 0.007s	sys 0.016s
I20260709 12:23:39.546617  6160 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.547751  6160 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:39.565553  5956 tablet_service.cc:1511] Processing CreateTablet for tablet 81efabae1bb448e3a8483e6231673c10 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:39.566967  5956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81efabae1bb448e3a8483e6231673c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.568883  5950 tablet_service.cc:1511] Processing CreateTablet for tablet aa90f801f44d4669a2a93aafa33e4e17 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:39.570178  5950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa90f801f44d4669a2a93aafa33e4e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.572023  6032 tablet_service.cc:1511] Processing CreateTablet for tablet 81efabae1bb448e3a8483e6231673c10 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:39.572984  6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81efabae1bb448e3a8483e6231673c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.581717  6025 tablet_service.cc:1511] Processing CreateTablet for tablet aa90f801f44d4669a2a93aafa33e4e17 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:39.583155  6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa90f801f44d4669a2a93aafa33e4e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.583873  6158 tablet_bootstrap.cc:492] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:39.584535  6158 ts_tablet_manager.cc:1403] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.222s	user 0.010s	sys 0.005s
I20260709 12:23:39.585122  5993 heartbeater.cc:499] Master 127.4.181.126:41341 was elected leader, sending a full tablet report...
I20260709 12:23:39.587517  6158 raft_consensus.cc:359] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } }
I20260709 12:23:39.591598  6030 tablet_service.cc:1511] Processing CreateTablet for tablet 5744a277c5a3409b95831573168daf3f (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:39.639365  6158 raft_consensus.cc:385] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.639772  6158 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.639962  6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5744a277c5a3409b95831573168daf3f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.583499  6029 tablet_service.cc:1511] Processing CreateTablet for tablet 4a03c10b4bbc407ebfd96681074ae05b (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:39.642611  6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a03c10b4bbc407ebfd96681074ae05b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.642987  6032 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff337cd5a364d1c9100f9a31dd826f7 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:39.644202  6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff337cd5a364d1c9100f9a31dd826f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.593312  5958 tablet_service.cc:1511] Processing CreateTablet for tablet d0a77cc9656a4b88bc262752ad91e486 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:39.594271  6026 tablet_service.cc:1511] Processing CreateTablet for tablet d0a77cc9656a4b88bc262752ad91e486 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:39.650239  6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a77cc9656a4b88bc262752ad91e486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.600097  6033 tablet_service.cc:1511] Processing CreateTablet for tablet b1b3ddf896ce40f5b9c2632735843215 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:39.652978  6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b3ddf896ce40f5b9c2632735843215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.659204  5958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a77cc9656a4b88bc262752ad91e486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.661504  6024 tablet_service.cc:1511] Processing CreateTablet for tablet 0468d70863214876bf59fb3ea9474307 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:39.662912  6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0468d70863214876bf59fb3ea9474307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.605589  5953 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff337cd5a364d1c9100f9a31dd826f7 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:39.678362  5953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff337cd5a364d1c9100f9a31dd826f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.611186  5955 tablet_service.cc:1511] Processing CreateTablet for tablet b1b3ddf896ce40f5b9c2632735843215 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:39.615154  5950 tablet_service.cc:1511] Processing CreateTablet for tablet cbdceec3ce444e7b812ac717eafb85ee (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:39.620003  6069 heartbeater.cc:499] Master 127.4.181.126:41341 was elected leader, sending a full tablet report...
I20260709 12:23:39.684211  6028 tablet_service.cc:1511] Processing CreateTablet for tablet 465414d7b00f409684b7f69cfbcfad77 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:39.623342  5949 tablet_service.cc:1511] Processing CreateTablet for tablet 0468d70863214876bf59fb3ea9474307 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:39.686795  5955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b3ddf896ce40f5b9c2632735843215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.688228  5950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbdceec3ce444e7b812ac717eafb85ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.689121  6107 tablet_service.cc:1511] Processing CreateTablet for tablet 0468d70863214876bf59fb3ea9474307 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:23:39.629488  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:39.690557  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0468d70863214876bf59fb3ea9474307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.688022  6027 tablet_service.cc:1511] Processing CreateTablet for tablet a0acc59e2e4d43029c959c64a291c5a0 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:39.631762  6101 tablet_service.cc:1511] Processing CreateTablet for tablet aa90f801f44d4669a2a93aafa33e4e17 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:23:39.696656  6101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa90f801f44d4669a2a93aafa33e4e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.632557  6102 tablet_service.cc:1511] Processing CreateTablet for tablet 81efabae1bb448e3a8483e6231673c10 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:23:39.699210  6102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81efabae1bb448e3a8483e6231673c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.633710  6104 tablet_service.cc:1511] Processing CreateTablet for tablet d0a77cc9656a4b88bc262752ad91e486 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:23:39.701066  6104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a77cc9656a4b88bc262752ad91e486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.635648  6103 tablet_service.cc:1511] Processing CreateTablet for tablet b1b3ddf896ce40f5b9c2632735843215 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:23:39.635946  6106 tablet_service.cc:1511] Processing CreateTablet for tablet 8ff337cd5a364d1c9100f9a31dd826f7 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:23:39.637524  6160 ts_tablet_manager.cc:1434] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.095s	user 0.015s	sys 0.011s
I20260709 12:23:39.707254  6103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b3ddf896ce40f5b9c2632735843215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.707643  6160 tablet_bootstrap.cc:492] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:39.637274  6100 tablet_service.cc:1511] Processing CreateTablet for tablet 5744a277c5a3409b95831573168daf3f (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:23:39.651759  6025 tablet_service.cc:1511] Processing CreateTablet for tablet cbdceec3ce444e7b812ac717eafb85ee (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:39.638922  6108 tablet_service.cc:1511] Processing CreateTablet for tablet cbdceec3ce444e7b812ac717eafb85ee (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:23:39.709235  6100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5744a277c5a3409b95831573168daf3f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:39.710562  6081 leader_election.cc:343] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.713053  5956 tablet_service.cc:1511] Processing CreateTablet for tablet a0acc59e2e4d43029c959c64a291c5a0 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:39.714253  5956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0acc59e2e4d43029c959c64a291c5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.717094  6106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff337cd5a364d1c9100f9a31dd826f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.717608  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:23:39.719241  6082 leader_election.cc:343] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:39.719698  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:39.720424  6031 tablet_service.cc:1511] Processing CreateTablet for tablet 02dd5c8c15e34ecfbc46620193fb5762 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:39.674582  6032 tablet_service.cc:1511] Processing CreateTablet for tablet be9bf17a0be244b3bdd7bec88bf5a051 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:39.675776  6158 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } }
I20260709 12:23:39.622696  5957 tablet_service.cc:1511] Processing CreateTablet for tablet 4a03c10b4bbc407ebfd96681074ae05b (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:39.722522  5957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a03c10b4bbc407ebfd96681074ae05b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.602890  6159 tablet_bootstrap.cc:492] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:39.685448  5951 tablet_service.cc:1511] Processing CreateTablet for tablet 465414d7b00f409684b7f69cfbcfad77 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:39.629395  6099 tablet_service.cc:1511] Processing CreateTablet for tablet 4a03c10b4bbc407ebfd96681074ae05b (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:23:39.735580  5951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465414d7b00f409684b7f69cfbcfad77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.693199  6024 tablet_service.cc:1511] Processing CreateTablet for tablet 382d3eda9eaa4b9c96393a12d9f2be5c (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:39.631014  5954 tablet_service.cc:1511] Processing CreateTablet for tablet be9bf17a0be244b3bdd7bec88bf5a051 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:39.743166  5954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be9bf17a0be244b3bdd7bec88bf5a051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.690014  6028 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465414d7b00f409684b7f69cfbcfad77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.720683  6163 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:39.750769  6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbdceec3ce444e7b812ac717eafb85ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.751765  6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02dd5c8c15e34ecfbc46620193fb5762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.753844  6027 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0acc59e2e4d43029c959c64a291c5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.754724  6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be9bf17a0be244b3bdd7bec88bf5a051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.750866  6107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0468d70863214876bf59fb3ea9474307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.744904  5952 tablet_service.cc:1511] Processing CreateTablet for tablet 382d3eda9eaa4b9c96393a12d9f2be5c (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:39.757051  6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382d3eda9eaa4b9c96393a12d9f2be5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.757459  5952 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382d3eda9eaa4b9c96393a12d9f2be5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.629204  6105 tablet_service.cc:1511] Processing CreateTablet for tablet 117509103bb449868a97cf0ba4fdda89 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:23:39.772920  6026 tablet_service.cc:1511] Processing CreateTablet for tablet 5e596fee38d14bcb913a2aaadffa2a72 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:39.775611  6029 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd6047b66ab4b4abc3fe659e8cff000 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:39.776880  6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd6047b66ab4b4abc3fe659e8cff000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.780776  6159 tablet_bootstrap.cc:654] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.782307  6033 tablet_service.cc:1511] Processing CreateTablet for tablet bd91034e550f4704be7f47b7aff3ed25 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:39.784359  6160 tablet_bootstrap.cc:654] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.788618  6030 tablet_service.cc:1511] Processing CreateTablet for tablet 5a6d648272bf4bef9d5337acfc9d4a96 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:39.791059  6099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a03c10b4bbc407ebfd96681074ae05b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.793457  6105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117509103bb449868a97cf0ba4fdda89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.794721  6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e596fee38d14bcb913a2aaadffa2a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.802950  6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6d648272bf4bef9d5337acfc9d4a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.805279  6170 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.805764  6170 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } }
I20260709 12:23:39.807036  6108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbdceec3ce444e7b812ac717eafb85ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.808488  5954 tablet_service.cc:1511] Processing CreateTablet for tablet 02dd5c8c15e34ecfbc46620193fb5762 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:39.809706  5954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02dd5c8c15e34ecfbc46620193fb5762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.810892  6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd91034e550f4704be7f47b7aff3ed25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.811604  5949 tablet_service.cc:1511] Processing CreateTablet for tablet bd91034e550f4704be7f47b7aff3ed25 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:39.812788  5949 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd91034e550f4704be7f47b7aff3ed25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.815680  6158 ts_tablet_manager.cc:1434] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.231s	user 0.008s	sys 0.014s
I20260709 12:23:39.816687  6158 tablet_bootstrap.cc:492] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:39.817296  5957 tablet_service.cc:1511] Processing CreateTablet for tablet 5e596fee38d14bcb913a2aaadffa2a72 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:39.818956  5957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e596fee38d14bcb913a2aaadffa2a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.824355  5953 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd6047b66ab4b4abc3fe659e8cff000 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:39.825678  5953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd6047b66ab4b4abc3fe659e8cff000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.828243  5955 tablet_service.cc:1511] Processing CreateTablet for tablet 5a6d648272bf4bef9d5337acfc9d4a96 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:39.829502  5955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6d648272bf4bef9d5337acfc9d4a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.833775  5958 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf137aab07e4b9b8024d07355c33351 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:39.835107  5958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf137aab07e4b9b8024d07355c33351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.837186  6102 tablet_service.cc:1511] Processing CreateTablet for tablet a0acc59e2e4d43029c959c64a291c5a0 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:23:39.838518  6102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0acc59e2e4d43029c959c64a291c5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.841361  6101 tablet_service.cc:1511] Processing CreateTablet for tablet be9bf17a0be244b3bdd7bec88bf5a051 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:23:39.887423  6101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be9bf17a0be244b3bdd7bec88bf5a051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.844391  6103 tablet_service.cc:1511] Processing CreateTablet for tablet 465414d7b00f409684b7f69cfbcfad77 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:23:39.889866  6103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 465414d7b00f409684b7f69cfbcfad77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.851397  6104 tablet_service.cc:1511] Processing CreateTablet for tablet 382d3eda9eaa4b9c96393a12d9f2be5c (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:23:39.855683  5950 tablet_service.cc:1511] Processing CreateTablet for tablet 7df97235d12b46dd8e54f8f1d6ed40bd (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:39.892088  6104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 382d3eda9eaa4b9c96393a12d9f2be5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.892246  5950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df97235d12b46dd8e54f8f1d6ed40bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.857805  5956 tablet_service.cc:1511] Processing CreateTablet for tablet 78c13bc0b46b40a3886a209b87dd6f98 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:39.860314  6160 tablet_bootstrap.cc:492] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:39.893919  6160 ts_tablet_manager.cc:1403] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.186s	user 0.009s	sys 0.005s
I20260709 12:23:39.894272  5956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c13bc0b46b40a3886a209b87dd6f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.862900  6158 tablet_bootstrap.cc:654] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:39.864771  6106 tablet_service.cc:1511] Processing CreateTablet for tablet 02dd5c8c15e34ecfbc46620193fb5762 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:23:39.867527  6099 tablet_service.cc:1511] Processing CreateTablet for tablet bd91034e550f4704be7f47b7aff3ed25 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:23:39.868108  6031 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf137aab07e4b9b8024d07355c33351 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:39.879981  6170 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:39.880522  6100 tablet_service.cc:1511] Processing CreateTablet for tablet 5e596fee38d14bcb913a2aaadffa2a72 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:23:39.905551  6106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02dd5c8c15e34ecfbc46620193fb5762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.905738  6031 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf137aab07e4b9b8024d07355c33351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.906256  6100 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e596fee38d14bcb913a2aaadffa2a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.907222  6099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd91034e550f4704be7f47b7aff3ed25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.921499  6032 tablet_service.cc:1511] Processing CreateTablet for tablet 7df97235d12b46dd8e54f8f1d6ed40bd (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
W20260709 12:23:39.926096  5853 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 59360.1us
I20260709 12:23:39.937026  6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df97235d12b46dd8e54f8f1d6ed40bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.955775  6032 tablet_service.cc:1511] Processing CreateTablet for tablet 78c13bc0b46b40a3886a209b87dd6f98 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:39.957024  6032 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c13bc0b46b40a3886a209b87dd6f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.965914  6159 tablet_bootstrap.cc:492] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:39.966641  6159 ts_tablet_manager.cc:1403] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.364s	user 0.010s	sys 0.011s
I20260709 12:23:39.976303  5957 tablet_service.cc:1511] Processing CreateTablet for tablet cc2b965a354c426fb89e1a743dccd273 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:39.977597  5957 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc2b965a354c426fb89e1a743dccd273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.983927  6105 tablet_service.cc:1511] Processing CreateTablet for tablet 3fd6047b66ab4b4abc3fe659e8cff000 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:23:39.985297  6105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd6047b66ab4b4abc3fe659e8cff000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.989001  5951 tablet_service.cc:1511] Processing CreateTablet for tablet efdaf6941ab7409d90619a5e9f5c10c3 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:39.990401  5951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdaf6941ab7409d90619a5e9f5c10c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:39.989003  6024 tablet_service.cc:1511] Processing CreateTablet for tablet efdaf6941ab7409d90619a5e9f5c10c3 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:39.995853  6167 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:39.996353  6167 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:39.969952  6159 raft_consensus.cc:359] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:39.998760  6159 raft_consensus.cc:385] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.999099  6159 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:39.998955  6160 raft_consensus.cc:359] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:39.999697  6160 raft_consensus.cc:385] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:39.999850  6159 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.002869  6159 ts_tablet_manager.cc:1434] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.036s	user 0.006s	sys 0.001s
I20260709 12:23:40.022918  6159 tablet_bootstrap.cc:492] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:40.028497  6107 tablet_service.cc:1511] Processing CreateTablet for tablet 5a6d648272bf4bef9d5337acfc9d4a96 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:23:40.030193  6107 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6d648272bf4bef9d5337acfc9d4a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.003808  6160 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.026772  6167 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.035544  6104 tablet_service.cc:1511] Processing CreateTablet for tablet 7bf137aab07e4b9b8024d07355c33351 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:23:40.040278  6024 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdaf6941ab7409d90619a5e9f5c10c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.052232  6160 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.052894  6108 tablet_service.cc:1511] Processing CreateTablet for tablet 7df97235d12b46dd8e54f8f1d6ed40bd (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:23:40.054280  6108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df97235d12b46dd8e54f8f1d6ed40bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.055411  6160 ts_tablet_manager.cc:1434] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.161s	user 0.007s	sys 0.008s
I20260709 12:23:40.059293  6025 tablet_service.cc:1511] Processing CreateTablet for tablet cc2b965a354c426fb89e1a743dccd273 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:40.070847  6099 tablet_service.cc:1511] Processing CreateTablet for tablet 78c13bc0b46b40a3886a209b87dd6f98 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:23:40.073410  6158 tablet_bootstrap.cc:492] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:40.074507  6158 ts_tablet_manager.cc:1403] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.258s	user 0.019s	sys 0.005s
I20260709 12:23:40.076689  6159 tablet_bootstrap.cc:654] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.080883  6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc2b965a354c426fb89e1a743dccd273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.086855  6099 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c13bc0b46b40a3886a209b87dd6f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.087507  6104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf137aab07e4b9b8024d07355c33351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.089830  6103 tablet_service.cc:1511] Processing CreateTablet for tablet cc2b965a354c426fb89e1a743dccd273 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:23:40.092862  6160 tablet_bootstrap.cc:492] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:40.099291  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:40.106568  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:23:40.111366  6006 leader_election.cc:343] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:40.112435  5932 leader_election.cc:343] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.121399  6160 tablet_bootstrap.cc:654] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.122812  6103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cc2b965a354c426fb89e1a743dccd273. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.122602  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:23:40.124469  5934 leader_election.cc:343] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.125025  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:40.124184  6030 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1c158430bb487aa1d4c5a69165aa32 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:40.125907  6170 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:40.126869  6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1c158430bb487aa1d4c5a69165aa32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.080924  6158 raft_consensus.cc:359] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.129803  6158 raft_consensus.cc:385] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.130216  6158 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.128074  5953 tablet_service.cc:1511] Processing CreateTablet for tablet 1956c0a3a799470a83a524ca2ae0ce14 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:40.134728  6101 tablet_service.cc:1511] Processing CreateTablet for tablet efdaf6941ab7409d90619a5e9f5c10c3 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:23:40.137998  6101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdaf6941ab7409d90619a5e9f5c10c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.138554  6158 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.140439  6029 tablet_service.cc:1511] Processing CreateTablet for tablet 1956c0a3a799470a83a524ca2ae0ce14 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:40.141058  6102 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1c158430bb487aa1d4c5a69165aa32 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:40.141881  6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1956c0a3a799470a83a524ca2ae0ce14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.142362  6102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1c158430bb487aa1d4c5a69165aa32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.138561  5953 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1956c0a3a799470a83a524ca2ae0ce14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.149708  6170 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.150282  6170 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.151247  5950 tablet_service.cc:1511] Processing CreateTablet for tablet 12ca0d61cb524660bae3b43f9f1c5389 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:40.152818  5950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ca0d61cb524660bae3b43f9f1c5389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.155084  6106 tablet_service.cc:1511] Processing CreateTablet for tablet 1956c0a3a799470a83a524ca2ae0ce14 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:23:40.156916  6158 ts_tablet_manager.cc:1434] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.082s	user 0.005s	sys 0.002s
I20260709 12:23:40.158506  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:40.164078  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:23:40.165153  5932 leader_election.cc:343] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.160774  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:23:40.165686  6009 leader_election.cc:343] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.166131  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:40.166925  6167 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:40.167418  6026 tablet_service.cc:1511] Processing CreateTablet for tablet 12ca0d61cb524660bae3b43f9f1c5389 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:40.168794  6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ca0d61cb524660bae3b43f9f1c5389. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:40.171095  5934 leader_election.cc:343] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.171671  6106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1956c0a3a799470a83a524ca2ae0ce14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.171548  5934 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:40.172075  5951 tablet_service.cc:1511] Processing CreateTablet for tablet ec584257f9db451c965f6b092aa9069c (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:40.172578  6169 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:40.175051  6105 tablet_service.cc:1511] Processing CreateTablet for tablet 12ca0d61cb524660bae3b43f9f1c5389 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:23:40.175846  6033 tablet_service.cc:1511] Processing CreateTablet for tablet ec584257f9db451c965f6b092aa9069c (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:40.187446  6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec584257f9db451c965f6b092aa9069c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.187156  5956 tablet_service.cc:1511] Processing CreateTablet for tablet 7d1c158430bb487aa1d4c5a69165aa32 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:23:40.190515  6159 tablet_bootstrap.cc:492] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:40.191092  6159 ts_tablet_manager.cc:1403] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.168s	user 0.016s	sys 0.005s
I20260709 12:23:40.176457  6158 tablet_bootstrap.cc:492] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:40.177037  5951 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec584257f9db451c965f6b092aa9069c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.161405  6170 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.196415  5956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1c158430bb487aa1d4c5a69165aa32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.193974  6159 raft_consensus.cc:359] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.208036  6159 raft_consensus.cc:385] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.212612  6159 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.214844  6159 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.217125  6159 ts_tablet_manager.cc:1434] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.026s	user 0.006s	sys 0.000s
I20260709 12:23:40.218612  6159 tablet_bootstrap.cc:492] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:40.217581  6105 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ca0d61cb524660bae3b43f9f1c5389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.227499  6158 tablet_bootstrap.cc:654] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.233598  6102 tablet_service.cc:1511] Processing CreateTablet for tablet ec584257f9db451c965f6b092aa9069c (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:23:40.234961  6102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec584257f9db451c965f6b092aa9069c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.236299  5954 tablet_service.cc:1511] Processing CreateTablet for tablet 06e81868728a4e2592f3ee289cff3431 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:40.237516  5954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e81868728a4e2592f3ee289cff3431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.238399  6025 tablet_service.cc:1511] Processing CreateTablet for tablet 06e81868728a4e2592f3ee289cff3431 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:40.239639  6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e81868728a4e2592f3ee289cff3431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.247741  6160 tablet_bootstrap.cc:492] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:40.248348  6160 ts_tablet_manager.cc:1403] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.156s	user 0.014s	sys 0.002s
I20260709 12:23:40.251354  6160 raft_consensus.cc:359] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.252065  6160 raft_consensus.cc:385] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.252354  6160 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.256124  5958 tablet_service.cc:1511] Processing CreateTablet for tablet 35f225b19c174d73b8b1d76af9a231dd (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:40.257479  5958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f225b19c174d73b8b1d76af9a231dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.258194  6159 tablet_bootstrap.cc:654] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.259598  6108 tablet_service.cc:1511] Processing CreateTablet for tablet 35f225b19c174d73b8b1d76af9a231dd (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:40.259907  6160 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.260344  5955 tablet_service.cc:1511] Processing CreateTablet for tablet c87516dfcddf4c8b8d921f3512db9063 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:40.261143  6108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f225b19c174d73b8b1d76af9a231dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.261520  5955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c87516dfcddf4c8b8d921f3512db9063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.265012  6160 ts_tablet_manager.cc:1434] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:23:40.259605  6103 tablet_service.cc:1511] Processing CreateTablet for tablet 06e81868728a4e2592f3ee289cff3431 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:23:40.266054  6160 tablet_bootstrap.cc:492] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:40.266723  6103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 06e81868728a4e2592f3ee289cff3431. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.280845  6030 tablet_service.cc:1511] Processing CreateTablet for tablet c87516dfcddf4c8b8d921f3512db9063 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:40.282162  6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c87516dfcddf4c8b8d921f3512db9063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.284718  6033 tablet_service.cc:1511] Processing CreateTablet for tablet 35f225b19c174d73b8b1d76af9a231dd (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:23:40.286743  6101 tablet_service.cc:1511] Processing CreateTablet for tablet c87516dfcddf4c8b8d921f3512db9063 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:23:40.288067  6101 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c87516dfcddf4c8b8d921f3512db9063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.284626  6160 tablet_bootstrap.cc:654] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.291293  6033 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35f225b19c174d73b8b1d76af9a231dd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.292910  6158 tablet_bootstrap.cc:492] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:40.312242  6158 ts_tablet_manager.cc:1403] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.136s	user 0.013s	sys 0.003s
I20260709 12:23:40.313218  6026 tablet_service.cc:1511] Processing CreateTablet for tablet 22f53da618b548f89206b5390bbf5aec (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:40.315580  6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22f53da618b548f89206b5390bbf5aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.315222  6158 raft_consensus.cc:359] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.302217  5954 tablet_service.cc:1511] Processing CreateTablet for tablet a1138b447c084c17ab4b465255e54118 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:40.304266  6029 tablet_service.cc:1511] Processing CreateTablet for tablet a1138b447c084c17ab4b465255e54118 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:40.315939  6158 raft_consensus.cc:385] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.316291  6158 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.316805  6029 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1138b447c084c17ab4b465255e54118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.317000  6158 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.323233  6158 ts_tablet_manager.cc:1434] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:23:40.308121  6106 tablet_service.cc:1511] Processing CreateTablet for tablet a1138b447c084c17ab4b465255e54118 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:23:40.324232  6158 tablet_bootstrap.cc:492] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:40.328805  6106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1138b447c084c17ab4b465255e54118. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.331239  5954 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1138b447c084c17ab4b465255e54118. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:23:40.334106  5914 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:40.335846  6158 tablet_bootstrap.cc:654] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.324739  5958 tablet_service.cc:1511] Processing CreateTablet for tablet 22f53da618b548f89206b5390bbf5aec (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:40.342222  6159 tablet_bootstrap.cc:492] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:40.342799  6159 ts_tablet_manager.cc:1403] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.124s	user 0.014s	sys 0.004s
I20260709 12:23:40.342396  5958 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22f53da618b548f89206b5390bbf5aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.345758  6159 raft_consensus.cc:359] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } }
I20260709 12:23:40.349088  6159 raft_consensus.cc:385] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.358863  6159 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.348322  6108 tablet_service.cc:1511] Processing CreateTablet for tablet 22f53da618b548f89206b5390bbf5aec (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:23:40.352707  5956 tablet_service.cc:1511] Processing CreateTablet for tablet 42702625c5a04990a24ae81a2dede920 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:40.360428  5956 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42702625c5a04990a24ae81a2dede920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.356452  6025 tablet_service.cc:1511] Processing CreateTablet for tablet 42702625c5a04990a24ae81a2dede920 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:40.362970  6159 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } }
I20260709 12:23:40.364781  6106 tablet_service.cc:1511] Processing CreateTablet for tablet 42702625c5a04990a24ae81a2dede920 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:23:40.365851  6159 ts_tablet_manager.cc:1434] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 12:23:40.366885  6025 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42702625c5a04990a24ae81a2dede920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.369724  6026 tablet_service.cc:1511] Processing CreateTablet for tablet 3d61b6b50d6746189e849070b208d9a5 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:40.370198  5950 tablet_service.cc:1511] Processing CreateTablet for tablet 3d61b6b50d6746189e849070b208d9a5 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:40.371018  6026 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d61b6b50d6746189e849070b208d9a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.370908  6102 tablet_service.cc:1511] Processing CreateTablet for tablet 3d61b6b50d6746189e849070b208d9a5 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:23:40.371452  5950 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d61b6b50d6746189e849070b208d9a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.372571  5955 tablet_service.cc:1511] Processing CreateTablet for tablet adcfbfcb66fd4891959337c005335841 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:40.373724  5955 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adcfbfcb66fd4891959337c005335841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.373847  6030 tablet_service.cc:1511] Processing CreateTablet for tablet adcfbfcb66fd4891959337c005335841 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:40.374914  6030 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adcfbfcb66fd4891959337c005335841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.375801  6103 tablet_service.cc:1511] Processing CreateTablet for tablet adcfbfcb66fd4891959337c005335841 (DEFAULT_TABLE table=test-workload [id=320467eb1eff4b52a15f6712ded136a5]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:23:40.387995  6108 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 22f53da618b548f89206b5390bbf5aec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.388676  6106 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42702625c5a04990a24ae81a2dede920. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.390973  6102 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d61b6b50d6746189e849070b208d9a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.392099  6160 tablet_bootstrap.cc:492] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:40.392596  6160 ts_tablet_manager.cc:1403] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.127s	user 0.016s	sys 0.000s
I20260709 12:23:40.392769  6103 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet adcfbfcb66fd4891959337c005335841. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:40.395373  6160 raft_consensus.cc:359] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.396109  6160 raft_consensus.cc:385] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.396469  6160 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.397367  6160 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.399375  6159 tablet_bootstrap.cc:492] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:40.405902  6159 tablet_bootstrap.cc:654] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.407572  6160 ts_tablet_manager.cc:1434] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.015s	user 0.008s	sys 0.000s
I20260709 12:23:40.426499  6160 tablet_bootstrap.cc:492] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:40.427994  6158 tablet_bootstrap.cc:492] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:40.428478  6158 ts_tablet_manager.cc:1403] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.104s	user 0.012s	sys 0.007s
I20260709 12:23:40.432966  6160 tablet_bootstrap.cc:654] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.433845  6159 tablet_bootstrap.cc:492] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:40.434366  6159 ts_tablet_manager.cc:1403] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.035s	user 0.010s	sys 0.002s
I20260709 12:23:40.437381  6158 raft_consensus.cc:359] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.437479  6159 raft_consensus.cc:359] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.438380  6158 raft_consensus.cc:385] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.438395  6159 raft_consensus.cc:385] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.439072  6158 raft_consensus.cc:740] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.439095  6159 raft_consensus.cc:740] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.440212  6159 consensus_queue.cc:260] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.440222  6158 consensus_queue.cc:260] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.444693  6160 tablet_bootstrap.cc:492] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:40.445176  6160 ts_tablet_manager.cc:1403] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:23:40.446026  6159 ts_tablet_manager.cc:1434] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.003s
I20260709 12:23:40.447072  6159 tablet_bootstrap.cc:492] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:40.447973  6160 raft_consensus.cc:359] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.448683  6160 raft_consensus.cc:385] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.448951  6160 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.449647  6160 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.451375  6160 ts_tablet_manager.cc:1434] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:40.452423  6158 ts_tablet_manager.cc:1434] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:23:40.452457  6160 tablet_bootstrap.cc:492] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:40.453649  6158 tablet_bootstrap.cc:492] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:40.454803  6163 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.455273  6163 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.457458  6163 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:40.459120  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:40.459569  6160 tablet_bootstrap.cc:654] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.460454  6159 tablet_bootstrap.cc:654] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.460788  6158 tablet_bootstrap.cc:654] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:40.462656  6082 leader_election.cc:343] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.463066  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:40.466679  6167 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.467180  6167 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.469168  6167 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.470271  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:40.470916  6118 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:40.471585  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:23:40.471829  6081 leader_election.cc:343] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.472321  6081 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:23:40.473106  6006 leader_election.cc:343] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.473500  6163 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:40.474694  6009 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:40.475467  6167 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:40.475822  6167 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.476153  6167 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.477357  6158 tablet_bootstrap.cc:492] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:40.477834  6158 ts_tablet_manager.cc:1403] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.004s
I20260709 12:23:40.480611  6160 tablet_bootstrap.cc:492] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:40.480621  6158 raft_consensus.cc:359] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.481194  6160 ts_tablet_manager.cc:1403] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.004s
I20260709 12:23:40.483148  6167 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.483500  6160 raft_consensus.cc:359] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.483888  6159 tablet_bootstrap.cc:492] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:40.484272  6160 raft_consensus.cc:385] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.484390  6159 ts_tablet_manager.cc:1403] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.038s	user 0.012s	sys 0.006s
I20260709 12:23:40.484571  6160 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.485263  6160 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.486008  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:23:40.487423  6006 leader_election.cc:343] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.487285  6159 raft_consensus.cc:359] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.484066  6158 raft_consensus.cc:385] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.488008  6160 ts_tablet_manager.cc:1434] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:23:40.488041  6158 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.488005  6159 raft_consensus.cc:385] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.488554  6167 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.488799  6159 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.488981  6158 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.489634  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:40.490159  6160 tablet_bootstrap.cc:492] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:40.490192  6118 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.493368  6158 ts_tablet_manager.cc:1434] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.015s	user 0.002s	sys 0.005s
I20260709 12:23:40.495031  6158 tablet_bootstrap.cc:492] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:40.496496  6159 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.493888  6191 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.497517  6191 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.498903  6159 ts_tablet_manager.cc:1434] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:23:40.499759  6191 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.500349  6160 tablet_bootstrap.cc:654] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.500710  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:40.501838  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:40.502492  6117 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
W20260709 12:23:40.502571  6006 leader_election.cc:343] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.503931  6009 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:40.504613  6158 tablet_bootstrap.cc:654] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.505191  6191 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:40.505659  6191 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.506049  6191 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.507375  6167 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.507918  6167 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.510452  6167 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.511981  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:23:40.513990  6009 leader_election.cc:343] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.516502  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:40.517210  5968 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:40.517453  6158 tablet_bootstrap.cc:492] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:40.517982  6158 ts_tablet_manager.cc:1403] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.010s
I20260709 12:23:40.520411  6159 tablet_bootstrap.cc:492] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:40.520920  6158 raft_consensus.cc:359] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.521677  6158 raft_consensus.cc:385] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.521965  6158 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.522890  6158 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.525908  6158 ts_tablet_manager.cc:1434] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:40.526943  6158 tablet_bootstrap.cc:492] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:40.529578  6159 tablet_bootstrap.cc:654] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.524310  6118 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:40.531507  6009 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:40.532572  6167 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:40.533058  6158 tablet_bootstrap.cc:654] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.538780  6191 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.543457  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:40.543978  6167 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:23:40.545158  6006 leader_election.cc:343] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.544975  6167 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.547004  6158 tablet_bootstrap.cc:492] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:40.547508  6158 ts_tablet_manager.cc:1403] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.021s	user 0.013s	sys 0.003s
I20260709 12:23:40.550637  6158 raft_consensus.cc:359] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.551362  6158 raft_consensus.cc:385] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.551653  6158 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.552143  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:40.552739  6118 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.552466  6158 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.555691  6006 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:40.558732  6194 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.559188  6194 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.560142  6158 ts_tablet_manager.cc:1434] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:23:40.561177  6158 tablet_bootstrap.cc:492] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:40.562393  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:23:40.563812  6009 leader_election.cc:343] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.564353  6191 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.564905  6191 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:40.565232  6191 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.565551  6191 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.569908  6158 tablet_bootstrap.cc:654] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.571211  6118 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:40.572356  6009 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:40.574977  6159 tablet_bootstrap.cc:492] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:40.575476  6159 ts_tablet_manager.cc:1403] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.055s	user 0.011s	sys 0.000s
I20260709 12:23:40.570047  6194 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.579061  6194 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:40.579504  6194 raft_consensus.cc:697] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:40.580327  6194 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.581220  6158 tablet_bootstrap.cc:492] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:40.581637  6158 ts_tablet_manager.cc:1403] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.007s
I20260709 12:23:40.581722  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:40.582448  5968 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:40.584040  6006 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:40.584362  6158 raft_consensus.cc:359] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.585017  6158 raft_consensus.cc:385] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.585292  6158 raft_consensus.cc:740] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.585438  6198 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:40.585865  6198 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.586230  6198 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.586014  6158 consensus_queue.cc:260] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.588754  6158 ts_tablet_manager.cc:1434] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:23:40.589380  6160 tablet_bootstrap.cc:492] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:40.589797  6158 tablet_bootstrap.cc:492] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:40.590451  5865 catalog_manager.cc:5697] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.589890  6160 ts_tablet_manager.cc:1403] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.100s	user 0.051s	sys 0.036s
I20260709 12:23:40.595208  6198 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.597654  6160 raft_consensus.cc:359] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.598112  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:40.599728  6160 raft_consensus.cc:385] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.599850  5968 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.600185  6160 raft_consensus.cc:740] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.601233  6160 consensus_queue.cc:260] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.601723  6191 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.603822  6160 ts_tablet_manager.cc:1434] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.009s	user 0.004s	sys 0.002s
I20260709 12:23:40.604460  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:40.604830  6160 tablet_bootstrap.cc:492] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:40.605036  5967 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.606518  5968 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:40.578420  6159 raft_consensus.cc:359] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.598248  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:40.604878  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:40.607283  6159 raft_consensus.cc:385] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:40.608469  6009 leader_election.cc:343] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.609432  6198 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.599366  6158 tablet_bootstrap.cc:654] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.608474  6159 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.610052  6191 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.611269  6006 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:40.611497  6159 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.613051  6160 tablet_bootstrap.cc:654] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.613375  6118 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.618091  5967 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:40.619282  6006 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:40.620662  6191 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:40.621650  6191 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:40.621965  6198 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:40.622583  6191 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.622548  6198 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:40.624975  6198 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.627236  6118 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:40.632019  6163 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.632599  6163 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } }
I20260709 12:23:40.631460  6194 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.636627  6208 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.637043  6194 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.639497  6194 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.640254  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:40.640635  6163 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:40.640844  5967 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:40.642328  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:40.643038  5967 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:40.643360  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:40.643930  6117 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:40.644315  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:40.642319  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:40.645491  6163 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:40.648188  6160 tablet_bootstrap.cc:492] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:40.643976  6159 ts_tablet_manager.cc:1434] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.068s	user 0.009s	sys 0.001s
I20260709 12:23:40.646111  6158 tablet_bootstrap.cc:492] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:40.655471  6160 ts_tablet_manager.cc:1403] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.051s	user 0.016s	sys 0.021s
I20260709 12:23:40.656091  6158 ts_tablet_manager.cc:1403] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.067s	user 0.011s	sys 0.016s
I20260709 12:23:40.655189  6163 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.646497  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:40.645901  6194 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:40.656805  6163 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.657106  6194 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.661741  6194 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.662431  6170 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.662955  6159 tablet_bootstrap.cc:492] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:40.663044  6170 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.665372  6170 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.665882  6191 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.666409  6191 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.670396  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:40.671216  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:40.672030  6160 raft_consensus.cc:359] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } }
W20260709 12:23:40.672502  5932 leader_election.cc:343] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.672708  6160 raft_consensus.cc:385] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.673007  6160 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.645426  6208 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.670598  6159 tablet_bootstrap.cc:654] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:40.667030  6082 leader_election.cc:343] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.674798  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:40.668305  6158 raft_consensus.cc:359] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.675381  5967 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:40.675736  6158 raft_consensus.cc:385] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.673591  6191 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.675948  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:40.676612  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:23:40.677606  6009 leader_election.cc:343] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.673686  6160 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } }
W20260709 12:23:40.678651  5934 leader_election.cc:343] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.677577  6194 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.679090  5934 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:40.679916  6160 ts_tablet_manager.cc:1434] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:23:40.680183  6170 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:40.680950  6160 tablet_bootstrap.cc:492] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:40.677556  6198 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:40.681478  6198 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.681825  6198 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.681850  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:40.676013  6158 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.682534  5967 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.682940  6158 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.685125  6158 ts_tablet_manager.cc:1434] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.029s	user 0.002s	sys 0.003s
I20260709 12:23:40.687355  6160 tablet_bootstrap.cc:654] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.689234  5967 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:40.690575  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:40.691431  6191 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:40.691880  6191 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:40.692510  6198 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.692911  6191 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.695464  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:40.696120  6044 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:40.696507  6198 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.696743  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:40.697319  6082 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:40.697615  6208 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:40.698104  6208 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:40.698343  6194 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.698428  6208 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.699761  6208 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.700932  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:40.701524  5968 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.708875  6158 tablet_bootstrap.cc:492] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:40.709081  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:40.709837  5967 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:40.712049  5968 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:40.713440  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:40.714514  6194 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:40.715108  6194 raft_consensus.cc:697] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:40.716070  6194 consensus_queue.cc:237] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.719460  6163 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } }
I20260709 12:23:40.721624  6160 tablet_bootstrap.cc:492] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:40.722246  6160 ts_tablet_manager.cc:1403] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.041s	user 0.019s	sys 0.011s
I20260709 12:23:40.725632  6160 raft_consensus.cc:359] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.726516  6160 raft_consensus.cc:385] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.726202  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:40.727299  6160 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.727413  5968 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.728953  6160 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.732088  6160 ts_tablet_manager.cc:1434] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:23:40.734757  6160 tablet_bootstrap.cc:492] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:40.735139  5968 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:40.736672  6158 tablet_bootstrap.cc:654] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.737011  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:40.739233  6159 tablet_bootstrap.cc:492] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:40.739678  6159 ts_tablet_manager.cc:1403] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.081s	user 0.020s	sys 0.001s
I20260709 12:23:40.740048  6212 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:23:40.741350  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 44109.2us
I20260709 12:23:40.727975  6163 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:23:40.742228  6009 leader_election.cc:343] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.744297  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:40.742283  6159 raft_consensus.cc:359] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.744940  6044 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.745079  6159 raft_consensus.cc:385] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.745393  6159 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.746048  6159 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.747604  6160 tablet_bootstrap.cc:654] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.752084  6044 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:40.748364  6159 ts_tablet_manager.cc:1434] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:40.753976  6159 tablet_bootstrap.cc:492] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:40.755280  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:40.755862  6118 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.756625  6212 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:23:40.757513  6212 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } }
I20260709 12:23:40.729918  6208 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.760082  6160 tablet_bootstrap.cc:492] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:40.760659  6160 ts_tablet_manager.cc:1403] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.026s	user 0.009s	sys 0.007s
I20260709 12:23:40.761615  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:40.762185  5968 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.763798  6160 raft_consensus.cc:359] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.764374  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:40.764732  6160 raft_consensus.cc:385] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.764973  6044 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.765165  6160 raft_consensus.cc:740] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.765669  6170 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.766136  6170 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.766252  6160 consensus_queue.cc:260] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.768174  6170 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.768944  6160 ts_tablet_manager.cc:1434] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:40.769774  5968 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:40.770004  6160 tablet_bootstrap.cc:492] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:40.771070  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:40.771778  6043 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:40.771883  6118 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:40.769788  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:40.773058  6117 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:40.773890  6158 tablet_bootstrap.cc:492] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:40.774329  6158 ts_tablet_manager.cc:1403] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.070s	user 0.009s	sys 0.000s
I20260709 12:23:40.774530  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:40.775553  6081 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:40.777642  6216 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:40.778017  6160 tablet_bootstrap.cc:654] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.778620  6170 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:40.778981  6170 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.779330  6170 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.778326  6216 raft_consensus.cc:697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:23:40.777033  6158 raft_consensus.cc:359] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.781255  6158 raft_consensus.cc:385] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.781546  6158 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.781620  6216 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.782284  6158 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.791627  6159 tablet_bootstrap.cc:654] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.790832  6208 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:40.802055  6170 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.805388  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:40.806962  6043 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.809306  6170 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.805337  6044 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:40.811873  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:40.813676  6117 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.826789  6160 tablet_bootstrap.cc:492] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:40.827121  6117 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:40.828507  5934 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:40.828860  6159 tablet_bootstrap.cc:492] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:40.829293  6159 ts_tablet_manager.cc:1403] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.000s
I20260709 12:23:40.829447  6170 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:40.830019  6170 raft_consensus.cc:697] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:40.827301  6160 ts_tablet_manager.cc:1403] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.000s
I20260709 12:23:40.830967  6170 consensus_queue.cc:237] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.830175  6043 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:40.835163  6158 ts_tablet_manager.cc:1434] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.061s	user 0.025s	sys 0.028s
I20260709 12:23:40.833379  6160 raft_consensus.cc:359] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.835222  6159 raft_consensus.cc:359] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.835933  6159 raft_consensus.cc:385] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.836160  6159 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.836364  6158 tablet_bootstrap.cc:492] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:40.836684  6159 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.835659  6160 raft_consensus.cc:385] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.837559  6160 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.838091  6160 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.831859  5864 catalog_manager.cc:5697] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.840111  6160 ts_tablet_manager.cc:1434] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.009s	user 0.001s	sys 0.003s
I20260709 12:23:40.839633  5864 catalog_manager.cc:5697] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.841346  6160 tablet_bootstrap.cc:492] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:40.843351  6159 ts_tablet_manager.cc:1434] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:23:40.844427  6159 tablet_bootstrap.cc:492] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:40.845829  5864 catalog_manager.cc:5697] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.847255  6158 tablet_bootstrap.cc:654] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.848083  5864 catalog_manager.cc:5697] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.849879  5864 catalog_manager.cc:5697] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.852380  6159 tablet_bootstrap.cc:654] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.854249  6160 tablet_bootstrap.cc:654] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.856416  6158 tablet_bootstrap.cc:492] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:40.856963  6158 ts_tablet_manager.cc:1403] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.001s
I20260709 12:23:40.859851  6158 raft_consensus.cc:359] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.860708  6158 raft_consensus.cc:385] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.860994  6158 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.861759  6158 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.863957  6158 ts_tablet_manager.cc:1434] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:23:40.865000  6158 tablet_bootstrap.cc:492] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:40.865628  5866 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.873018  6159 tablet_bootstrap.cc:492] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:40.873559  6159 ts_tablet_manager.cc:1403] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.000s
I20260709 12:23:40.876335  6159 raft_consensus.cc:359] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.877079  6159 raft_consensus.cc:385] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.877367  6159 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.882344  6158 tablet_bootstrap.cc:654] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.885782  6159 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.888128  6159 ts_tablet_manager.cc:1434] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.000s
I20260709 12:23:40.889426  6159 tablet_bootstrap.cc:492] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:40.894781  6159 tablet_bootstrap.cc:654] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.894714  5864 catalog_manager.cc:5697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:40.897204  6158 tablet_bootstrap.cc:492] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:40.897753  6158 ts_tablet_manager.cc:1403] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.033s	user 0.011s	sys 0.000s
I20260709 12:23:40.897667  5866 catalog_manager.cc:5697] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:40.900794  6158 raft_consensus.cc:359] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.901544  6158 raft_consensus.cc:385] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.901805  6158 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.902529  6158 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.904955  6158 ts_tablet_manager.cc:1434] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.002s
I20260709 12:23:40.905813  6158 tablet_bootstrap.cc:492] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:40.906208  6159 tablet_bootstrap.cc:492] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:40.906685  6159 ts_tablet_manager.cc:1403] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.017s	user 0.016s	sys 0.000s
I20260709 12:23:40.909873  6159 raft_consensus.cc:359] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.910559  6159 raft_consensus.cc:385] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.910816  6159 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.911644  6158 tablet_bootstrap.cc:654] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.911661  6159 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.914003  6159 ts_tablet_manager.cc:1434] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:40.915027  6159 tablet_bootstrap.cc:492] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:40.915072  6160 tablet_bootstrap.cc:492] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:40.915613  6160 ts_tablet_manager.cc:1403] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.074s	user 0.014s	sys 0.021s
I20260709 12:23:40.918243  6160 raft_consensus.cc:359] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.918926  6160 raft_consensus.cc:385] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.919183  6160 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.920205  6160 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.922231  6160 ts_tablet_manager.cc:1434] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:23:40.923427  6159 tablet_bootstrap.cc:654] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.925778  6160 tablet_bootstrap.cc:492] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:40.929040  6158 tablet_bootstrap.cc:492] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:40.929538  6158 ts_tablet_manager.cc:1403] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.009s
I20260709 12:23:40.931841  6159 tablet_bootstrap.cc:492] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:40.932272  6159 ts_tablet_manager.cc:1403] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.017s	user 0.004s	sys 0.008s
I20260709 12:23:40.932068  6158 raft_consensus.cc:359] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.932703  6158 raft_consensus.cc:385] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.932979  6158 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.933621  6158 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.934916  6159 raft_consensus.cc:359] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.935552  6159 raft_consensus.cc:385] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.935808  6159 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.936630  6159 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.938508  6158 ts_tablet_manager.cc:1434] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.001s
I20260709 12:23:40.938714  6159 ts_tablet_manager.cc:1434] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:23:40.939540  6159 tablet_bootstrap.cc:492] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:40.939687  6158 tablet_bootstrap.cc:492] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:40.945115  6159 tablet_bootstrap.cc:654] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.945652  6158 tablet_bootstrap.cc:654] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.946449  6160 tablet_bootstrap.cc:654] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.953333  6194 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.953862  6194 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.956022  6194 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.956543  6158 tablet_bootstrap.cc:492] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:40.956677  6159 tablet_bootstrap.cc:492] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:40.957026  6158 ts_tablet_manager.cc:1403] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.018s	user 0.012s	sys 0.003s
I20260709 12:23:40.957060  6159 ts_tablet_manager.cc:1403] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.018s	user 0.006s	sys 0.008s
I20260709 12:23:40.957852  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:40.958508  5968 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:40.958961  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:40.959597  6117 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:40.959710  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:40.959815  6159 raft_consensus.cc:359] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.960487  6159 raft_consensus.cc:385] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.960522  6194 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:40.960825  6159 raft_consensus.cc:740] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.960999  6194 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.961412  6194 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.961794  6158 raft_consensus.cc:359] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.962504  6158 raft_consensus.cc:385] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.962127  6159 consensus_queue.cc:260] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.962792  6158 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:40.963718  6158 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.964484  6170 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.964910  6170 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.967983  6159 ts_tablet_manager.cc:1434] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:23:40.968087  6160 tablet_bootstrap.cc:492] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:40.968860  6216 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:40.969319  6216 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.969676  6170 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.968770  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:40.970346  6043 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:40.970788  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:40.971374  6216 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:40.971657  5932 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:40.972404  6170 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:23:40.972580  5934 leader_election.cc:343] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.972612  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:40.972760  6170 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:40.968879  6160 ts_tablet_manager.cc:1403] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.043s	user 0.010s	sys 0.007s
I20260709 12:23:40.973882  6159 tablet_bootstrap.cc:492] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:40.973387  6170 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:40.974123  6082 leader_election.cc:343] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.978247  6159 tablet_bootstrap.cc:654] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.980530  6160 raft_consensus.cc:359] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.981251  6160 raft_consensus.cc:385] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:40.981123  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:40.981542  6160 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
W20260709 12:23:40.982600  6081 leader_election.cc:343] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.982402  6160 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.983062  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:40.983908  6170 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:40.984671  6160 ts_tablet_manager.cc:1434] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:23:40.985155  6216 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:40.987040  6158 ts_tablet_manager.cc:1434] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.030s	user 0.009s	sys 0.000s
I20260709 12:23:40.988083  6158 tablet_bootstrap.cc:492] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:40.989964  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:23:40.991484  5934 leader_election.cc:343] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:40.992098  6170 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:40.985628  6160 tablet_bootstrap.cc:492] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:40.993688  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:40.994419  6043 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:40.995721  6158 tablet_bootstrap.cc:654] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:40.999577  6160 tablet_bootstrap.cc:654] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.006887  6216 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.007580  6216 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.010402  6191 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:41.011494  6160 tablet_bootstrap.cc:492] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:41.012012  6160 ts_tablet_manager.cc:1403] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.027s	user 0.009s	sys 0.008s
I20260709 12:23:41.013005  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:41.015021  6160 raft_consensus.cc:359] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.015832  6160 raft_consensus.cc:385] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.016242  6160 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.016970  6160 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.012060  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:41.019152  5968 raft_consensus.cc:2393] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:23:41.020481  6081 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:41.021462  6212 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.025163  6160 ts_tablet_manager.cc:1434] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:41.026227  6160 tablet_bootstrap.cc:492] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:41.033313  6160 tablet_bootstrap.cc:654] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.010175  6216 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:41.042900  6198 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:41.049741  6216 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.050292  6216 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.052389  6216 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:41.054230  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:41.057310  5967 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.066911  6043 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:41.068022  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:41.068540  6212 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:41.070334  6081 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:23:41.071810  5994 tablet.cc:2406] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:23:41.072763  6194 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.074419  6216 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.074674  6208 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:41.075094  6216 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.078909  6117 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.086727  6198 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:41.093098  6170 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.093652  6170 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.094554  5932 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:41.095515  6218 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:41.095683  6170 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:41.095695  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:41.099251  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:23:41.101094  5934 leader_election.cc:343] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.101720  6170 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.102226  6170 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.102694  6191 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:41.103564  6167 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:41.105217  6170 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:41.108122  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:23:41.109782  5934 leader_election.cc:343] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.112272  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:23:41.113101  6082 leader_election.cc:343] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.113256  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:41.115260  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:41.115948  5967 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.118373  6191 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.119144  6191 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.120404  6198 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:41.121966  6191 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:41.125895  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:41.126452  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:41.095777  6216 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:41.128997  6194 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:41.130021  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:41.130673  6113 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.135470  6216 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.136145  6216 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:41.144760  6081 leader_election.cc:343] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.145316  6081 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:41.146399  6212 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:41.160499  6170 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.161212  6170 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:41.151369  6009 leader_election.cc:343] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.144140  6194 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20260709 12:23:41.176342  6198 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.175246  6216 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:41.184005  6198 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.175933  6247 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20260709 12:23:41.180075  6113 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:41.188460  6198 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:41.192526  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:41.194432  6160 tablet_bootstrap.cc:492] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:41.194998  6160 ts_tablet_manager.cc:1403] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.169s	user 0.032s	sys 0.047s
I20260709 12:23:41.195755  6158 tablet_bootstrap.cc:492] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:41.196195  6158 ts_tablet_manager.cc:1403] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.208s	user 0.015s	sys 0.059s
I20260709 12:23:41.196744  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:41.197930  6160 raft_consensus.cc:359] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.200346  6160 raft_consensus.cc:385] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.200640  6160 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.201331  6160 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.202754  6158 raft_consensus.cc:359] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.203557  6158 raft_consensus.cc:385] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.203883  6158 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.205753  6158 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.204594  6160 ts_tablet_manager.cc:1434] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:41.212993  6160 tablet_bootstrap.cc:492] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:41.213516  6009 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:41.213886  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:41.214777  6247 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:23:41.215255  5934 leader_election.cc:343] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.215266  6247 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:41.216037  6170 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:41.216425  6247 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.216876  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:41.220336  6113 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:41.219125  6170 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.222522  6170 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.227926  5966 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.230491  5967 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:41.237046  6159 tablet_bootstrap.cc:492] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:41.237665  6159 ts_tablet_manager.cc:1403] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.269s	user 0.027s	sys 0.023s
I20260709 12:23:41.237988  6170 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:41.240876  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:41.241650  5968 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:41.240775  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:41.244155  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:41.245278  6194 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:41.245689  6194 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.246023  6194 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:41.247437  6082 leader_election.cc:343] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.248169  6159 raft_consensus.cc:359] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.248869  6167 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:41.248889  6159 raft_consensus.cc:385] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.251243  6159 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.252025  6159 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.256841  6159 ts_tablet_manager.cc:1434] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.002s
I20260709 12:23:41.257859  6159 tablet_bootstrap.cc:492] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:41.253930  6218 raft_consensus.cc:697] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:41.288761  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:41.284291  6198 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.259294  6218 consensus_queue.cc:237] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.295502  6198 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.301008  6198 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:41.310858  6194 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:41.293979  5932 leader_election.cc:343] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.316159  6158 ts_tablet_manager.cc:1434] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.120s	user 0.016s	sys 0.036s
I20260709 12:23:41.317173  6158 tablet_bootstrap.cc:492] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:41.319645  5932 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:41.319957  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:41.324271  6216 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:41.324556  6009 leader_election.cc:343] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:41.324489  5932 leader_election.cc:343] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.325155  5932 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:41.315999  5863 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.327826  6242 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:41.330988  6170 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:41.333043  6194 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:23:41.339131  5914 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:41.343918  6160 tablet_bootstrap.cc:654] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.353968  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:23:41.354039  6006 leader_election.cc:343] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.354976  6006 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:41.355198  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:41.355484  6159 tablet_bootstrap.cc:654] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.355816  6116 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:41.358230  6081 leader_election.cc:343] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.358950  6081 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:41.360229  6212 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:41.360190  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:41.357321  6194 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:41.363269  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:41.364437  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:41.365021  5966 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.367057  5866 catalog_manager.cc:5697] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.368101  6198 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:41.369966  6198 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:41.371989  5966 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:41.373371  6116 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:41.374810  6216 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.375290  6216 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.377370  6216 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:41.383090  6158 tablet_bootstrap.cc:654] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.386596  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:41.387408  6247 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:41.387872  6247 raft_consensus.cc:697] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:41.388351  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:41.388659  6247 consensus_queue.cc:237] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.391512  6159 tablet_bootstrap.cc:492] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:41.391737  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:41.392043  6159 ts_tablet_manager.cc:1403] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.134s	user 0.014s	sys 0.008s
I20260709 12:23:41.392428  6044 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
W20260709 12:23:41.393114  6081 leader_election.cc:343] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:41.393669  6006 leader_election.cc:343] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.393766  6216 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:41.394200  6006 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:41.394493  6212 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:41.395128  6159 raft_consensus.cc:359] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.395781  6159 raft_consensus.cc:385] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.396246  6159 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.396299  6198 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:23:41.393041  5932 leader_election.cc:343] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.396996  6159 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.397063  6198 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:41.397729  5932 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:41.399259  6159 ts_tablet_manager.cc:1434] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.002s
I20260709 12:23:41.400211  6159 tablet_bootstrap.cc:492] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:41.400102  6218 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:41.401986  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:41.404420  6158 tablet_bootstrap.cc:492] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:41.404671  6218 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:41.405972  6158 ts_tablet_manager.cc:1403] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.089s	user 0.006s	sys 0.006s
I20260709 12:23:41.406715  6082 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:41.407658  6159 tablet_bootstrap.cc:654] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.407436  6218 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:41.408490  6212 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:41.408915  6212 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.409258  6212 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.411551  6158 raft_consensus.cc:359] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.412259  6158 raft_consensus.cc:385] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.412550  6158 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.416831  6212 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.424010  6158 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.427685  6158 ts_tablet_manager.cc:1434] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.021s	user 0.004s	sys 0.003s
I20260709 12:23:41.428761  6158 tablet_bootstrap.cc:492] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:41.431823  6212 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:41.433437  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:41.434047  6044 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.435359  6158 tablet_bootstrap.cc:654] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.441318  6216 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.453890  6160 tablet_bootstrap.cc:492] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:41.454567  6160 ts_tablet_manager.cc:1403] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.242s	user 0.013s	sys 0.007s
I20260709 12:23:41.465071  5863 catalog_manager.cc:5697] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.441880  6216 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.442906  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:41.482795  6159 tablet_bootstrap.cc:492] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:41.483366  6159 ts_tablet_manager.cc:1403] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.083s	user 0.020s	sys 0.035s
I20260709 12:23:41.482065  6044 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:41.490428  6082 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:41.492372  6216 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:41.493021  6216 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:41.493470  6160 raft_consensus.cc:359] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.494128  6160 raft_consensus.cc:385] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.474031  6170 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:23:41.476583  5963 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.494395  6160 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.495996  6160 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.497529  6160 ts_tablet_manager.cc:1434] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.043s	user 0.004s	sys 0.000s
I20260709 12:23:41.498274  6160 tablet_bootstrap.cc:492] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:41.499229  6208 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:41.484198  6194 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.493471  6216 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:23:41.508872  6216 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.510064  6194 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.512769  6194 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:41.514257  6158 tablet_bootstrap.cc:492] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:41.514741  6158 ts_tablet_manager.cc:1403] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.086s	user 0.015s	sys 0.020s
I20260709 12:23:41.516897  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:41.524325  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:41.536105  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:41.536792  5968 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:41.534965  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:41.529299  6044 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
W20260709 12:23:41.546267  6009 leader_election.cc:343] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:41.546594  6081 leader_election.cc:343] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.548431  6006 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:41.549275  6198 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:41.549634  6198 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.549947  6198 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.563827  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:41.564860  6212 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:41.565254  6212 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.565572  6212 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.568034  6159 raft_consensus.cc:359] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.568766  6159 raft_consensus.cc:385] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.569017  6159 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.569654  6159 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.572192  6159 ts_tablet_manager.cc:1434] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.089s	user 0.004s	sys 0.003s
I20260709 12:23:41.571993  6212 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.573303  6159 tablet_bootstrap.cc:492] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:41.574249  6212 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:41.576261  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:41.578286  6044 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.576057  6198 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.580149  6198 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:41.581789  6160 tablet_bootstrap.cc:654] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.587918  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:41.591495  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:41.595767  6044 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:41.595338  6158 raft_consensus.cc:359] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.596550  6158 raft_consensus.cc:385] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.596900  6158 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
W20260709 12:23:41.596447  6009 leader_election.cc:343] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.597587  6158 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.594138  5963 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:41.601423  6158 ts_tablet_manager.cc:1434] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.086s	user 0.004s	sys 0.003s
I20260709 12:23:41.603253  6158 tablet_bootstrap.cc:492] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
W20260709 12:23:41.603317  6081 leader_election.cc:343] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.609216  6159 tablet_bootstrap.cc:654] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.613591  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:41.614269  5964 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.613493  5863 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.614868  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:41.621480  6158 tablet_bootstrap.cc:654] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.623131  6212 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:41.623613  6212 raft_consensus.cc:697] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:23:41.629680  6212 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.636413  5964 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:41.656574  6006 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:41.657433  6194 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:41.657930  6194 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:41.658249  6198 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:41.658824  6194 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.678210  6158 tablet_bootstrap.cc:492] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:41.678692  6158 ts_tablet_manager.cc:1403] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.076s	user 0.011s	sys 0.004s
I20260709 12:23:41.684455  6158 raft_consensus.cc:359] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.685274  6158 raft_consensus.cc:385] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.685715  6158 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.686599  6158 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.691329  6160 tablet_bootstrap.cc:492] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:41.691813  6160 ts_tablet_manager.cc:1403] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.194s	user 0.012s	sys 0.010s
I20260709 12:23:41.694660  6158 ts_tablet_manager.cc:1434] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:23:41.695367  6160 raft_consensus.cc:359] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.696076  6160 raft_consensus.cc:385] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.696354  6160 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.697141  6160 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.698716  5865 catalog_manager.cc:5697] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:41.699954  6160 ts_tablet_manager.cc:1434] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:41.704560  6160 tablet_bootstrap.cc:492] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:41.707330  5866 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.717842  6194 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:41.719403  6160 tablet_bootstrap.cc:654] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.723389  6158 tablet_bootstrap.cc:492] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:41.727697  6159 tablet_bootstrap.cc:492] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:41.728102  6159 ts_tablet_manager.cc:1403] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.155s	user 0.012s	sys 0.041s
I20260709 12:23:41.730432  6159 raft_consensus.cc:359] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.731873  6159 raft_consensus.cc:385] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.732087  6159 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.732283  6160 tablet_bootstrap.cc:492] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:41.732743  6160 ts_tablet_manager.cc:1403] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.028s	user 0.009s	sys 0.000s
I20260709 12:23:41.732666  6159 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.734264  6159 ts_tablet_manager.cc:1434] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.002s
I20260709 12:23:41.735018  6159 tablet_bootstrap.cc:492] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:41.735267  6160 raft_consensus.cc:359] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.735958  6160 raft_consensus.cc:385] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.736217  6160 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.740075  6160 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.742326  6160 ts_tablet_manager.cc:1434] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:23:41.740899  6159 tablet_bootstrap.cc:654] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.746877  6160 tablet_bootstrap.cc:492] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:41.747130  6158 tablet_bootstrap.cc:654] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.752599  6158 tablet_bootstrap.cc:492] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:41.752770  6160 tablet_bootstrap.cc:654] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.753062  6158 ts_tablet_manager.cc:1403] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.030s	user 0.012s	sys 0.000s
I20260709 12:23:41.755671  6158 raft_consensus.cc:359] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.756361  6158 raft_consensus.cc:385] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.756644  6158 raft_consensus.cc:740] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.757400  6158 consensus_queue.cc:260] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.758424  6159 tablet_bootstrap.cc:492] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:41.758917  6159 ts_tablet_manager.cc:1403] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.024s	user 0.005s	sys 0.005s
I20260709 12:23:41.759747  6158 ts_tablet_manager.cc:1434] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:41.760739  6158 tablet_bootstrap.cc:492] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:41.761363  6159 raft_consensus.cc:359] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.761854  6159 raft_consensus.cc:385] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.762056  6159 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.762609  6159 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.765880  6159 ts_tablet_manager.cc:1434] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:41.770742  6113 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.771186  6159 tablet_bootstrap.cc:492] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:41.773337  6212 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.773943  6212 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.776557  6212 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:41.776997  6159 tablet_bootstrap.cc:654] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.778323  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:41.779152  5964 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:23:41.780967  6250 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:41.782721  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:41.787009  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:41.788650  6273 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.794083  6160 tablet_bootstrap.cc:492] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:41.794567  6160 ts_tablet_manager.cc:1403] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.048s	user 0.026s	sys 0.015s
I20260709 12:23:41.795544  6273 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:41.797075  6160 raft_consensus.cc:359] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.797775  6160 raft_consensus.cc:385] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.798031  6160 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.798779  6160 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.799214  6158 tablet_bootstrap.cc:654] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.818809  6160 ts_tablet_manager.cc:1434] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.024s	user 0.005s	sys 0.001s
I20260709 12:23:41.819105  6242 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:41.825896  6160 tablet_bootstrap.cc:492] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:41.827023  6198 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.827899  6158 tablet_bootstrap.cc:492] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:41.828279  6158 ts_tablet_manager.cc:1403] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.068s	user 0.015s	sys 0.001s
I20260709 12:23:41.827579  6198 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.830776  6198 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:41.831471  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:41.832088  5964 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:41.833374  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:41.833461  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:23:41.835153  6009 leader_election.cc:343] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.835470  6198 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:41.835971  6198 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.836356  6198 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.840799  6160 tablet_bootstrap.cc:654] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.844435  6158 raft_consensus.cc:359] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.844410  6198 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.867954  6158 raft_consensus.cc:385] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.868328  6158 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.869076  6159 tablet_bootstrap.cc:492] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:41.869517  6159 ts_tablet_manager.cc:1403] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.100s	user 0.012s	sys 0.041s
I20260709 12:23:41.869545  6198 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:41.871176  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:41.872232  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:41.872774  5964 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.872732  6159 raft_consensus.cc:359] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.873492  6159 raft_consensus.cc:385] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.873769  6159 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.874354  6159 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.874738  6158 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:41.878450  6009 leader_election.cc:343] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:41.878976  6159 ts_tablet_manager.cc:1434] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:41.879678  6158 ts_tablet_manager.cc:1434] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.051s	user 0.004s	sys 0.003s
I20260709 12:23:41.880903  6159 tablet_bootstrap.cc:492] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:41.880915  6158 tablet_bootstrap.cc:492] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:41.883642  5964 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:41.885106  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:41.886183  6198 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:41.889815  6198 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:41.890674  6198 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.894212  6159 tablet_bootstrap.cc:654] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.899606  6158 tablet_bootstrap.cc:654] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.906203  6194 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:41.907131  6160 tablet_bootstrap.cc:492] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:41.908764  6160 ts_tablet_manager.cc:1403] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.083s	user 0.016s	sys 0.017s
I20260709 12:23:41.912313  6159 tablet_bootstrap.cc:492] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:41.912814  6159 ts_tablet_manager.cc:1403] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.032s	user 0.008s	sys 0.006s
I20260709 12:23:41.913060  6160 raft_consensus.cc:359] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.913731  6160 raft_consensus.cc:385] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.913980  6160 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.914871  6160 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.915833  6159 raft_consensus.cc:359] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.916352  6198 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:41.916435  6159 raft_consensus.cc:385] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.915673  5862 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:41.916823  6160 ts_tablet_manager.cc:1434] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.002s
I20260709 12:23:41.916887  6198 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.917785  6160 tablet_bootstrap.cc:492] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:41.918349  6158 tablet_bootstrap.cc:492] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:41.918856  6158 ts_tablet_manager.cc:1403] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.004s
I20260709 12:23:41.919641  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:41.920279  5963 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:41.921208  6159 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.921821  6006 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:41.922842  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:41.923437  6118 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:41.924248  6194 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:41.924614  6194 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:41.924942  6194 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.926942  6158 raft_consensus.cc:359] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.927636  6158 raft_consensus.cc:385] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:41.927953  6158 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:41.928594  6158 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.930599  6158 ts_tablet_manager.cc:1434] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:23:41.931481  6158 tablet_bootstrap.cc:492] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:41.931886  6194 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.932231  6159 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.934217  6159 ts_tablet_manager.cc:1434] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:23:41.934161  6198 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:41.954708  6160 tablet_bootstrap.cc:654] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.954896  6159 tablet_bootstrap.cc:492] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:41.954977  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:41.955638  5963 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.954792  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:41.959039  6118 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:41.960299  6158 tablet_bootstrap.cc:654] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.963155  5963 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:41.964308  6006 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:41.965086  6198 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:41.965622  6198 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:41.953222  6194 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:41.967813  6198 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:41.971340  6194 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:41.974431  6159 tablet_bootstrap.cc:654] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:41.985456  6118 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:41.985721  6160 tablet_bootstrap.cc:492] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:41.991660  6160 ts_tablet_manager.cc:1403] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.074s	user 0.010s	sys 0.016s
I20260709 12:23:42.000451  6273 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.000977  6273 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.001734  6158 tablet_bootstrap.cc:492] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:42.002277  6158 ts_tablet_manager.cc:1403] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.071s	user 0.012s	sys 0.009s
I20260709 12:23:42.004009  6273 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:42.004841  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:42.007059  5964 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:42.005497  6160 raft_consensus.cc:359] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.007867  6160 raft_consensus.cc:385] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.008145  6160 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.008387  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:42.008453  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:42.008755  6160 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.009122  6043 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:42.009481  6273 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:42.009828  6273 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.010175  6273 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.011051  6160 ts_tablet_manager.cc:1434] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.019s	user 0.006s	sys 0.001s
I20260709 12:23:42.011948  6160 tablet_bootstrap.cc:492] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:42.013797  6159 tablet_bootstrap.cc:492] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:42.014286  6159 ts_tablet_manager.cc:1403] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.060s	user 0.016s	sys 0.000s
I20260709 12:23:42.017418  6273 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.018811  6160 tablet_bootstrap.cc:654] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.019311  6158 raft_consensus.cc:359] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.019032  5862 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.020134  6158 raft_consensus.cc:385] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.020548  6158 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.020469  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:42.021279  5964 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.021507  6158 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.023808  6158 ts_tablet_manager.cc:1434] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 12:23:42.025444  6158 tablet_bootstrap.cc:492] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:42.026822  6198 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.027287  6198 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.029544  6198 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.031595  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:42.031590  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:42.032414  6113 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:42.032456  5963 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:42.033070  6273 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:42.032270  5964 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:42.034134  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:42.034423  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:42.035029  6043 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.035244  6198 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:42.035620  6198 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.035938  6198 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.018230  6159 raft_consensus.cc:359] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.040105  6159 raft_consensus.cc:385] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.040413  6159 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.041045  6159 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.041406  6043 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:42.041745  6198 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.042604  6082 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:42.043388  6273 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:42.043819  6273 raft_consensus.cc:697] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:23:42.044512  6159 ts_tablet_manager.cc:1434] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.000s
I20260709 12:23:42.044584  6273 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.045475  6159 tablet_bootstrap.cc:492] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:42.045523  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:42.046171  6113 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.049394  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:42.050055  5964 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.051812  6159 tablet_bootstrap.cc:654] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.052830  6113 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:42.054111  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:42.055135  6194 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:42.055615  6194 raft_consensus.cc:697] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:42.056465  6194 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.062150  5964 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:42.068238  6160 tablet_bootstrap.cc:492] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:42.068841  6160 ts_tablet_manager.cc:1403] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.007s
I20260709 12:23:42.069075  6212 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:42.071723  6160 raft_consensus.cc:359] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.072538  6160 raft_consensus.cc:385] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.072889  6160 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.073544  6198 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.073773  6160 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.075716  6158 tablet_bootstrap.cc:654] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.076090  6160 ts_tablet_manager.cc:1434] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:42.077065  6160 tablet_bootstrap.cc:492] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:42.084040  6160 tablet_bootstrap.cc:654] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.090873  6212 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.091534  6194 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.094092  5863 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.098580  6159 tablet_bootstrap.cc:492] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:42.106938  6159 ts_tablet_manager.cc:1403] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.062s	user 0.020s	sys 0.009s
I20260709 12:23:42.114425  5862 catalog_manager.cc:5697] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:42.116966  6160 tablet_bootstrap.cc:492] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:42.117462  6160 ts_tablet_manager.cc:1403] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.041s	user 0.012s	sys 0.003s
I20260709 12:23:42.121623  6158 tablet_bootstrap.cc:492] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:42.122134  6158 ts_tablet_manager.cc:1403] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.097s	user 0.007s	sys 0.007s
I20260709 12:23:42.123238  5964 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.124925  6158 raft_consensus.cc:359] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.125649  6158 raft_consensus.cc:385] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.125414  6160 raft_consensus.cc:359] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.125942  6158 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.126160  6160 raft_consensus.cc:385] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.126500  6160 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.126752  6158 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.127146  6160 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.129133  6158 ts_tablet_manager.cc:1434] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:23:42.130043  6158 tablet_bootstrap.cc:492] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:42.132671  6247 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.133168  6247 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.135257  6212 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.135591  6158 tablet_bootstrap.cc:654] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.136621  6247 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.137908  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:42.129618  6160 ts_tablet_manager.cc:1434] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:23:42.138362  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:42.138617  6247 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:42.139006  5966 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:42.139405  6160 tablet_bootstrap.cc:492] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:42.138621  6113 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:42.142829  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:42.144083  6212 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.144706  6212 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.145537  6159 raft_consensus.cc:359] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.146220  6159 raft_consensus.cc:385] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.147893  6212 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:42.156111  6159 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.149760  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:42.146350  6247 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:42.157217  6247 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.157125  6043 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:42.157816  6247 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.157559  6159 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.151516  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:42.161149  5967 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:42.162287  6159 ts_tablet_manager.cc:1434] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.053s	user 0.006s	sys 0.000s
I20260709 12:23:42.164186  6160 tablet_bootstrap.cc:654] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.165977  6158 tablet_bootstrap.cc:492] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:42.165941  6247 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.166680  6158 ts_tablet_manager.cc:1403] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.009s
I20260709 12:23:42.167743  6081 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:42.169675  6159 tablet_bootstrap.cc:492] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:42.169910  6158 raft_consensus.cc:359] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.170149  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:42.170758  6158 raft_consensus.cc:385] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.171257  6158 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.170944  6113 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.170830  6247 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.170780  6212 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:42.173569  6212 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.171986  6158 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.176275  6158 ts_tablet_manager.cc:1434] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:23:42.177755  6158 tablet_bootstrap.cc:492] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:42.174283  6212 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.191483  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:42.192279  5966 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.192915  6113 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:42.209056  6159 tablet_bootstrap.cc:654] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.216473  6160 tablet_bootstrap.cc:492] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:42.216995  6160 ts_tablet_manager.cc:1403] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.078s	user 0.020s	sys 0.010s
I20260709 12:23:42.219363  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:42.220134  5966 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:42.222543  6247 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:42.230552  6247 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:42.231410  6247 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.223423  6311 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:23:42.236837  6160 raft_consensus.cc:359] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.238088  6160 raft_consensus.cc:385] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.238399  6160 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.240144  6160 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.240274  6250 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.246152  6250 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.247812  6212 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.248842  6250 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.249029  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:42.249850  6212 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:23:42.250351  5932 leader_election.cc:343] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.251719  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:42.252822  5966 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.254014  6160 ts_tablet_manager.cc:1434] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.037s	user 0.007s	sys 0.002s
I20260709 12:23:42.255445  6194 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.255898  6194 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.257897  6194 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.259963  6250 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.260221  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:42.260715  6250 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:42.261818  5934 leader_election.cc:343] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.262508  5934 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:42.264106  6170 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:42.264528  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:42.264837  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:42.265455  6042 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:42.266505  6250 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:23:42.267277  6006 leader_election.cc:343] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.267648  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:42.268296  6113 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:42.266779  5932 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:42.271193  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:42.272284  6250 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:42.272735  6250 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.276058  6160 tablet_bootstrap.cc:492] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:42.274820  6250 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:42.311275  6009 leader_election.cc:343] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.311846  6009 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:42.312635  6198 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:42.320843  6158 tablet_bootstrap.cc:654] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.335979  6250 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.337878  5966 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:42.345285  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:42.345917  6044 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.350515  5865 catalog_manager.cc:5697] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.354013  6160 tablet_bootstrap.cc:654] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.342576  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:42.357724  6081 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:42.361439  6250 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.362170  6310 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:42.358788  6042 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.363571  6310 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:23:42.369880  6310 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.373675  6159 tablet_bootstrap.cc:492] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:42.374243  6159 ts_tablet_manager.cc:1403] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.205s	user 0.024s	sys 0.025s
I20260709 12:23:42.372309  6212 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.376507  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:42.376504  6212 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.377821  6113 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.379276  6212 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:42.381844  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:42.384138  6113 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:42.386405  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:42.387742  6170 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:42.387770  6250 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.388331  6250 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.390182  6250 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.388339  6170 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:42.393100  6170 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.391904  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:42.396322  6041 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:42.392084  6194 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.398123  6042 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:42.398351  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:42.406824  6044 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:42.411849  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:42.404233  5932 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:42.425330  6159 raft_consensus.cc:359] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.426904  6159 raft_consensus.cc:385] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.427204  6159 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.428361  6250 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:42.427882  6159 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.428756  6250 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.429109  6250 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.430351  6159 ts_tablet_manager.cc:1434] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.056s	user 0.005s	sys 0.000s
I20260709 12:23:42.431308  6159 tablet_bootstrap.cc:492] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
W20260709 12:23:42.426323  5934 leader_election.cc:343] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:42.436589  6315 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:23:42.437471  6081 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:42.438520  6212 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:42.441192  5865 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:42.447295  5863 catalog_manager.cc:5697] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.451601  6250 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.453403  6158 tablet_bootstrap.cc:492] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:42.453979  6158 ts_tablet_manager.cc:1403] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.276s	user 0.013s	sys 0.008s
I20260709 12:23:42.464998  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:42.476076  6159 tablet_bootstrap.cc:654] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.479461  6113 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.480911  6250 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.472965  6044 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.484555  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:42.489277  6159 tablet_bootstrap.cc:492] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:42.489804  6159 ts_tablet_manager.cc:1403] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.059s	user 0.012s	sys 0.000s
I20260709 12:23:42.494263  6159 raft_consensus.cc:359] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.482821  6160 tablet_bootstrap.cc:492] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:42.495285  6160 ts_tablet_manager.cc:1403] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.219s	user 0.009s	sys 0.022s
I20260709 12:23:42.494410  6158 raft_consensus.cc:359] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.498045  6158 raft_consensus.cc:385] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:42.498317  5934 leader_election.cc:343] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.498771  6158 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.495002  6159 raft_consensus.cc:385] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.499617  6159 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.499490  6158 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.500294  6159 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.497603  6044 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:42.501853  6158 ts_tablet_manager.cc:1434] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.047s	user 0.001s	sys 0.005s
I20260709 12:23:42.501735  5932 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:42.501655  6160 raft_consensus.cc:359] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.502475  6160 raft_consensus.cc:385] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.502772  6160 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.502879  6158 tablet_bootstrap.cc:492] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:42.503087  6250 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:42.502905  6159 ts_tablet_manager.cc:1434] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.002s
I20260709 12:23:42.503635  6250 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:42.503561  6160 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.504338  6159 tablet_bootstrap.cc:492] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:42.504645  6250 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.505978  6160 ts_tablet_manager.cc:1434] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:23:42.506965  6160 tablet_bootstrap.cc:492] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:42.511078  6191 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.511792  6158 tablet_bootstrap.cc:654] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.523670  6160 tablet_bootstrap.cc:654] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.524330  6159 tablet_bootstrap.cc:654] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:42.526026  5914 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:42.534452  6160 tablet_bootstrap.cc:492] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:42.535213  6160 ts_tablet_manager.cc:1403] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.028s	user 0.012s	sys 0.000s
I20260709 12:23:42.538618  6158 tablet_bootstrap.cc:492] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:42.539116  6158 ts_tablet_manager.cc:1403] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.000s
I20260709 12:23:42.538508  6160 raft_consensus.cc:359] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.541020  6160 raft_consensus.cc:385] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.541316  6160 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.541613  6158 raft_consensus.cc:359] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.542304  6158 raft_consensus.cc:385] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.542121  6160 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.542595  6158 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.543563  6159 tablet_bootstrap.cc:492] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:42.543350  6158 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.544102  6159 ts_tablet_manager.cc:1403] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.004s
I20260709 12:23:42.545750  6158 ts_tablet_manager.cc:1434] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:42.546676  6158 tablet_bootstrap.cc:492] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:42.548264  6160 ts_tablet_manager.cc:1434] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:23:42.549150  6160 tablet_bootstrap.cc:492] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:42.546725  6159 raft_consensus.cc:359] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.551313  6159 raft_consensus.cc:385] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.551733  6159 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.552588  6159 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.553393  6158 tablet_bootstrap.cc:654] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.554684  6159 ts_tablet_manager.cc:1434] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:42.555545  6160 tablet_bootstrap.cc:654] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.565237  6158 tablet_bootstrap.cc:492] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:42.565775  6158 ts_tablet_manager.cc:1403] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:23:42.567140  5862 catalog_manager.cc:5697] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.570007  6310 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.568531  6158 raft_consensus.cc:359] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.579865  6158 raft_consensus.cc:385] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.581897  6194 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.580200  6158 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.584249  6158 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.584555  6310 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.585083  6310 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.587026  6158 ts_tablet_manager.cc:1434] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.005s
I20260709 12:23:42.588522  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:42.590191  6044 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:23:42.569131  6159 tablet_bootstrap.cc:492] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:42.587322  6310 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:42.589186  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:42.597445  6081 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:42.597718  6158 tablet_bootstrap.cc:492] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:42.598743  6273 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.600116  6273 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.603502  6160 tablet_bootstrap.cc:492] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:42.603940  6250 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.604430  6250 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.603983  6160 ts_tablet_manager.cc:1403] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.055s	user 0.029s	sys 0.016s
I20260709 12:23:42.608361  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:42.608740  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:42.609038  6042 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:42.608852  6160 raft_consensus.cc:359] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.609328  6113 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:42.609572  6160 raft_consensus.cc:385] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.609943  6160 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.611152  6160 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.605103  6247 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:23:42.611914  5934 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:42.612883  6250 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.613005  6322 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:42.613384  6322 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.613704  6322 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.617432  6160 ts_tablet_manager.cc:1434] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:23:42.618423  6160 tablet_bootstrap.cc:492] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:42.619175  6247 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.620823  6322 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.623724  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:42.624290  6042 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.624987  6160 tablet_bootstrap.cc:654] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.628587  6273 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:42.633383  6042 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:42.635944  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:42.640682  6116 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.637434  6159 tablet_bootstrap.cc:654] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.638371  6160 tablet_bootstrap.cc:492] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:42.641705  6160 ts_tablet_manager.cc:1403] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.023s	user 0.005s	sys 0.008s
I20260709 12:23:42.646787  5932 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:42.647596  6250 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:42.647482  6158 tablet_bootstrap.cc:654] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.648188  6250 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:42.648528  6116 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:42.649214  6250 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.639513  6198 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.649420  6160 raft_consensus.cc:359] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.656682  6160 raft_consensus.cc:385] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.657032  6160 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.657743  6160 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.662683  6160 ts_tablet_manager.cc:1434] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:23:42.665452  6160 tablet_bootstrap.cc:492] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:42.639333  6322 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.680938  6160 tablet_bootstrap.cc:654] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.682901  6159 tablet_bootstrap.cc:492] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:42.686292  6159 ts_tablet_manager.cc:1403] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.117s	user 0.009s	sys 0.012s
I20260709 12:23:42.689230  6159 raft_consensus.cc:359] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.700801  6159 raft_consensus.cc:385] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.691470  6158 tablet_bootstrap.cc:492] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:42.698722  6250 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.701498  6158 ts_tablet_manager.cc:1403] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.104s	user 0.013s	sys 0.007s
I20260709 12:23:42.701450  6250 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.703729  6250 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.704571  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:42.705312  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:42.706151  6158 raft_consensus.cc:359] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.707602  6158 raft_consensus.cc:385] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:42.706583  5932 leader_election.cc:343] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.706861  6159 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
W20260709 12:23:42.708546  5934 leader_election.cc:343] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.709280  6159 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.709532  5934 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:42.710431  6250 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:42.712218  6159 ts_tablet_manager.cc:1434] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:23:42.707950  6158 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.713109  6158 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.713662  6247 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.714376  6159 tablet_bootstrap.cc:492] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:42.714131  6247 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.716210  6247 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.717690  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:42.718277  6160 tablet_bootstrap.cc:492] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
W20260709 12:23:42.719048  6009 leader_election.cc:343] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.719411  6160 ts_tablet_manager.cc:1403] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.054s	user 0.023s	sys 0.002s
I20260709 12:23:42.720336  6158 ts_tablet_manager.cc:1434] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:23:42.720978  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:42.720440  5865 catalog_manager.cc:5697] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.721207  6158 tablet_bootstrap.cc:492] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:42.724274  6159 tablet_bootstrap.cc:654] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.725121  6247 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.726082  6160 raft_consensus.cc:359] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.729279  6250 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.730696  6250 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:42.731665  6006 leader_election.cc:343] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.732076  6006 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:42.732740  6250 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.733650  6160 raft_consensus.cc:385] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.733991  6160 raft_consensus.cc:740] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.733950  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:42.734803  6160 consensus_queue.cc:260] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.730188  6158 tablet_bootstrap.cc:654] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:42.735550  5934 leader_election.cc:343] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.735652  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:23:42.736980  5932 leader_election.cc:343] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.737398  5932 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:42.738104  6250 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:42.739239  6159 tablet_bootstrap.cc:492] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:42.739773  6159 ts_tablet_manager.cc:1403] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.006s
I20260709 12:23:42.740271  6247 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:42.741535  6160 ts_tablet_manager.cc:1434] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:23:42.742367  6160 tablet_bootstrap.cc:492] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:42.742376  6159 raft_consensus.cc:359] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.743211  6159 raft_consensus.cc:385] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.743510  6159 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.744297  6159 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.747605  6159 ts_tablet_manager.cc:1434] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 12:23:42.748606  6160 tablet_bootstrap.cc:654] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.748919  6159 tablet_bootstrap.cc:492] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:42.754999  6159 tablet_bootstrap.cc:654] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.758332  6158 tablet_bootstrap.cc:492] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:42.758867  6158 ts_tablet_manager.cc:1403] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.038s	user 0.010s	sys 0.007s
I20260709 12:23:42.761565  6158 raft_consensus.cc:359] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.762291  6158 raft_consensus.cc:385] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.762593  6158 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.763271  6158 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.766244  6160 tablet_bootstrap.cc:492] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:42.766793  6160 ts_tablet_manager.cc:1403] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.003s
I20260709 12:23:42.770360  6159 tablet_bootstrap.cc:492] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:42.771152  6158 ts_tablet_manager.cc:1434] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:23:42.771768  6159 ts_tablet_manager.cc:1403] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.001s
I20260709 12:23:42.772357  6158 tablet_bootstrap.cc:492] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:42.774351  6159 raft_consensus.cc:359] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.775519  6250 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.769397  6160 raft_consensus.cc:359] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.775102  6159 raft_consensus.cc:385] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.776356  6159 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.776028  6250 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.777170  6159 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.778570  6250 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.776026  6160 raft_consensus.cc:385] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.779762  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:42.780086  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:42.780257  6160 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.780743  6044 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:42.781021  6160 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:42.781383  5934 leader_election.cc:343] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.782039  5932 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:42.783111  6322 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:42.783460  6322 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.783816  6322 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.785228  6160 ts_tablet_manager.cc:1434] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.018s	user 0.002s	sys 0.003s
I20260709 12:23:42.788213  6160 tablet_bootstrap.cc:492] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:42.787213  6159 ts_tablet_manager.cc:1434] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.001s
I20260709 12:23:42.790930  6159 tablet_bootstrap.cc:492] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:42.790447  6322 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.792137  6212 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.794581  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:23:42.795943  5934 leader_election.cc:343] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.797254  6158 tablet_bootstrap.cc:654] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.798272  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:42.798683  6322 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.798859  6042 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.799542  6273 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.804006  6159 tablet_bootstrap.cc:654] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.807255  6160 tablet_bootstrap.cc:654] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:42.806811  6273 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.808746  6273 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.812282  6273 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:42.815701  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:42.816449  6043 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:42.817793  6082 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:42.818877  6198 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.819224  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:42.819406  6198 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.819967  5964 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:42.822785  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:42.823416  6118 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:42.824671  6009 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:42.825595  6191 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:42.825961  6191 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.826280  6191 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.827068  6198 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.827559  6273 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:42.828161  6273 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.828539  6273 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.831861  6198 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.833271  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:42.838737  6042 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:42.846745  6194 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.867975  6194 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.868417  5932 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:42.869400  6250 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:42.869872  6250 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:42.870110  6194 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.841763  6322 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.870736  6250 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.877218  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:23:42.878646  6009 leader_election.cc:343] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:42.859506  6006 leader_election.cc:343] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.866340  6212 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.901221  6212 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.903419  6212 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:23:42.905561  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 46103.2us
I20260709 12:23:42.855216  6191 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.909296  6191 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.910346  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:42.917235  6113 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.918013  6273 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.918311  6250 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:42.910737  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:42.920461  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:42.921386  6273 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:42.922823  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:42.923429  5966 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:42.924237  6113 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:42.925349  6009 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:42.911104  6212 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.913484  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:42.916132  6194 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:42.926644  6194 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.926229  6212 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.928820  6194 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.929306  6212 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:42.930847  6042 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:42.931416  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:42.926155  6198 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:42.932122  6041 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.932256  6198 raft_consensus.cc:697] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:42.935515  6198 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.937453  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:42.941167  6113 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:42.944223  6009 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:42.945226  6194 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:42.945667  6194 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:42.946048  6194 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.947409  6041 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:42.949026  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:42.949790  5963 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.953862  6194 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.957237  5963 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
W20260709 12:23:42.959367  6081 leader_election.cc:343] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.960584  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:42.960927  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:42.961580  6212 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:42.961711  6113 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:42.962159  6212 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:23:42.963192  6212 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:42.972188  6354 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:23:42.972724  6160 tablet_bootstrap.cc:492] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:42.973143  6160 ts_tablet_manager.cc:1403] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.185s	user 0.025s	sys 0.051s
I20260709 12:23:42.975343  6160 raft_consensus.cc:359] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.976029  6160 raft_consensus.cc:385] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:42.976292  6160 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:42.976835  6160 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:42.977974  6160 ts_tablet_manager.cc:1434] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.005s	user 0.003s	sys 0.000s
W20260709 12:23:42.982106  6006 leader_election.cc:343] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:42.982475  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:42.986083  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:42.987110  6160 tablet_bootstrap.cc:492] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:42.967818  6194 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:42.986912  6043 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
W20260709 12:23:43.001076  6081 leader_election.cc:343] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.003940  5863 catalog_manager.cc:5697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:42.998265  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:43.006712  6159 tablet_bootstrap.cc:492] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:43.006677  6198 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.007303  6159 ts_tablet_manager.cc:1403] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.217s	user 0.031s	sys 0.057s
I20260709 12:23:43.007160  6082 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:43.009104  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:43.010037  6159 raft_consensus.cc:359] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.010741  6159 raft_consensus.cc:385] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.010845  6113 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:43.011039  6159 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.011837  6273 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.012284  6273 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.011952  6159 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.016757  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:43.013844  6212 raft_consensus.cc:2764] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:23:43.018354  6158 tablet_bootstrap.cc:492] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:43.018613  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:43.018900  6158 ts_tablet_manager.cc:1403] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.247s	user 0.074s	sys 0.088s
I20260709 12:23:43.007222  6198 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.014370  6009 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:43.027060  6198 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.027796  6158 raft_consensus.cc:359] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:43.022075  6350 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:23:43.024121  6006 leader_election.cc:343] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:43.029584  6006 leader_election.cc:343] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.025812  6159 ts_tablet_manager.cc:1434] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:23:43.028484  6158 raft_consensus.cc:385] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.028362  6194 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:43.012890  6273 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.032193  6158 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.033852  6159 tablet_bootstrap.cc:492] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:43.033071  6158 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.035568  6322 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.038802  6194 raft_consensus.cc:697] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:43.039647  6194 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.042881  6159 tablet_bootstrap.cc:654] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.042819  6158 ts_tablet_manager.cc:1434] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.023s	user 0.002s	sys 0.004s
I20260709 12:23:43.028455  6160 tablet_bootstrap.cc:654] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.045010  6158 tablet_bootstrap.cc:492] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:43.044440  5865 catalog_manager.cc:5697] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.038302  6273 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.046177  6191 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.049365  6250 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.056149  6191 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.055733  6160 tablet_bootstrap.cc:492] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:43.057925  6160 ts_tablet_manager.cc:1403] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.071s	user 0.008s	sys 0.006s
I20260709 12:23:43.058301  6191 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.059815  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:43.060055  6273 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:43.060070  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:43.060798  6118 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
W20260709 12:23:43.061425  6081 leader_election.cc:343] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.066756  6159 tablet_bootstrap.cc:492] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:43.067332  6159 ts_tablet_manager.cc:1403] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.034s	user 0.013s	sys 0.004s
I20260709 12:23:43.071208  5866 catalog_manager.cc:5697] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.074312  6160 raft_consensus.cc:359] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.075068  6160 raft_consensus.cc:385] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.075335  6160 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.076002  6160 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.079463  6158 tablet_bootstrap.cc:654] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.080101  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:43.082269  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:43.082036  6160 ts_tablet_manager.cc:1434] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:23:43.082901  6041 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.083845  6160 tablet_bootstrap.cc:492] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:43.082867  5966 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:43.090608  6041 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:43.095234  6159 raft_consensus.cc:359] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.096966  6159 raft_consensus.cc:385] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.096727  6160 tablet_bootstrap.cc:654] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.097397  6159 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.099879  6159 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.100448  6198 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.102260  6159 ts_tablet_manager.cc:1434] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.002s
I20260709 12:23:43.105202  6159 tablet_bootstrap.cc:492] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:43.102438  6198 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.114379  6158 tablet_bootstrap.cc:492] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:43.115300  6158 ts_tablet_manager.cc:1403] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.071s	user 0.014s	sys 0.001s
I20260709 12:23:43.119014  6158 raft_consensus.cc:359] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.119750  6158 raft_consensus.cc:385] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.120024  6158 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.120311  6160 tablet_bootstrap.cc:492] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:43.120774  6160 ts_tablet_manager.cc:1403] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.037s	user 0.008s	sys 0.006s
I20260709 12:23:43.120609  6158 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.123999  6158 ts_tablet_manager.cc:1434] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:23:43.125195  6158 tablet_bootstrap.cc:492] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:43.126364  6160 raft_consensus.cc:359] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.127238  6160 raft_consensus.cc:385] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.127516  6160 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.128146  6160 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.130189  6160 ts_tablet_manager.cc:1434] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:23:43.131428  6160 tablet_bootstrap.cc:492] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:43.132122  6158 tablet_bootstrap.cc:654] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.106812  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:43.136057  6212 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:43.136612  6212 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:23:43.137490  6212 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.139883  6160 tablet_bootstrap.cc:654] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.141043  6159 tablet_bootstrap.cc:654] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.144006  6158 tablet_bootstrap.cc:492] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:43.144495  6158 ts_tablet_manager.cc:1403] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:23:43.105232  6009 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:43.147449  6158 raft_consensus.cc:359] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.148386  6158 raft_consensus.cc:385] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.148633  6158 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.149381  6158 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.151809  6158 ts_tablet_manager.cc:1434] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:43.152732  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:43.153309  5964 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.154644  6158 tablet_bootstrap.cc:492] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:43.162432  6160 tablet_bootstrap.cc:492] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:43.162609  6198 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.163277  6160 ts_tablet_manager.cc:1403] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.032s	user 0.018s	sys 0.005s
I20260709 12:23:43.163336  6198 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.163805  6198 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.164774  5964 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:43.165405  6159 tablet_bootstrap.cc:492] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:43.166581  6159 ts_tablet_manager.cc:1403] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.062s	user 0.008s	sys 0.006s
I20260709 12:23:43.166352  6160 raft_consensus.cc:359] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.167008  6160 raft_consensus.cc:385] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.167292  6160 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.167966  6160 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.168839  5863 catalog_manager.cc:5697] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.169476  6159 raft_consensus.cc:359] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.169975  6160 ts_tablet_manager.cc:1434] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:43.170176  6159 raft_consensus.cc:385] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.170501  6159 raft_consensus.cc:740] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.166098  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:43.171041  6160 tablet_bootstrap.cc:492] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
W20260709 12:23:43.162695  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 57553.7us
I20260709 12:23:43.171478  6194 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:43.171954  6194 raft_consensus.cc:697] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:43.172384  6198 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.172655  6194 consensus_queue.cc:237] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.174571  6198 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.170328  6273 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.177531  6160 tablet_bootstrap.cc:654] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.177314  6273 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.178375  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:43.182178  6273 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:43.184562  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:43.185345  6158 tablet_bootstrap.cc:654] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.186367  6159 consensus_queue.cc:260] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.187294  6118 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.187393  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:43.185741  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:43.188176  5966 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:43.188500  6044 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:43.190001  6081 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:43.190900  6273 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.191258  6273 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.191574  6273 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.191682  5865 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.198293  6118 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:43.198943  6273 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.185266  5964 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.207088  5964 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:43.209154  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:43.209820  6117 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.209046  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:43.211867  5966 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.220868  5966 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:43.223659  6117 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:43.225288  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:43.225873  6044 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.226222  6158 tablet_bootstrap.cc:492] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:43.226756  6158 ts_tablet_manager.cc:1403] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.072s	user 0.021s	sys 0.008s
I20260709 12:23:43.222023  6273 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:43.229395  6158 raft_consensus.cc:359] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.230684  6158 raft_consensus.cc:385] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.231001  6158 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.231482  6009 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:43.231812  6044 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:43.231637  6158 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.233109  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:43.229329  5864 catalog_manager.cc:5697] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.234195  6273 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:43.235684  6273 raft_consensus.cc:697] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:23:43.236478  6273 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.234522  6159 ts_tablet_manager.cc:1434] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 12:23:43.239090  6159 tablet_bootstrap.cc:492] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:43.241758  6158 ts_tablet_manager.cc:1434] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.015s	user 0.005s	sys 0.000s
I20260709 12:23:43.231830  6160 tablet_bootstrap.cc:492] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:43.243063  6194 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:43.243191  6160 ts_tablet_manager.cc:1403] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.072s	user 0.010s	sys 0.017s
I20260709 12:23:43.243742  6194 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:43.244518  6194 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.245993  6160 raft_consensus.cc:359] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.247776  6160 raft_consensus.cc:385] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.248132  6160 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.248837  6160 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.249804  6242 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.251027  6158 tablet_bootstrap.cc:492] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:43.253273  6160 ts_tablet_manager.cc:1434] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.000s
I20260709 12:23:43.254248  6160 tablet_bootstrap.cc:492] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:43.251463  6159 tablet_bootstrap.cc:654] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.260010  6160 tablet_bootstrap.cc:654] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.262022  6158 tablet_bootstrap.cc:654] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.267256  6322 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:43.291697  6158 tablet_bootstrap.cc:492] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:43.297808  6158 ts_tablet_manager.cc:1403] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.000s
I20260709 12:23:43.296990  6159 tablet_bootstrap.cc:492] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:43.299176  6159 ts_tablet_manager.cc:1403] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.060s	user 0.013s	sys 0.000s
I20260709 12:23:43.301091  5863 catalog_manager.cc:5697] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.301771  6159 raft_consensus.cc:359] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.302402  6159 raft_consensus.cc:385] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.306977  6159 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.307768  6159 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.309520  6159 ts_tablet_manager.cc:1434] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.000s
I20260709 12:23:43.310235  6159 tablet_bootstrap.cc:492] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:43.312117  5864 catalog_manager.cc:5697] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:43.317188  6158 raft_consensus.cc:359] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.318804  6160 tablet_bootstrap.cc:492] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:43.317894  6158 raft_consensus.cc:385] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.319267  6160 ts_tablet_manager.cc:1403] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.065s	user 0.032s	sys 0.024s
I20260709 12:23:43.320219  6194 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.320639  6194 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.321708  6160 raft_consensus.cc:359] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.322149  6159 tablet_bootstrap.cc:654] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.322392  6160 raft_consensus.cc:385] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.322737  6160 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.323352  6160 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.323820  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:43.319375  6158 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.325069  6158 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.325450  6160 ts_tablet_manager.cc:1434] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
W20260709 12:23:43.325716  6006 leader_election.cc:343] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.326367  6160 tablet_bootstrap.cc:492] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:43.322392  6194 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.327009  6158 ts_tablet_manager.cc:1434] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.000s
I20260709 12:23:43.328214  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:43.328471  6158 tablet_bootstrap.cc:492] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
W20260709 12:23:43.329600  6009 leader_election.cc:343] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.330011  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:43.331112  6194 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:43.335522  6159 tablet_bootstrap.cc:492] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:43.336017  6159 ts_tablet_manager.cc:1403] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.003s
I20260709 12:23:43.336509  6160 tablet_bootstrap.cc:654] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.338549  6159 raft_consensus.cc:359] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.339279  6159 raft_consensus.cc:385] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.339538  6159 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.340283  6159 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.341187  6158 tablet_bootstrap.cc:654] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.342514  6159 ts_tablet_manager.cc:1434] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:43.343415  6159 tablet_bootstrap.cc:492] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:43.345520  6250 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.353431  6159 tablet_bootstrap.cc:654] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.377338  6198 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.377831  6198 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.381919  6198 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.382987  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:43.383374  6158 tablet_bootstrap.cc:492] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:43.383805  6158 ts_tablet_manager.cc:1403] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.056s	user 0.029s	sys 0.012s
I20260709 12:23:43.384248  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:23:43.384717  6009 leader_election.cc:343] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:43.385674  6006 leader_election.cc:343] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.386051  6006 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:43.386432  6159 tablet_bootstrap.cc:492] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:43.386899  6159 ts_tablet_manager.cc:1403] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.044s	user 0.009s	sys 0.007s
I20260709 12:23:43.386988  6198 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:43.387024  6158 raft_consensus.cc:359] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.387825  6158 raft_consensus.cc:385] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.388118  6158 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.388779  6158 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.390901  6158 ts_tablet_manager.cc:1434] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:23:43.391603  6160 tablet_bootstrap.cc:492] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:43.391999  6160 ts_tablet_manager.cc:1403] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.066s	user 0.032s	sys 0.012s
I20260709 12:23:43.393673  6158 tablet_bootstrap.cc:492] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:43.394327  6160 raft_consensus.cc:359] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.395015  6160 raft_consensus.cc:385] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.395270  6160 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.395891  6160 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.397105  6159 raft_consensus.cc:359] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.397769  6159 raft_consensus.cc:385] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.398063  6159 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.398908  6159 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.397590  6118 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.399418  6160 ts_tablet_manager.cc:1434] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:23:43.407300  6160 tablet_bootstrap.cc:492] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:43.399852  6158 tablet_bootstrap.cc:654] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.400624  6159 ts_tablet_manager.cc:1434] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:23:43.409996  6159 tablet_bootstrap.cc:492] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:43.412573  6273 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.413125  6273 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.413434  6322 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.415266  6273 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:43.415467  6160 tablet_bootstrap.cc:654] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.418118  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:23:43.419540  6081 leader_election.cc:343] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.419955  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:43.420666  6044 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:43.423377  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:43.424407  6212 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.424804  6212 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.424918  6159 tablet_bootstrap.cc:654] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.426141  6198 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.428869  6212 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.445295  6158 tablet_bootstrap.cc:492] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:43.445825  6158 ts_tablet_manager.cc:1403] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.052s	user 0.018s	sys 0.004s
I20260709 12:23:43.448768  6158 raft_consensus.cc:359] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.449549  6158 raft_consensus.cc:385] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.449839  6158 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.450546  6158 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.454310  6158 ts_tablet_manager.cc:1434] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:23:43.458446  6158 tablet_bootstrap.cc:492] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:43.458385  6311 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:43.460848  6311 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.462363  6322 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.462916  6322 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.466847  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:43.467747  6044 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 1: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:23:43.469309  6158 tablet_bootstrap.cc:654] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.469592  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:43.472004  5932 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:43.472888  6242 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.478607  6322 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.480967  6212 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.484061  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:23:43.486392  6081 leader_election.cc:343] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.487500  6158 tablet_bootstrap.cc:492] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:43.487463  6212 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:43.488142  6158 ts_tablet_manager.cc:1403] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.030s	user 0.007s	sys 0.005s
I20260709 12:23:43.492733  5963 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.494405  6158 raft_consensus.cc:359] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.495257  6158 raft_consensus.cc:385] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.495513  6158 raft_consensus.cc:740] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.496140  6158 consensus_queue.cc:260] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.497390  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:43.497956  6041 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.504092  6158 ts_tablet_manager.cc:1434] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.016s	user 0.003s	sys 0.005s
I20260709 12:23:43.505128  6158 tablet_bootstrap.cc:492] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:43.511085  6041 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:43.512876  6198 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.514882  6242 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:43.514333  6158 tablet_bootstrap.cc:654] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.519308  6198 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.521569  6160 tablet_bootstrap.cc:492] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:43.522053  6160 ts_tablet_manager.cc:1403] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.115s	user 0.034s	sys 0.016s
I20260709 12:23:43.524901  6160 raft_consensus.cc:359] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.525586  6160 raft_consensus.cc:385] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.525854  6160 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.526527  6160 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.528844  6160 ts_tablet_manager.cc:1434] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.003s
I20260709 12:23:43.529765  6160 tablet_bootstrap.cc:492] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:43.536791  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:43.541146  6212 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:43.541723  6212 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:23:43.542603  6212 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.555797  6242 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.556427  6242 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.558805  6242 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.560079  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:43.566346  6160 tablet_bootstrap.cc:654] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.577252  6158 tablet_bootstrap.cc:492] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:43.577790  6158 ts_tablet_manager.cc:1403] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.073s	user 0.014s	sys 0.003s
I20260709 12:23:43.580710  6158 raft_consensus.cc:359] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.581535  6158 raft_consensus.cc:385] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.581923  6158 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.582666  6158 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.584877  6158 ts_tablet_manager.cc:1434] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:23:43.585803  6158 tablet_bootstrap.cc:492] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:43.586602  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:43.587886  6160 tablet_bootstrap.cc:492] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:43.588348  6160 ts_tablet_manager.cc:1403] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.059s	user 0.009s	sys 0.001s
I20260709 12:23:43.590931  6160 raft_consensus.cc:359] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.591566  6198 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.591768  6160 raft_consensus.cc:385] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.592064  6160 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.592020  6198 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.592895  6160 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.596285  6160 ts_tablet_manager.cc:1434] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.004s
I20260709 12:23:43.596526  6198 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.597203  6160 tablet_bootstrap.cc:492] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:43.609809  6158 tablet_bootstrap.cc:654] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:43.612514  5914 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:43.613461  6160 tablet_bootstrap.cc:654] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.624181  6160 tablet_bootstrap.cc:492] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:43.625254  6160 ts_tablet_manager.cc:1403] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.028s	user 0.008s	sys 0.006s
I20260709 12:23:43.628041  6158 tablet_bootstrap.cc:492] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:43.628583  6158 ts_tablet_manager.cc:1403] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.043s	user 0.005s	sys 0.006s
I20260709 12:23:43.631656  6158 raft_consensus.cc:359] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.632400  6158 raft_consensus.cc:385] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.632669  6158 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.633338  6158 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.635929  6160 raft_consensus.cc:359] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.636682  6160 raft_consensus.cc:385] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.636930  6160 raft_consensus.cc:740] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.639358  6158 ts_tablet_manager.cc:1434] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.002s
I20260709 12:23:43.640442  6158 tablet_bootstrap.cc:492] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:43.646237  6158 tablet_bootstrap.cc:654] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.648121  6160 consensus_queue.cc:260] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.650391  6160 ts_tablet_manager.cc:1434] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:23:43.651419  6160 tablet_bootstrap.cc:492] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:43.657156  6160 tablet_bootstrap.cc:654] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.660065  5932 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:43.661068  6322 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:43.663623  6198 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:43.663682  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 67017.5us
I20260709 12:23:43.664204  6198 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.666078  6198 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.672122  6160 tablet_bootstrap.cc:492] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:43.672760  6160 ts_tablet_manager.cc:1403] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.022s	user 0.008s	sys 0.003s
I20260709 12:23:43.677506  6158 tablet_bootstrap.cc:492] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:43.678071  6158 ts_tablet_manager.cc:1403] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.038s	user 0.007s	sys 0.005s
I20260709 12:23:43.681581  6160 raft_consensus.cc:359] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.682356  6160 raft_consensus.cc:385] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.682651  6160 raft_consensus.cc:740] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.683306  6160 consensus_queue.cc:260] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.685796  6160 ts_tablet_manager.cc:1434] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.013s	user 0.007s	sys 0.000s
I20260709 12:23:43.686767  6160 tablet_bootstrap.cc:492] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:43.692498  6160 tablet_bootstrap.cc:654] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.695713  6198 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.696257  6198 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.698248  6198 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.696409  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:43.699613  6242 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.700091  6242 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.700359  6158 raft_consensus.cc:359] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.701119  6158 raft_consensus.cc:385] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.701406  6158 raft_consensus.cc:740] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.702056  6242 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.702064  6158 consensus_queue.cc:260] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.703861  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:43.704504  6116 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:43.704808  6158 ts_tablet_manager.cc:1434] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.026s	user 0.007s	sys 0.000s
I20260709 12:23:43.705826  5934 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:43.706746  6242 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.707137  6242 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.707574  6242 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.709625  6160 tablet_bootstrap.cc:492] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:43.710083  6160 ts_tablet_manager.cc:1403] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.000s
I20260709 12:23:43.713035  6160 raft_consensus.cc:359] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.713757  6160 raft_consensus.cc:385] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.714082  6160 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.713595  6212 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:43.715070  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52838.9us
I20260709 12:23:43.714993  6160 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.715004  6212 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.717729  6242 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.728894  5967 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.718219  6160 ts_tablet_manager.cc:1434] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:23:43.719755  6212 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:43.715420  5863 catalog_manager.cc:5697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:43.731323  6160 tablet_bootstrap.cc:492] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:43.731480  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:43.732178  6113 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.724572  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:43.727131  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:43.733263  5966 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:43.727497  6159 tablet_bootstrap.cc:492] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:43.736253  6158 tablet_bootstrap.cc:492] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:43.736281  6159 ts_tablet_manager.cc:1403] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.326s	user 0.064s	sys 0.103s
I20260709 12:23:43.737511  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:43.739328  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:43.740080  5968 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:43.743088  6159 raft_consensus.cc:359] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.743795  6159 raft_consensus.cc:385] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.744048  6159 raft_consensus.cc:740] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.744804  6159 consensus_queue.cc:260] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:43.745684  6009 leader_election.cc:343] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.746914  6194 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.747103  6159 ts_tablet_manager.cc:1434] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:23:43.747423  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:43.748159  5968 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:43.730186  6242 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.752064  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:43.752790  6041 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:43.757134  6198 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.757513  6006 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:43.759038  6160 tablet_bootstrap.cc:654] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.759090  6198 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.760210  6198 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.760574  6198 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.763636  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:43.765096  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:43.766072  5968 raft_consensus.cc:2393] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:23:43.765918  6191 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.766928  6006 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:43.767755  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:43.769649  6247 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.770011  6191 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.770110  6247 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.770507  6191 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.770699  6247 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.770915  6191 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.773820  6212 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.774320  6212 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.776315  6212 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:43.776816  6212 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.778975  6158 tablet_bootstrap.cc:654] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:43.783136  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:43.783272  6247 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.783831  5968 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:43.785742  6191 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.787864  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:43.792033  6311 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:43.792500  6311 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:43.793433  6311 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.795727  6113 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:43.793576  6247 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.796947  6198 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.808792  6212 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.817772  6242 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.818310  6242 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.820369  6242 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.822541  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:23:43.823707  5934 leader_election.cc:343] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.828603  6242 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.829154  6242 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.831369  6242 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.748456  6159 tablet_bootstrap.cc:492] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:43.804093  6191 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.804677  6311 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:43.804625  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 58053.9us
I20260709 12:23:43.832949  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:43.801949  6194 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.847838  6194 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.848515  6311 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:43.849623  6194 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.850026  6158 tablet_bootstrap.cc:492] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:43.850529  6158 ts_tablet_manager.cc:1403] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.114s	user 0.005s	sys 0.008s
I20260709 12:23:43.836910  6273 raft_consensus.cc:2764] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260709 12:23:43.851629  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:43.852351  5968 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:43.853873  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 85447.7us
I20260709 12:23:43.838888  6198 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.857056  5934 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:43.857985  6242 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:43.858439  6242 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:43.859264  6242 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.869700  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:43.872723  6042 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:23:43.869861  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:23:43.867199  5934 leader_election.cc:343] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.882752  6160 tablet_bootstrap.cc:492] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:43.910676  6198 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:43.911773  6160 ts_tablet_manager.cc:1403] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.181s	user 0.038s	sys 0.022s
I20260709 12:23:43.914086  6044 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:23:43.910478  6009 leader_election.cc:343] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.922983  6407 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:43.923857  6009 leader_election.cc:343] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:43.926847  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:43.927471  5962 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.918558  6158 raft_consensus.cc:359] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.929051  6158 raft_consensus.cc:385] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.929325  6158 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.930151  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:43.930486  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:43.931334  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:43.932072  6117 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 1: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:23:43.931861  6411 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:43.910351  5968 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:43.938776  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:43.940963  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:43.941581  6042 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:43.939065  6158 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.943789  6159 tablet_bootstrap.cc:654] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:43.913457  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 47444.9us
I20260709 12:23:43.949877  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:43.954151  6158 ts_tablet_manager.cc:1434] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.103s	user 0.003s	sys 0.018s
I20260709 12:23:43.954792  6041 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:43.962877  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:43.963599  6039 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:43.962942  6391 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:43.964875  6391 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.966419  6160 raft_consensus.cc:359] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.967110  6160 raft_consensus.cc:385] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:43.967375  6160 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:43.967881  6391 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:43.967986  6160 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:43.972201  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:43.972951  6038 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:43.981312  6160 ts_tablet_manager.cc:1434] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.069s	user 0.002s	sys 0.005s
I20260709 12:23:43.975960  6407 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:23:43.962076  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:43.990387  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:43.991189  5963 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 1: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:23:43.993691  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:43.991074  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:43.995617  5962 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
W20260709 12:23:44.002808  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 45287.1us
I20260709 12:23:44.000672  6407 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:44.005873  6407 raft_consensus.cc:697] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:23:44.004155  5965 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.014175  5932 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:44.015691  6322 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:44.016069  6322 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.016424  5960 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:44.014302  6009 leader_election.cc:343] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:44.017436  6009 leader_election.cc:343] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.016510  6322 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.008397  6407 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.028527  6158 tablet_bootstrap.cc:492] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:44.035243  6006 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:44.029121  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:23:44.018391  5934 leader_election.cc:343] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.047312  6247 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:44.058872  6247 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:44.060005  6247 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.030639  6273 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.026s
I20260709 12:23:44.035862  6009 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:44.070884  6406 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:23:44.072911  6009 leader_election.cc:343] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.081919  6160 tablet_bootstrap.cc:492] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:44.081377  6242 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.082864  6242 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.083995  6041 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:44.087464  6242 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:44.088930  5965 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:44.073990  6322 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.089607  5932 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:44.090360  5961 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 1: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:23:44.089900  5864 catalog_manager.cc:5697] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.090670  6242 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:44.102887  6242 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.092927  6405 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:23:44.105217  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:44.110201  6198 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.110738  6198 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.112782  6198 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:44.114174  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:44.115528  6198 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
W20260709 12:23:44.116137  6418 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:23:44.107040  6242 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.115967  6198 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:44.120378  6158 tablet_bootstrap.cc:654] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.120512  6198 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.115943  6006 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:44.130119  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:44.131403  6421 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.133654  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:44.150765  6159 tablet_bootstrap.cc:492] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:44.151458  6159 ts_tablet_manager.cc:1403] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.403s	user 0.031s	sys 0.020s
I20260709 12:23:44.149712  6322 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:44.156865  6159 raft_consensus.cc:359] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.157974  6159 raft_consensus.cc:385] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.158344  6159 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
W20260709 12:23:44.168905  6006 leader_election.cc:343] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.168727  6159 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.166579  6322 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.174801  6159 ts_tablet_manager.cc:1434] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.023s	user 0.005s	sys 0.002s
I20260709 12:23:44.176937  6159 tablet_bootstrap.cc:492] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:44.179193  6322 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.188643  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:44.197932  6160 tablet_bootstrap.cc:654] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.207232  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:44.209555  6322 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:23:44.210230  6423 log.cc:927] Time spent T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.001s
W20260709 12:23:44.212636  5932 leader_election.cc:343] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.213160  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:44.217856  6158 tablet_bootstrap.cc:492] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:44.223387  6158 ts_tablet_manager.cc:1403] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.195s	user 0.011s	sys 0.014s
W20260709 12:23:44.233932  6009 leader_election.cc:343] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.234617  6009 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:44.235580  6194 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:44.235512  5865 catalog_manager.cc:5697] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:44.240541  6421 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:44.272149  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:44.277266  6242 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.283380  6159 tablet_bootstrap.cc:654] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.284739  6420 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:44.285223  6242 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:44.280107  6273 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.291000  6273 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.293396  6273 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:44.295770  6158 raft_consensus.cc:359] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.296620  6158 raft_consensus.cc:385] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.296901  6158 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.297537  6158 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:44.301050  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 47685.1us
I20260709 12:23:44.297434  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:44.303846  6158 ts_tablet_manager.cc:1434] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.080s	user 0.007s	sys 0.000s
I20260709 12:23:44.304337  6160 tablet_bootstrap.cc:492] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:44.304757  6160 ts_tablet_manager.cc:1403] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.223s	user 0.017s	sys 0.004s
I20260709 12:23:44.305160  6158 tablet_bootstrap.cc:492] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:44.321417  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:44.301798  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:44.323589  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:23:44.312996  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 66822.7us
I20260709 12:23:44.410837  6160 raft_consensus.cc:359] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.412077  6160 raft_consensus.cc:385] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:23:44.412221  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 91018.3us
I20260709 12:23:44.412391  6160 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.413053  6160 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.330883  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:44.421196  5966 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:23:44.348481  6044 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
W20260709 12:23:44.420351  5934 leader_election.cc:343] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.348515  6431 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:44.426946  5932 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:44.427410  6159 tablet_bootstrap.cc:492] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:44.384395  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:44.427968  6159 ts_tablet_manager.cc:1403] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.251s	user 0.045s	sys 0.015s
I20260709 12:23:44.415012  6039 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.431594  6160 ts_tablet_manager.cc:1434] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.127s	user 0.011s	sys 0.001s
I20260709 12:23:44.432545  6160 tablet_bootstrap.cc:492] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:44.434274  6159 raft_consensus.cc:359] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.434900  6159 raft_consensus.cc:385] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.435099  6159 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.435619  6159 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.430984  6322 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:44.438889  6322 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.439270  6322 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.440516  6158 tablet_bootstrap.cc:654] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.441812  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:44.442788  6159 ts_tablet_manager.cc:1434] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
W20260709 12:23:44.447340  5934 leader_election.cc:343] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.449146  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:23:44.451906  5934 leader_election.cc:343] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.451858  6322 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.454084  6322 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:44.455487  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:23:44.456910  5934 leader_election.cc:343] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.458438  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:44.459095  6044 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.459241  6081 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:44.460103  6407 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.461359  6322 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:44.464231  6159 tablet_bootstrap.cc:492] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:44.467695  6407 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:44.469525  6041 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:44.476346  5932 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:44.475422  6322 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.478434  6242 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:44.479002  6242 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:44.477344  6322 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.494364  6322 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:44.491472  5865 catalog_manager.cc:5697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.495196  6242 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.496801  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:44.496332  5865 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:44.498426  5934 leader_election.cc:343] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.500321  6420 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:44.501333  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:23:44.503386  5932 leader_election.cc:343] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.503780  5932 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:44.504477  6160 tablet_bootstrap.cc:654] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.504527  6420 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:44.506803  6044 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:44.511127  5932 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:44.515020  6158 tablet_bootstrap.cc:492] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:44.512223  6322 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:44.516153  6322 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:44.516896  6322 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.519340  6159 tablet_bootstrap.cc:654] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.515552  6158 ts_tablet_manager.cc:1403] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.211s	user 0.010s	sys 0.026s
I20260709 12:23:44.527149  6039 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:44.529152  5932 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:44.530917  6158 raft_consensus.cc:359] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.531666  6242 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:44.533654  5863 catalog_manager.cc:5697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.538046  6159 tablet_bootstrap.cc:492] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:44.538908  6242 raft_consensus.cc:697] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:44.541191  6160 tablet_bootstrap.cc:492] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:44.538782  6158 raft_consensus.cc:385] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.542683  6158 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.543468  6158 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.545586  6158 ts_tablet_manager.cc:1434] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.001s
I20260709 12:23:44.546309  6158 tablet_bootstrap.cc:492] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:44.546732  6160 ts_tablet_manager.cc:1403] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.114s	user 0.010s	sys 0.007s
I20260709 12:23:44.547437  6159 ts_tablet_manager.cc:1403] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.083s	user 0.014s	sys 0.000s
I20260709 12:23:44.549263  6160 raft_consensus.cc:359] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.549947  6160 raft_consensus.cc:385] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.549780  6159 raft_consensus.cc:359] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.550236  6160 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.550426  6159 raft_consensus.cc:385] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.550719  6159 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.550917  6160 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.551433  6159 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.553625  6159 ts_tablet_manager.cc:1434] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:23:44.554919  6159 tablet_bootstrap.cc:492] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:44.542092  6242 consensus_queue.cc:237] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.559495  6158 tablet_bootstrap.cc:654] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.560334  6159 tablet_bootstrap.cc:654] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.563795  6322 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.564313  6322 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.566578  6322 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:44.567878  6160 ts_tablet_manager.cc:1434] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:23:44.568557  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:44.568872  6160 tablet_bootstrap.cc:492] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:44.569228  6039 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:44.572247  5932 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:44.575193  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:23:44.576936  5934 leader_election.cc:343] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.579690  6322 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:44.580153  6322 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.580507  6322 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.586301  6273 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:44.591957  6273 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:44.622246  6322 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.636945  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:44.642870  6159 tablet_bootstrap.cc:492] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:44.643999  6159 ts_tablet_manager.cc:1403] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.089s	user 0.012s	sys 0.015s
I20260709 12:23:44.639823  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:23:44.638432  5934 leader_election.cc:343] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.638749  6322 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:44.646872  6039 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.649794  6159 raft_consensus.cc:359] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.650319  6159 raft_consensus.cc:385] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.650612  6159 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.651201  6159 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.654091  6159 ts_tablet_manager.cc:1434] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:23:44.654994  6159 tablet_bootstrap.cc:492] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:44.656147  6158 tablet_bootstrap.cc:492] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:44.656594  6158 ts_tablet_manager.cc:1403] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.110s	user 0.011s	sys 0.002s
I20260709 12:23:44.661665  6158 raft_consensus.cc:359] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.662357  6158 raft_consensus.cc:385] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.662648  6158 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.663362  6158 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.670848  6403 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:44.671573  5863 catalog_manager.cc:5697] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.672966  6116 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.670871  6158 ts_tablet_manager.cc:1434] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:23:44.673425  5863 catalog_manager.cc:5697] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.681295  6158 tablet_bootstrap.cc:492] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:44.686337  6160 tablet_bootstrap.cc:654] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.690287  6039 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:44.691666  5932 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:44.692672  6322 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:44.693169  6322 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:44.693951  6322 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.694813  6158 tablet_bootstrap.cc:654] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.697880  6403 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:44.702201  6159 tablet_bootstrap.cc:654] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.714380  6405 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.714974  6405 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.749997  6405 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:44.762306  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:44.763283  6044 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:23:44.756779  6191 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:23:44.779160  6198 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:44.777860  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:44.792016  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:44.797988  6158 tablet_bootstrap.cc:492] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:44.798939  6407 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.799768  6158 ts_tablet_manager.cc:1403] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.119s	user 0.024s	sys 0.005s
I20260709 12:23:44.814019  5863 catalog_manager.cc:5697] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:44.814931  6407 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:44.860322  6158 raft_consensus.cc:359] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.861102  6158 raft_consensus.cc:385] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.861382  6158 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.869889  6421 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.870409  6421 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.872525  6421 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:44.874908  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:23:44.880125  5914 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:44.882824  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:44.883147  6160 tablet_bootstrap.cc:492] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:44.883577  6160 ts_tablet_manager.cc:1403] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.315s	user 0.015s	sys 0.005s
I20260709 12:23:44.883530  6116 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:44.883836  6159 tablet_bootstrap.cc:492] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:44.884275  6159 ts_tablet_manager.cc:1403] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.229s	user 0.043s	sys 0.069s
I20260709 12:23:44.884743  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:44.886309  6160 raft_consensus.cc:359] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.887003  6160 raft_consensus.cc:385] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.886777  6159 raft_consensus.cc:359] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.887286  6160 raft_consensus.cc:740] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.887545  6159 raft_consensus.cc:385] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.887853  6159 raft_consensus.cc:740] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.887948  6160 consensus_queue.cc:260] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.888520  6159 consensus_queue.cc:260] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.889003  6406 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:44.889333  6406 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.889637  6406 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.890666  6159 ts_tablet_manager.cc:1434] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.003s
I20260709 12:23:44.890936  6212 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.891566  6159 tablet_bootstrap.cc:492] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:44.891377  6212 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.893348  6212 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:44.886329  6158 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.889569  6160 ts_tablet_manager.cc:1434] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:23:44.897257  6160 tablet_bootstrap.cc:492] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:44.897496  6159 tablet_bootstrap.cc:654] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.897682  5961 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:44.901175  6158 ts_tablet_manager.cc:1434] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.101s	user 0.006s	sys 0.000s
I20260709 12:23:44.902191  6158 tablet_bootstrap.cc:492] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:44.906764  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:44.907420  6160 tablet_bootstrap.cc:654] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.912204  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:44.913009  6039 raft_consensus.cc:2393] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:23:44.908978  6159 tablet_bootstrap.cc:492] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:44.914523  6159 ts_tablet_manager.cc:1403] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.023s	user 0.010s	sys 0.008s
I20260709 12:23:44.914737  6406 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.917277  6159 raft_consensus.cc:359] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.917977  6159 raft_consensus.cc:385] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.918263  6159 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.919523  6406 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:44.920272  6158 tablet_bootstrap.cc:654] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.918974  6159 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.922962  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:44.923564  5961 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.924494  6159 ts_tablet_manager.cc:1434] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:23:44.925393  6159 tablet_bootstrap.cc:492] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:44.928196  6082 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:44.929774  6407 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.930649  6159 tablet_bootstrap.cc:654] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.936491  6407 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:44.937626  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:44.938405  6273 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.939117  6273 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.941322  6273 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:44.943881  6158 tablet_bootstrap.cc:492] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:44.944339  6158 ts_tablet_manager.cc:1403] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.042s	user 0.015s	sys 0.000s
I20260709 12:23:44.945851  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:44.946635  6044 raft_consensus.cc:2393] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:23:44.946769  6116 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.947263  6158 raft_consensus.cc:359] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.947958  6158 raft_consensus.cc:385] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.948216  6158 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.948417  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:44.949033  6158 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.951097  6158 ts_tablet_manager.cc:1434] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:23:44.952822  6082 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:44.953408  6273 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.956481  6158 tablet_bootstrap.cc:492] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:44.957135  6160 tablet_bootstrap.cc:492] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:44.957573  6160 ts_tablet_manager.cc:1403] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.061s	user 0.009s	sys 0.000s
I20260709 12:23:44.960295  6160 raft_consensus.cc:359] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.960639  5961 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:44.960930  6160 raft_consensus.cc:385] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.960877  6116 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:44.961314  6160 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.961964  6160 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.962592  6006 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:44.969545  6406 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:44.970826  6159 tablet_bootstrap.cc:492] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:44.971325  6159 ts_tablet_manager.cc:1403] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.046s	user 0.009s	sys 0.015s
I20260709 12:23:44.968060  6158 tablet_bootstrap.cc:654] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.971451  6406 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:44.972749  6406 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.973857  6159 raft_consensus.cc:359] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.974546  6159 raft_consensus.cc:385] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.974818  6159 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:44.968441  6160 ts_tablet_manager.cc:1434] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.001s
I20260709 12:23:44.975433  6159 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.976596  6160 tablet_bootstrap.cc:492] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:44.977715  6159 ts_tablet_manager.cc:1434] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:44.981808  6273 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:44.983407  6322 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:44.983923  6322 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.986001  6158 tablet_bootstrap.cc:492] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:44.986248  6322 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:44.986491  6158 ts_tablet_manager.cc:1403] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.030s	user 0.010s	sys 0.000s
I20260709 12:23:44.987234  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:44.987879  6044 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:44.989063  5932 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:44.989181  6158 raft_consensus.cc:359] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.989820  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:44.989821  6158 raft_consensus.cc:385] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:44.990710  6158 raft_consensus.cc:740] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
W20260709 12:23:44.991511  5934 leader_election.cc:343] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:44.991358  6158 consensus_queue.cc:260] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:44.989800  6159 tablet_bootstrap.cc:492] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:44.992381  6242 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:44.992755  6242 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:44.993088  6242 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:44.993428  6158 ts_tablet_manager.cc:1434] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.000s
I20260709 12:23:44.993873  6160 tablet_bootstrap.cc:654] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:44.997998  6159 tablet_bootstrap.cc:654] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.003413  6158 tablet_bootstrap.cc:492] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:45.010313  6406 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.010861  6406 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.011094  5864 catalog_manager.cc:5697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.014881  6158 tablet_bootstrap.cc:654] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.014676  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:45.015710  6116 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:45.016906  6009 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:45.017618  6198 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:45.017940  6198 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.018250  6198 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.018127  6420 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:45.018113  6406 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.024143  6198 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.025712  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:45.026377  5961 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:45.027237  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:45.027829  6116 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.027915  6158 tablet_bootstrap.cc:492] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:45.028458  6158 ts_tablet_manager.cc:1403] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.005s
I20260709 12:23:45.035508  6116 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:45.040634  6198 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.047474  6242 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.049117  6009 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:23:45.057315  5934 consensus_peers.cc:597] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:45.049244  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:45.049925  6421 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.058018  6421 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.060101  6421 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.060218  6159 tablet_bootstrap.cc:492] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:45.060859  6159 ts_tablet_manager.cc:1403] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.071s	user 0.009s	sys 0.012s
I20260709 12:23:45.061020  5961 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.061463  6421 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:45.062953  6421 raft_consensus.cc:697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:45.063259  6159 raft_consensus.cc:359] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.063740  6159 raft_consensus.cc:385] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.063762  6421 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.064625  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:23:45.065896  6009 leader_election.cc:343] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.067647  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:45.068127  6160 tablet_bootstrap.cc:492] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:45.068602  6160 ts_tablet_manager.cc:1403] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.092s	user 0.006s	sys 0.011s
I20260709 12:23:45.068532  6420 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:45.068310  5962 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:45.071099  6322 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:45.071290  6160 raft_consensus.cc:359] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.072299  6242 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.072357  6159 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.073032  5961 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:45.074076  6198 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.074601  6159 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.074744  6198 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.076696  6159 ts_tablet_manager.cc:1434] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.016s	user 0.004s	sys 0.000s
I20260709 12:23:45.077632  6159 tablet_bootstrap.cc:492] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:45.071892  6160 raft_consensus.cc:385] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.073437  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:45.049714  6158 raft_consensus.cc:359] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.078783  6158 raft_consensus.cc:385] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.079341  6158 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.079383  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:45.080106  6039 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:45.080529  5934 leader_election.cc:343] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.081334  6160 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.082053  6160 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.084142  6160 ts_tablet_manager.cc:1434] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.015s	user 0.007s	sys 0.000s
I20260709 12:23:45.084128  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:45.085047  5961 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:45.085290  6160 tablet_bootstrap.cc:492] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:45.080212  6158 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.087949  6158 ts_tablet_manager.cc:1434] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.001s
I20260709 12:23:45.088063  6039 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:45.077562  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:45.093117  6159 tablet_bootstrap.cc:654] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.095304  6158 tablet_bootstrap.cc:492] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:45.096524  5932 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:45.097431  6322 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:45.097956  6322 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:45.098676  6406 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:45.098547  6425 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:45.099152  6406 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.098878  6322 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.099565  6406 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.098899  6420 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:45.107784  6158 tablet_bootstrap.cc:654] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.129268  6198 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.108096  6242 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.131553  6242 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.110092  5863 catalog_manager.cc:5697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.113703  6420 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:45.133651  6242 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.136431  6191 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.137183  6191 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.137814  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:45.138511  6117 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:45.139688  6191 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.141422  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:45.117158  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:45.118046  6006 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:45.146142  6421 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:45.149098  6421 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.141573  5934 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:45.149464  6421 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.150293  6322 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:45.154914  6322 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.155319  6322 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.157473  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:45.160040  5865 catalog_manager.cc:5697] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.161222  6160 tablet_bootstrap.cc:654] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.116175  6406 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.162017  6421 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:45.169683  6009 leader_election.cc:343] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:45.171339  6009 leader_election.cc:343] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:45.171604  6006 leader_election.cc:343] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.176501  6420 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.178041  6006 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:45.177047  6420 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.183632  6247 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:45.176559  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:45.190313  6041 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:45.206354  6420 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.208437  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:45.207001  6420 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:23:45.210652  5932 leader_election.cc:343] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.211846  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:23:45.215831  5934 leader_election.cc:343] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.216281  5934 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:45.231165  6159 tablet_bootstrap.cc:492] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:45.231688  6159 ts_tablet_manager.cc:1403] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.154s	user 0.011s	sys 0.003s
I20260709 12:23:45.236398  6160 tablet_bootstrap.cc:492] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:45.237357  6160 ts_tablet_manager.cc:1403] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.152s	user 0.012s	sys 0.004s
I20260709 12:23:45.225026  6420 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:45.310500  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:45.236434  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:23:45.314023  6009 leader_election.cc:343] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.255331  6406 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.323164  5962 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.332892  6421 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.323939  6159 raft_consensus.cc:359] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.334619  6159 raft_consensus.cc:385] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.334924  6159 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.335089  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:45.335570  6159 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.336549  5962 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:45.338040  6159 ts_tablet_manager.cc:1434] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.106s	user 0.004s	sys 0.001s
W20260709 12:23:45.336728  6009 leader_election.cc:343] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.338912  6159 tablet_bootstrap.cc:492] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:45.339516  6160 raft_consensus.cc:359] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.340178  6160 raft_consensus.cc:385] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.340440  6160 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.341006  6160 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.326527  6322 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.346774  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:45.347497  6198 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:45.348467  6160 ts_tablet_manager.cc:1434] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 12:23:45.349323  6160 tablet_bootstrap.cc:492] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:45.372530  6198 raft_consensus.cc:697] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:45.374706  6158 tablet_bootstrap.cc:492] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:45.375105  6158 ts_tablet_manager.cc:1403] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.280s	user 0.037s	sys 0.022s
I20260709 12:23:45.373360  6198 consensus_queue.cc:237] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.384259  6159 tablet_bootstrap.cc:654] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.392774  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:45.393445  6041 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.395399  6158 raft_consensus.cc:359] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.396127  6158 raft_consensus.cc:385] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.396785  6158 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.404134  6041 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:45.397452  6158 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.409286  6158 ts_tablet_manager.cc:1434] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.034s	user 0.006s	sys 0.001s
I20260709 12:23:45.417497  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:23:45.410441  6471 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:23:45.425828  6158 tablet_bootstrap.cc:492] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:45.431951  6477 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.414292  6322 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.432850  6477 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.444361  6247 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:45.424160  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:45.430677  6242 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:45.452723  5967 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.459709  6477 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.454316  6242 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:45.462513  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:45.462291  6242 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:45.463912  5932 leader_election.cc:343] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.468839  6160 tablet_bootstrap.cc:654] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.465227  6478 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.012s
I20260709 12:23:45.505800  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:45.509341  5967 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:45.510133  6478 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:45.510808  6406 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:45.497669  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:45.506078  6159 tablet_bootstrap.cc:492] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:45.512466  6114 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.513156  6159 ts_tablet_manager.cc:1403] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.174s	user 0.017s	sys 0.022s
I20260709 12:23:45.520375  6006 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:45.524812  6191 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:45.525343  6191 raft_consensus.cc:697] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:45.526082  6191 consensus_queue.cc:237] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:45.523860  5934 leader_election.cc:343] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.533492  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:45.539410  6159 raft_consensus.cc:359] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.539975  6159 raft_consensus.cc:385] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.540203  6159 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.543893  6159 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.548825  6485 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:45.551172  6114 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:45.551220  6159 ts_tablet_manager.cc:1434] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.038s	user 0.004s	sys 0.002s
I20260709 12:23:45.559000  6159 tablet_bootstrap.cc:492] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:45.559708  6273 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.560290  6273 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.573721  5863 catalog_manager.cc:5697] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.578222  6273 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:45.580283  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:23:45.594343  6081 leader_election.cc:343] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.598718  6159 tablet_bootstrap.cc:654] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:45.599140  6487 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.084s	user 0.000s	sys 0.004s
I20260709 12:23:45.599614  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:45.613109  6247 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.616595  6247 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.617660  6039 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:45.622952  6158 tablet_bootstrap.cc:654] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.625336  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:45.632814  6322 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:45.638715  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:23:45.640471  6006 leader_election.cc:343] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.639407  6116 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:45.652022  6082 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:45.653013  6273 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:45.653018  6160 tablet_bootstrap.cc:492] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:45.653426  6273 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.653705  6160 ts_tablet_manager.cc:1403] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.305s	user 0.037s	sys 0.028s
I20260709 12:23:45.653795  6273 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.656781  6160 raft_consensus.cc:359] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.657455  6160 raft_consensus.cc:385] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.657718  6160 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.663913  6160 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.671291  6114 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:45.671622  5934 consensus_peers.cc:597] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:45.669520  6273 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.680676  5865 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.683115  6160 ts_tablet_manager.cc:1434] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.029s	user 0.006s	sys 0.001s
I20260709 12:23:45.684453  6273 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:45.685442  6160 tablet_bootstrap.cc:492] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:45.687661  6159 tablet_bootstrap.cc:492] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:45.688148  6159 ts_tablet_manager.cc:1403] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.129s	user 0.014s	sys 0.005s
I20260709 12:23:45.690722  6247 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.692673  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:45.692986  6159 raft_consensus.cc:359] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.693675  6159 raft_consensus.cc:385] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.693933  6159 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.703320  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:23:45.709800  6081 leader_election.cc:343] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.706720  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:45.712586  6160 tablet_bootstrap.cc:654] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.713533  6158 tablet_bootstrap.cc:492] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:45.713958  6158 ts_tablet_manager.cc:1403] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.288s	user 0.016s	sys 0.006s
I20260709 12:23:45.709360  6482 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:45.715060  6482 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.715188  6159 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.713884  5863 catalog_manager.cc:5697] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.716511  6482 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.717231  6159 ts_tablet_manager.cc:1434] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.029s	user 0.009s	sys 0.002s
I20260709 12:23:45.718020  6159 tablet_bootstrap.cc:492] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:45.729773  6482 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.731047  6041 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:23:45.732854  6159 tablet_bootstrap.cc:654] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.734592  6158 raft_consensus.cc:359] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.735292  6158 raft_consensus.cc:385] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.735551  6158 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.735509  6082 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:45.736302  6273 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:45.743736  6160 tablet_bootstrap.cc:492] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:45.744306  6160 ts_tablet_manager.cc:1403] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.059s	user 0.014s	sys 0.000s
I20260709 12:23:45.746785  6160 raft_consensus.cc:359] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.747435  6160 raft_consensus.cc:385] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.747699  6160 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.748315  6160 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.736289  6158 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.750623  6160 ts_tablet_manager.cc:1434] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.003s
I20260709 12:23:45.753454  6158 ts_tablet_manager.cc:1434] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.039s	user 0.005s	sys 0.001s
I20260709 12:23:45.754315  6160 tablet_bootstrap.cc:492] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:45.754400  6158 tablet_bootstrap.cc:492] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:45.767565  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:45.769860  6482 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:23:45.771124  6006 leader_election.cc:343] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.777416  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:45.778285  6117 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 1: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:23:45.786911  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:45.788019  6482 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:45.791718  6158 tablet_bootstrap.cc:654] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.801806  6160 tablet_bootstrap.cc:654] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.801934  6159 tablet_bootstrap.cc:492] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:45.802346  6159 ts_tablet_manager.cc:1403] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.085s	user 0.016s	sys 0.039s
I20260709 12:23:45.803218  6247 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.803601  6247 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.804944  6159 raft_consensus.cc:359] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.805645  6159 raft_consensus.cc:385] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.805832  6247 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.805940  6159 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.806777  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:45.806918  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:45.808044  5961 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:45.806902  6159 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:45.810772  6009 leader_election.cc:343] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.812415  6158 tablet_bootstrap.cc:492] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:45.812902  6158 ts_tablet_manager.cc:1403] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.059s	user 0.007s	sys 0.004s
I20260709 12:23:45.813419  6159 ts_tablet_manager.cc:1434] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:23:45.814555  6159 tablet_bootstrap.cc:492] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:45.816497  6006 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:45.817808  6158 raft_consensus.cc:359] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.818526  6158 raft_consensus.cc:385] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.818825  6158 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.819322  6482 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:45.819905  6159 tablet_bootstrap.cc:654] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.819658  6158 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.819682  6482 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.821403  6482 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.822049  6158 ts_tablet_manager.cc:1434] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.001s
I20260709 12:23:45.823746  6158 tablet_bootstrap.cc:492] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:45.831772  6482 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.833340  6159 tablet_bootstrap.cc:492] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:45.833979  6160 tablet_bootstrap.cc:492] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:45.834174  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:45.834384  6160 ts_tablet_manager.cc:1403] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.080s	user 0.011s	sys 0.006s
I20260709 12:23:45.834740  5961 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.835983  6158 tablet_bootstrap.cc:654] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.836918  6160 raft_consensus.cc:359] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.837553  6160 raft_consensus.cc:385] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.837803  6160 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.837918  6482 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:45.839687  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:45.840107  6160 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:45.841579  6009 leader_election.cc:343] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:45.843145  6160 ts_tablet_manager.cc:1434] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 12:23:45.844053  6160 tablet_bootstrap.cc:492] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:45.833773  6159 ts_tablet_manager.cc:1403] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.019s	user 0.005s	sys 0.005s
I20260709 12:23:45.850195  5961 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:45.852711  6006 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:45.853209  6160 tablet_bootstrap.cc:654] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.853416  6406 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:45.853838  6159 raft_consensus.cc:359] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.855283  6406 raft_consensus.cc:697] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:45.855566  6159 raft_consensus.cc:385] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.855851  6159 raft_consensus.cc:740] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.856086  6406 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.856451  6159 consensus_queue.cc:260] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.863513  6158 tablet_bootstrap.cc:492] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:45.865814  6159 ts_tablet_manager.cc:1434] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.019s	user 0.003s	sys 0.002s
I20260709 12:23:45.865775  6158 ts_tablet_manager.cc:1403] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.004s
I20260709 12:23:45.866804  6159 tablet_bootstrap.cc:492] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:45.874442  6159 tablet_bootstrap.cc:654] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.870247  6158 raft_consensus.cc:359] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.883769  6158 raft_consensus.cc:385] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.884053  6158 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.884645  6158 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.887002  6158 ts_tablet_manager.cc:1434] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.020s	user 0.007s	sys 0.000s
I20260709 12:23:45.890108  6273 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.890643  6273 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.891180  6158 tablet_bootstrap.cc:492] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:45.892428  6273 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:45.895939  6159 tablet_bootstrap.cc:492] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:45.896345  6159 ts_tablet_manager.cc:1403] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.030s	user 0.004s	sys 0.004s
I20260709 12:23:45.896829  6158 tablet_bootstrap.cc:654] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.897925  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:45.898739  6159 raft_consensus.cc:359] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.899402  6159 raft_consensus.cc:385] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.899663  6159 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.899639  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:45.900030  6160 tablet_bootstrap.cc:492] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:45.900532  5961 raft_consensus.cc:2393] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:23:45.901712  6081 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:45.902751  6273 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.909176  6273 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:45.900751  6160 ts_tablet_manager.cc:1403] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.057s	user 0.015s	sys 0.023s
I20260709 12:23:45.910125  6159 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.912204  6159 ts_tablet_manager.cc:1434] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:23:45.905259  5865 catalog_manager.cc:5697] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:45.914881  6159 tablet_bootstrap.cc:492] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:45.920420  6159 tablet_bootstrap.cc:654] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.926090  6158 tablet_bootstrap.cc:492] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:45.926724  6158 ts_tablet_manager.cc:1403] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.036s	user 0.022s	sys 0.011s
I20260709 12:23:45.929518  6158 raft_consensus.cc:359] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.930220  6158 raft_consensus.cc:385] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.930496  6158 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.931077  6158 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.932094  6160 raft_consensus.cc:359] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.932821  6160 raft_consensus.cc:385] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.933017  6158 ts_tablet_manager.cc:1434] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:23:45.933130  6160 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.933952  6158 tablet_bootstrap.cc:492] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:45.933919  6160 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.940464  6158 tablet_bootstrap.cc:654] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.943714  6160 ts_tablet_manager.cc:1434] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.034s	user 0.003s	sys 0.002s
I20260709 12:23:45.944904  6160 tablet_bootstrap.cc:492] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:45.960500  6160 tablet_bootstrap.cc:654] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:45.973445  6158 tablet_bootstrap.cc:492] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:45.973954  6158 ts_tablet_manager.cc:1403] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.040s	user 0.016s	sys 0.012s
I20260709 12:23:45.976655  6158 raft_consensus.cc:359] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.976912  6482 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:45.977481  6482 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.979955  6482 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:23:45.980435  5914 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:45.981411  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:45.982894  5961 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:45.983893  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:45.984110  6006 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:45.984544  6114 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:45.985337  6406 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:45.985729  6406 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:45.986053  6406 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.987958  6159 tablet_bootstrap.cc:492] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:45.988157  6158 raft_consensus.cc:385] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:45.988734  6158 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:45.989634  6158 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:45.991935  6158 ts_tablet_manager.cc:1434] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.000s
I20260709 12:23:45.989724  6159 ts_tablet_manager.cc:1403] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.075s	user 0.010s	sys 0.009s
I20260709 12:23:45.993420  6158 tablet_bootstrap.cc:492] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:46.001415  6191 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:46.002175  6158 tablet_bootstrap.cc:654] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:46.002475  6160 tablet_bootstrap.cc:492] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:45.991914  6114 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:45.998894  6406 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.005633  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:46.002913  6160 ts_tablet_manager.cc:1403] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.058s	user 0.006s	sys 0.020s
I20260709 12:23:46.006449  5961 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.011344  6159 raft_consensus.cc:359] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.012051  6159 raft_consensus.cc:385] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:46.012352  6191 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:46.016649  6158 tablet_bootstrap.cc:492] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:46.017992  6158 ts_tablet_manager.cc:1403] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.025s	user 0.011s	sys 0.006s
I20260709 12:23:46.018419  6160 raft_consensus.cc:359] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.019243  6160 raft_consensus.cc:385] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:46.019541  6160 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:46.020187  6160 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.012351  6159 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:46.022229  6160 ts_tablet_manager.cc:1434] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.000s
I20260709 12:23:46.022059  6158 raft_consensus.cc:359] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.023387  6158 raft_consensus.cc:385] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:46.023710  6158 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:46.024468  6158 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.024370  6159 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.023885  6160 tablet_bootstrap.cc:492] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:46.031229  6482 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.026083  6158 ts_tablet_manager.cc:1434] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.002s
I20260709 12:23:46.031816  6482 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.032716  6158 tablet_bootstrap.cc:492] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:46.033823  6482 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.035677  6420 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:46.036381  6160 tablet_bootstrap.cc:654] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:46.036523  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:46.038354  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:46.038990  5965 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:46.039179  6159 ts_tablet_manager.cc:1434] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.047s	user 0.007s	sys 0.000s
W20260709 12:23:46.039753  6009 leader_election.cc:343] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:46.040079  6159 tablet_bootstrap.cc:492] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:46.042167  6158 tablet_bootstrap.cc:654] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:46.042184  6420 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:23:46.046156  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:46.046913  6191 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:46.047238  6191 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.047514  6191 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.051440  6273 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.051885  6273 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.053603  6407 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.057591  6273 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:46.054111  6407 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.060572  6407 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:46.063081  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:46.064477  5961 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:46.065882  6006 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:46.066798  6421 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:46.067299  6421 raft_consensus.cc:697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:46.069798  6247 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:46.069202  6421 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.075053  6160 tablet_bootstrap.cc:492] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:46.075619  6160 ts_tablet_manager.cc:1403] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.004s
I20260709 12:23:46.078517  6160 raft_consensus.cc:359] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.079368  6160 raft_consensus.cc:385] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:46.079715  6160 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:46.080598  6160 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.082515  6160 ts_tablet_manager.cc:1434] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:23:46.081084  6406 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.085145  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:46.084249  6160 tablet_bootstrap.cc:492] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:46.053433  6191 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.091929  6191 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.094314  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:46.095240  5965 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.098043  6406 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:46.103760  5965 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:46.110138  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:46.111711  6482 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:46.112252  6482 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:46.115703  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:46.118024  6160 tablet_bootstrap.cc:654] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:46.113895  6482 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.119304  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:23:46.129386  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 85501.8us
I20260709 12:23:46.131102  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:46.123901  6117 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:46.142062  6009 leader_election.cc:343] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:46.145455  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:46.165391  6158 tablet_bootstrap.cc:492] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:46.165908  6158 ts_tablet_manager.cc:1403] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.133s	user 0.025s	sys 0.068s
I20260709 12:23:46.168936  6158 raft_consensus.cc:359] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.169745  6158 raft_consensus.cc:385] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:46.170038  6158 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:46.170804  6159 tablet_bootstrap.cc:700] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent opening tablet: real 0.126s	user 0.003s	sys 0.000s
I20260709 12:23:46.171505  6159 tablet_bootstrap.cc:654] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:46.171062  5865 catalog_manager.cc:5697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:46.178203  6247 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.179148  6247 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.179243  6158 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.181501  6247 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.181644  6158 ts_tablet_manager.cc:1434] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.015s	user 0.003s	sys 0.003s
I20260709 12:23:46.182631  6158 tablet_bootstrap.cc:492] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:46.193166  6158 tablet_bootstrap.cc:654] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:46.200179  6081 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:46.201177  6516 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:46.206445  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:46.207576  5966 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:46.208784  6006 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:46.209604  6421 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:46.209965  6421 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.210291  6421 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.211349  6158 tablet_bootstrap.cc:492] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:46.211798  6158 ts_tablet_manager.cc:1403] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.029s	user 0.006s	sys 0.006s
I20260709 12:23:46.214211  6158 raft_consensus.cc:359] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.219321  6158 raft_consensus.cc:385] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:46.219611  6158 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:46.220214  6421 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.220239  6158 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.224710  6159 tablet_bootstrap.cc:492] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:46.224993  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:46.225229  6159 ts_tablet_manager.cc:1403] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.185s	user 0.009s	sys 0.001s
I20260709 12:23:46.225581  5966 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.227859  6159 raft_consensus.cc:359] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.228458  6421 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.228542  6081 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:46.229511  6516 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:46.228541  6159 raft_consensus.cc:385] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:46.231207  6158 ts_tablet_manager.cc:1434] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:23:46.231084  6420 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.231676  6420 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.233821  6420 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.230089  6159 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:46.235227  6159 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.237344  6159 ts_tablet_manager.cc:1434] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.000s
I20260709 12:23:46.237234  5966 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:46.238281  6159 tablet_bootstrap.cc:492] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:46.240528  6425 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.241070  6425 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.243114  6425 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.252847  6425 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.253405  6425 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.254534  6158 tablet_bootstrap.cc:492] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:46.255421  6425 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.255576  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:46.258613  6159 tablet_bootstrap.cc:654] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:46.272464  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45288.2us
I20260709 12:23:46.275107  6006 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:46.282893  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:46.284070  6117 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:46.287937  6191 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.288446  6191 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.275199  6425 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.294961  6425 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.286727  6406 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:46.297966  6191 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:23:46.290508  6009 leader_election.cc:343] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:46.297076  6425 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:23:46.301447  6009 leader_election.cc:343] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:46.303575  5865 catalog_manager.cc:5697] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:46.309283  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:46.309358  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:46.310130  6039 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 1: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:23:46.297187  6406 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:46.312295  6406 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.325351  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:46.326637  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:46.327255  6039 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
W20260709 12:23:46.328213  6009 consensus_peers.cc:597] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:23:46.328740  6009 leader_election.cc:343] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:46.277407  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 46530.1us
I20260709 12:23:46.338788  6158 tablet_bootstrap.cc:654] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:46.346254  6160 tablet_bootstrap.cc:492] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:46.346773  6160 ts_tablet_manager.cc:1403] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.263s	user 0.042s	sys 0.054s
I20260709 12:23:46.344319  6518 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.351542  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:46.352176  6112 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:46.354236  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:46.350163  6518 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.366822  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:46.368878  6518 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:46.401145  5934 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:46.432503  6420 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:46.433002  6420 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.433336  6420 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.354837  6118 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:46.445281  5934 leader_election.cc:343] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:46.442998  6117 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 1: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:23:46.482013  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:46.485462  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:46.486406  6041 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:46.495075  6527 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:46.494762  5932 leader_election.cc:343] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:46.496701  6159 tablet_bootstrap.cc:492] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:46.495594  6527 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.497182  6159 ts_tablet_manager.cc:1403] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.259s	user 0.006s	sys 0.013s
I20260709 12:23:46.497217  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:46.493733  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:46.516356  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:46.518242  5966 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:46.527998  6322 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:46.529506  6425 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.529978  6322 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.530056  6425 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.530678  6322 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.531363  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:46.535449  6159 raft_consensus.cc:359] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.536407  6159 raft_consensus.cc:385] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:46.536783  6159 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:46.515177  6527 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.537789  6159 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.518023  6529 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:46.546064  6159 ts_tablet_manager.cc:1434] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.048s	user 0.004s	sys 0.005s
I20260709 12:23:46.511334  5934 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:46.550478  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:46.551232  6425 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.560700  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:46.554292  6160 raft_consensus.cc:359] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.561518  5966 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:46.561877  6160 raft_consensus.cc:385] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:46.562203  6160 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:46.562830  6160 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.564392  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:46.565104  6160 ts_tablet_manager.cc:1434] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.218s	user 0.021s	sys 0.005s
I20260709 12:23:46.540967  6529 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.541980  6041 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 0.
I20260709 12:23:46.567438  6406 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:46.569056  6406 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.569409  6406 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.572758  6322 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.575129  6160 tablet_bootstrap.cc:492] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:46.584403  6082 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:46.585402  6518 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:46.585852  6518 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.586251  6518 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.586611  6159 tablet_bootstrap.cc:492] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:46.597800  6322 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.567564  6529 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.592615  6425 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.605237  6159 tablet_bootstrap.cc:654] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:46.613180  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 44336.9us
I20260709 12:23:46.621526  5865 catalog_manager.cc:5697] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:23:46.602397  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 103761us
I20260709 12:23:46.622871  6116 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.661566  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:46.662806  6040 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:46.624254  6420 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.667949  6158 tablet_bootstrap.cc:492] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:46.669025  6158 ts_tablet_manager.cc:1403] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.435s	user 0.012s	sys 0.046s
I20260709 12:23:46.674811  6420 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.681041  6518 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.682492  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:46.685714  6113 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 1: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:23:46.717293  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:46.716665  6518 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:46.728348  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:46.725438  6420 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:46.729703  6420 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:46.729867  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:46.730079  6420 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.730527  6198 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:46.732465  6198 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:46.733753  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:46.737262  6191 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:46.737386  6536 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:23:46.740711  5959 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.733781  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:46.744514  6160 tablet_bootstrap.cc:654] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:46.759229  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:46.760284  6037 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.759626  6158 raft_consensus.cc:359] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.761750  6158 raft_consensus.cc:385] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:46.762028  6158 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
W20260709 12:23:46.759054  5934 leader_election.cc:343] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:46.763540  6529 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.766171  6158 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.771396  6158 ts_tablet_manager.cc:1434] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.102s	user 0.002s	sys 0.004s
I20260709 12:23:46.776077  5934 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:23:46.776968  5932 leader_election.cc:343] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:46.794117  6516 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:46.794643  6516 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:46.804587  5934 leader_election.cc:343] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:46.794924  6482 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:23:46.766548  6420 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.757954  6406 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.807909  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:46.808606  6529 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.815742  6420 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.821785  6158 tablet_bootstrap.cc:492] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Bootstrap starting.
I20260709 12:23:46.821951  6425 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:46.826310  6041 raft_consensus.cc:2393] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 1: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:23:46.827509  6516 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:46.832243  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:46.832856  6112 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.833462  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:46.826659  5959 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:46.854842  6322 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:46.864779  6037 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:46.869282  6406 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:46.874154  6159 tablet_bootstrap.cc:492] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:46.874402  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:46.874714  6158 tablet_bootstrap.cc:654] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:46.874794  6159 ts_tablet_manager.cc:1403] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.288s	user 0.035s	sys 0.019s
I20260709 12:23:46.877816  6159 raft_consensus.cc:359] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.878588  6159 raft_consensus.cc:385] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:46.878921  6159 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:46.879629  6159 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.881733  6159 ts_tablet_manager.cc:1434] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:23:46.882733  6159 tablet_bootstrap.cc:492] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:46.885911  6082 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:46.887001  6112 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:46.888706  6159 tablet_bootstrap.cc:654] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
W20260709 12:23:46.888537  5934 leader_election.cc:343] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:46.891166  6516 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:46.891681  6516 raft_consensus.cc:697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:23:46.892517  6516 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.894088  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:46.894685  6041 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:46.897061  5934 leader_election.cc:343] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:46.899931  5934 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:46.901010  6528 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:46.901512  6528 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:46.902338  6528 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:46.902819  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:46.903313  6041 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
W20260709 12:23:46.904400  5934 leader_election.cc:343] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:46.907946  6160 tablet_bootstrap.cc:492] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:46.908420  6160 ts_tablet_manager.cc:1403] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.333s	user 0.013s	sys 0.016s
I20260709 12:23:46.914130  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:46.914898  6041 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:46.924993  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:46.923463  5865 catalog_manager.cc:5697] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:46.941047  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:47.036167  6081 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:47.039669  6273 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:23:47.040535  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:47.041519  5959 raft_consensus.cc:2393] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 1: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:23:47.043907  6160 raft_consensus.cc:359] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.045783  6160 raft_consensus.cc:385] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:47.046098  6160 raft_consensus.cc:740] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:47.052613  6247 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:47.065798  6158 tablet_bootstrap.cc:492] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: No bootstrap required, opened a new log
I20260709 12:23:47.066296  6158 ts_tablet_manager.cc:1403] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Time spent bootstrapping tablet: real 0.246s	user 0.050s	sys 0.077s
I20260709 12:23:47.067505  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:47.069710  6159 tablet_bootstrap.cc:492] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:47.070240  6159 ts_tablet_manager.cc:1403] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.188s	user 0.020s	sys 0.009s
I20260709 12:23:47.070935  6322 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:23:47.073000  6158 raft_consensus.cc:359] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.073783  6158 raft_consensus.cc:385] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:47.074119  6158 raft_consensus.cc:740] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Initialized, Role: FOLLOWER
I20260709 12:23:47.075627  6158 consensus_queue.cc:260] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.073660  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:47.078336  6322 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:47.078781  6322 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:47.079440  6322 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.083206  6158 ts_tablet_manager.cc:1434] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:23:47.102514  6159 raft_consensus.cc:359] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.106760  6159 raft_consensus.cc:385] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:47.107110  6159 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:47.107838  6159 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.113422  6159 ts_tablet_manager.cc:1434] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.001s
I20260709 12:23:47.135941  6041 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:47.146332  5863 catalog_manager.cc:5697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 0 to 1, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
W20260709 12:23:47.182094  6009 leader_election.cc:343] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:47.183837  6009 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:47.191864  6540 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20260709 12:23:47.192888  6009 consensus_peers.cc:597] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:47.198519  6160 consensus_queue.cc:260] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:23:47.199976  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 58504.7us
I20260709 12:23:47.209901  6159 tablet_bootstrap.cc:492] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:47.176146  6420 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:23:47.206375  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 74890.9us
I20260709 12:23:47.213047  6420 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.226714  6420 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:47.227829  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:47.232180  6160 ts_tablet_manager.cc:1434] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.324s	user 0.011s	sys 0.012s
W20260709 12:23:47.232118  5934 leader_election.cc:343] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:47.233253  6160 tablet_bootstrap.cc:492] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:47.240401  6528 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.242597  6528 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.250423  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:47.257228  6322 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:47.257786  6322 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:47.258502  6322 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.246105  6117 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:23:47.274300  5914 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:47.271474  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:47.280798  6528 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:47.283694  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:23:47.285491  5934 leader_election.cc:343] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:23:47.289222  5932 leader_election.cc:343] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:47.289723  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:23:47.281172  6159 tablet_bootstrap.cc:654] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:47.292558  6538 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:47.297647  6160 tablet_bootstrap.cc:654] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:47.301136  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:47.301748  6044 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 0.
I20260709 12:23:47.302922  5932 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:47.303828  6538 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:47.304441  6538 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.307729  6538 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:47.320925  6538 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.322707  6528 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:47.325557  6160 tablet_bootstrap.cc:492] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:47.325907  6159 tablet_bootstrap.cc:492] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:47.326071  6160 ts_tablet_manager.cc:1403] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.093s	user 0.012s	sys 0.002s
I20260709 12:23:47.326359  6159 ts_tablet_manager.cc:1403] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.117s	user 0.013s	sys 0.002s
I20260709 12:23:47.329294  6538 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:47.330250  6159 raft_consensus.cc:359] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.331240  6159 raft_consensus.cc:385] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:47.330638  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:47.331547  6159 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:47.332216  6159 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.334349  6159 ts_tablet_manager.cc:1434] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.000s
I20260709 12:23:47.335311  6159 tablet_bootstrap.cc:492] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
W20260709 12:23:47.334278  5934 leader_election.cc:343] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:47.339459  6160 raft_consensus.cc:359] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.340245  6160 raft_consensus.cc:385] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:47.340507  6160 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:47.341462  6159 tablet_bootstrap.cc:654] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:47.341444  6160 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.349550  6160 ts_tablet_manager.cc:1434] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.002s
I20260709 12:23:47.351759  6518 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:47.352787  6159 tablet_bootstrap.cc:492] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:47.353272  6159 ts_tablet_manager.cc:1403] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.004s
I20260709 12:23:47.361084  6160 tablet_bootstrap.cc:492] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c: Bootstrap starting.
I20260709 12:23:47.367882  6159 raft_consensus.cc:359] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.368605  6159 raft_consensus.cc:385] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:47.368446  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:47.369068  6040 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:47.374011  6160 tablet_bootstrap.cc:654] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:47.379397  6040 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:47.381390  5932 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:47.382625  6322 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:47.382723  6159 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:47.383239  6322 raft_consensus.cc:697] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:47.383589  6159 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.384056  6322 consensus_queue.cc:237] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.385438  6160 tablet_bootstrap.cc:492] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c: No bootstrap required, opened a new log
I20260709 12:23:47.385937  6160 ts_tablet_manager.cc:1403] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.005s
I20260709 12:23:47.385946  6159 ts_tablet_manager.cc:1434] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.032s	user 0.005s	sys 0.003s
I20260709 12:23:47.387951  6558 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.388535  6160 raft_consensus.cc:359] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.388458  6558 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.389259  6159 tablet_bootstrap.cc:492] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:47.389215  6160 raft_consensus.cc:385] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:47.389640  6160 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Initialized, Role: FOLLOWER
I20260709 12:23:47.390368  6160 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.399719  6558 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:47.401360  6160 ts_tablet_manager.cc:1434] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent starting tablet: real 0.015s	user 0.000s	sys 0.006s
I20260709 12:23:47.404047  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:47.404707  6558 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.405272  6558 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.405400  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:47.407888  6040 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:23:47.401342  5864 catalog_manager.cc:5697] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:47.409240  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:47.409893  5967 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:47.411198  6558 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:47.410039  5864 catalog_manager.cc:5697] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:47.411917  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:47.415129  6081 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:47.414624  6041 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:23:47.416828  6518 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:47.417189  6518 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.417501  6518 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.419941  6082 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:47.426070  6041 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:47.425578  6558 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:47.453909  6556 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:23:47.456334  6518 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.466249  6420 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:47.465482  5864 catalog_manager.cc:5697] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 1, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:47.515983  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:47.516737  5967 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.518059  6159 tablet_bootstrap.cc:654] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:47.521968  6518 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:47.527539  6482 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.527561  6528 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:47.530027  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:47.528936  6482 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.530642  6041 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:47.533367  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:47.533386  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:47.534031  5960 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 0.
I20260709 12:23:47.532281  6482 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:47.537184  6558 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:47.537439  6041 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
W20260709 12:23:47.538179  6009 leader_election.cc:343] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:47.545365  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:47.545595  5967 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:23:47.546999  6082 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:23:47.547231  6421 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:23:47.547714  6421 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:47.547825  6518 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:47.548079  6421 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:47.548362  6518 raft_consensus.cc:697] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:23:47.552613  6518 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.563055  6421 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.565122  6421 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:47.566428  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:23:47.567824  6009 leader_election.cc:343] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:23:47.571146  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:23:47.571765  5960 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:47.573330  6159 tablet_bootstrap.cc:492] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:47.573854  6159 ts_tablet_manager.cc:1403] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.185s	user 0.011s	sys 0.005s
I20260709 12:23:47.575937  6538 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:47.576411  6159 raft_consensus.cc:359] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.577702  6159 raft_consensus.cc:385] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:47.576826  5864 catalog_manager.cc:5697] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 0 to 2, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:23:47.577998  6159 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:47.578750  6159 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.580075  5960 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:23:47.581487  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:23:47.581845  6159 ts_tablet_manager.cc:1434] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.003s
I20260709 12:23:47.582518  6482 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:23:47.582959  6159 tablet_bootstrap.cc:492] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:47.583026  6482 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:23:47.584069  6482 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.588970  6159 tablet_bootstrap.cc:654] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:47.613577  6159 tablet_bootstrap.cc:492] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:47.614084  6159 ts_tablet_manager.cc:1403] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.031s	user 0.022s	sys 0.008s
I20260709 12:23:47.614627  6518 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.615114  6518 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.616665  6159 raft_consensus.cc:359] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.617214  6518 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:47.617408  6159 raft_consensus.cc:385] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:47.617825  6159 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:47.618543  6159 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.619565  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:47.618031  5864 catalog_manager.cc:5697] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:47.622649  6159 ts_tablet_manager.cc:1434] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:23:47.623653  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:47.624766  6159 tablet_bootstrap.cc:492] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f: Bootstrap starting.
I20260709 12:23:47.626256  6081 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:47.630544  6518 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:47.631359  6159 tablet_bootstrap.cc:654] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f: Neither blocks nor log segments found. Creating new log.
I20260709 12:23:47.644923  6159 tablet_bootstrap.cc:492] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f: No bootstrap required, opened a new log
I20260709 12:23:47.645403  6159 ts_tablet_manager.cc:1403] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent bootstrapping tablet: real 0.021s	user 0.016s	sys 0.000s
I20260709 12:23:47.648053  6159 raft_consensus.cc:359] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.648731  6159 raft_consensus.cc:385] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:23:47.648993  6159 raft_consensus.cc:740] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Initialized, Role: FOLLOWER
I20260709 12:23:47.649670  6159 consensus_queue.cc:260] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.650187  6544 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:47.651778  6159 ts_tablet_manager.cc:1434] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:23:47.662325  6117 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:47.678742  6528 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:47.737407  6518 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.737984  6518 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.740168  6518 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:47.740731  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:47.741494  5967 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:23:47.741492  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:47.742830  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:47.743394  6518 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:47.747812  6518 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:47.757097  6113 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:47.798879  6558 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:47.799347  6558 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:47.801046  6558 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:47.801646  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:23:47.801930  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:47.802481  5967 raft_consensus.cc:2393] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:23:47.802623  6041 raft_consensus.cc:2393] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 1: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:23:47.803676  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:23:47.804373  6558 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:47.811575  6558 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:23:47.828902  6113 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:23:47.835191  6538 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:47.861904  6538 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:47.992514  6041 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:47.994331  6518 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:48.002933  5960 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:48.006669  6516 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:48.054545  6530 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:23:48.071575  6406 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:23:48.305253  5914 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:23:49.011435  6420 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:23:49.012303  6420 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:49.014075  6420 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:49.015007  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:23:49.015128  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:23:49.015789  6041 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:49.015995  6115 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:23:49.017002  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:49.017658  6420 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:23:49.018036  6420 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:23:49.018381  6420 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.024369  6420 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:49.025836  6420 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:49.026901  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:23:49.027498  6117 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.028007  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:23:49.028576  6041 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:23:49.035012  6117 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:23:49.035084  6041 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:23:49.036355  5934 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:23:49.037212  6593 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:23:49.037714  6593 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:23:49.038827  6593 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:23:49.079330  5864 catalog_manager.cc:5697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 0 to 2, leader changed from <none> to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:49.343741  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:23:49.352162  6599 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:49.380378  6600 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:23:49.381480  6602 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:23:49.381795  4821 server_base.cc:1061] running on GCE node
I20260709 12:23:49.383010  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:23:49.383258  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:23:49.383450  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783599829383431 us; error 0 us; skew 500 ppm
I20260709 12:23:49.384119  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:23:49.395202  4821 webserver.cc:533] Webserver started at http://127.4.181.68:44383/ using document root <none> and password file <none>
I20260709 12:23:49.395903  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:23:49.396183  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:23:49.396929  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:23:49.398602  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-3-root/instance:
uuid: "24012af7747d4c4ea89c3da2ff950099"
format_stamp: "Formatted at 2026-07-09 12:23:49 on dist-test-slave-k014"
I20260709 12:23:49.404711  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.001s
I20260709 12:23:49.408440  6607 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:49.409191  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:23:49.409495  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-3-root
uuid: "24012af7747d4c4ea89c3da2ff950099"
format_stamp: "Formatted at 2026-07-09 12:23:49 on dist-test-slave-k014"
I20260709 12:23:49.409793  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:23:49.450197  6041 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:49.451517  6420 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:49.468276  6117 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:23:49.469419  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:23:49.469731  6420 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:23:49.471362  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:23:49.493292  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:23:49.500926  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:23:49.501307  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:23:49.501628  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:23:49.501864  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:23:49.590170  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.68:45477
I20260709 12:23:49.590294  6675 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.68:45477 every 8 connection(s)
I20260709 12:23:49.593961  4821 auto_leader_rebalancer-test.cc:439] add a tserver: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:23:49.614655  6676 heartbeater.cc:344] Connected to a master server at 127.4.181.126:41341
I20260709 12:23:49.615195  6676 heartbeater.cc:461] Registering TS with master...
I20260709 12:23:49.616035  6676 heartbeater.cc:507] Master 127.4.181.126:41341 requested a full tablet report, sending...
I20260709 12:23:49.618194  5865 ts_manager.cc:194] Registered new tserver with Master: 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:23:49.619594  5865 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54950
I20260709 12:23:50.467173  6044 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:50.473469  6113 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:50.474550  5960 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:50.476109  6406 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:50.480643  6406 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:50.488775  6530 raft_consensus.cc:2955] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
W20260709 12:23:50.494783  6009 consensus_peers.cc:597] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c87516dfcddf4c8b8d921f3512db9063. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:50.493288  6113 raft_consensus.cc:2955] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:50.510946  5865 catalog_manager.cc:5697] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:50.514931  5964 raft_consensus.cc:2955] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:50.541478  5964 consensus_queue.cc:237] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:50.548815  6041 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:50.550959  6113 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:50.553084  6420 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:50.554450  6615 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:50.566632  5934 consensus_peers.cc:597] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5e596fee38d14bcb913a2aaadffa2a72. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:50.566713  6420 raft_consensus.cc:2955] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:50.572896  6044 raft_consensus.cc:2955] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:50.579494  6041 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:50.582716  6115 raft_consensus.cc:2955] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:50.587615  5865 catalog_manager.cc:5697] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:50.605535  6115 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:50.606822  6009 consensus_peers.cc:597] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0636290fb57e4842995ddf9549f0c721. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:50.607554  6406 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:50.607815  5960 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:50.609140  6406 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:50.619050  6530 raft_consensus.cc:2955] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:50.622335  6676 heartbeater.cc:499] Master 127.4.181.126:41341 was elected leader, sending a full tablet report...
I20260709 12:23:50.626266  6115 raft_consensus.cc:2955] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:50.627540  5960 raft_consensus.cc:2955] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:50.647408  5863 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:50.663268  5960 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:50.672096  6112 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:50.675578  5934 consensus_peers.cc:597] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 78c13bc0b46b40a3886a209b87dd6f98. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:50.676247  6041 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:50.676183  6695 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:50.686374  6615 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:50.691354  6420 raft_consensus.cc:2955] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:50.696826  6041 raft_consensus.cc:2955] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:50.699021  6112 raft_consensus.cc:2955] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:50.721318  5865 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:51.005704  6708 ts_tablet_manager.cc:933] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:51.007458  6708 tablet_copy_client.cc:323] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:23:51.022346  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet c87516dfcddf4c8b8d921f3512db9063 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:23:51.022979  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet c87516dfcddf4c8b8d921f3512db9063 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-c87516dfcddf4c8b8d921f3512db9063
I20260709 12:23:51.028959  6054 tablet_copy_source_session.cc:215] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:51.032747  6708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c87516dfcddf4c8b8d921f3512db9063. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.045590  6708 tablet_copy_client.cc:806] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:51.046173  6708 tablet_copy_client.cc:670] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:51.050738  6708 tablet_copy_client.cc:538] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:51.057904  6708 tablet_bootstrap.cc:492] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:23:51.079610  6708 tablet_bootstrap.cc:492] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:51.081952  6708 tablet_bootstrap.cc:492] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:23:51.082764  6708 ts_tablet_manager.cc:1403] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.013s
I20260709 12:23:51.086886  6708 raft_consensus.cc:359] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:51.087906  6708 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:23:51.088625  6708 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:51.098353  6713 ts_tablet_manager.cc:933] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:23:51.101464  6708 ts_tablet_manager.cc:1434] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 12:23:51.106329  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-c87516dfcddf4c8b8d921f3512db9063 received from {username='slave'} at 127.0.0.1:60122
I20260709 12:23:51.106900  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-c87516dfcddf4c8b8d921f3512db9063 on tablet c87516dfcddf4c8b8d921f3512db9063 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:23:51.108704  6713 tablet_copy_client.cc:323] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.65:42981
I20260709 12:23:51.115720  6708 ts_tablet_manager.cc:933] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:51.126305  5978 tablet_copy_service.cc:140] P f1bb8e63c2b448cdafd51f05d277c741: Received BeginTabletCopySession request for tablet 5e596fee38d14bcb913a2aaadffa2a72 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:37174)
I20260709 12:23:51.126974  5978 tablet_copy_service.cc:161] P f1bb8e63c2b448cdafd51f05d277c741: Beginning new tablet copy session on tablet 5e596fee38d14bcb913a2aaadffa2a72 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:37174: session id = 24012af7747d4c4ea89c3da2ff950099-5e596fee38d14bcb913a2aaadffa2a72
I20260709 12:23:51.135977  5978 tablet_copy_source_session.cc:215] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:51.141677  6713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e596fee38d14bcb913a2aaadffa2a72. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.143373  6708 tablet_copy_client.cc:323] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:23:51.145123  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet 0636290fb57e4842995ddf9549f0c721 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:23:51.145812  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet 0636290fb57e4842995ddf9549f0c721 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-0636290fb57e4842995ddf9549f0c721
I20260709 12:23:51.156809  6054 tablet_copy_source_session.cc:215] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:51.156898  6713 tablet_copy_client.cc:806] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:51.157527  6713 tablet_copy_client.cc:670] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:51.160624  6708 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0636290fb57e4842995ddf9549f0c721. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.162583  6713 tablet_copy_client.cc:538] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:51.172991  6713 tablet_bootstrap.cc:492] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:23:51.178350  6708 tablet_copy_client.cc:806] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:51.183317  6708 tablet_copy_client.cc:670] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:51.191752  6708 tablet_copy_client.cc:538] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:51.202337  6708 tablet_bootstrap.cc:492] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:23:51.249310  6708 tablet_bootstrap.cc:492] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:51.250231  6708 tablet_bootstrap.cc:492] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:23:51.250931  6708 ts_tablet_manager.cc:1403] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.049s	user 0.022s	sys 0.012s
I20260709 12:23:51.253911  6708 raft_consensus.cc:359] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:51.254796  6708 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:23:51.255484  6708 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:51.264145  6708 ts_tablet_manager.cc:1434] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.001s
I20260709 12:23:51.274996  6721 ts_tablet_manager.cc:933] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:23:51.275938  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-0636290fb57e4842995ddf9549f0c721 received from {username='slave'} at 127.0.0.1:60122
I20260709 12:23:51.276454  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-0636290fb57e4842995ddf9549f0c721 on tablet 0636290fb57e4842995ddf9549f0c721 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:23:51.287815  6713 tablet_bootstrap.cc:492] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:51.289036  6713 tablet_bootstrap.cc:492] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:23:51.289788  6713 ts_tablet_manager.cc:1403] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.117s	user 0.018s	sys 0.008s
I20260709 12:23:51.293206  6713 raft_consensus.cc:359] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:51.294109  6713 raft_consensus.cc:740] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:23:51.294353  6721 tablet_copy_client.cc:323] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.65:42981
I20260709 12:23:51.294791  6713 consensus_queue.cc:260] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:51.296110  5978 tablet_copy_service.cc:140] P f1bb8e63c2b448cdafd51f05d277c741: Received BeginTabletCopySession request for tablet 78c13bc0b46b40a3886a209b87dd6f98 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:37174)
I20260709 12:23:51.296660  5978 tablet_copy_service.cc:161] P f1bb8e63c2b448cdafd51f05d277c741: Beginning new tablet copy session on tablet 78c13bc0b46b40a3886a209b87dd6f98 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:37174: session id = 24012af7747d4c4ea89c3da2ff950099-78c13bc0b46b40a3886a209b87dd6f98
I20260709 12:23:51.301669  6713 ts_tablet_manager.cc:1434] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.011s	user 0.002s	sys 0.004s
I20260709 12:23:51.305716  5977 tablet_copy_service.cc:342] P f1bb8e63c2b448cdafd51f05d277c741: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-5e596fee38d14bcb913a2aaadffa2a72 received from {username='slave'} at 127.0.0.1:37174
I20260709 12:23:51.305994  5978 tablet_copy_source_session.cc:215] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:51.306262  5977 tablet_copy_service.cc:434] P f1bb8e63c2b448cdafd51f05d277c741: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-5e596fee38d14bcb913a2aaadffa2a72 on tablet 5e596fee38d14bcb913a2aaadffa2a72 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:23:51.310649  6721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78c13bc0b46b40a3886a209b87dd6f98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:51.326488  6721 tablet_copy_client.cc:806] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:51.327323  6721 tablet_copy_client.cc:670] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:51.331245  6721 tablet_copy_client.cc:538] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:51.338048  6721 tablet_bootstrap.cc:492] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:23:51.356329  6721 tablet_bootstrap.cc:492] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:51.357004  6721 tablet_bootstrap.cc:492] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:23:51.357577  6721 ts_tablet_manager.cc:1403] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.020s	user 0.010s	sys 0.010s
I20260709 12:23:51.359894  6721 raft_consensus.cc:359] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:51.360553  6721 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:23:51.361254  6721 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:51.363358  6721 ts_tablet_manager.cc:1434] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:23:51.365922  5978 tablet_copy_service.cc:342] P f1bb8e63c2b448cdafd51f05d277c741: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-78c13bc0b46b40a3886a209b87dd6f98 received from {username='slave'} at 127.0.0.1:37174
I20260709 12:23:51.366297  5978 tablet_copy_service.cc:434] P f1bb8e63c2b448cdafd51f05d277c741: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-78c13bc0b46b40a3886a209b87dd6f98 on tablet 78c13bc0b46b40a3886a209b87dd6f98 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:23:51.504463  6651 raft_consensus.cc:1217] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:51.529241  6651 raft_consensus.cc:1217] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:51.534910  6651 raft_consensus.cc:1217] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:51.799664  6651 raft_consensus.cc:1217] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:51.915282  6695 raft_consensus.cc:1064] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:23:51.917989  6695 consensus_queue.cc:237] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:51.925068  6651 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:51.925390  6040 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:51.925721  6112 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:51.926774  6615 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:51.927726  6420 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:51.929512  6420 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:51.947109  6726 raft_consensus.cc:2955] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:51.950059  6112 raft_consensus.cc:2955] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:51.955055  6651 raft_consensus.cc:2955] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:51.958359  6044 raft_consensus.cc:2955] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:51.970093  5863 catalog_manager.cc:5697] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:52.003508  5959 consensus_queue.cc:237] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:52.014348  6651 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:52.014834  6115 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:52.016626  6726 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:52.017767  6615 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:52.027618  6695 raft_consensus.cc:2955] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.035991  6650 raft_consensus.cc:2955] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.036669  6112 raft_consensus.cc:2955] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.039220  5850 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5e596fee38d14bcb913a2aaadffa2a72 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:52.049153  5865 catalog_manager.cc:5697] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:52.064273  6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 5e596fee38d14bcb913a2aaadffa2a72 with delete_type TABLET_DATA_TOMBSTONED (TS 0557a7246c8945b99e5215c99d4ddf9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36246
I20260709 12:23:52.090612  6718 raft_consensus.cc:1064] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:23:52.097221  6718 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:52.108318  6734 tablet_replica.cc:333] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:23:52.109900  6112 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:52.110011  6734 raft_consensus.cc:2243] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.110869  6734 raft_consensus.cc:2272] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.112934  6650 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:52.114099  5967 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:52.115010  6704 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:52.116109  6406 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:52.117053  6734 ts_tablet_manager.cc:1916] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:52.118011  6703 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:52.161576  6703 raft_consensus.cc:1064] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:23:52.165972  6703 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:52.174325  6734 ts_tablet_manager.cc:1929] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:52.181200  6734 log.cc:1199] T 5e596fee38d14bcb913a2aaadffa2a72 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/wals/5e596fee38d14bcb913a2aaadffa2a72
I20260709 12:23:52.181180  6704 raft_consensus.cc:2955] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.186295  5851 catalog_manager.cc:5028] TS 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): tablet 5e596fee38d14bcb913a2aaadffa2a72 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:23:52.190322  6650 raft_consensus.cc:2955] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.203253  6115 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:52.205446  6115 raft_consensus.cc:2955] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.224725  6744 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.014s
I20260709 12:23:52.229017  6651 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:52.230574  5960 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:52.229038  5862 catalog_manager.cc:5697] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.241539  6740 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:23:52.252436  6744 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:52.252039  5967 raft_consensus.cc:2955] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.273813  6040 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:52.278424  6718 raft_consensus.cc:2955] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.287729  6650 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:52.288826  6651 raft_consensus.cc:2955] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.290175  6718 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:52.291924  6115 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:52.292882  6117 raft_consensus.cc:2955] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.300438  6744 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:52.303402  6740 raft_consensus.cc:2955] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.319509  5865 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.321121  6650 raft_consensus.cc:2955] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.322571  6115 raft_consensus.cc:2955] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.334173  5864 catalog_manager.cc:5697] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.337468  6726 raft_consensus.cc:1064] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:23:52.339799  6726 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:52.336781  5967 raft_consensus.cc:2955] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.371205  5955 tablet_service.cc:1558] Processing DeleteTablet for tablet c87516dfcddf4c8b8d921f3512db9063 with delete_type TABLET_DATA_TOMBSTONED (TS f1bb8e63c2b448cdafd51f05d277c741 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34548
I20260709 12:23:52.375926  6040 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:52.377063  6749 tablet_replica.cc:333] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:23:52.380393  6749 raft_consensus.cc:2243] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.382309  6749 raft_consensus.cc:2272] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.386157  6749 ts_tablet_manager.cc:1916] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:52.390909  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c87516dfcddf4c8b8d921f3512db9063 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:52.393976  5959 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:52.397900  6742 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:52.404466  6651 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:52.405063  6744 raft_consensus.cc:2955] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.406746  5967 raft_consensus.cc:2955] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.413117  6742 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:52.423441  6651 raft_consensus.cc:2955] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.433055  6749 ts_tablet_manager.cc:1929] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:52.433549  6749 log.cc:1199] T c87516dfcddf4c8b8d921f3512db9063 P f1bb8e63c2b448cdafd51f05d277c741: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/wals/c87516dfcddf4c8b8d921f3512db9063
I20260709 12:23:52.435215  5850 catalog_manager.cc:5028] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): tablet c87516dfcddf4c8b8d921f3512db9063 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:23:52.435509  6650 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:52.437186  6113 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:52.439242  6615 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:52.440761  6615 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:52.444957  5862 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:23:52.538839  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 82706.5us
I20260709 12:23:52.541505  6103 tablet_service.cc:1558] Processing DeleteTablet for tablet 0636290fb57e4842995ddf9549f0c721 with delete_type TABLET_DATA_TOMBSTONED (TS 0069e2ba1f02412e8e1d6c20a1fb510f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35576
I20260709 12:23:52.558535  6753 raft_consensus.cc:2955] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.563422  6756 tablet_replica.cc:333] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:23:52.566260  6756 raft_consensus.cc:2243] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:52.569509  6651 raft_consensus.cc:2955] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:23:52.566692  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 104912us
W20260709 12:23:52.582818  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 113523us
I20260709 12:23:52.584697  6044 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:52.588804  6112 raft_consensus.cc:2955] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.591635  6756 raft_consensus.cc:2272] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:52.603505  5865 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:52.609251  6754 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:52.615978  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0636290fb57e4842995ddf9549f0c721 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:52.649029  6756 ts_tablet_manager.cc:1916] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:52.674765  6044 raft_consensus.cc:2955] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:52.719105  6756 ts_tablet_manager.cc:1929] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:52.719589  6756 log.cc:1199] T 0636290fb57e4842995ddf9549f0c721 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/wals/0636290fb57e4842995ddf9549f0c721
I20260709 12:23:52.721822  5853 catalog_manager.cc:5028] TS 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): tablet 0636290fb57e4842995ddf9549f0c721 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:23:53.246515  5960 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:53.253425  6651 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:53.256085  6040 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:53.257530  6615 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:53.259323  6754 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:53.267030  6762 raft_consensus.cc:2955] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:53.270864  6040 raft_consensus.cc:2955] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:53.271041  6651 raft_consensus.cc:2955] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:53.276563  5850 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 78c13bc0b46b40a3886a209b87dd6f98 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:53.286892  5862 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:53.307391  6103 tablet_service.cc:1558] Processing DeleteTablet for tablet 78c13bc0b46b40a3886a209b87dd6f98 with delete_type TABLET_DATA_TOMBSTONED (TS 0069e2ba1f02412e8e1d6c20a1fb510f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35576
I20260709 12:23:53.309734  6769 tablet_replica.cc:333] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:23:53.310702  6769 raft_consensus.cc:2243] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:53.311375  6769 raft_consensus.cc:2272] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:53.316412  6769 ts_tablet_manager.cc:1916] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:53.331512  6769 ts_tablet_manager.cc:1929] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:53.331846  6769 log.cc:1199] T 78c13bc0b46b40a3886a209b87dd6f98 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/wals/78c13bc0b46b40a3886a209b87dd6f98
I20260709 12:23:53.333215  5853 catalog_manager.cc:5028] TS 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): tablet 78c13bc0b46b40a3886a209b87dd6f98 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:23:54.391436  6109 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:54.398269  6040 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:54.398947  5962 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:54.400856  6775 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:54.401886  6688 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:54.410377  6770 raft_consensus.cc:2955] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:54.413478  6040 raft_consensus.cc:2955] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:54.413746  5962 raft_consensus.cc:2955] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
W20260709 12:23:54.420989  6084 consensus_peers.cc:597] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d7b7660ead3b4a4da081b0199f44037f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:54.428773  5864 catalog_manager.cc:5697] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:54.433739  5962 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:54.442445  6115 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:54.443440  5934 consensus_peers.cc:597] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a0acc59e2e4d43029c959c64a291c5a0. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:54.444399  6762 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:54.445004  6040 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:54.447434  6755 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:54.459885  6782 raft_consensus.cc:2955] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:54.461625  6044 raft_consensus.cc:2955] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:54.462694  6115 raft_consensus.cc:2955] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:54.483743  6044 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:54.496111  6109 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:54.499696  6009 consensus_peers.cc:597] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: afdcf44718954edea3bd3aa8ada58035. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:54.500694  5962 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:54.500981  6757 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:23:54.504456  6758 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:54.504401  5865 catalog_manager.cc:5697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:54.529565  6757 raft_consensus.cc:2955] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:54.535983  5960 raft_consensus.cc:2955] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:54.543681  6109 raft_consensus.cc:2955] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:54.551704  6040 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:54.553377  5864 catalog_manager.cc:5697] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:54.579756  6115 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:54.578287  6009 consensus_peers.cc:597] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 02dd5c8c15e34ecfbc46620193fb5762. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:54.581791  6758 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:54.583113  5960 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:54.587441  6793 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:23:54.605911  6771 raft_consensus.cc:2955] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:54.607805  6109 raft_consensus.cc:2955] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:54.613212  5962 raft_consensus.cc:2955] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:54.628741  5862 catalog_manager.cc:5697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:54.887138  6798 ts_tablet_manager.cc:933] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:54.892980  6798 tablet_copy_client.cc:323] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.67:39787
I20260709 12:23:54.908238  6802 ts_tablet_manager.cc:933] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:23:54.908262  6128 tablet_copy_service.cc:140] P 0069e2ba1f02412e8e1d6c20a1fb510f: Received BeginTabletCopySession request for tablet d7b7660ead3b4a4da081b0199f44037f from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:42484)
I20260709 12:23:54.909731  6128 tablet_copy_service.cc:161] P 0069e2ba1f02412e8e1d6c20a1fb510f: Beginning new tablet copy session on tablet d7b7660ead3b4a4da081b0199f44037f from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:42484: session id = 24012af7747d4c4ea89c3da2ff950099-d7b7660ead3b4a4da081b0199f44037f
I20260709 12:23:54.917574  6802 tablet_copy_client.cc:323] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.65:42981
I20260709 12:23:54.919327  6128 tablet_copy_source_session.cc:215] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:54.920665  5978 tablet_copy_service.cc:140] P f1bb8e63c2b448cdafd51f05d277c741: Received BeginTabletCopySession request for tablet a0acc59e2e4d43029c959c64a291c5a0 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:37174)
I20260709 12:23:54.921247  5978 tablet_copy_service.cc:161] P f1bb8e63c2b448cdafd51f05d277c741: Beginning new tablet copy session on tablet a0acc59e2e4d43029c959c64a291c5a0 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:37174: session id = 24012af7747d4c4ea89c3da2ff950099-a0acc59e2e4d43029c959c64a291c5a0
I20260709 12:23:54.922147  6798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7b7660ead3b4a4da081b0199f44037f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.928591  5978 tablet_copy_source_session.cc:215] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:54.931561  6802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0acc59e2e4d43029c959c64a291c5a0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:54.935801  6798 tablet_copy_client.cc:806] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:54.936372  6798 tablet_copy_client.cc:670] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:54.940920  6798 tablet_copy_client.cc:538] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:54.948081  6802 tablet_copy_client.cc:806] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:54.948863  6802 tablet_copy_client.cc:670] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:54.953142  6798 tablet_bootstrap.cc:492] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:23:54.953936  6802 tablet_copy_client.cc:538] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:54.960485  6802 tablet_bootstrap.cc:492] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:23:54.984881  6798 tablet_bootstrap.cc:492] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:54.985829  6798 tablet_bootstrap.cc:492] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:23:54.986558  6798 ts_tablet_manager.cc:1403] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.034s	user 0.025s	sys 0.005s
I20260709 12:23:54.990648  6798 raft_consensus.cc:359] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:54.991508  6798 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:23:54.992157  6798 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:54.993013  6802 tablet_bootstrap.cc:492] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:54.993906  6802 tablet_bootstrap.cc:492] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:23:54.994577  6802 ts_tablet_manager.cc:1403] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.034s	user 0.025s	sys 0.003s
I20260709 12:23:54.997502  6802 raft_consensus.cc:359] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:54.998282  6802 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:23:54.998886  6802 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:55.009153  6802 ts_tablet_manager.cc:1434] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.014s	user 0.008s	sys 0.004s
I20260709 12:23:55.013792  5978 tablet_copy_service.cc:342] P f1bb8e63c2b448cdafd51f05d277c741: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-a0acc59e2e4d43029c959c64a291c5a0 received from {username='slave'} at 127.0.0.1:37174
I20260709 12:23:55.014341  5978 tablet_copy_service.cc:434] P f1bb8e63c2b448cdafd51f05d277c741: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-a0acc59e2e4d43029c959c64a291c5a0 on tablet a0acc59e2e4d43029c959c64a291c5a0 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:23:55.023965  6802 ts_tablet_manager.cc:933] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:55.031237  6802 tablet_copy_client.cc:323] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:23:55.032903  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet afdcf44718954edea3bd3aa8ada58035 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:23:55.033463  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet afdcf44718954edea3bd3aa8ada58035 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-afdcf44718954edea3bd3aa8ada58035
I20260709 12:23:55.043561  6054 tablet_copy_source_session.cc:215] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:55.045154  6798 ts_tablet_manager.cc:1434] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.058s	user 0.012s	sys 0.034s
I20260709 12:23:55.046955  6128 tablet_copy_service.cc:342] P 0069e2ba1f02412e8e1d6c20a1fb510f: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-d7b7660ead3b4a4da081b0199f44037f received from {username='slave'} at 127.0.0.1:42484
I20260709 12:23:55.047423  6128 tablet_copy_service.cc:434] P 0069e2ba1f02412e8e1d6c20a1fb510f: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-d7b7660ead3b4a4da081b0199f44037f on tablet d7b7660ead3b4a4da081b0199f44037f with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:23:55.047798  6802 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet afdcf44718954edea3bd3aa8ada58035. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.060640  6802 tablet_copy_client.cc:806] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:55.061203  6802 tablet_copy_client.cc:670] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:55.065014  6802 tablet_copy_client.cc:538] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:55.071309  6802 tablet_bootstrap.cc:492] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:23:55.079107  6798 ts_tablet_manager.cc:933] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:55.080904  6798 tablet_copy_client.cc:323] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:23:55.082716  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet 02dd5c8c15e34ecfbc46620193fb5762 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:23:55.083271  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet 02dd5c8c15e34ecfbc46620193fb5762 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-02dd5c8c15e34ecfbc46620193fb5762
I20260709 12:23:55.089011  6802 tablet_bootstrap.cc:492] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:55.089949  6802 tablet_bootstrap.cc:492] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:23:55.090654  6802 ts_tablet_manager.cc:1403] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.020s	user 0.019s	sys 0.000s
I20260709 12:23:55.091279  6054 tablet_copy_source_session.cc:215] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:55.095881  6798 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 02dd5c8c15e34ecfbc46620193fb5762. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:55.097604  6802 raft_consensus.cc:359] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:55.098675  6802 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:23:55.099431  6802 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:55.102285  6802 ts_tablet_manager.cc:1434] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.011s	user 0.003s	sys 0.004s
I20260709 12:23:55.104348  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-afdcf44718954edea3bd3aa8ada58035 received from {username='slave'} at 127.0.0.1:60122
I20260709 12:23:55.104801  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-afdcf44718954edea3bd3aa8ada58035 on tablet afdcf44718954edea3bd3aa8ada58035 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:23:55.127425  6798 tablet_copy_client.cc:806] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:55.128052  6798 tablet_copy_client.cc:670] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:55.143247  6798 tablet_copy_client.cc:538] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:55.159762  6798 tablet_bootstrap.cc:492] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:23:55.182782  6798 tablet_bootstrap.cc:492] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:55.183583  6798 tablet_bootstrap.cc:492] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:23:55.184288  6798 ts_tablet_manager.cc:1403] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.000s
I20260709 12:23:55.186952  6798 raft_consensus.cc:359] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:55.187753  6798 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:23:55.188427  6798 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:55.190793  6798 ts_tablet_manager.cc:1434] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:23:55.192659  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-02dd5c8c15e34ecfbc46620193fb5762 received from {username='slave'} at 127.0.0.1:60122
I20260709 12:23:55.193193  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-02dd5c8c15e34ecfbc46620193fb5762 on tablet 02dd5c8c15e34ecfbc46620193fb5762 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:23:55.308691  6651 raft_consensus.cc:1217] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:55.442921  6651 raft_consensus.cc:1217] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:55.484555  6651 raft_consensus.cc:1217] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:55.566623  6651 raft_consensus.cc:1217] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:55.706025  6688 raft_consensus.cc:1064] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:23:55.708725  6688 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:55.718123  6044 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:55.719038  6651 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:55.719525  5962 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:55.720307  6770 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:55.721189  6688 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:55.722663  6813 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:55.733867  6688 raft_consensus.cc:2955] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:55.735432  6650 raft_consensus.cc:2955] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:55.739408  6044 raft_consensus.cc:2955] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:55.750994  5962 raft_consensus.cc:2955] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:55.756274  5862 catalog_manager.cc:5697] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:55.827870  6112 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:55.833811  6650 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:55.835361  6818 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:55.839099  6040 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:55.840481  6818 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:55.842780  6813 raft_consensus.cc:2955] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:55.844897  6650 raft_consensus.cc:2955] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:55.855283  6040 raft_consensus.cc:2955] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:55.856812  5864 catalog_manager.cc:5697] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:55.865495  5853 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d7b7660ead3b4a4da081b0199f44037f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:55.870806  5955 tablet_service.cc:1558] Processing DeleteTablet for tablet d7b7660ead3b4a4da081b0199f44037f with delete_type TABLET_DATA_TOMBSTONED (TS f1bb8e63c2b448cdafd51f05d277c741 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34548
I20260709 12:23:55.873713  6825 tablet_replica.cc:333] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:23:55.874852  6825 raft_consensus.cc:2243] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:55.875691  6825 raft_consensus.cc:2272] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:55.879971  6825 ts_tablet_manager.cc:1916] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:55.888935  6819 raft_consensus.cc:1064] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:23:55.891477  6819 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:55.905965  6825 ts_tablet_manager.cc:1929] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:55.906610  6825 log.cc:1199] T d7b7660ead3b4a4da081b0199f44037f P f1bb8e63c2b448cdafd51f05d277c741: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/wals/d7b7660ead3b4a4da081b0199f44037f
I20260709 12:23:55.908543  5850 catalog_manager.cc:5028] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): tablet d7b7660ead3b4a4da081b0199f44037f (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:23:55.915331  6650 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:55.916345  6112 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:55.916819  6758 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:55.917856  6821 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:55.930264  6650 raft_consensus.cc:2955] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:55.934641  5967 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:55.927881  6819 raft_consensus.cc:2955] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:55.939000  6793 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:55.955410  5864 catalog_manager.cc:5697] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:55.959028  6112 raft_consensus.cc:2955] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:55.987454  5967 raft_consensus.cc:2955] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.023365  6821 raft_consensus.cc:1064] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:23:56.025604  6821 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:56.028419  6755 raft_consensus.cc:1064] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:23:56.030792  6755 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:56.033082  6112 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:56.034545  6821 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:56.034863  5962 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:56.036326  6650 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:56.036796  6758 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:56.042872  6793 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:56.050163  6651 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:56.052021  6115 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:56.054349  6040 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:56.054780  6788 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:56.056442  6762 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:56.060698  6762 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:56.087410  6821 raft_consensus.cc:2955] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.090994  6762 raft_consensus.cc:2955] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.096211  6038 raft_consensus.cc:2955] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.098349  6650 raft_consensus.cc:2955] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.098688  6651 raft_consensus.cc:2955] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.105350  5967 raft_consensus.cc:2955] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.114643  5863 catalog_manager.cc:5697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:56.121644  6115 raft_consensus.cc:2955] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.127529  6112 raft_consensus.cc:2955] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.134876  6038 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:56.130435  5865 catalog_manager.cc:5697] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.159382  6112 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:56.161592  6650 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:56.162777  6771 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:56.164244  6819 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:56.169260  5967 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:56.179386  6651 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:56.179793  6109 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:56.181243  6755 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:56.182843  6755 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:56.188604  6771 raft_consensus.cc:2955] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.190519  6788 raft_consensus.cc:2955] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.195430  6112 raft_consensus.cc:2955] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.199021  6113 raft_consensus.cc:2955] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.208139  6650 raft_consensus.cc:2955] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.235956  5850 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a0acc59e2e4d43029c959c64a291c5a0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:56.257774  5862 catalog_manager.cc:5697] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.267452  5862 catalog_manager.cc:5697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.228524  6651 raft_consensus.cc:2955] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.278658  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 02dd5c8c15e34ecfbc46620193fb5762 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:23:56.281435  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 45784.9us
I20260709 12:23:56.310132  6025 tablet_service.cc:1558] Processing DeleteTablet for tablet a0acc59e2e4d43029c959c64a291c5a0 with delete_type TABLET_DATA_TOMBSTONED (TS 0557a7246c8945b99e5215c99d4ddf9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36246
I20260709 12:23:56.312536  5955 tablet_service.cc:1558] Processing DeleteTablet for tablet 02dd5c8c15e34ecfbc46620193fb5762 with delete_type TABLET_DATA_TOMBSTONED (TS f1bb8e63c2b448cdafd51f05d277c741 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34548
I20260709 12:23:56.315186  6825 tablet_replica.cc:333] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:23:56.316344  6825 raft_consensus.cc:2243] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.317094  6825 raft_consensus.cc:2272] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.325475  6825 ts_tablet_manager.cc:1916] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:56.333186  6842 tablet_replica.cc:333] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:23:56.334316  6842 raft_consensus.cc:2243] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.336176  6842 raft_consensus.cc:2272] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.339977  6842 ts_tablet_manager.cc:1916] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:56.349805  6825 ts_tablet_manager.cc:1929] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:56.350266  6825 log.cc:1199] T 02dd5c8c15e34ecfbc46620193fb5762 P f1bb8e63c2b448cdafd51f05d277c741: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/wals/02dd5c8c15e34ecfbc46620193fb5762
I20260709 12:23:56.352352  5850 catalog_manager.cc:5028] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): tablet 02dd5c8c15e34ecfbc46620193fb5762 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:23:56.358944  6842 ts_tablet_manager.cc:1929] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:56.359453  6842 log.cc:1199] T a0acc59e2e4d43029c959c64a291c5a0 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/wals/a0acc59e2e4d43029c959c64a291c5a0
I20260709 12:23:56.361107  5851 catalog_manager.cc:5028] TS 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): tablet a0acc59e2e4d43029c959c64a291c5a0 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:23:56.479065  6040 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:56.483506  5967 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:56.483506  6651 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:56.485129  6771 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:56.485948  6821 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:56.492882  6841 raft_consensus.cc:2955] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.499817  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet afdcf44718954edea3bd3aa8ada58035 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:56.499367  5967 raft_consensus.cc:2955] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.508198  5864 catalog_manager.cc:5697] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:56.508872  6651 raft_consensus.cc:2955] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:56.519531  6103 tablet_service.cc:1558] Processing DeleteTablet for tablet afdcf44718954edea3bd3aa8ada58035 with delete_type TABLET_DATA_TOMBSTONED (TS 0069e2ba1f02412e8e1d6c20a1fb510f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35576
I20260709 12:23:56.521694  6843 tablet_replica.cc:333] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:23:56.522727  6843 raft_consensus.cc:2243] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:56.523471  6843 raft_consensus.cc:2272] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:56.528999  6843 ts_tablet_manager.cc:1916] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:56.572656  6843 ts_tablet_manager.cc:1929] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:56.573153  6843 log.cc:1199] T afdcf44718954edea3bd3aa8ada58035 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/wals/afdcf44718954edea3bd3aa8ada58035
I20260709 12:23:56.575326  5853 catalog_manager.cc:5028] TS 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): tablet afdcf44718954edea3bd3aa8ada58035 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:23:57.585911  6112 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
W20260709 12:23:57.593082  6084 consensus_peers.cc:597] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4783d1a7790a4be2a959bd61e6f21947. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:57.593984  5967 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:57.594223  6038 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:57.596105  6818 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.596982  6688 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.608721  6818 raft_consensus.cc:2955] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:57.611264  5962 raft_consensus.cc:2955] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:57.613988  6038 raft_consensus.cc:2955] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:57.633337  5862 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.637809  6113 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:57.669902  6038 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:57.671976  5962 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:23:57.672585  6084 consensus_peers.cc:597] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8ff337cd5a364d1c9100f9a31dd826f7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:57.673748  6688 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.675541  6688 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.683102  6688 raft_consensus.cc:2955] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:57.687704  5962 raft_consensus.cc:2955] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:57.693969  6044 raft_consensus.cc:2955] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:57.697053  6038 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:57.706799  6112 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:57.708353  5962 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:57.708468  6821 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.709631  5865 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
W20260709 12:23:57.711054  6009 consensus_peers.cc:597] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d0a77cc9656a4b88bc262752ad91e486. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:57.714913  6771 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.763145  6862 raft_consensus.cc:2955] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:57.769065  5962 raft_consensus.cc:2955] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:57.776381  6113 raft_consensus.cc:2955] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:57.780439  6109 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:57.789657  6044 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:57.788699  5862 catalog_manager.cc:5697] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:57.791606  6818 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:23:57.794224  6084 consensus_peers.cc:597] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ba1e2d6430774a629131a0953161507b. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:23:57.798441  5962 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:23:57.800325  6688 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:23:57.801748  6855 raft_consensus.cc:2955] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:57.803352  6044 raft_consensus.cc:2955] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:57.815572  5967 raft_consensus.cc:2955] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:23:57.832584  5862 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:58.004629  6868 ts_tablet_manager.cc:933] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:58.006371  6868 tablet_copy_client.cc:323] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.67:39787
I20260709 12:23:58.007833  6128 tablet_copy_service.cc:140] P 0069e2ba1f02412e8e1d6c20a1fb510f: Received BeginTabletCopySession request for tablet 4783d1a7790a4be2a959bd61e6f21947 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:42484)
I20260709 12:23:58.008268  6128 tablet_copy_service.cc:161] P 0069e2ba1f02412e8e1d6c20a1fb510f: Beginning new tablet copy session on tablet 4783d1a7790a4be2a959bd61e6f21947 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:42484: session id = 24012af7747d4c4ea89c3da2ff950099-4783d1a7790a4be2a959bd61e6f21947
I20260709 12:23:58.013770  6128 tablet_copy_source_session.cc:215] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:58.016515  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4783d1a7790a4be2a959bd61e6f21947. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.033903  6868 tablet_copy_client.cc:806] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:58.034432  6868 tablet_copy_client.cc:670] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:58.042893  6868 tablet_copy_client.cc:538] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:58.052675  6868 tablet_bootstrap.cc:492] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:23:58.084815  6868 tablet_bootstrap.cc:492] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:58.085959  6868 tablet_bootstrap.cc:492] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:23:58.086776  6868 ts_tablet_manager.cc:1403] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.034s	user 0.019s	sys 0.012s
I20260709 12:23:58.089937  6868 raft_consensus.cc:359] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:58.090837  6868 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:23:58.091496  6868 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:58.096851  6868 ts_tablet_manager.cc:1434] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:23:58.098649  6128 tablet_copy_service.cc:342] P 0069e2ba1f02412e8e1d6c20a1fb510f: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-4783d1a7790a4be2a959bd61e6f21947 received from {username='slave'} at 127.0.0.1:42484
I20260709 12:23:58.099493  6128 tablet_copy_service.cc:434] P 0069e2ba1f02412e8e1d6c20a1fb510f: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-4783d1a7790a4be2a959bd61e6f21947 on tablet 4783d1a7790a4be2a959bd61e6f21947 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:23:58.198038  6868 ts_tablet_manager.cc:933] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:23:58.199759  6868 tablet_copy_client.cc:323] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:23:58.201787  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet d0a77cc9656a4b88bc262752ad91e486 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:23:58.202260  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet d0a77cc9656a4b88bc262752ad91e486 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-d0a77cc9656a4b88bc262752ad91e486
I20260709 12:23:58.207800  6054 tablet_copy_source_session.cc:215] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:58.211302  6868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d0a77cc9656a4b88bc262752ad91e486. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.226011  6868 tablet_copy_client.cc:806] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:58.226675  6868 tablet_copy_client.cc:670] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:58.231359  6868 tablet_copy_client.cc:538] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:58.240969  6868 tablet_bootstrap.cc:492] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:23:58.252512  6873 ts_tablet_manager.cc:933] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:58.257639  6873 tablet_copy_client.cc:323] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.67:39787
I20260709 12:23:58.261055  6128 tablet_copy_service.cc:140] P 0069e2ba1f02412e8e1d6c20a1fb510f: Received BeginTabletCopySession request for tablet 8ff337cd5a364d1c9100f9a31dd826f7 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:42484)
I20260709 12:23:58.261832  6128 tablet_copy_service.cc:161] P 0069e2ba1f02412e8e1d6c20a1fb510f: Beginning new tablet copy session on tablet 8ff337cd5a364d1c9100f9a31dd826f7 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:42484: session id = 24012af7747d4c4ea89c3da2ff950099-8ff337cd5a364d1c9100f9a31dd826f7
I20260709 12:23:58.275975  6128 tablet_copy_source_session.cc:215] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:58.277871  6868 tablet_bootstrap.cc:492] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:58.278908  6868 tablet_bootstrap.cc:492] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:23:58.279572  6873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8ff337cd5a364d1c9100f9a31dd826f7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.279667  6868 ts_tablet_manager.cc:1403] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.022s
I20260709 12:23:58.282914  6868 raft_consensus.cc:359] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:58.283856  6868 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:23:58.284548  6868 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:58.290819  6868 ts_tablet_manager.cc:1434] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.002s
I20260709 12:23:58.292776  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-d0a77cc9656a4b88bc262752ad91e486 received from {username='slave'} at 127.0.0.1:60122
I20260709 12:23:58.293176  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-d0a77cc9656a4b88bc262752ad91e486 on tablet d0a77cc9656a4b88bc262752ad91e486 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:23:58.298671  6873 tablet_copy_client.cc:806] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:58.299384  6873 tablet_copy_client.cc:670] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:58.303465  6873 tablet_copy_client.cc:538] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:58.312346  6873 tablet_bootstrap.cc:492] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:23:58.328773  6873 tablet_bootstrap.cc:492] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:58.329829  6873 tablet_bootstrap.cc:492] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:23:58.330529  6873 ts_tablet_manager.cc:1403] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.008s
I20260709 12:23:58.333138  6873 raft_consensus.cc:359] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:58.333859  6873 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:23:58.334354  6873 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:58.336026  6873 ts_tablet_manager.cc:1434] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:23:58.337772  6128 tablet_copy_service.cc:342] P 0069e2ba1f02412e8e1d6c20a1fb510f: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-8ff337cd5a364d1c9100f9a31dd826f7 received from {username='slave'} at 127.0.0.1:42484
I20260709 12:23:58.338195  6128 tablet_copy_service.cc:434] P 0069e2ba1f02412e8e1d6c20a1fb510f: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-8ff337cd5a364d1c9100f9a31dd826f7 on tablet 8ff337cd5a364d1c9100f9a31dd826f7 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:23:58.372828  6873 ts_tablet_manager.cc:933] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:23:58.374195  6873 tablet_copy_client.cc:323] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.67:39787
I20260709 12:23:58.375662  6128 tablet_copy_service.cc:140] P 0069e2ba1f02412e8e1d6c20a1fb510f: Received BeginTabletCopySession request for tablet ba1e2d6430774a629131a0953161507b from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:42484)
I20260709 12:23:58.376197  6128 tablet_copy_service.cc:161] P 0069e2ba1f02412e8e1d6c20a1fb510f: Beginning new tablet copy session on tablet ba1e2d6430774a629131a0953161507b from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:42484: session id = 24012af7747d4c4ea89c3da2ff950099-ba1e2d6430774a629131a0953161507b
I20260709 12:23:58.385073  6128 tablet_copy_source_session.cc:215] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:23:58.387754  6873 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ba1e2d6430774a629131a0953161507b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:23:58.405529  6873 tablet_copy_client.cc:806] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:23:58.406253  6873 tablet_copy_client.cc:670] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:23:58.410099  6873 tablet_copy_client.cc:538] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:23:58.418430  6873 tablet_bootstrap.cc:492] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:23:58.457835  6651 raft_consensus.cc:1217] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:58.461393  6873 tablet_bootstrap.cc:492] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:23:58.462404  6873 tablet_bootstrap.cc:492] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:23:58.463164  6873 ts_tablet_manager.cc:1403] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.045s	user 0.032s	sys 0.008s
I20260709 12:23:58.468487  6873 raft_consensus.cc:359] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:58.469384  6873 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:23:58.470501  6873 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:23:58.480158  6873 ts_tablet_manager.cc:1434] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.000s
I20260709 12:23:58.486872  6128 tablet_copy_service.cc:342] P 0069e2ba1f02412e8e1d6c20a1fb510f: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-ba1e2d6430774a629131a0953161507b received from {username='slave'} at 127.0.0.1:42484
I20260709 12:23:58.487323  6128 tablet_copy_service.cc:434] P 0069e2ba1f02412e8e1d6c20a1fb510f: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-ba1e2d6430774a629131a0953161507b on tablet ba1e2d6430774a629131a0953161507b with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:23:58.805842  6650 raft_consensus.cc:1217] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:58.883533  6651 raft_consensus.cc:1217] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:58.927127  6650 raft_consensus.cc:1217] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:23:58.947919  6688 raft_consensus.cc:1064] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:23:58.952659  6688 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:58.960467  6040 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.961172  5960 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.961301  6650 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:58.963079  6884 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:58.965977  6884 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:58.971190  6884 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:58.992259  6651 raft_consensus.cc:2955] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:58.992861  6040 raft_consensus.cc:2955] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:58.989246  6688 raft_consensus.cc:2955] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.036638  5862 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.043777  5960 raft_consensus.cc:2955] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.105211  6109 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:59.110363  6651 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:59.111886  6883 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:59.118482  5960 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:59.119205  6688 raft_consensus.cc:2955] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.120492  6885 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:59.121093  6651 raft_consensus.cc:2955] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.125250  5960 raft_consensus.cc:2955] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.131386  5853 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4783d1a7790a4be2a959bd61e6f21947 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:59.138195  5865 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.150902  6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 4783d1a7790a4be2a959bd61e6f21947 with delete_type TABLET_DATA_TOMBSTONED (TS 0557a7246c8945b99e5215c99d4ddf9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36246
I20260709 12:23:59.173534  6897 tablet_replica.cc:333] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:23:59.175413  6897 raft_consensus.cc:2243] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:59.176251  6897 raft_consensus.cc:2272] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:59.181217  6897 ts_tablet_manager.cc:1916] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:59.200277  6897 ts_tablet_manager.cc:1929] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:59.200824  6897 log.cc:1199] T 4783d1a7790a4be2a959bd61e6f21947 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/wals/4783d1a7790a4be2a959bd61e6f21947
I20260709 12:23:59.203085  5851 catalog_manager.cc:5028] TS 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): tablet 4783d1a7790a4be2a959bd61e6f21947 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:23:59.359869  6888 raft_consensus.cc:1064] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:23:59.362658  6888 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:59.369997  6113 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:59.370829  5964 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:59.371905  6651 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:59.371941  6888 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:59.373287  6882 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:59.374091  6771 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:59.420900  6882 raft_consensus.cc:2955] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.425217  6113 raft_consensus.cc:2955] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.427421  6651 raft_consensus.cc:2955] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.433454  5959 raft_consensus.cc:2955] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.445783  5863 catalog_manager.cc:5697] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.465890  6040 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:59.477069  6884 raft_consensus.cc:1064] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:23:59.479907  6884 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:59.484982  6651 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:59.485508  5959 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:59.487051  6888 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:59.491497  6882 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:59.495900  6771 raft_consensus.cc:2955] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.507520  6688 raft_consensus.cc:1064] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:23:59.507282  5959 raft_consensus.cc:2955] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.509896  6688 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:59.515069  5964 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:59.517930  6885 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:23:59.518873  6651 raft_consensus.cc:2955] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.517881  6038 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:59.533118  6885 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:59.536207  5864 catalog_manager.cc:5697] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.546732  6103 tablet_service.cc:1558] Processing DeleteTablet for tablet d0a77cc9656a4b88bc262752ad91e486 with delete_type TABLET_DATA_TOMBSTONED (TS 0069e2ba1f02412e8e1d6c20a1fb510f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35576
I20260709 12:23:59.552047  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d0a77cc9656a4b88bc262752ad91e486 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:59.567613  6651 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:59.569308  6884 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:59.570674  6907 tablet_replica.cc:333] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:23:59.575464  6038 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:59.576924  6650 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:59.580008  6883 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:59.586572  6883 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:59.591935  6885 raft_consensus.cc:2955] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.595080  5964 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:23:59.597018  5959 raft_consensus.cc:2955] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.607398  6884 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:23:59.614938  6907 raft_consensus.cc:2243] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:59.615830  6907 raft_consensus.cc:2272] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:59.632688  6907 ts_tablet_manager.cc:1916] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:59.670841  6903 raft_consensus.cc:2955] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.676364  6040 raft_consensus.cc:2955] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.677373  6650 raft_consensus.cc:2955] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.683535  6038 raft_consensus.cc:2955] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.693887  5863 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:23:59.701251  6651 raft_consensus.cc:2955] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.720477  5863 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.754216  5962 raft_consensus.cc:2955] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.762575  6109 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:59.779700  6651 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:59.781230  6903 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:59.785624  6038 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:59.787425  6885 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:59.794015  6109 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:23:59.795476  6884 raft_consensus.cc:2955] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.799371  6038 raft_consensus.cc:2955] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.806545  6651 raft_consensus.cc:2955] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.812180  5853 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 8ff337cd5a364d1c9100f9a31dd826f7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:59.819069  5864 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:23:59.828194  6907 ts_tablet_manager.cc:1929] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:59.830991  6650 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:59.835031  5955 tablet_service.cc:1558] Processing DeleteTablet for tablet 8ff337cd5a364d1c9100f9a31dd826f7 with delete_type TABLET_DATA_TOMBSTONED (TS f1bb8e63c2b448cdafd51f05d277c741 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34548
I20260709 12:23:59.841820  6903 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:23:59.846709  6907 log.cc:1199] T d0a77cc9656a4b88bc262752ad91e486 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/wals/d0a77cc9656a4b88bc262752ad91e486
I20260709 12:23:59.850505  6883 raft_consensus.cc:2955] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.835752  5962 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:23:59.855355  5853 catalog_manager.cc:5028] TS 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): tablet d0a77cc9656a4b88bc262752ad91e486 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:23:59.858235  6885 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:23:59.865980  6651 raft_consensus.cc:2955] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.869580  5962 raft_consensus.cc:2955] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.878866  6913 tablet_replica.cc:333] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:23:59.881691  5853 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ba1e2d6430774a629131a0953161507b with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:23:59.889827  5862 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:23:59.906975  6025 tablet_service.cc:1558] Processing DeleteTablet for tablet ba1e2d6430774a629131a0953161507b with delete_type TABLET_DATA_TOMBSTONED (TS 0557a7246c8945b99e5215c99d4ddf9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36246
I20260709 12:23:59.922782  6914 tablet_replica.cc:333] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:23:59.923676  6914 raft_consensus.cc:2243] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:59.924038  6913 raft_consensus.cc:2243] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:23:59.924269  6914 raft_consensus.cc:2272] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:59.924674  6913 raft_consensus.cc:2272] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:23:59.927035  6914 ts_tablet_manager.cc:1916] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:59.927897  6913 ts_tablet_manager.cc:1916] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:23:59.942953  6914 ts_tablet_manager.cc:1929] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:59.943302  6913 ts_tablet_manager.cc:1929] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:23:59.943405  6914 log.cc:1199] T ba1e2d6430774a629131a0953161507b P 0557a7246c8945b99e5215c99d4ddf9c: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/wals/ba1e2d6430774a629131a0953161507b
I20260709 12:23:59.943800  6913 log.cc:1199] T 8ff337cd5a364d1c9100f9a31dd826f7 P f1bb8e63c2b448cdafd51f05d277c741: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/wals/8ff337cd5a364d1c9100f9a31dd826f7
I20260709 12:23:59.945132  5851 catalog_manager.cc:5028] TS 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): tablet ba1e2d6430774a629131a0953161507b (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:23:59.945976  5850 catalog_manager.cc:5028] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): tablet 8ff337cd5a364d1c9100f9a31dd826f7 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:00.980587  6041 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:00.985987  6113 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:00.987520  5964 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:00.987432  6771 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:00.988404  6009 consensus_peers.cc:597] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: d24ea63f22cb4977ad36707d9d0fffea. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:00.989656  6771 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.005373  6109 raft_consensus.cc:2955] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.005620  5964 raft_consensus.cc:2955] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.000485  6911 raft_consensus.cc:2955] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.021705  5864 catalog_manager.cc:5697] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.034408  5964 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:01.045083  6109 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:01.045630  6041 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:24:01.046365  5934 consensus_peers.cc:597] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7df97235d12b46dd8e54f8f1d6ed40bd. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:01.047267  6887 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.048172  6877 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.060737  6877 raft_consensus.cc:2955] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.062419  6041 raft_consensus.cc:2955] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.062726  6109 raft_consensus.cc:2955] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.081063  5862 catalog_manager.cc:5697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.081689  6109 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:01.091102  6041 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:01.093377  6885 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.093642  5964 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:01.095876  6883 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:01.096870  6084 consensus_peers.cc:597] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4f2d24cb0978411e851e8ff35955bf2e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:01.113813  6885 raft_consensus.cc:2955] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.116115  6038 raft_consensus.cc:2955] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.130235  5962 raft_consensus.cc:2955] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.136379  5865 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.149354  6112 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:01.165334  6041 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:24:01.167292  6084 consensus_peers.cc:597] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0ad617c44395493f82e992b73a4295ad. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:01.171067  6883 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.176298  5962 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:01.178076  6929 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:01.181950  6883 raft_consensus.cc:2955] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.185247  6041 raft_consensus.cc:2955] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.190373  5964 raft_consensus.cc:2955] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:01.201381  5865 catalog_manager.cc:5697] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:01.491696  6936 ts_tablet_manager.cc:933] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:24:01.493785  6936 tablet_copy_client.cc:323] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.65:42981
I20260709 12:24:01.495875  5978 tablet_copy_service.cc:140] P f1bb8e63c2b448cdafd51f05d277c741: Received BeginTabletCopySession request for tablet 7df97235d12b46dd8e54f8f1d6ed40bd from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:37174)
I20260709 12:24:01.496340  5978 tablet_copy_service.cc:161] P f1bb8e63c2b448cdafd51f05d277c741: Beginning new tablet copy session on tablet 7df97235d12b46dd8e54f8f1d6ed40bd from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:37174: session id = 24012af7747d4c4ea89c3da2ff950099-7df97235d12b46dd8e54f8f1d6ed40bd
I20260709 12:24:01.516615  5978 tablet_copy_source_session.cc:215] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:01.520519  6936 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7df97235d12b46dd8e54f8f1d6ed40bd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:01.529034  6938 ts_tablet_manager.cc:933] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:01.560658  6940 ts_tablet_manager.cc:933] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:01.561626  6938 tablet_copy_client.cc:323] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.67:39787
I20260709 12:24:01.563709  6128 tablet_copy_service.cc:140] P 0069e2ba1f02412e8e1d6c20a1fb510f: Received BeginTabletCopySession request for tablet 4f2d24cb0978411e851e8ff35955bf2e from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:42484)
I20260709 12:24:01.564270  6128 tablet_copy_service.cc:161] P 0069e2ba1f02412e8e1d6c20a1fb510f: Beginning new tablet copy session on tablet 4f2d24cb0978411e851e8ff35955bf2e from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:42484: session id = 24012af7747d4c4ea89c3da2ff950099-4f2d24cb0978411e851e8ff35955bf2e
I20260709 12:24:01.566504  6940 tablet_copy_client.cc:323] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:24:01.568480  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet d24ea63f22cb4977ad36707d9d0fffea from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:24:01.568984  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet d24ea63f22cb4977ad36707d9d0fffea from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-d24ea63f22cb4977ad36707d9d0fffea
I20260709 12:24:01.564224  6936 tablet_copy_client.cc:806] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:01.569938  6936 tablet_copy_client.cc:670] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:01.576463  6128 tablet_copy_source_session.cc:215] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:01.576872  6054 tablet_copy_source_session.cc:215] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:01.577524  6936 tablet_copy_client.cc:538] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:01.579958  6938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4f2d24cb0978411e851e8ff35955bf2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:01.580698  6940 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d24ea63f22cb4977ad36707d9d0fffea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:01.589231  6936 tablet_bootstrap.cc:492] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:01.605026  6940 tablet_copy_client.cc:806] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:01.605640  6940 tablet_copy_client.cc:670] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:01.609769  6940 tablet_copy_client.cc:538] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:01.625710  6940 tablet_bootstrap.cc:492] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:01.626025  6936 tablet_bootstrap.cc:492] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:01.626550  6938 tablet_copy_client.cc:806] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:01.626947  6936 tablet_bootstrap.cc:492] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:01.627223  6938 tablet_copy_client.cc:670] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:01.629683  6936 ts_tablet_manager.cc:1403] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.009s
I20260709 12:24:01.634169  6938 tablet_copy_client.cc:538] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:01.634958  6936 raft_consensus.cc:359] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:01.637291  6936 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:01.637934  6936 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:01.652869  6936 ts_tablet_manager.cc:1434] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.023s	user 0.009s	sys 0.004s
I20260709 12:24:01.654031  6938 tablet_bootstrap.cc:492] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:01.658838  5978 tablet_copy_service.cc:342] P f1bb8e63c2b448cdafd51f05d277c741: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-7df97235d12b46dd8e54f8f1d6ed40bd received from {username='slave'} at 127.0.0.1:37174
I20260709 12:24:01.660995  5978 tablet_copy_service.cc:434] P f1bb8e63c2b448cdafd51f05d277c741: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-7df97235d12b46dd8e54f8f1d6ed40bd on tablet 7df97235d12b46dd8e54f8f1d6ed40bd with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:01.676652  6940 tablet_bootstrap.cc:492] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:01.677985  6940 tablet_bootstrap.cc:492] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:01.678731  6940 ts_tablet_manager.cc:1403] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.055s	user 0.020s	sys 0.013s
I20260709 12:24:01.684705  6940 raft_consensus.cc:359] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:01.685611  6940 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:01.686319  6940 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:01.692643  6940 ts_tablet_manager.cc:1434] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.001s
I20260709 12:24:01.694514  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-d24ea63f22cb4977ad36707d9d0fffea received from {username='slave'} at 127.0.0.1:60122
I20260709 12:24:01.694990  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-d24ea63f22cb4977ad36707d9d0fffea on tablet d24ea63f22cb4977ad36707d9d0fffea with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:01.701417  6938 tablet_bootstrap.cc:492] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:01.702817  6938 tablet_bootstrap.cc:492] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:01.703599  6938 ts_tablet_manager.cc:1403] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.014s
I20260709 12:24:01.706998  6938 raft_consensus.cc:359] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:01.708133  6938 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:01.708822  6938 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:01.716363  6938 ts_tablet_manager.cc:1434] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.012s	user 0.004s	sys 0.001s
I20260709 12:24:01.718918  6128 tablet_copy_service.cc:342] P 0069e2ba1f02412e8e1d6c20a1fb510f: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-4f2d24cb0978411e851e8ff35955bf2e received from {username='slave'} at 127.0.0.1:42484
I20260709 12:24:01.719385  6128 tablet_copy_service.cc:434] P 0069e2ba1f02412e8e1d6c20a1fb510f: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-4f2d24cb0978411e851e8ff35955bf2e on tablet 4f2d24cb0978411e851e8ff35955bf2e with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:01.769055  6938 ts_tablet_manager.cc:933] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:01.772889  6938 tablet_copy_client.cc:323] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.67:39787
I20260709 12:24:01.774887  6128 tablet_copy_service.cc:140] P 0069e2ba1f02412e8e1d6c20a1fb510f: Received BeginTabletCopySession request for tablet 0ad617c44395493f82e992b73a4295ad from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:42484)
I20260709 12:24:01.775414  6128 tablet_copy_service.cc:161] P 0069e2ba1f02412e8e1d6c20a1fb510f: Beginning new tablet copy session on tablet 0ad617c44395493f82e992b73a4295ad from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:42484: session id = 24012af7747d4c4ea89c3da2ff950099-0ad617c44395493f82e992b73a4295ad
I20260709 12:24:01.782028  6128 tablet_copy_source_session.cc:215] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:01.785692  6938 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ad617c44395493f82e992b73a4295ad. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:01.803216  6938 tablet_copy_client.cc:806] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:01.803819  6938 tablet_copy_client.cc:670] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:01.808879  6938 tablet_copy_client.cc:538] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:01.839107  6938 tablet_bootstrap.cc:492] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:01.858594  6938 tablet_bootstrap.cc:492] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:01.859501  6938 tablet_bootstrap.cc:492] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:01.860138  6938 ts_tablet_manager.cc:1403] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.021s	user 0.020s	sys 0.000s
I20260709 12:24:01.863122  6938 raft_consensus.cc:359] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:01.863984  6938 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:01.864619  6938 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:01.867182  6938 ts_tablet_manager.cc:1434] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:24:01.868745  6128 tablet_copy_service.cc:342] P 0069e2ba1f02412e8e1d6c20a1fb510f: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-0ad617c44395493f82e992b73a4295ad received from {username='slave'} at 127.0.0.1:42484
I20260709 12:24:01.869168  6128 tablet_copy_service.cc:434] P 0069e2ba1f02412e8e1d6c20a1fb510f: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-0ad617c44395493f82e992b73a4295ad on tablet 0ad617c44395493f82e992b73a4295ad with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:01.906163  6650 raft_consensus.cc:1217] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:01.913532  6650 raft_consensus.cc:1217] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:02.106282  6650 raft_consensus.cc:1217] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:02.201776  6651 raft_consensus.cc:1217] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:02.386950  6919 raft_consensus.cc:1064] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:02.389807  6919 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:02.400522  6948 raft_consensus.cc:1064] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:02.403093  6948 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:02.405349  6109 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:02.406769  6651 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:02.407260  6919 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:02.408663  6918 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:02.406771  5964 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:02.413304  6919 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:02.421016  5962 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:02.421854  6650 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:02.423348  6948 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:02.423960  6041 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:02.425279  6883 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:02.427994  6948 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:02.435250  6911 raft_consensus.cc:2955] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.452700  6883 raft_consensus.cc:2955] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.453130  6041 raft_consensus.cc:2955] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.445242  6651 raft_consensus.cc:2955] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.465966  6112 raft_consensus.cc:2955] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.471848  5964 raft_consensus.cc:2955] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.474643  6650 raft_consensus.cc:2955] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.481992  5959 raft_consensus.cc:2955] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.477476  5864 catalog_manager.cc:5697] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:02.511888  5865 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:24:02.517889  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45537.3us
I20260709 12:24:02.539294  6041 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:02.544912  6112 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:02.546213  6651 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:02.548262  6918 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:02.548743  6109 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:02.552831  6918 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:02.565764  6911 raft_consensus.cc:2955] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.571087  5964 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:02.571350  6109 raft_consensus.cc:2955] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.573998  6651 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:02.575536  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet d24ea63f22cb4977ad36707d9d0fffea with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:02.575626  6883 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:24:02.581203  6958 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:02.585587  6651 raft_consensus.cc:2955] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.591339  6883 raft_consensus.cc:2955] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.593017  6650 raft_consensus.cc:2955] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.599675  5959 raft_consensus.cc:2955] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:24:02.630216  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 44637.9us
I20260709 12:24:02.641814  6948 raft_consensus.cc:1064] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:02.644424  6948 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:02.649106  6877 raft_consensus.cc:1064] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:02.654026  6877 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:02.654175  5863 catalog_manager.cc:5697] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.655767  5853 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 4f2d24cb0978411e851e8ff35955bf2e with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:02.661223  5865 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.665748  5955 tablet_service.cc:1558] Processing DeleteTablet for tablet d24ea63f22cb4977ad36707d9d0fffea with delete_type TABLET_DATA_TOMBSTONED (TS f1bb8e63c2b448cdafd51f05d277c741 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34548
I20260709 12:24:02.666333  5959 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:02.679781  6883 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:02.680397  6650 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:02.681756  6927 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:02.683462  6651 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:02.687516  6948 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:02.692965  6109 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:02.694423  6887 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:02.708943  6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 4f2d24cb0978411e851e8ff35955bf2e with delete_type TABLET_DATA_TOMBSTONED (TS 0557a7246c8945b99e5215c99d4ddf9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36246
I20260709 12:24:02.720387  6927 raft_consensus.cc:2955] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.723834  6038 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:02.731243  6967 tablet_replica.cc:333] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:24:02.734201  6650 raft_consensus.cc:2955] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.742910  6973 tablet_replica.cc:333] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:24:02.745648  6883 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:02.750783  6041 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:02.752329  6109 raft_consensus.cc:2955] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.753679  6948 raft_consensus.cc:2955] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.757085  6967 raft_consensus.cc:2243] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.758397  5962 raft_consensus.cc:2955] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.773209  6967 raft_consensus.cc:2272] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.763499  6973 raft_consensus.cc:2243] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.796905  6973 raft_consensus.cc:2272] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.806351  6974 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:02.805950  5865 catalog_manager.cc:5697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.809372  6038 raft_consensus.cc:2955] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.812000  6973 ts_tablet_manager.cc:1916] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:02.826112  6650 raft_consensus.cc:2955] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.855232  6967 ts_tablet_manager.cc:1916] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:02.856117  5865 catalog_manager.cc:5697] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.872109  6040 raft_consensus.cc:2955] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.883898  6967 ts_tablet_manager.cc:1929] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:02.884547  6967 log.cc:1199] T d24ea63f22cb4977ad36707d9d0fffea P f1bb8e63c2b448cdafd51f05d277c741: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/wals/d24ea63f22cb4977ad36707d9d0fffea
I20260709 12:24:02.891300  5850 catalog_manager.cc:5028] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): tablet d24ea63f22cb4977ad36707d9d0fffea (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:02.908138  6112 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:02.914316  6650 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:02.915258  6973 ts_tablet_manager.cc:1929] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:02.919607  6973 log.cc:1199] T 4f2d24cb0978411e851e8ff35955bf2e P 0557a7246c8945b99e5215c99d4ddf9c: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/wals/4f2d24cb0978411e851e8ff35955bf2e
I20260709 12:24:02.917059  6883 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:02.926759  5851 catalog_manager.cc:5028] TS 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): tablet 4f2d24cb0978411e851e8ff35955bf2e (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:02.930970  5962 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:02.933447  6883 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:02.935024  6948 raft_consensus.cc:2955] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.936676  6651 raft_consensus.cc:2955] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.943789  5853 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0ad617c44395493f82e992b73a4295ad with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:02.944752  5962 raft_consensus.cc:2955] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.951772  5863 catalog_manager.cc:5697] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:02.964821  6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 0ad617c44395493f82e992b73a4295ad with delete_type TABLET_DATA_TOMBSTONED (TS 0557a7246c8945b99e5215c99d4ddf9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36246
I20260709 12:24:02.965839  6973 tablet_replica.cc:333] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:24:02.967013  6973 raft_consensus.cc:2243] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:02.967895  6973 raft_consensus.cc:2272] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:02.970674  6973 ts_tablet_manager.cc:1916] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:02.987421  6973 ts_tablet_manager.cc:1929] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:02.987797  6973 log.cc:1199] T 0ad617c44395493f82e992b73a4295ad P 0557a7246c8945b99e5215c99d4ddf9c: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/wals/0ad617c44395493f82e992b73a4295ad
I20260709 12:24:02.989297  5851 catalog_manager.cc:5028] TS 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): tablet 0ad617c44395493f82e992b73a4295ad (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:03.424760  5959 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:03.432319  6651 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:03.433836  6927 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:03.434677  6040 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:03.436604  6974 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:03.441237  6978 raft_consensus.cc:2955] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:03.442799  6651 raft_consensus.cc:2955] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:03.467065  6044 raft_consensus.cc:2955] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:03.469960  5850 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7df97235d12b46dd8e54f8f1d6ed40bd with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:03.482136  5862 catalog_manager.cc:5697] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:03.510102  6103 tablet_service.cc:1558] Processing DeleteTablet for tablet 7df97235d12b46dd8e54f8f1d6ed40bd with delete_type TABLET_DATA_TOMBSTONED (TS 0069e2ba1f02412e8e1d6c20a1fb510f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35576
I20260709 12:24:03.525220  6985 tablet_replica.cc:333] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:24:03.526345  6985 raft_consensus.cc:2243] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:03.527226  6985 raft_consensus.cc:2272] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:03.530340  6985 ts_tablet_manager.cc:1916] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:03.542104  6985 ts_tablet_manager.cc:1929] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:03.542416  6985 log.cc:1199] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/wals/7df97235d12b46dd8e54f8f1d6ed40bd
I20260709 12:24:03.543849  5853 catalog_manager.cc:5028] TS 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): tablet 7df97235d12b46dd8e54f8f1d6ed40bd (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:04.580188  6044 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
W20260709 12:24:04.587515  6009 consensus_peers.cc:597] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: be9bf17a0be244b3bdd7bec88bf5a051. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:04.588058  5959 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:04.588699  6109 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:04.590054  6989 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:04.591622  6968 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.598395  6968 raft_consensus.cc:2955] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:04.606058  5959 raft_consensus.cc:2955] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:04.614491  6044 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:04.604256  6109 raft_consensus.cc:2955] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:04.628856  6112 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:24:04.629144  6009 consensus_peers.cc:597] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c357e710ee044329b93321405ae76071. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:04.629698  5863 catalog_manager.cc:5697] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:04.630565  6992 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.631979  5959 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:04.636691  6992 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.647696  6989 raft_consensus.cc:2955] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:04.649843  6112 raft_consensus.cc:2955] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:04.655241  5962 raft_consensus.cc:2955] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:04.674824  5962 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
W20260709 12:24:04.681654  5934 consensus_peers.cc:597] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7bf137aab07e4b9b8024d07355c33351. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:04.684152  6112 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:04.684808  6044 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:04.685467  6927 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.686360  6980 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.689010  5864 catalog_manager.cc:5697] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:04.712598  6927 raft_consensus.cc:2955] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:04.714082  6044 raft_consensus.cc:2955] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:04.719405  6112 raft_consensus.cc:2955] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:04.731014  5862 catalog_manager.cc:5697] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:04.731983  6044 consensus_queue.cc:237] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
W20260709 12:24:04.752825  6009 consensus_peers.cc:597] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: cf28639931bb43a58703f0afd043e166. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:04.755424  6112 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:04.757423  6968 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.762838  5959 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:04.764560  7000 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:04.771374  6113 raft_consensus.cc:2955] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:04.769364  7000 raft_consensus.cc:2955] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:04.789773  5863 catalog_manager.cc:5697] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:04.794206  5962 raft_consensus.cc:2955] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:05.056237  7011 ts_tablet_manager.cc:933] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:05.061633  7011 tablet_copy_client.cc:323] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:24:05.063319  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet c357e710ee044329b93321405ae76071 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:24:05.063781  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet c357e710ee044329b93321405ae76071 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-c357e710ee044329b93321405ae76071
I20260709 12:24:05.071789  6054 tablet_copy_source_session.cc:215] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:05.076061  7011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c357e710ee044329b93321405ae76071. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.096547  7011 tablet_copy_client.cc:806] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:05.097162  7011 tablet_copy_client.cc:670] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:05.101011  7011 tablet_copy_client.cc:538] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:05.111738  7011 tablet_bootstrap.cc:492] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:05.132480  7011 tablet_bootstrap.cc:492] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:05.133430  7011 tablet_bootstrap.cc:492] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:05.134879  7011 ts_tablet_manager.cc:1403] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.009s
I20260709 12:24:05.148927  7011 raft_consensus.cc:359] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:05.152240  7011 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:05.157127  7011 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:05.170327  7014 ts_tablet_manager.cc:933] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:05.183130  7014 tablet_copy_client.cc:323] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:24:05.187201  7017 ts_tablet_manager.cc:933] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:24:05.190346  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet be9bf17a0be244b3bdd7bec88bf5a051 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:24:05.190989  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet be9bf17a0be244b3bdd7bec88bf5a051 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-be9bf17a0be244b3bdd7bec88bf5a051
I20260709 12:24:05.200083  6054 tablet_copy_source_session.cc:215] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:05.203416  7011 ts_tablet_manager.cc:1434] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.068s	user 0.022s	sys 0.001s
I20260709 12:24:05.207736  7014 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be9bf17a0be244b3bdd7bec88bf5a051. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.215116  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-c357e710ee044329b93321405ae76071 received from {username='slave'} at 127.0.0.1:60122
I20260709 12:24:05.215727  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-c357e710ee044329b93321405ae76071 on tablet c357e710ee044329b93321405ae76071 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:05.221632  7017 tablet_copy_client.cc:323] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.65:42981
I20260709 12:24:05.225122  5978 tablet_copy_service.cc:140] P f1bb8e63c2b448cdafd51f05d277c741: Received BeginTabletCopySession request for tablet 7bf137aab07e4b9b8024d07355c33351 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:37174)
I20260709 12:24:05.225704  5978 tablet_copy_service.cc:161] P f1bb8e63c2b448cdafd51f05d277c741: Beginning new tablet copy session on tablet 7bf137aab07e4b9b8024d07355c33351 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:37174: session id = 24012af7747d4c4ea89c3da2ff950099-7bf137aab07e4b9b8024d07355c33351
I20260709 12:24:05.229833  7014 tablet_copy_client.cc:806] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:05.230571  7014 tablet_copy_client.cc:670] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:05.234740  7014 tablet_copy_client.cc:538] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:05.235666  5978 tablet_copy_source_session.cc:215] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:05.239346  7017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7bf137aab07e4b9b8024d07355c33351. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.247231  7014 tablet_bootstrap.cc:492] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:05.257354  7017 tablet_copy_client.cc:806] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:05.257933  7017 tablet_copy_client.cc:670] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:05.262055  7017 tablet_copy_client.cc:538] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:05.271006  7014 tablet_bootstrap.cc:492] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:05.271998  7014 tablet_bootstrap.cc:492] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:05.272699  7014 ts_tablet_manager.cc:1403] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.006s
I20260709 12:24:05.273972  7017 tablet_bootstrap.cc:492] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:05.276158  7014 raft_consensus.cc:359] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:05.276995  7014 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:05.277645  7014 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:05.290230  7014 ts_tablet_manager.cc:1434] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 12:24:05.292011  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-be9bf17a0be244b3bdd7bec88bf5a051 received from {username='slave'} at 127.0.0.1:60122
I20260709 12:24:05.292480  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-be9bf17a0be244b3bdd7bec88bf5a051 on tablet be9bf17a0be244b3bdd7bec88bf5a051 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:05.308794  7017 tablet_bootstrap.cc:492] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:05.309778  7017 tablet_bootstrap.cc:492] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:05.310497  7017 ts_tablet_manager.cc:1403] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.037s	user 0.010s	sys 0.016s
I20260709 12:24:05.313357  7017 raft_consensus.cc:359] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:05.314177  7017 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:05.314854  7017 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:05.317178  7017 ts_tablet_manager.cc:1434] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:24:05.321230  5978 tablet_copy_service.cc:342] P f1bb8e63c2b448cdafd51f05d277c741: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-7bf137aab07e4b9b8024d07355c33351 received from {username='slave'} at 127.0.0.1:37174
I20260709 12:24:05.321668  5978 tablet_copy_service.cc:434] P f1bb8e63c2b448cdafd51f05d277c741: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-7bf137aab07e4b9b8024d07355c33351 on tablet 7bf137aab07e4b9b8024d07355c33351 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:05.340204  7017 ts_tablet_manager.cc:933] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:05.343739  7017 tablet_copy_client.cc:323] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:24:05.345469  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet cf28639931bb43a58703f0afd043e166 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:24:05.346053  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet cf28639931bb43a58703f0afd043e166 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-cf28639931bb43a58703f0afd043e166
I20260709 12:24:05.356376  6054 tablet_copy_source_session.cc:215] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:05.359808  7017 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cf28639931bb43a58703f0afd043e166. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:05.373863  7017 tablet_copy_client.cc:806] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:05.374389  7017 tablet_copy_client.cc:670] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:05.377565  7017 tablet_copy_client.cc:538] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:05.386685  7017 tablet_bootstrap.cc:492] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:05.409121  7017 tablet_bootstrap.cc:492] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:05.410319  7017 tablet_bootstrap.cc:492] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:05.411098  7017 ts_tablet_manager.cc:1403] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.025s	user 0.025s	sys 0.000s
I20260709 12:24:05.413854  7017 raft_consensus.cc:359] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:05.414775  7017 raft_consensus.cc:740] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:05.416419  7017 consensus_queue.cc:260] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:05.418708  7017 ts_tablet_manager.cc:1434] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:24:05.423127  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-cf28639931bb43a58703f0afd043e166 received from {username='slave'} at 127.0.0.1:60122
I20260709 12:24:05.423535  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-cf28639931bb43a58703f0afd043e166 on tablet cf28639931bb43a58703f0afd043e166 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:05.574930  6650 raft_consensus.cc:1217] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:05.594264  6650 raft_consensus.cc:1217] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:05.659471  6650 raft_consensus.cc:1217] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:05.936468  6650 raft_consensus.cc:1217] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:06.117691  7016 raft_consensus.cc:1064] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:06.126164  7016 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:06.131706  6992 raft_consensus.cc:1064] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:06.133921  6992 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:06.145145  5962 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.147400  6112 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.148998  6650 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.149154  6968 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.150996  7027 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.153122  7016 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.164911  6651 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.166927  7027 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.169166  5964 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.170674  7027 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.177892  6113 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.182497  7027 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.184541  6927 raft_consensus.cc:1064] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:06.189850  6927 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:06.194857  6968 raft_consensus.cc:2955] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.198761  5964 raft_consensus.cc:2955] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.218328  7016 raft_consensus.cc:2955] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.229496  6109 raft_consensus.cc:2955] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.229904  5863 catalog_manager.cc:5697] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.261062  5862 catalog_manager.cc:5697] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.273722  6109 raft_consensus.cc:2955] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.280055  6651 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.287276  7023 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:24:06.294420  6651 raft_consensus.cc:2955] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.303825  6109 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.307485  7023 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:06.311503  6649 raft_consensus.cc:2955] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.352727  6044 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.355904  5964 raft_consensus.cc:2955] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.362202  7024 raft_consensus.cc:2955] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.378539  7023 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.379972  6651 raft_consensus.cc:2955] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.388739  6109 raft_consensus.cc:2955] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.411749  5862 catalog_manager.cc:5697] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:06.438879  7038 raft_consensus.cc:1064] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:06.438666  6044 raft_consensus.cc:2955] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.441409  7038 consensus_queue.cc:237] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:06.450143  6040 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:06.456331  6109 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.453845  6041 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:06.459100  6651 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.461226  7038 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.461459  6651 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:06.463151  7038 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.466536  7040 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:06.472015  5959 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:06.472131  5964 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:06.477902  7040 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.480372  5967 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:06.481938  7040 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:06.482975  6650 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:06.492489  6113 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:06.493949  7039 raft_consensus.cc:2955] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.498708  6649 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:06.502096  5967 raft_consensus.cc:2955] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.505307  7044 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:06.507032  7016 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.509049  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c357e710ee044329b93321405ae76071 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:06.512326  6115 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:06.513564  7016 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.513309  5862 catalog_manager.cc:5697] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:06.514834  6927 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.525993  6103 tablet_service.cc:1558] Processing DeleteTablet for tablet c357e710ee044329b93321405ae76071 with delete_type TABLET_DATA_TOMBSTONED (TS 0069e2ba1f02412e8e1d6c20a1fb510f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35576
I20260709 12:24:06.530717  7044 raft_consensus.cc:2955] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.534629  6650 raft_consensus.cc:2955] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.541064  6113 raft_consensus.cc:2955] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.556900  7038 raft_consensus.cc:2955] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.567166  6649 raft_consensus.cc:2955] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.570744  5862 catalog_manager.cc:5697] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.573951  6115 raft_consensus.cc:2955] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.575848  5850 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7bf137aab07e4b9b8024d07355c33351 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:06.574136  6648 raft_consensus.cc:2955] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.581380  7040 raft_consensus.cc:2955] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.587311  6113 raft_consensus.cc:2955] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.599047  6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 7bf137aab07e4b9b8024d07355c33351 with delete_type TABLET_DATA_TOMBSTONED (TS 0557a7246c8945b99e5215c99d4ddf9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36246
I20260709 12:24:06.602947  7056 tablet_replica.cc:333] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:24:06.610436  7056 raft_consensus.cc:2243] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.611143  7056 raft_consensus.cc:2272] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.623843  7057 tablet_replica.cc:333] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:24:06.624997  7057 raft_consensus.cc:2243] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.624130  5967 raft_consensus.cc:2955] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.625751  7057 raft_consensus.cc:2272] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.634853  5864 catalog_manager.cc:5697] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.636477  5864 catalog_manager.cc:5697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.640494  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet be9bf17a0be244b3bdd7bec88bf5a051 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:06.643692  7056 ts_tablet_manager.cc:1916] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:06.654310  6650 raft_consensus.cc:2955] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.659101  7056 ts_tablet_manager.cc:1929] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:06.659621  7056 log.cc:1199] T c357e710ee044329b93321405ae76071 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/wals/c357e710ee044329b93321405ae76071
I20260709 12:24:06.661253  5853 catalog_manager.cc:5028] TS 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): tablet c357e710ee044329b93321405ae76071 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:06.663560  5955 tablet_service.cc:1558] Processing DeleteTablet for tablet be9bf17a0be244b3bdd7bec88bf5a051 with delete_type TABLET_DATA_TOMBSTONED (TS f1bb8e63c2b448cdafd51f05d277c741 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34548
I20260709 12:24:06.666424  7057 ts_tablet_manager.cc:1916] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:06.667073  7058 tablet_replica.cc:333] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:24:06.668249  7058 raft_consensus.cc:2243] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.669234  7058 raft_consensus.cc:2272] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.673269  7058 ts_tablet_manager.cc:1916] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:06.682838  7057 ts_tablet_manager.cc:1929] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:06.683300  7057 log.cc:1199] T 7bf137aab07e4b9b8024d07355c33351 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/wals/7bf137aab07e4b9b8024d07355c33351
I20260709 12:24:06.684935  5851 catalog_manager.cc:5028] TS 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): tablet 7bf137aab07e4b9b8024d07355c33351 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:06.712267  6041 consensus_queue.cc:237] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:06.715312  7058 ts_tablet_manager.cc:1929] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:06.715736  7058 log.cc:1199] T be9bf17a0be244b3bdd7bec88bf5a051 P f1bb8e63c2b448cdafd51f05d277c741: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/wals/be9bf17a0be244b3bdd7bec88bf5a051
I20260709 12:24:06.717514  5850 catalog_manager.cc:5028] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): tablet be9bf17a0be244b3bdd7bec88bf5a051 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:06.719216  6648 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:06.719384  5967 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:06.720456  7038 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.721221  7040 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:06.730315  5967 raft_consensus.cc:2955] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.730315  6648 raft_consensus.cc:2955] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.730434  6968 raft_consensus.cc:2955] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.746836  5864 catalog_manager.cc:5697] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:06.756955  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet cf28639931bb43a58703f0afd043e166 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:06.762774  6103 tablet_service.cc:1558] Processing DeleteTablet for tablet cf28639931bb43a58703f0afd043e166 with delete_type TABLET_DATA_TOMBSTONED (TS 0069e2ba1f02412e8e1d6c20a1fb510f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35576
I20260709 12:24:06.763931  7056 tablet_replica.cc:333] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:24:06.764927  7056 raft_consensus.cc:2243] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:06.765698  7056 raft_consensus.cc:2272] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:06.769341  7056 ts_tablet_manager.cc:1916] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:06.781599  7056 ts_tablet_manager.cc:1929] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:06.782001  7056 log.cc:1199] T cf28639931bb43a58703f0afd043e166 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/wals/cf28639931bb43a58703f0afd043e166
I20260709 12:24:06.784348  5853 catalog_manager.cc:5028] TS 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): tablet cf28639931bb43a58703f0afd043e166 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:07.838259  6041 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:07.844216  6115 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:07.845736  6968 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:07.848213  6009 consensus_peers.cc:597] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 38df61ba407240499023581d9f885037. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:07.851480  5960 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:07.853199  6968 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:07.852911  7039 raft_consensus.cc:2955] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:07.857602  5960 raft_consensus.cc:2955] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:07.864142  6115 raft_consensus.cc:2955] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:07.865265  6041 consensus_queue.cc:237] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:07.869915  5864 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:07.871193  6113 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:07.872814  7039 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:07.873725  6009 consensus_peers.cc:597] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: efdaf6941ab7409d90619a5e9f5c10c3. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:07.874209  5967 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:07.881356  7061 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:07.913064  7070 raft_consensus.cc:2955] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:07.914677  6113 raft_consensus.cc:2955] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:07.937315  5967 raft_consensus.cc:2955] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:07.940670  5960 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:07.951308  6113 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:24:07.951670  5934 consensus_peers.cc:597] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bc02451d94184328a520860e40f6b77c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:07.951308  6041 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:07.954452  7024 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:07.955329  6927 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:07.957849  5862 catalog_manager.cc:5697] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:07.992594  7074 raft_consensus.cc:2955] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:07.994024  6044 raft_consensus.cc:2955] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:08.009037  6113 raft_consensus.cc:2955] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:08.009681  5865 catalog_manager.cc:5697] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:08.021119  6041 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:08.031476  5960 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:08.032727  7061 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:08.034371  6113 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:08.035778  7061 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:08.036621  6009 consensus_peers.cc:597] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6b70d6df693140769deef828413df1ba. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:08.041914  7070 raft_consensus.cc:2955] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:08.052127  5960 raft_consensus.cc:2955] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:08.064450  6113 raft_consensus.cc:2955] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:08.068179  5864 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:08.333799  7081 ts_tablet_manager.cc:933] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:08.335670  7081 tablet_copy_client.cc:323] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:24:08.337007  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet efdaf6941ab7409d90619a5e9f5c10c3 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:24:08.337426  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet efdaf6941ab7409d90619a5e9f5c10c3 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-efdaf6941ab7409d90619a5e9f5c10c3
I20260709 12:24:08.342645  6054 tablet_copy_source_session.cc:215] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:08.345546  7081 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet efdaf6941ab7409d90619a5e9f5c10c3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:08.360031  7081 tablet_copy_client.cc:806] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:08.360560  7081 tablet_copy_client.cc:670] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:08.370213  7081 tablet_copy_client.cc:538] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:08.375484  7083 ts_tablet_manager.cc:933] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:08.380064  7081 tablet_bootstrap.cc:492] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:08.422942  7083 tablet_copy_client.cc:323] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:24:08.425931  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet 38df61ba407240499023581d9f885037 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:24:08.426537  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet 38df61ba407240499023581d9f885037 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-38df61ba407240499023581d9f885037
I20260709 12:24:08.432350  7081 tablet_bootstrap.cc:492] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:08.433122  7081 tablet_bootstrap.cc:492] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:08.433679  7081 ts_tablet_manager.cc:1403] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.054s	user 0.020s	sys 0.003s
I20260709 12:24:08.437004  6054 tablet_copy_source_session.cc:215] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:08.436800  7081 raft_consensus.cc:359] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:08.437630  7081 raft_consensus.cc:740] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:08.438279  7081 consensus_queue.cc:260] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:08.442055  7086 ts_tablet_manager.cc:933] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:08.444972  7083 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38df61ba407240499023581d9f885037. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:08.454157  7087 ts_tablet_manager.cc:933] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:24:08.468065  7086 tablet_copy_client.cc:323] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:24:08.470187  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet 6b70d6df693140769deef828413df1ba from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:24:08.470757  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet 6b70d6df693140769deef828413df1ba from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-6b70d6df693140769deef828413df1ba
I20260709 12:24:08.475710  7081 ts_tablet_manager.cc:1434] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.042s	user 0.021s	sys 0.018s
I20260709 12:24:08.478899  7083 tablet_copy_client.cc:806] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:08.479486  7083 tablet_copy_client.cc:670] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:08.481175  6053 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-efdaf6941ab7409d90619a5e9f5c10c3 received from {username='slave'} at 127.0.0.1:60122
I20260709 12:24:08.481635  6053 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-efdaf6941ab7409d90619a5e9f5c10c3 on tablet efdaf6941ab7409d90619a5e9f5c10c3 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:08.489111  7083 tablet_copy_client.cc:538] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:08.490533  7087 tablet_copy_client.cc:323] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.65:42981
I20260709 12:24:08.492739  5978 tablet_copy_service.cc:140] P f1bb8e63c2b448cdafd51f05d277c741: Received BeginTabletCopySession request for tablet bc02451d94184328a520860e40f6b77c from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:37174)
I20260709 12:24:08.493345  5978 tablet_copy_service.cc:161] P f1bb8e63c2b448cdafd51f05d277c741: Beginning new tablet copy session on tablet bc02451d94184328a520860e40f6b77c from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:37174: session id = 24012af7747d4c4ea89c3da2ff950099-bc02451d94184328a520860e40f6b77c
I20260709 12:24:08.499416  5978 tablet_copy_source_session.cc:215] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:08.492729  6054 tablet_copy_source_session.cc:215] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:08.503533  7086 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6b70d6df693140769deef828413df1ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:08.505404  7083 tablet_bootstrap.cc:492] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:08.528258  7083 tablet_bootstrap.cc:492] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:08.529240  7083 tablet_bootstrap.cc:492] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:08.529954  7083 ts_tablet_manager.cc:1403] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.001s
I20260709 12:24:08.533150  7087 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bc02451d94184328a520860e40f6b77c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:08.533082  7083 raft_consensus.cc:359] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:08.534153  7083 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:08.534811  7083 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:08.537171  7083 ts_tablet_manager.cc:1434] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:24:08.538892  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-38df61ba407240499023581d9f885037 received from {username='slave'} at 127.0.0.1:60122
I20260709 12:24:08.539235  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-38df61ba407240499023581d9f885037 on tablet 38df61ba407240499023581d9f885037 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:08.551518  7086 tablet_copy_client.cc:806] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:08.552101  7086 tablet_copy_client.cc:670] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:08.561448  7086 tablet_copy_client.cc:538] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:08.569856  7087 tablet_copy_client.cc:806] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:08.570530  7087 tablet_copy_client.cc:670] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:08.572124  7086 tablet_bootstrap.cc:492] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:08.574136  7087 tablet_copy_client.cc:538] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:08.583638  7087 tablet_bootstrap.cc:492] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:08.604046  7086 tablet_bootstrap.cc:492] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:08.604983  7086 tablet_bootstrap.cc:492] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:08.605729  7086 ts_tablet_manager.cc:1403] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.034s	user 0.020s	sys 0.011s
I20260709 12:24:08.610258  7086 raft_consensus.cc:359] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:08.611114  7086 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:08.611812  7086 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:08.614144  7086 ts_tablet_manager.cc:1434] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:24:08.614591  7087 tablet_bootstrap.cc:492] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:08.615422  7087 tablet_bootstrap.cc:492] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:08.616060  7087 ts_tablet_manager.cc:1403] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.033s	user 0.024s	sys 0.005s
I20260709 12:24:08.616250  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-6b70d6df693140769deef828413df1ba received from {username='slave'} at 127.0.0.1:60122
I20260709 12:24:08.616669  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-6b70d6df693140769deef828413df1ba on tablet 6b70d6df693140769deef828413df1ba with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:08.618976  7087 raft_consensus.cc:359] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:08.619803  7087 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:08.620411  7087 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:08.623101  7087 ts_tablet_manager.cc:1434] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.003s
I20260709 12:24:08.624599  5978 tablet_copy_service.cc:342] P f1bb8e63c2b448cdafd51f05d277c741: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-bc02451d94184328a520860e40f6b77c received from {username='slave'} at 127.0.0.1:37174
I20260709 12:24:08.625000  5978 tablet_copy_service.cc:434] P f1bb8e63c2b448cdafd51f05d277c741: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-bc02451d94184328a520860e40f6b77c on tablet bc02451d94184328a520860e40f6b77c with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:08.817646  6648 raft_consensus.cc:1217] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:09.696012  7097 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:09.697347  7097 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:09.702644  6649 raft_consensus.cc:1217] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:09.704780  7097 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:09.706811  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:09.708503  6650 raft_consensus.cc:1217] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:09.712635  7096 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:09.713614  7096 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:09.717837  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:09.716286  7096 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:09.740150  7095 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:09.741156  7095 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:09.743918  7095 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:09.746502  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:09.753779  6651 raft_consensus.cc:1217] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:09.816936  7100 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:09.826865  7101 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:09.841511  7101 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:09.843658  7101 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:09.844249  7100 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:09.846020  7100 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:09.834487  7114 raft_consensus.cc:1064] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:09.873497  7110 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:09.874205  7110 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:09.873771  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:09.876689  7110 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:09.881866  7100 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:09.880843  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:09.883244  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:09.882623  7100 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:09.882521  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:09.887635  7100 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:09.888171  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:09.885658  7114 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:09.894842  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:09.900480  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:09.902813  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:09.927027  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:09.928596  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:09.931160  5932 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:09.932085  7116 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:09.932386  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:09.931674  5960 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:09.933267  7116 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:09.935910  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:09.936626  7096 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:09.932942  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:09.937721  7111 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:09.938233  7114 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:09.939836  6109 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:09.939999  6650 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:09.941885  5932 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:09.942577  7096 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:09.958349  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:09.963835  5932 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:09.964938  7096 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:09.967483  7111 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:09.969436  7114 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:09.970739  6081 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:09.972193  7097 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:09.980441  6651 raft_consensus.cc:2955] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:09.981396  7111 raft_consensus.cc:2955] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:09.984191  6109 raft_consensus.cc:2955] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:09.994279  5960 raft_consensus.cc:2955] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.005455  5863 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.037032  6041 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:10.042757  6651 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:10.043709  6109 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:10.044523  7110 raft_consensus.cc:1064] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:10.047309  7110 consensus_queue.cc:237] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:10.052680  7108 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:10.054495  7109 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:10.067478  7106 raft_consensus.cc:2955] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.075102  6115 raft_consensus.cc:2955] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.083590  6650 raft_consensus.cc:2955] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.089936  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 38df61ba407240499023581d9f885037 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:10.097074  5865 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.109761  6109 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:10.111055  6650 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:10.111843  7113 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:10.113173  7109 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:10.114185  5955 tablet_service.cc:1558] Processing DeleteTablet for tablet 38df61ba407240499023581d9f885037 with delete_type TABLET_DATA_TOMBSTONED (TS f1bb8e63c2b448cdafd51f05d277c741 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34548
I20260709 12:24:10.120002  5959 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:10.130607  7114 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:10.154415  7129 tablet_replica.cc:333] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:24:10.157752  7129 raft_consensus.cc:2243] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.160578  7113 raft_consensus.cc:2955] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.163830  5959 raft_consensus.cc:2955] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.162396  6650 raft_consensus.cc:2955] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.190541  7129 raft_consensus.cc:2272] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.195736  7129 ts_tablet_manager.cc:1916] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:10.195737  5862 catalog_manager.cc:5697] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.200805  6115 raft_consensus.cc:2955] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.209758  7105 raft_consensus.cc:1064] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:10.216288  7105 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:10.221341  6041 consensus_queue.cc:237] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:10.235370  6650 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:10.237219  5959 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:10.239542  7113 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:10.244827  7109 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:10.247921  6115 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:10.250682  6650 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:10.252154  5959 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:10.251929  7106 raft_consensus.cc:2955] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.257571  7109 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:10.259197  7114 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:10.265657  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet efdaf6941ab7409d90619a5e9f5c10c3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:10.272691  6650 raft_consensus.cc:2955] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.276872  7113 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:10.284118  5864 catalog_manager.cc:5697] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:10.290751  7129 ts_tablet_manager.cc:1929] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:10.291407  7129 log.cc:1199] T 38df61ba407240499023581d9f885037 P f1bb8e63c2b448cdafd51f05d277c741: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/wals/38df61ba407240499023581d9f885037
I20260709 12:24:10.294570  5850 catalog_manager.cc:5028] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): tablet 38df61ba407240499023581d9f885037 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:10.298112  5959 raft_consensus.cc:2955] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.303366  6103 tablet_service.cc:1558] Processing DeleteTablet for tablet efdaf6941ab7409d90619a5e9f5c10c3 with delete_type TABLET_DATA_TOMBSTONED (TS 0069e2ba1f02412e8e1d6c20a1fb510f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35576
I20260709 12:24:10.321754  7136 tablet_replica.cc:333] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:24:10.324106  7114 raft_consensus.cc:2955] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.325271  6115 raft_consensus.cc:2955] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.334972  7116 raft_consensus.cc:1064] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:10.338107  7116 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:10.345494  7136 raft_consensus.cc:2243] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.346359  7136 raft_consensus.cc:2272] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.349509  5865 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.351478  6651 raft_consensus.cc:2955] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.356266  7136 ts_tablet_manager.cc:1916] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:10.361938  6115 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:10.367257  7099 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:10.367961  6041 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:10.373193  5960 raft_consensus.cc:2955] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.375387  7100 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:10.376574  6650 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:10.379601  7100 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:10.394236  6041 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:10.399629  7136 ts_tablet_manager.cc:1929] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:10.400233  7136 log.cc:1199] T efdaf6941ab7409d90619a5e9f5c10c3 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/wals/efdaf6941ab7409d90619a5e9f5c10c3
I20260709 12:24:10.401762  6109 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:10.403230  5853 catalog_manager.cc:5028] TS 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): tablet efdaf6941ab7409d90619a5e9f5c10c3 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:10.403546  7113 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:10.408149  6649 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:10.409507  7114 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:10.414381  7099 raft_consensus.cc:2955] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.424948  7106 raft_consensus.cc:2955] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.429541  6109 raft_consensus.cc:2955] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.438210  6649 raft_consensus.cc:2955] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.416832  6039 raft_consensus.cc:2955] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.476429  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 6b70d6df693140769deef828413df1ba with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:10.480412  6650 raft_consensus.cc:2955] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.485355  5865 catalog_manager.cc:5697] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.485390  6115 raft_consensus.cc:2955] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.492691  5864 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.512814  5955 tablet_service.cc:1558] Processing DeleteTablet for tablet 6b70d6df693140769deef828413df1ba with delete_type TABLET_DATA_TOMBSTONED (TS f1bb8e63c2b448cdafd51f05d277c741 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34548
I20260709 12:24:10.513702  7129 tablet_replica.cc:333] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:24:10.523273  7129 raft_consensus.cc:2243] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.524083  7129 raft_consensus.cc:2272] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.527716  7129 ts_tablet_manager.cc:1916] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:10.529829  5960 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:10.536327  6650 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:10.537424  6115 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:10.538266  7116 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:10.539235  7096 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:10.546696  7096 raft_consensus.cc:2955] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.551635  6115 raft_consensus.cc:2955] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.557435  5850 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bc02451d94184328a520860e40f6b77c with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:10.558921  6650 raft_consensus.cc:2955] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:10.562407  7129 ts_tablet_manager.cc:1929] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:10.562971  7129 log.cc:1199] T 6b70d6df693140769deef828413df1ba P f1bb8e63c2b448cdafd51f05d277c741: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/wals/6b70d6df693140769deef828413df1ba
I20260709 12:24:10.564749  5850 catalog_manager.cc:5028] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): tablet 6b70d6df693140769deef828413df1ba (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:10.566938  5864 catalog_manager.cc:5697] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.580804  6025 tablet_service.cc:1558] Processing DeleteTablet for tablet bc02451d94184328a520860e40f6b77c with delete_type TABLET_DATA_TOMBSTONED (TS 0557a7246c8945b99e5215c99d4ddf9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36246
I20260709 12:24:10.582765  7142 tablet_replica.cc:333] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:24:10.583994  7142 raft_consensus.cc:2243] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:10.584869  7142 raft_consensus.cc:2272] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:10.589371  7142 ts_tablet_manager.cc:1916] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:10.599857  7142 ts_tablet_manager.cc:1929] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:10.600181  7142 log.cc:1199] T bc02451d94184328a520860e40f6b77c P 0557a7246c8945b99e5215c99d4ddf9c: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/wals/bc02451d94184328a520860e40f6b77c
I20260709 12:24:10.601887  5851 catalog_manager.cc:5028] TS 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): tablet bc02451d94184328a520860e40f6b77c (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:10.615897  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:10.673086  5960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:24:10.673607  5960 raft_consensus.cc:606] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:10.684885  6039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:10.685496  6039 raft_consensus.cc:606] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:10.688900  6039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:10.689375  6039 raft_consensus.cc:606] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:10.691936  6039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b70d6df693140769deef828413df1ba"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:10.692377  6039 raft_consensus.cc:606] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Received request to transfer leadership to TS 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:10.694346  6039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:10.694798  6039 raft_consensus.cc:606] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Received request to transfer leadership to TS 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:10.696969  6039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c357e710ee044329b93321405ae76071"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:10.697484  6039 raft_consensus.cc:606] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Received request to transfer leadership to TS 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:10.698561  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:24:10.699579  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:10.700249  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:10.729799  7096 raft_consensus.cc:993] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:10.730373  7095 raft_consensus.cc:1081] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:10.731980  6115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:24:10.732623  6115 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:10.732951  6115 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.739498  6115 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:10.742214  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:10.742801  5964 raft_consensus.cc:3055] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:10.743012  5964 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:10.743206  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:10.743763  6039 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.743600  5964 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:10.744649  5964 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.749300  6039 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:10.741698  6115 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:10.750509  6082 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:10.750989  5964 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:10.751315  7120 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:10.751832  7120 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:10.753499  7120 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:10.760594  7113 raft_consensus.cc:993] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:24:10.760978  7106 raft_consensus.cc:1081] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Signalling peer 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:24:10.762351  6650 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:50454
I20260709 12:24:10.762807  6650 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:10.763123  6650 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.765467  5863 catalog_manager.cc:5697] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 2, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.769256  6650 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:10.771656  6650 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:10.772074  6672 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb440 after lost signal to thread 4824
W20260709 12:24:10.773159  6672 debug-util.cc:398] Leaking SignalData structure 0x7b08002d94e0 after lost signal to thread 5900
I20260709 12:24:10.773062  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:10.773820  6039 raft_consensus.cc:3055] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:10.774189  6039 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:10.775019  6039 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:10.775849  6672 debug-util.cc:398] Leaking SignalData structure 0x7b0800303580 after lost signal to thread 6142
I20260709 12:24:10.776247  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:10.776788  5964 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:10.776840  6672 debug-util.cc:398] Leaking SignalData structure 0x7b08003248c0 after lost signal to thread 6675
I20260709 12:24:10.782886  5964 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:10.776209  6039 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.784235  6608 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:10.785292  7115 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:10.786854  7115 raft_consensus.cc:697] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:10.787822  7115 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:10.793491  6039 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:10.799373  5863 catalog_manager.cc:5697] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 2 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.863246  7106 raft_consensus.cc:993] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:24:10.863718  7113 raft_consensus.cc:1081] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Signalling peer 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:24:10.865041  6649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b70d6df693140769deef828413df1ba"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:50454
I20260709 12:24:10.865475  6649 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:10.865758  6649 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.871462  6649 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:10.874842  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:10.875205  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:10.875458  6039 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:10.875732  6109 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.875818  6039 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:10.876710  6039 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:10.877802  6039 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.880378  7113 raft_consensus.cc:993] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:10.880937  7106 raft_consensus.cc:1081] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:10.881484  6649 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:10.882534  6115 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35596
I20260709 12:24:10.883044  6115 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:10.883343  6115 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.885558  6109 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:10.886816  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:10.886976  6039 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:10.887744  7115 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:10.888252  7115 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:10.889122  7115 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:10.891148  6115 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:10.893376  6115 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:10.893759  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:10.894297  5964 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.898955  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:10.899641  6039 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:10.900326  6039 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:10.901213  6039 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:10.902773  6039 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:10.908420  5863 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 2 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:10.911770  5964 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:10.913232  6081 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:10.914018  7120 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:10.914207  6039 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:10.914525  7120 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:10.915436  7120 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:10.930423  5863 catalog_manager.cc:5697] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.002120  7108 raft_consensus.cc:993] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:11.002736  7108 raft_consensus.cc:1081] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:11.005676  6118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35596
I20260709 12:24:11.006192  6118 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:11.006608  6118 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.014533  6118 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:11.017514  6118 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:11.017412  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:11.018445  5959 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.018759  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:11.019371  6039 raft_consensus.cc:3055] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:11.019639  6039 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:11.023710  6039 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:11.024760  6039 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.025864  5959 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:11.027072  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:11.027971  7098 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:11.028497  7098 raft_consensus.cc:697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:11.029363  7098 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:11.031947  6039 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:11.036254  7108 raft_consensus.cc:993] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:24:11.036666  7108 raft_consensus.cc:1081] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Signalling peer 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:24:11.038318  6649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c357e710ee044329b93321405ae76071"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:50454
I20260709 12:24:11.038870  6649 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:11.039412  6649 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.041983  5863 catalog_manager.cc:5697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.047221  6649 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:11.059653  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:11.060271  5959 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.059688  6649 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:11.061283  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:11.061856  6039 raft_consensus.cc:3055] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:11.062134  6039 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:11.062855  6039 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:11.063993  6039 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:11.071260  5959 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:11.072320  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:11.074092  7115 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:11.074602  7115 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:11.075475  7115 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:11.084257  6039 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:11.096248  5863 catalog_manager.cc:5697] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 2 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:11.212698  5959 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:11.214854  7120 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:24:11.239373  6039 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:11.242538  7097 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:11.278518  6118 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:11.279989  7115 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:11.295960  6041 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:11.298751  7147 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:11.314352  5959 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:11.315843  7120 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:11.348611  6039 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:11.353201  7097 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:11.360795  5959 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:11.365017  7115 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:11.378520  6039 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:11.380120  7115 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:11.421712  6041 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:11.423096  7097 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:11.435446  5959 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:11.436926  7097 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:11.492448  6041 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:11.493916  7115 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:11.519572  5959 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:11.521041  7163 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:11.664532  6118 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:11.678769  6039 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:24:11.680316  6084 consensus_peers.cc:597] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bd91034e550f4704be7f47b7aff3ed25. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.680804  7097 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:11.681412  5959 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:11.682929  7097 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:11.691063  7120 raft_consensus.cc:2955] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:11.693145  6039 raft_consensus.cc:2955] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:11.695490  5964 raft_consensus.cc:2955] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:11.715866  5864 catalog_manager.cc:5697] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:11.728091  6118 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:11.739964  6039 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260709 12:24:11.740877  6084 consensus_peers.cc:597] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5744a277c5a3409b95831573168daf3f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:11.741448  7120 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:11.742029  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:11.749258  5964 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:11.750948  7097 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:11.755755  6039 raft_consensus.cc:2955] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:11.772542  7097 raft_consensus.cc:2955] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:11.812282  6039 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:11.814939  5964 raft_consensus.cc:2955] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:11.844233  5863 catalog_manager.cc:5697] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:12.620673  7181 ts_tablet_manager.cc:933] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:12.623494  7180 ts_tablet_manager.cc:933] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:12.661437  7180 tablet_copy_client.cc:323] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.67:39787
I20260709 12:24:12.662729  7181 tablet_copy_client.cc:323] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.67:39787
I20260709 12:24:12.663746  6128 tablet_copy_service.cc:140] P 0069e2ba1f02412e8e1d6c20a1fb510f: Received BeginTabletCopySession request for tablet bd91034e550f4704be7f47b7aff3ed25 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:42484)
I20260709 12:24:12.664356  6128 tablet_copy_service.cc:161] P 0069e2ba1f02412e8e1d6c20a1fb510f: Beginning new tablet copy session on tablet bd91034e550f4704be7f47b7aff3ed25 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:42484: session id = 24012af7747d4c4ea89c3da2ff950099-bd91034e550f4704be7f47b7aff3ed25
I20260709 12:24:12.671300  6127 tablet_copy_service.cc:140] P 0069e2ba1f02412e8e1d6c20a1fb510f: Received BeginTabletCopySession request for tablet 5744a277c5a3409b95831573168daf3f from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:42484)
I20260709 12:24:12.671957  6127 tablet_copy_service.cc:161] P 0069e2ba1f02412e8e1d6c20a1fb510f: Beginning new tablet copy session on tablet 5744a277c5a3409b95831573168daf3f from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:42484: session id = 24012af7747d4c4ea89c3da2ff950099-5744a277c5a3409b95831573168daf3f
I20260709 12:24:12.700337  6127 tablet_copy_source_session.cc:215] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:12.705720  7181 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5744a277c5a3409b95831573168daf3f. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:24:12.712713  6039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.887s	user 0.001s	sys 0.030s
W20260709 12:24:12.719401  6039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.893s	user 0.003s	sys 0.031s
I20260709 12:24:12.715724  6128 tablet_copy_source_session.cc:215] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:12.808440  7185 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:12.809460  7185 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:12.815326  7185 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:12.815687  7181 tablet_copy_client.cc:806] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:12.823782  7181 tablet_copy_client.cc:670] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:12.825989  7193 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:12.833982  7193 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.153822  7186 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.149222  7192 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:13.155915  7186 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.156368  7192 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.148691  7193 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.160827  7193 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:13.161473  7193 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.163143  7193 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:13.163509  7193 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:13.163825  7193 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.165270  7193 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.159667  7191 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:13.151755  7197 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.160858  7192 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.166043  7191 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.107697  7187 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:13.153776  7188 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.149866  7189 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:13.169699  7197 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.171550  7191 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:13.172106  7191 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.172550  7191 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.172971  7197 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.174572  7188 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.176995  7188 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.160147  7186 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.167331  7187 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.183061  7191 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:13.169898  7185 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.212913  7191 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.213650  7191 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.214474  7185 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.215970  7191 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:13.217018  7185 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.184069  7189 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.199260  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.230500  7189 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.196516  7186 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:13.246891  7186 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.249073  7186 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.258288  7184 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.259016  7184 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.261739  7184 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.213555  7187 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.268906  7192 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.269642  7192 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.272330  7192 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.272895  7192 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:13.273368  7192 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.274715  7193 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.274885  7197 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:13.275316  7193 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.275545  7197 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:13.277412  7193 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.277701  7197 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.274781  7187 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.325567  7187 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.327977  7187 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:13.400701  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.430371  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.431114  7189 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:13.440032  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.458125  7189 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:13.458839  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.460593  7189 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.437641  7191 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.461338  7191 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.461701  7192 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.463376  7191 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.399614  7185 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.464107  7185 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.464985  7196 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.430492  7186 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:13.468612  7187 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.469278  7198 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.469861  7186 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.469177  7187 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.470553  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.471903  7186 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.471982  7187 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.465632  7196 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.473883  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.474203  7188 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:13.478137  7188 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.479166  7147 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.470319  7185 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.475194  7199 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.475776  7192 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:13.480800  7188 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.481357  7199 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.469923  7198 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.484583  7192 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.495963  7199 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.479665  7147 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.570981  7184 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.572170  7202 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.586396  7202 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.597385  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.589658  7184 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.599817  7192 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:13.602147  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.605186  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:13.606806  7125 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.851s	user 0.015s	sys 0.034s
W20260709 12:24:13.607285  7125 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.016s	sys 0.036s
I20260709 12:24:13.597585  7147 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:13.614300  5967 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:13.601660  7202 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.599526  7196 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.647892  7207 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.650862  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.649720  7207 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.662592  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.665144  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.665736  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.667570  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.668831  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.664384  7198 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.671258  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.667806  7184 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.667726  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.688968  7204 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.688156  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.690524  7203 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.687879  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.691730  7203 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.694036  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.696602  7203 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.698890  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.699070  7207 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:13.690209  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.689574  7204 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.700892  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.701116  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.691038  7208 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.703094  7204 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.699586  7207 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.711750  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.718549  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.710451  7207 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.741037  7207 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:13.707552  7208 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:13.810933  6065 debug-util.cc:398] Leaking SignalData structure 0x7b0800167f80 after lost signal to thread 4824
W20260709 12:24:13.812096  6065 debug-util.cc:398] Leaking SignalData structure 0x7b08001656e0 after lost signal to thread 5900
W20260709 12:24:13.812494  6065 debug-util.cc:398] Leaking SignalData structure 0x7b08001657a0 after lost signal to thread 5914
I20260709 12:24:13.741779  7210 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.832696  7207 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.833293  7207 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.835594  7215 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.840704  7208 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:13.841290  7208 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.841740  7208 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.853116  7218 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.857589  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.866314  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.867324  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.859851  7193 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:24:13.844017  7208 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:13.836133  7215 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.870728  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.881842  7212 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.884408  5863 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 237) took 2048 ms. Trace:
I20260709 12:24:13.882223  7215 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:13.887712  7198 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.888252  7198 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.890215  7207 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:13.882494  7212 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.890599  7196 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.891106  7196 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.846129  7210 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.895701  7215 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.896639  7215 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.895311  7207 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.897279  7210 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:13.852064  7211 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.882920  7208 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.900161  7196 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.890306  7198 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:13.903702  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.903843  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.903728  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.906383  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.917858  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.918586  7205 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.876884  7218 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.924039  7218 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:13.919135  7205 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.925566  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.910637  7202 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.909060  7210 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.914281  7196 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.926789  7202 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.885483  5863 rpcz_store.cc:276] 0709 12:24:11.834261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.834397 (+   136us) service_pool.cc:224] Handling call
0709 12:24:13.882818 (+2048421us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:12.727178 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:12.727774 (+   596us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:12.727818 (+    44us) write_op.cc:435] Acquired schema lock
0709 12:24:12.727844 (+    26us) tablet.cc:662] Decoding operations
0709 12:24:12.728229 (+   385us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:12.728293 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:12.728323 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:12.728511 (+   188us) tablet.cc:701] Row locks acquired
0709 12:24:12.728529 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:24:12.728664 (+   135us) write_op.cc:270] Start()
0709 12:24:12.728779 (+   115us) write_op.cc:276] Timestamp: P: 1783599852728613 usec, L: 0
0709 12:24:12.728798 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:24:12.729506 (+   708us) log.cc:844] Serialized 595 byte log entry
0709 12:24:12.794354 (+ 64848us) op_driver.cc:464] REPLICATION: finished
0709 12:24:13.166654 (+372300us) write_op.cc:301] APPLY: starting
0709 12:24:13.166767 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:13.166875 (+   108us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:13.167013 (+   138us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:13.167257 (+   244us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:13.167414 (+   157us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:13.167463 (+    49us) write_op.cc:312] APPLY: finished
0709 12:24:13.234160 (+ 66697us) log.cc:844] Serialized 23 byte log entry
0709 12:24:13.234361 (+   201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:13.234443 (+    82us) write_op.cc:454] Released schema lock
0709 12:24:13.234498 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:13.234864 (+   366us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:13.234897 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":371950,"apply.run_cpu_time_us":2109,"apply.run_wall_time_us":68250,"num_ops":1,"prepare.queue_time_us":873481,"prepare.run_cpu_time_us":2612,"prepare.run_wall_time_us":2612,"replication_time_us":65423,"thread_start_us":38348,"threads_started":1}]]}
I20260709 12:24:13.937378  7212 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:13.902371  7207 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.927755  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.934520  7218 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.912000  7208 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.933640  7214 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.941284  7216 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.944659  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:13.944358  7216 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.930519  7213 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:13.933183  7210 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.948585  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.947211  7213 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.946547  7218 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.938084  7196 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:13.952481  7210 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:13.969455  6009 consensus_peers.cc:597] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c087bb99e3b64274863f583bf7ae435f. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:13.958828  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.995194  7219 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:13.997097  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:13.997748  6651 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:24:13.996433  7208 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:13.999492  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:13.947603  7205 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.996125  7219 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.002430  6009 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:13.916703  7211 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:13.970568  7202 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.964533  7196 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:13.954834  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:13.994796  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.015239  7197 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:14.001308  7147 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:13.953763  7213 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.036182  7217 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.013576  7218 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.086990  7202 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:14.089244  7202 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.091284  7120 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:14.092293  7180 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bd91034e550f4704be7f47b7aff3ed25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:14.092020  7120 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.092984  7208 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.091636  7218 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:14.093490  7208 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.093994  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.021260  7197 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:24:14.095077  6065 debug-util.cc:398] Leaking SignalData structure 0x7b08003434c0 after lost signal to thread 5992
I20260709 12:24:14.086956  7212 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.099737  7213 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:14.100198  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.101521  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.103272  6651 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:14.094174  7120 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:14.065191  7220 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.064580  7211 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.064958  7207 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.037573  7215 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:13.970669  7214 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.106345  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.118014  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:24:14.108125  6065 debug-util.cc:398] Leaking SignalData structure 0x7b080033e760 after lost signal to thread 5993
I20260709 12:24:14.080356  7219 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:14.100947  7202 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.029417  7147 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.126916  7194 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:14.057076  7222 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:14.108915  7197 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.111006  7205 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:24:14.122040  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 181726us
I20260709 12:24:14.110502  7218 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.136085  7222 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.113014  7212 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.120298  7213 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.134699  7194 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:14.178489  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 57785.1us
I20260709 12:24:14.145056  7207 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.179473  6084 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:14.182138  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.173283  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.146267  7211 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.146900  7202 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:14.147110  7120 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:14.036975  7217 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.149648  7205 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.202025  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:14.195362  7120 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.196203  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.197518  7147 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:14.198230  7202 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.175890  7221 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:14.188692  7215 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.202739  6115 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:14.203377  6039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:14.202622  7205 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:14.244349  6039 raft_consensus.cc:606] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Received request to transfer leadership to TS 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:14.129741  7220 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:14.211171  6065 debug-util.cc:398] Leaking SignalData structure 0x7b08002fcca0 after lost signal to thread 6068
I20260709 12:24:14.252707  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:14.258579  6115 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:14.185659  7207 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.255674  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:14.256373  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:14.260121  6113 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:14.259567  6117 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:14.268703  7222 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.263126  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.272974  7120 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.256273  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.274207  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.277546  7202 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:14.279258  5862 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 233) took 2454 ms. Trace:
W20260709 12:24:14.280027  6065 debug-util.cc:398] Leaking SignalData structure 0x7b08002b50e0 after lost signal to thread 6142
W20260709 12:24:14.280375  6065 debug-util.cc:398] Leaking SignalData structure 0x7b08001f1720 after lost signal to thread 6143
W20260709 12:24:14.281473  6065 debug-util.cc:398] Leaking SignalData structure 0x7b0800342f00 after lost signal to thread 6675
W20260709 12:24:14.281775  6065 debug-util.cc:398] Leaking SignalData structure 0x7b0800342fc0 after lost signal to thread 6676
I20260709 12:24:14.283206  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:14.283852  6117 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:14.279652  5862 rpcz_store.cc:276] 0709 12:24:11.824852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.835143 (+ 10291us) service_pool.cc:224] Handling call
0709 12:24:14.279174 (+2444031us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7737,"reported_tablets":2}
I20260709 12:24:14.269572  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:14.291706  6111 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:14.193512  7211 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.294806  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:14.295532  6113 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:14.300290  5865 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 242) took 2439 ms. Trace:
I20260709 12:24:14.300786  5865 rpcz_store.cc:276] 0709 12:24:11.862381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.701207 (+838826us) service_pool.cc:224] Handling call
0709 12:24:14.300212 (+1599005us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":186183,"reported_tablets":1}
I20260709 12:24:14.303299  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.306100  5864 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 130) took 2431 ms. Trace:
I20260709 12:24:14.306525  5864 rpcz_store.cc:276] 0709 12:24:11.875002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:13.688921 (+1813919us) service_pool.cc:224] Handling call
0709 12:24:14.305997 (+617076us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":398475,"reported_tablets":1}
I20260709 12:24:14.286026  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.256597  7215 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.289145  6039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:14.320708  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.250036  7208 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.256143  7221 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.315279  6039 raft_consensus.cc:606] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:14.320758  7147 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:14.328437  7201 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:14.329304  7207 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.329737  7203 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:14.326676  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:14.332998  7209 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:14.333274  7180 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50472 (request call id 202) took 1967 ms. Trace:
I20260709 12:24:14.331079  7204 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:14.341161  7204 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.341626  7194 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:14.342211  7194 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:14.342700  7194 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.343322  7204 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:14.295426  7211 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:14.335335  7184 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:24:14.349100  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 77698.4us
I20260709 12:24:14.342573  7180 rpcz_store.cc:276] 0709 12:24:12.365395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.365577 (+   182us) service_pool.cc:224] Handling call
0709 12:24:12.623975 (+258398us) ts_tablet_manager.cc:934] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
0709 12:24:14.091075 (+1467100us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:14.280895 (+189820us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:14.281022 (+   127us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:14.302162 (+ 21140us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:14.313945 (+ 11783us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:14.333094 (+ 19149us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:14.333175 (+    81us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":214,"tablet-copy.queue_time_us":257413,"thread_start_us":295600,"threads_started":2}
I20260709 12:24:14.344030  7204 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:14.357432  7220 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.357371  7204 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.358752  7180 tablet_copy_client.cc:806] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:14.359364  7180 tablet_copy_client.cc:670] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:14.343775  7201 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.335219  7147 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.353516  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:14.353852  7203 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.355598  7184 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.361517  6039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:14.366529  6039 raft_consensus.cc:606] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:24:14.320910  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 47399.9us
I20260709 12:24:14.345207  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.371344  7184 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:14.371783  7147 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:14.371922  7184 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:14.372567  7184 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:14.372974  7184 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.359546  7204 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:14.374934  7224 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.162s	user 0.000s	sys 0.001s
I20260709 12:24:14.376472  7203 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:14.376988  7213 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.377414  7212 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:14.378715  7184 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:14.379271  5959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1138b447c084c17ab4b465255e54118"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:24:14.380323  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.384536  6608 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:14.384938  7201 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:14.385372  7216 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.388887  5959 raft_consensus.cc:606] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:14.386648  7204 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:14.391582  7214 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:14.393038  7218 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.402344  7225 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:14.369617  7209 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:14.402976  7225 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:14.403414  7225 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.395313  7147 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:14.418210  7194 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:14.401041  7204 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.400926  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.427273  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.402513  7217 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.422536  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:14.421737  7221 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:24:14.436709  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.424255  7194 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:14.438156  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.441303  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.443696  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.433681  7215 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.424981  7225 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.434132  7204 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:14.442773  7221 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:14.447741  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 261640us
W20260709 12:24:14.462569  6082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.008s	sys 0.038s
W20260709 12:24:14.464073  6082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.008s	sys 0.038s
I20260709 12:24:14.439500  7209 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:14.465140  6117 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:14.451771  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:14.465150  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 285726us
I20260709 12:24:14.444314  7194 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.473225  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.475183  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.476985  7216 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:14.477568  7216 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.479668  7216 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:14.487959  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.487953  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.489274  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.489971  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.490296  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.479123  7193 raft_consensus.cc:2955] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:14.470072  7217 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.494985  5960 raft_consensus.cc:2955] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:14.499118  7217 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.496244  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.496796  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.497072  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.497407  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.497620  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.498070  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.498220  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.487810  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.496728  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.509032  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.502640  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.508970  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.515153  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.493578  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.516306  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.512387  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.517313  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.517793  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.494941  7184 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:14.512624  7225 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:14.518908  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.519482  7227 ts_tablet_manager.cc:933] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.515796  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.520398  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:14.504364  7203 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:14.527841  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.527146  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:14.529158  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.530355  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.531716  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.531751  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.531967  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.534242  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.535637  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.536054  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.536829  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.538072  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.538904  7192 raft_consensus.cc:993] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:24:14.539376  7192 raft_consensus.cc:1081] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Signalling peer 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:24:14.541442  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.525839  7203 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.544698  7203 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:14.524456  7217 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.547606  6647 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:50454
I20260709 12:24:14.548357  6647 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:14.548749  6647 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.549796  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.549854  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.549099  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.564527  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.571833  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.574043  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.575193  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:14.576653  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.527918  7184 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.589244  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.591183  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.609517  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:14.610915  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.611950  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.613544  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.614187  7197 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.614836  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.615309  6040 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:14.616984  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:14.626605  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:14.627817  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:14.628769  7197 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:14.629037  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:14.631464  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:14.639891  7213 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:14.609076  7194 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:14.610303  7184 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:14.633390  7218 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:14.651279  7194 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:14.651943  7194 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:14.655694  7215 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:14.670138  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 147968us
I20260709 12:24:14.683307  5934 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:14.654342  7194 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:14.684415  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:14.685300  7225 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:14.685787  7227 tablet_copy_client.cc:323] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:24:14.687791  5934 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:14.688997  5934 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:14.690104  5934 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:14.692152  7184 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:14.692103  5934 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:14.698398  5934 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:14.699666  5934 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:14.701820  7231 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:14.702224  7231 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.702601  7231 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.703181  7233 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:14.703578  7233 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.688356  7194 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:14.705533  5864 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:14.706621  7233 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.692047  7209 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:14.714969  7203 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:14.715375  7203 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.715744  7203 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.715900  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet c087bb99e3b64274863f583bf7ae435f from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:24:14.699635  7184 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.708964  7204 raft_consensus.cc:993] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:14.707561  7237 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:14.719652  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet c087bb99e3b64274863f583bf7ae435f from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-c087bb99e3b64274863f583bf7ae435f
I20260709 12:24:14.733083  7237 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.733526  7237 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.711324  7209 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.720149  7184 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.707026  7194 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:14.741429  7232 raft_consensus.cc:1081] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:14.753551  7233 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.736913  7209 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.740469  7194 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:14.760838  6647 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:14.765606  7233 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:14.761925  7203 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.799461  7193 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:60112 (request call id 12) took 2976 ms. Trace:
I20260709 12:24:14.961377  7184 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:14.966630  6647 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:14.950443  7193 rpcz_store.cc:276] 0709 12:24:11.809558 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:11.810065 (+   507us) service_pool.cc:224] Handling call
0709 12:24:11.825759 (+ 15694us) log.cc:844] Serialized 499 byte log entry
0709 12:24:14.786015 (+2960256us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":402,"raft.queue_time_us":6842,"raft.run_cpu_time_us":527,"raft.run_wall_time_us":654,"thread_start_us":934114,"threads_started":2,"wal-append.queue_time_us":41520,"wal-append.run_cpu_time_us":133902,"wal-append.run_wall_time_us":2282102}
I20260709 12:24:15.005664  7194 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.010591  7184 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:15.012073  7209 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.015273  7209 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:15.001621  7237 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.018610  7237 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:15.009152  7194 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:15.023837  7203 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:15.044188  7231 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.046676  7231 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:15.053083  6054 tablet_copy_source_session.cc:215] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:15.059403  7227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c087bb99e3b64274863f583bf7ae435f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:15.079272  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:15.079944  6044 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:15.080240  6044 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:15.080845  7227 tablet_copy_client.cc:806] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:15.081588  7227 tablet_copy_client.cc:670] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:15.081067  6044 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:15.082407  6044 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.091837  7227 tablet_copy_client.cc:538] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:15.092684  6044 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:15.094647  6609 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:15.095783  7202 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:15.102389  7227 tablet_bootstrap.cc:492] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:15.111178  7202 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:15.112578  7202 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:15.117393  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:15.118366  6009 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.560s (SENT) [suppressed 2 similar messages]
I20260709 12:24:15.154114  6117 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
W20260709 12:24:15.184839  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 475641us
I20260709 12:24:15.185696  5934 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:15.186542  7231 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:15.187955  5932 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.013s	sys 0.022s
W20260709 12:24:15.188357  5932 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.013s	sys 0.022s
W20260709 12:24:15.188637  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 572235us
I20260709 12:24:15.192713  7201 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:15.193583  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:15.195950  7240 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:15.196319  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:15.198585  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:15.200678  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:15.202064  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:15.195935  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:15.202826  5968 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:15.196460  7240 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:15.224824  7240 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:15.226037  7240 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.262306  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:15.263145  5960 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:15.263926  6082 thread.cc:641] server-negotiator [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.030s	sys 0.015s
W20260709 12:24:15.266724  6082 thread.cc:608] server-negotiator [worker] (thread pool) Time spent starting thread: real 0.721s	user 0.030s	sys 0.015s
I20260709 12:24:15.270231  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.270241  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.270491  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.271046  6113 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:15.271178  6109 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:15.271288  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:15.272087  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.272660  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.272635  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.273224  6109 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
W20260709 12:24:15.272042  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.273406  6112 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:15.272624  6113 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:15.276479  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:15.281455  5962 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:15.282426  5959 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:15.282703  5961 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:15.284335  5959 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:15.284847  5966 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:15.286315  5963 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:15.289816  7194 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:15.291009  7240 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:15.291393  7240 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:15.292375  7240 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:15.293790  7240 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.278362  5965 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:15.300033  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.302201  7200 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.303252  7200 consensus_queue.cc:1059] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:15.306298  7199 consensus_queue.cc:1059] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:15.307087  5960 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:15.308257  5934 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:15.309016  7203 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.309755  7251 consensus_queue.cc:1059] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:15.310181  5934 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:15.310902  7203 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:15.312943  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:15.304316  7200 raft_consensus.cc:3055] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:15.316648  7200 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:15.315840  7193 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:15.319633  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.319662  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.320894  6111 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:15.321328  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.318024  7200 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.324002  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.322726  7200 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.336477  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.336724  7254 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:15.338099  7252 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:15.347417  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:15.344363  7203 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.340822  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.348516  7203 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:15.353497  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.346681  7252 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:15.355813  7206 raft_consensus.cc:3055] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:15.355720  7252 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.356371  7206 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:15.357085  7252 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.363183  6082 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:15.363852  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 49024.4us
I20260709 12:24:15.364807  7200 raft_consensus.cc:3055] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:15.365238  7200 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:15.366201  7200 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.367467  7200 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.366818  7251 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:15.368917  7225 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.369102  7254 consensus_queue.cc:1059] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:15.365968  5865 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 2 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:15.372329  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:15.372978  6044 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:15.376596  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.378285  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.382725  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:15.381856  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.384436  7206 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.386781  7197 raft_consensus.cc:3055] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:15.387181  7197 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:15.387310  7206 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.387622  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:15.382571  7193 raft_consensus.cc:3055] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:15.389231  5959 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:15.394574  7193 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:24:15.395080  6084 consensus_peers.cc:597] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 12ca0d61cb524660bae3b43f9f1c5389. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:15.389737  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.390430  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:15.395489  7193 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.391212  7197 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.396669  7193 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.398154  6044 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:15.399034  7225 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:15.382735  7251 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:15.399983  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:15.401579  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.403053  7197 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.403954  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:15.406050  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.403838  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:24:15.408579  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45482.4us
I20260709 12:24:15.409706  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.410585  7225 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.411053  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.411878  7225 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.412325  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.412474  6035 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:15.414669  7225 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.414680  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.419277  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.420214  6043 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:15.421980  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.422040  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:15.424997  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:15.429028  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:15.399902  7251 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:15.440447  5932 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:15.447624  5932 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:15.447796  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.447846  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:15.448472  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:15.449126  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:15.449172  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.447662  6044 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:15.451169  7253 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.451642  7194 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:15.451705  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:15.451915  6082 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.445771  7204 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:15.452270  7194 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:15.454270  7204 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:15.454706  7204 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.455054  7194 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.456928  6082 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.457087  7253 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.457731  7253 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.458179  6082 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.458947  7218 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.459261  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.459918  7218 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.460314  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:15.460978  7218 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.461086  7240 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:15.451079  7225 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.461359  6082 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.451670  7203 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:15.462158  7225 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.462430  7203 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:15.463809  7240 raft_consensus.cc:697] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:15.464423  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.464650  7240 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.465708  7251 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.466889  7251 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.467952  6082 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.468670  7218 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.470135  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:15.471407  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:15.472255  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:15.472802  6117 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.472738  6111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1138b447c084c17ab4b465255e54118"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:24:15.473593  6111 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:15.474102  6111 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.475178  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:15.475939  6113 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.473596  7218 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.476557  7253 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.463369  7203 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.471410  7225 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.477602  6040 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:15.451041  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:15.475970  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.481112  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:15.481290  6082 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.482695  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:15.483343  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.447341  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:15.483749  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:15.489753  5932 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:15.489907  6113 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:15.472754  7227 tablet_bootstrap.cc:492] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:15.490132  6115 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.484406  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:15.491624  6118 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.484763  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:15.485251  7218 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.486511  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:15.486712  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:15.498986  6112 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.487267  6608 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.483939  7225 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.488207  7201 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:15.494139  6117 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:15.498176  6115 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:15.499665  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.484963  7253 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.510811  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.499941  6118 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:15.501166  6114 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.521023  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:15.492631  7231 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:15.523954  6109 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.501957  7215 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.532436  6082 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.533638  7264 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.533780  6082 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.534664  7264 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.535113  6082 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.535884  7264 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.536270  6082 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.537446  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:15.538641  7264 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.539404  7264 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.519573  7202 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.510712  7217 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.544018  6082 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:15.526165  7246 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:15.540603  7253 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:15.541497  7231 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:15.548409  7227 tablet_bootstrap.cc:492] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:15.548887  7246 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:15.583673  7246 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:15.550433  5934 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:24:15.593233  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:15.597873  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 53939.6us
I20260709 12:24:15.547501  7204 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:15.604321  6109 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
W20260709 12:24:15.605279  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 54937us
I20260709 12:24:15.608824  5934 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:15.618160  6112 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:15.606942  7253 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:15.610039  7201 raft_consensus.cc:697] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:15.628594  7227 ts_tablet_manager.cc:1403] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.526s	user 0.053s	sys 0.069s
I20260709 12:24:15.617736  7203 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:15.736749  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:15.754106  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.635970  7240 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:15.758818  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:15.801594  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:15.801986  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:15.802261  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:15.804452  5960 raft_consensus.cc:2955] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:15.806524  6109 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:15.811882  6116 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:15.821578  6114 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:15.821092  7264 raft_consensus.cc:2955] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:15.710822  7231 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:15.875499  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 266742us
I20260709 12:24:15.876350  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:15.877521  5934 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:15.881615  6109 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:15.885422  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:15.846402  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 321478us
I20260709 12:24:15.904130  7203 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.895005  7270 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.905267  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:15.905951  6043 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:15.911147  7266 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:24:15.912591  7259 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.206s	user 0.001s	sys 0.000s
I20260709 12:24:15.927686  7227 raft_consensus.cc:359] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:15.928664  7227 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:15.929409  7227 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:15.887619  7184 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:15.937494  6111 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.938298  7204 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:15.940435  7246 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:15.942741  7206 consensus_meta.cc:287] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.555s	user 0.011s	sys 0.000s
I20260709 12:24:15.853885  7201 consensus_queue.cc:237] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:15.974954  6110 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:15.977423  6035 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:15.995483  6111 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:15.974069  6043 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
W20260709 12:24:15.996833  7261 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.237s	user 0.003s	sys 0.000s
W20260709 12:24:16.012971  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:16.017055  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 118336us
W20260709 12:24:16.022903  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 137549us
I20260709 12:24:16.025259  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:16.024016  7275 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:16.027493  7275 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:16.026497  7246 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:24:16.027995  6035 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:16.029690  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.030334  6116 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:24:16.018160  6111 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:16.034189  6043 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:15.994176  6038 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:16.041918  7194 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:16.032487  7275 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:16.021651  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 266109us
I20260709 12:24:16.042779  5934 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:16.044209  7194 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:16.045531  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:16.046298  7194 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:16.042083  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.047339  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.047847  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:16.048521  7194 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:16.049800  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:16.050604  7194 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:16.051005  6035 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:16.053246  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:24:16.054044  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 177353us
I20260709 12:24:16.055316  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.056118  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.056470  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.057240  6114 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:24:16.057430  7194 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:16.059015  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.059754  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.059868  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.060397  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.059263  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.060914  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.061269  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.041186  5932 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:16.060945  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.056584  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:16.062816  6038 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:16.063504  7194 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:16.065632  6035 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:16.065971  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:16.071054  7227 ts_tablet_manager.cc:1434] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.365s	user 0.011s	sys 0.002s
I20260709 12:24:16.072156  7274 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:16.064306  7194 raft_consensus.cc:697] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:16.079504  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.074131  7262 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:16.101922  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.079124  7265 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.030s
W20260709 12:24:16.099503  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 149333us
I20260709 12:24:16.123781  6647 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:16.136438  7274 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:16.137105  7274 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:16.139715  7274 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:16.140427  7274 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:16.140993  7274 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:16.146170  7272 consensus_queue.cc:1059] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:16.147598  7272 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:16.148041  7272 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:16.149024  7272 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:16.152673  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 49409.7us
W20260709 12:24:16.157253  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.110884  7262 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:16.161051  7262 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:16.171074  7274 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:16.171758  7201 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:16.173636  5864 catalog_manager.cc:5697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:16.178964  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.187151  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.150329  7272 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.192477  5934 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:16.196306  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-c087bb99e3b64274863f583bf7ae435f received from {username='slave'} at 127.0.0.1:60122
I20260709 12:24:16.196861  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-c087bb99e3b64274863f583bf7ae435f on tablet c087bb99e3b64274863f583bf7ae435f with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:16.197837  7283 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:16.205019  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:16.210234  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.151198  7194 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:16.198244  7260 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:24:16.211539  6139 debug-util.cc:398] Leaking SignalData structure 0x7b08001c9340 after lost signal to thread 4821
I20260709 12:24:16.217747  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:16.219007  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:24:16.218039  6139 debug-util.cc:398] Leaking SignalData structure 0x7b08000dbd00 after lost signal to thread 4824
W20260709 12:24:16.228098  6139 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8de0 after lost signal to thread 5900
W20260709 12:24:16.228490  6139 debug-util.cc:398] Leaking SignalData structure 0x7b08000dc980 after lost signal to thread 5914
I20260709 12:24:16.228785  6114 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:16.229640  6139 debug-util.cc:398] Leaking SignalData structure 0x7b080036a0c0 after lost signal to thread 5992
I20260709 12:24:16.231518  7260 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:16.242733  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:16.213974  7283 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:24:16.246528  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:16.248059  5960 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:16.247233  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:16.240842  6139 debug-util.cc:398] Leaking SignalData structure 0x7b080036a900 after lost signal to thread 6068
I20260709 12:24:16.249768  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:16.240422  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.253479  6647 raft_consensus.cc:1217] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:16.251030  5966 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:16.263772  6113 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:16.264299  6118 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:16.267009  6111 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:16.276679  5962 raft_consensus.cc:3055] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
W20260709 12:24:16.280557  6139 debug-util.cc:398] Leaking SignalData structure 0x7b0800368a60 after lost signal to thread 6142
I20260709 12:24:16.280879  6111 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:16.281718  6139 debug-util.cc:398] Leaking SignalData structure 0x7b0800368180 after lost signal to thread 6675
I20260709 12:24:16.277174  5962 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:16.282660  5961 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:16.282967  5962 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:16.284134  5962 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:16.284689  6139 debug-util.cc:398] Leaking SignalData structure 0x7b08003680e0 after lost signal to thread 7182
W20260709 12:24:16.293535  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.232496  7260 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:16.299471  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.296159  5960 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
W20260709 12:24:16.296873  6139 debug-util.cc:398] Leaking SignalData structure 0x7b08003680c0 after lost signal to thread 7183
I20260709 12:24:16.304731  7227 ts_tablet_manager.cc:933] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:16.300602  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.312947  6118 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:16.313910  7240 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:16.314257  6114 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:16.329689  5962 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:16.335275  6081 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:16.298413  7277 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:24:16.338080  7267 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:16.338694  7267 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:16.339630  7267 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:16.333237  7231 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:24:16.322199  7283 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.027s
I20260709 12:24:16.373682  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.333484  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:24:16.395042  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.397774  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.385846  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.408577  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.413842  6044 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:16.398699  7202 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:16.425196  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.428735  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.424530  7283 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
I20260709 12:24:16.430894  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.425534  7202 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:16.431664  7202 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:16.406100  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 83749.4us
I20260709 12:24:16.439422  5865 catalog_manager.cc:5697] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:24:16.447600  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:16.442533  7285 log.cc:927] Time spent T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:24:16.442369  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.457044  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:16.438926  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.459553  7280 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:24:16.459549  7274 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:16.460737  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:16.442981  7290 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:24:16.463800  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.460837  7274 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:16.465306  7274 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:16.471876  6040 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:16.472021  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.480334  6115 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:16.443471  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.489290  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.502007  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.515655  7271 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:24:16.527196  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.521756  7202 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:16.538393  7270 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.017s
I20260709 12:24:16.578424  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:16.579618  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.580849  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.548810  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:16.582347  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.595376  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:16.595532  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.603967  6040 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:16.589550  7227 tablet_copy_client.cc:323] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.67:39787
I20260709 12:24:16.607635  5965 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:16.760370  7181 tablet_copy_client.cc:538] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
W20260709 12:24:16.783680  7295 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
W20260709 12:24:16.786878  7288 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:24:16.845708  7290 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:24:16.787443  7276 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.074s
W20260709 12:24:16.863258  7243 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.149s	user 0.000s	sys 0.009s
I20260709 12:24:16.871694  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:16.865897  7181 tablet_bootstrap.cc:492] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:16.882409  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.883785  6113 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:24:16.882472  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:16.888438  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:16.888974  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.891754  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.892095  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.893297  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.893983  5960 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:16.894299  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.896441  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.896648  6082 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:16.897122  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.898281  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.898351  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.898932  6116 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:16.899498  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.899830  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:16.900418  6109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1e2d6430774a629131a0953161507b"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:16.901361  6109 raft_consensus.cc:606] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Received request to transfer leadership to TS 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:16.902750  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:16.891779  7180 tablet_copy_client.cc:538] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:16.914712  6128 tablet_copy_service.cc:140] P 0069e2ba1f02412e8e1d6c20a1fb510f: Received BeginTabletCopySession request for tablet 12ca0d61cb524660bae3b43f9f1c5389 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:42484)
W20260709 12:24:16.996685  7292 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.243s	user 0.000s	sys 0.001s
I20260709 12:24:16.898382  7202 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:16.901640  7267 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:17.016885  7297 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:24:17.017697  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:17.039218  7275 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:24:17.000918  7294 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
I20260709 12:24:16.923200  6128 tablet_copy_service.cc:161] P 0069e2ba1f02412e8e1d6c20a1fb510f: Beginning new tablet copy session on tablet 12ca0d61cb524660bae3b43f9f1c5389 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:42484: session id = 24012af7747d4c4ea89c3da2ff950099-12ca0d61cb524660bae3b43f9f1c5389
I20260709 12:24:17.042215  7278 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:17.042817  7278 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:17.044066  6113 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:17.044790  7278 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:16.919646  7281 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.136s
I20260709 12:24:17.045451  6112 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:17.049630  6110 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:17.067107  7180 tablet_bootstrap.cc:492] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:17.080121  6110 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:17.080138  6128 tablet_copy_source_session.cc:215] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:17.053838  7275 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:17.078397  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:17.135694  7274 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:17.138484  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 74907us
I20260709 12:24:17.163987  6611 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:17.165375  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:17.166610  7280 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.166376  7202 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.171257  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:17.173528  6044 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:17.174414  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:17.171854  6038 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.190045  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:17.190797  6038 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:17.195986  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:17.197521  6611 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:17.198623  7280 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.199586  7280 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:17.200510  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:17.200919  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.223608  6611 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:17.225790  6611 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:17.227515  7280 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.228138  7280 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.223738  7199 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.179447  7275 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.223551  7272 consensus_queue.cc:1059] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 1.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:24:17.247665  7257 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.248317  7257 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.250582  7281 raft_consensus.cc:3055] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:17.251037  7281 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:17.251941  7281 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:17.260722  7281 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:17.236083  7199 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:17.241168  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:17.277640  6611 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:24:17.284145  6009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.014s	sys 0.012s
I20260709 12:24:17.262940  7272 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:17.271183  7257 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:17.285977  6009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.014s	sys 0.012s
W20260709 12:24:17.295220  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 539949us
I20260709 12:24:17.285769  7202 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.286635  7280 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.293794  7272 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.330873  7194 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.356678  7194 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.359030  7194 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:17.371068  7199 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:17.386615  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 309126us
I20260709 12:24:17.395826  7217 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:17.396559  7217 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.404050  7270 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:17.328351  6611 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:17.429965  7217 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:17.398782  7295 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:24:17.432989  6039 raft_consensus.cc:2955] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:17.438450  6009 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:17.432745  7310 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.426731  7201 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:24:17.441741  7194 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
W20260709 12:24:17.442230  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 116926us
I20260709 12:24:17.442307  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:17.462390  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:17.442750  7253 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:17.463225  7253 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:17.464246  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:17.464556  7280 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.465190  7253 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:17.465641  6611 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:17.466411  7280 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.466563  7227 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 12ca0d61cb524660bae3b43f9f1c5389. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:17.468899  6118 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:17.472481  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:17.448144  7311 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:17.474221  7243 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.170s	user 0.000s	sys 0.002s
I20260709 12:24:17.479513  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:17.484786  5864 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 236) took 1314 ms. Trace:
I20260709 12:24:17.441964  7310 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:17.485353  7180 tablet_bootstrap.cc:492] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:17.487269  7180 tablet_bootstrap.cc:492] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:17.485910  7272 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:17.457242  7274 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.487908  7310 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:17.491460  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:17.494120  6038 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:17.441455  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:17.497637  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 56256.9us
I20260709 12:24:17.498412  6009 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:17.494520  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 69329.2us
I20260709 12:24:17.499552  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:17.499810  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 59610.2us
I20260709 12:24:17.510633  7274 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:17.511258  7274 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.514667  7274 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:17.519819  7304 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.525060  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:17.526093  6118 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:17.487957  7180 ts_tablet_manager.cc:1403] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.421s	user 0.023s	sys 0.009s
I20260709 12:24:17.528687  6009 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:17.530936  5959 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:17.450632  7193 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.535472  6009 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:17.536548  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:17.537066  7274 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:17.533620  7267 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.004s
I20260709 12:24:17.501636  7276 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.516275  7310 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:17.485322  5864 rpcz_store.cc:276] 0709 12:24:16.170805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.170921 (+   116us) service_pool.cc:224] Handling call
0709 12:24:17.478448 (+1307527us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:16.326854 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:16.327411 (+   557us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:16.327447 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:24:16.327462 (+    15us) tablet.cc:662] Decoding operations
0709 12:24:16.327790 (+   328us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:16.327843 (+    53us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:16.327872 (+    29us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:16.328051 (+   179us) tablet.cc:701] Row locks acquired
0709 12:24:16.328069 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:24:16.328215 (+   146us) write_op.cc:270] Start()
0709 12:24:16.328324 (+   109us) write_op.cc:276] Timestamp: P: 1783599856328157 usec, L: 0
0709 12:24:16.328345 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:24:16.331490 (+  3145us) log.cc:844] Serialized 595 byte log entry
0709 12:24:16.796714 (+465224us) op_driver.cc:464] REPLICATION: finished
0709 12:24:17.280835 (+484121us) write_op.cc:301] APPLY: starting
0709 12:24:17.280921 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:17.281027 (+   106us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:17.281162 (+   135us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:17.281381 (+   219us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:17.281529 (+   148us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:17.281571 (+    42us) write_op.cc:312] APPLY: finished
0709 12:24:17.281751 (+   180us) log.cc:844] Serialized 23 byte log entry
0709 12:24:17.281910 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:17.281985 (+    75us) write_op.cc:454] Released schema lock
0709 12:24:17.282028 (+    43us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:17.282340 (+   312us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:17.282366 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":429546,"apply.run_cpu_time_us":1500,"apply.run_wall_time_us":1500,"num_ops":1,"prepare.queue_time_us":149913,"prepare.run_cpu_time_us":2739,"prepare.run_wall_time_us":8581,"replication_time_us":425453,"thread_start_us":397242,"threads_started":2}]]}
I20260709 12:24:17.515810  7264 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:17.529783  7304 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.533692  7257 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.537886  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:17.540153  7199 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.593168  7181 tablet_bootstrap.cc:492] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
W20260709 12:24:17.597930  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 62523.4us
I20260709 12:24:17.580972  7193 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.606913  7269 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.607479  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:17.609146  6009 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:17.610718  6009 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:17.560688  7310 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.620174  6084 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:17.585976  7262 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:24:17.560331  7264 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:17.620152  6009 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:17.611483  7206 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.590165  6611 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:17.609927  7304 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.650197  7257 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:24:17.666909  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 101897us
I20260709 12:24:17.650327  7199 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.665428  7327 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:17.611614  7311 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.066s
I20260709 12:24:17.669764  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 872) took 1441 ms. Trace:
I20260709 12:24:17.684211  5965 rpcz_store.cc:276] 0709 12:24:16.208816 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.211495 (+  2679us) service_pool.cc:224] Handling call
0709 12:24:16.229556 (+ 18061us) spinlock_profiling.cc:243] Waited 4.51 ms on lock 0x7b5800010598. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2feee 000000000036eb39 00007f4825fa31e0 00007f482606c0c4 00007f482606c131 00007f482602dfc0 00007f4826018929 00007f48260183d2 00007f481f58fbd4
0709 12:24:16.229712 (+   156us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:16.750376 (+520664us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.619229 (+868853us) spinlock_profiling.cc:243] Waited 365 ms on lock 0x7b54001df954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:24:17.650062 (+ 30833us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":850202880}
I20260709 12:24:17.683691  7310 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:17.685318  5865 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 242) took 1353 ms. Trace:
I20260709 12:24:17.685320  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:17.687305  7264 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:17.612242  7269 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:17.691043  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:17.691704  6651 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:17.699154  7269 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:17.700984  7257 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.703676  7257 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:17.704157  7257 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:17.704741  7257 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.706832  7200 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:17.707091  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:17.707415  7200 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:17.709384  7200 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:17.745221  5862 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 1 to 2, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 2 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:17.752308  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:17.753369  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:17.755635  7217 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:17.755826  7269 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:17.756266  7217 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:17.757148  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:17.710582  7181 tablet_bootstrap.cc:492] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:17.685871  5865 rpcz_store.cc:276] 0709 12:24:16.332362 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.332524 (+   162us) service_pool.cc:224] Handling call
0709 12:24:17.685254 (+1352730us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:16.443238 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:16.443718 (+   480us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:16.443747 (+    29us) write_op.cc:435] Acquired schema lock
0709 12:24:16.443759 (+    12us) tablet.cc:662] Decoding operations
0709 12:24:16.444074 (+   315us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:16.444122 (+    48us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:16.444149 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:16.444321 (+   172us) tablet.cc:701] Row locks acquired
0709 12:24:16.444335 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:24:16.444466 (+   131us) write_op.cc:270] Start()
0709 12:24:16.444565 (+    99us) write_op.cc:276] Timestamp: P: 1783599856444413 usec, L: 0
0709 12:24:16.444593 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:24:16.445203 (+   610us) log.cc:844] Serialized 538 byte log entry
0709 12:24:17.158271 (+713068us) op_driver.cc:464] REPLICATION: finished
0709 12:24:17.282689 (+124418us) write_op.cc:301] APPLY: starting
0709 12:24:17.282762 (+    73us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:17.282850 (+    88us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:17.282940 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:17.283190 (+   250us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:17.283328 (+   138us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:17.283369 (+    41us) write_op.cc:312] APPLY: finished
0709 12:24:17.283531 (+   162us) log.cc:844] Serialized 23 byte log entry
0709 12:24:17.283664 (+   133us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:17.283735 (+    71us) write_op.cc:454] Released schema lock
0709 12:24:17.283766 (+    31us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":195167,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":123384,"apply.run_cpu_time_us":1319,"apply.run_wall_time_us":1319,"num_ops":1,"prepare.queue_time_us":1334,"prepare.run_cpu_time_us":2219,"prepare.run_wall_time_us":2219,"replication_time_us":711136,"spinlock_wait_cycles":91392,"thread_start_us":169633,"threads_started":1}]]}
I20260709 12:24:17.790932  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:17.711804  7274 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.722326  7199 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.794644  6040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:17.758400  7264 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:17.755573  7310 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:24:17.732551  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 52941.1us
I20260709 12:24:17.805235  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:17.789461  7330 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:17.770527  7237 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:17.796036  6040 raft_consensus.cc:606] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Received request to transfer leadership to TS 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:17.808903  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:17.791087  7265 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:17.788383  7267 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:17.810796  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:17.813887  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:17.814491  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:17.794719  7231 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:17.816388  7330 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.816531  7231 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:17.796736  7262 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:17.818665  7330 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:17.711047  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 134753us
I20260709 12:24:17.797241  7257 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:17.756361  7269 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.811415  7181 ts_tablet_manager.cc:1403] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 1.013s	user 0.030s	sys 0.041s
I20260709 12:24:17.755273  7180 raft_consensus.cc:359] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:17.828034  7320 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:17.834143  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:17.830067  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:24:17.837591  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:17.824791  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:17.838886  5959 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:17.838356  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:17.815331  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:17.847723  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:17.814081  7217 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:17.849982  7257 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:17.804057  7264 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.818570  7231 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:17.819579  7204 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:17.808632  7310 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:17.832074  7180 raft_consensus.cc:740] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:17.828403  7265 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:17.852954  6042 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:17.858434  7253 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:17.858834  7272 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:17.859829  7181 raft_consensus.cc:359] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:17.875985  7265 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:17.855319  7204 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:17.819943  7237 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.873378  7253 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:17.874234  7272 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:17.876299  7181 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:17.884140  7181 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:17.878090  7237 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:17.879798  7253 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:17.876621  7204 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:17.886397  7269 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:17.830080  7262 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:17.853189  7257 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:17.926213  7257 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:17.936708  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:17.862201  7320 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:17.937542  6043 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:17.988318  7274 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:17.988929  7274 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.991997  7332 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:17.992596  7332 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:17.947643  6643 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Advancing to term 2
I20260709 12:24:17.950960  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:17.954115  7320 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:17.972385  7271 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:17.976218  7181 ts_tablet_manager.cc:1434] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.144s	user 0.008s	sys 0.000s
I20260709 12:24:17.981804  7310 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:17.999993  7264 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:18.018422  7257 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:18.022446  7257 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:18.022588  7271 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:18.025907  7257 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:17.911371  7180 consensus_queue.cc:260] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:18.048267  7180 ts_tablet_manager.cc:1434] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.514s	user 0.010s	sys 0.001s
W20260709 12:24:18.048655  7180 ts_tablet_manager.cc:1467] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Tablet startup took 518ms
I20260709 12:24:18.004593  7227 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50472 (request call id 237) took 1860 ms. Trace:
I20260709 12:24:18.007023  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:18.009379  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:18.135012  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 125732us
I20260709 12:24:18.011463  6081 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:18.139709  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 128305us
I20260709 12:24:18.140727  6081 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:18.062523  7184 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:18.072871  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:18.171052  6110 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:18.173553  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:18.074792  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:18.085763  5960 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:18.093519  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:18.176608  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:18.104244  7272 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:18.108312  7262 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:18.109113  7274 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:18.134650  7227 rpcz_store.cc:276] 0709 12:24:16.144154 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:16.145532 (+  1378us) service_pool.cc:224] Handling call
0709 12:24:16.309381 (+163849us) ts_tablet_manager.cc:934] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
0709 12:24:17.465401 (+1156020us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:17.553957 (+ 88556us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:17.560626 (+  6669us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:18.003823 (+443197us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:18.004106 (+   283us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:18.004451 (+   345us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:18.004526 (+    75us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":36848,"tablet-copy.queue_time_us":158680,"thread_start_us":399914,"threads_started":2}
I20260709 12:24:18.185027  7227 tablet_copy_client.cc:806] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:18.185993  7227 tablet_copy_client.cc:670] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
W20260709 12:24:18.186698  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 44406.5us
I20260709 12:24:18.112768  7204 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:18.026154  7271 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:18.163663  7314 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:18.198102  7314 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:18.198621  7314 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:18.164527  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:18.199863  5968 raft_consensus.cc:2410] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 2 because replica has last-logged OpId of term: 1 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:18.166731  7310 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.169616  7279 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.179282  7306 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:18.180608  7184 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:18.205818  7184 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:18.206564  7184 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:18.202071  7306 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:18.207548  7184 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:18.213263  5962 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 3: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:18.150660  7332 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:18.209426  7271 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:18.230173  5865 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:18.251144  6081 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:18.255975  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:18.258116  6009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.022s	sys 0.073s
W20260709 12:24:18.259552  6009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.594s	user 0.023s	sys 0.073s
W20260709 12:24:18.048990  7180 ts_tablet_manager.cc:1469] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Trace:
0709 12:24:12.365395 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:12.365577 (+   182us) service_pool.cc:224] Handling call
0709 12:24:12.623975 (+258398us) ts_tablet_manager.cc:934] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
0709 12:24:14.091075 (+1467100us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:14.280895 (+189820us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:14.281022 (+   127us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:14.302162 (+ 21140us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:14.313945 (+ 11783us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:14.333094 (+ 19149us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:14.333175 (+    81us) inbound_call.cc:177] Queueing success response
0709 12:24:17.066729 (+2733554us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:24:17.534148 (+467419us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:24:17.598042 (+ 63894us) tablet_replica.cc:261] Starting instrumentation
0709 12:24:17.600657 (+  2615us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":214,"mutex_wait_us":35688,"raft.queue_time_us":2236,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":104,"tablet-copy.queue_time_us":257413,"tablet-download-pool.queue_time_us":27744,"tablet-download-pool.run_cpu_time_us":2179,"tablet-download-pool.run_wall_time_us":2491010,"thread_start_us":295600,"threads_started":2}
W20260709 12:24:18.260212  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 640077us
W20260709 12:24:18.261412  6008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.597s	user 0.131s	sys 0.184s
W20260709 12:24:18.261828  6008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.597s	user 0.131s	sys 0.184s
I20260709 12:24:18.288021  7279 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.262236  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:18.280946  5862 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.045s	sys 0.022s
W20260709 12:24:18.289084  5862 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.540s	user 0.045s	sys 0.022s
I20260709 12:24:18.326272  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:18.334409  6117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.616s	user 0.028s	sys 0.100s
W20260709 12:24:18.339488  6117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.028s	sys 0.100s
I20260709 12:24:18.265117  5865 catalog_manager.cc:5697] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.364362  5865 catalog_manager.cc:5697] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.371608  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:18.257189  7271 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:18.259547  7330 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.075s
I20260709 12:24:18.345161  6643 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:18.361443  7306 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:18.397353  5933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.008s	sys 0.031s
W20260709 12:24:18.431393  5933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.008s	sys 0.031s
I20260709 12:24:18.387395  7331 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:18.399065  7201 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.535s	user 0.019s	sys 0.020s
I20260709 12:24:18.399441  7199 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:18.410409  7184 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:18.436004  6082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.630s	user 0.038s	sys 0.068s
W20260709 12:24:18.436451  6082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.038s	sys 0.068s
I20260709 12:24:18.429826  5963 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
W20260709 12:24:18.437907  6084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.646s	user 0.077s	sys 0.138s
W20260709 12:24:18.439024  6084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.077s	sys 0.138s
I20260709 12:24:18.442091  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:18.442909  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:18.445385  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:18.447616  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:18.448340  6044 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:18.443611  6651 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
W20260709 12:24:18.437220  7201 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.019s	sys 0.021s
I20260709 12:24:18.437564  7199 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:18.452981  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:18.453289  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:18.453987  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:18.438347  7334 log.cc:927] Time spent T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:24:18.460260  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:18.458024  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:18.464809  6082 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:18.452627  5865 catalog_manager.cc:5697] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 2, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.490193  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:18.457885  7314 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:18.466646  6035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.007s	sys 0.011s
W20260709 12:24:18.535122  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 272932us
I20260709 12:24:18.498409  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:18.540904  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 50795.5us
I20260709 12:24:18.541941  5865 catalog_manager.cc:5697] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
W20260709 12:24:18.701254  5934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.852s	user 0.008s	sys 0.012s
I20260709 12:24:18.543769  7264 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:18.933465  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:18.934029  5934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.085s	user 0.021s	sys 0.023s
I20260709 12:24:18.542268  7337 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:24:18.964892  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 1.12576e+06us
W20260709 12:24:18.533520  7336 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.193s	user 0.001s	sys 0.001s
I20260709 12:24:18.971191  6117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 1114) took 1414 ms. Trace:
I20260709 12:24:18.570636  7330 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.965925  6009 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:18.977039  6117 rpcz_store.cc:276] 0709 12:24:17.552094 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.552252 (+   158us) service_pool.cc:224] Handling call
0709 12:24:17.716849 (+164597us) spinlock_profiling.cc:243] Waited 9.84 ms on lock 0x7b5800167d98. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482602dfc0 00007f4826018929 00007f48260183d2 00007f481f58fbd4
0709 12:24:17.717049 (+   200us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.717387 (+   338us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.717414 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.717832 (+   418us) log.cc:844] Serialized 26 byte log entry
0709 12:24:18.339924 (+622092us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:18.339968 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.340053 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:18.672818 (+332765us) raft_consensus.cc:1685] finished
0709 12:24:18.672839 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:18.966168 (+293329us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":93,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":22621056,"thread_start_us":621690,"threads_started":1,"wal-append.queue_time_us":722799}
I20260709 12:24:18.708267  7271 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:18.875597  7347 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.204s	user 0.001s	sys 0.000s
I20260709 12:24:18.981207  6009 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:18.934206  6035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.115s	user 0.010s	sys 0.030s
I20260709 12:24:18.940582  5865 catalog_manager.cc:5697] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.680521  7281 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:18.919610  7199 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:18.986614  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:18.724133  7342 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:18.919826  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:24:18.860371  7344 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
I20260709 12:24:18.970049  6643 raft_consensus.cc:1217] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:18.949385  7264 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:18.674425  7339 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:18.694051  7341 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:18.986498  5865 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:18.985998  7331 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:18.989511  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:18.992111  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:18.970147  7201 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:18.544008  7314 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:18.971805  7337 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:18.694077  7263 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:19.056928  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:18.970947  7351 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.979135  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:19.104032  6649 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
W20260709 12:24:18.979732  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 57784.3us
I20260709 12:24:19.155350  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 1120) took 1406 ms. Trace:
I20260709 12:24:19.155823  6115 rpcz_store.cc:276] 0709 12:24:17.749424 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.749551 (+   127us) service_pool.cc:224] Handling call
0709 12:24:17.790124 (+ 40573us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.790437 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.792194 (+  1757us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.792641 (+   447us) log.cc:844] Serialized 26 byte log entry
0709 12:24:17.995873 (+203232us) spinlock_profiling.cc:243] Waited 1.49 ms on lock 0x7b18002117e0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:24:18.407142 (+411269us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:18.407188 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:18.407265 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:19.147892 (+740627us) raft_consensus.cc:1685] finished
0709 12:24:19.147915 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.155284 (+  7369us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":183,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":3786,"spinlock_wait_cycles":3423104,"thread_start_us":411054,"threads_started":1,"wal-append.queue_time_us":708593}
I20260709 12:24:19.137737  7315 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:18.567342  6644 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:19.116103  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:18.985882  7281 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:19.160024  7281 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.141538  7201 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.163125  7201 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:18.984361  7350 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:18.990340  7204 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:19.138218  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 148694us
I20260709 12:24:19.178354  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:19.179847  6009 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:19.117224  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 619279us
I20260709 12:24:19.145327  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.102329  7264 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.158926  7315 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.183712  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:19.114888  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 1113) took 1565 ms. Trace:
I20260709 12:24:19.185714  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:19.188730  6117 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.191515  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:19.226310  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.144353  7332 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:19.148365  7271 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:19.117139  7339 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.072945  7342 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.143697  7352 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.182971  7354 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:19.223295  7314 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.196055  7199 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.185165  7331 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.185345  7351 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:19.240057  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 263198us
I20260709 12:24:19.233990  6043 raft_consensus.cc:2368] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3.
W20260709 12:24:19.240809  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 46225.2us
I20260709 12:24:19.249297  6117 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:19.121910  7341 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.227409  7358 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:19.280988  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:19.252487  7339 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:19.252686  7349 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:19.254752  7363 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:19.240496  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:19.257126  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 75480.5us
I20260709 12:24:19.227739  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 835) took 1445 ms. Trace:
I20260709 12:24:19.283768  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:19.270164  5966 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:19.146775  7263 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.291472  6084 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:19.281992  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:19.254333  7361 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:19.258390  7354 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:24:19.258356  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 104416us
I20260709 12:24:19.268304  7352 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:19.241830  7364 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:19.299873  7354 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.303426  7330 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:19.303959  7330 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.304860  7367 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:19.305382  7367 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.306100  7330 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:19.236903  7271 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.315979  7263 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:19.316562  7271 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:19.298166  6037 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:19.301923  7269 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:19.317476  7269 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:19.317864  7269 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.284235  7314 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:19.319043  7314 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.319823  7341 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:19.320220  7264 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.233805  7332 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.321130  7314 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:19.322146  7315 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:19.287037  6035 rpcz_store.cc:276] 0709 12:24:17.751567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.761292 (+  9725us) service_pool.cc:224] Handling call
0709 12:24:17.804781 (+ 43489us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.818542 (+ 13761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.818581 (+    39us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.819073 (+   492us) log.cc:844] Serialized 26 byte log entry
0709 12:24:19.056423 (+1237350us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:19.102683 (+ 46260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:19.114442 (+ 11759us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:19.147131 (+ 32689us) raft_consensus.cc:1685] finished
0709 12:24:19.164086 (+ 16955us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.187316 (+ 23230us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":151,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"thread_start_us":1168701,"threads_started":1,"wal-append.queue_time_us":867160}
I20260709 12:24:19.314653  7345 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:19.286580  7358 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.320477  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:19.336400  7345 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.295207  7363 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.337401  7358 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:19.322418  7332 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:19.338852  7345 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:19.339180  7363 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:19.339793  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:19.300825  7361 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.322674  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:19.312410  7337 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:19.306655  7364 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.307691  7367 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:19.325920  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:19.306568  7352 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.351941  7361 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:19.352559  7366 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:19.353192  6647 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:19.196199  6114 rpcz_store.cc:276] 0709 12:24:17.549124 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.550474 (+  1350us) service_pool.cc:224] Handling call
0709 12:24:17.587991 (+ 37517us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:17.601122 (+ 13131us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:17.607648 (+  6526us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:17.618960 (+ 11312us) log.cc:844] Serialized 26 byte log entry
0709 12:24:17.853494 (+234534us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:17.854233 (+   739us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:17.858495 (+  4262us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:18.992550 (+1134055us) raft_consensus.cc:1685] finished
0709 12:24:18.993107 (+   557us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:19.113081 (+119974us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":586,"raft.queue_time_us":3767,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"thread_start_us":226055,"threads_started":1,"wal-append.queue_time_us":628034}
I20260709 12:24:19.359668  7342 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:19.300470  7349 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.361238  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:19.335147  7262 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:19.362884  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:19.363246  7199 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:19.364114  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.365006  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:19.399646  5962 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.342684  7350 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:19.402820  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:19.403431  6650 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.411655  7264 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:19.392184  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:24:19.395016  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 109548us
I20260709 12:24:19.413358  6082 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:19.396849  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 65296.4us
I20260709 12:24:19.396628  7337 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:19.389672  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 111948us
W20260709 12:24:19.415112  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 52296.4us
I20260709 12:24:19.371452  7369 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:19.425601  6084 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:19.422214  6650 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:19.412523  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:19.378161  7281 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:19.437381  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 155489us
I20260709 12:24:19.417169  6644 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:24:19.433229  6043 raft_consensus.cc:2368] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3.
I20260709 12:24:19.430017  7369 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.441885  7349 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:19.442626  7358 raft_consensus.cc:2764] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:24:19.442890  7369 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:19.414410  7262 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.445667  7269 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.446767  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.453864  5962 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:19.450098  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:19.455268  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:19.417613  7199 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:19.458050  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 43761.3us
I20260709 12:24:19.425494  7337 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.461092  6082 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:19.458083  7345 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:19.399173  7366 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.449041  7314 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:19.468295  7199 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:19.455878  7315 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:24:19.448288  7264 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.468233  7337 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:19.477648  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.479322  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:19.479888  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:19.480448  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:19.480621  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:19.481101  5964 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:19.487498  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:19.489446  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:19.460502  7320 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:19.421674  7350 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
W20260709 12:24:19.537487  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 53305.2us
I20260709 12:24:19.538916  6082 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:19.469700  7314 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:24:19.546906  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 61464.9us
I20260709 12:24:19.548507  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:19.550230  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:19.535415  7320 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:19.536437  7360 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:19.562876  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 100979us
I20260709 12:24:19.540566  7352 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:19.472105  7354 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.569546  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:19.570027  7354 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:19.570652  6112 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:19.545063  7314 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.566733  7279 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.575806  7366 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:19.551630  6609 leader_election.cc:400] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3.
I20260709 12:24:19.552784  7330 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:19.576970  7330 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:24:19.577071  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 43776.1us
I20260709 12:24:19.578447  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:19.551342  7359 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.580252  7377 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:19.581130  7281 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:19.563529  7320 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.580020  7314 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.586637  6044 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:19.589033  7345 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:24:19.595510  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45327.8us
I20260709 12:24:19.626223  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.626940  6039 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:19.617602  7320 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.588519  7330 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.623416  7364 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:19.565630  7360 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:19.628608  6128 tablet_copy_service.cc:342] P 0069e2ba1f02412e8e1d6c20a1fb510f: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-5744a277c5a3409b95831573168daf3f received from {username='slave'} at 127.0.0.1:42484
I20260709 12:24:19.630782  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.647837  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.648494  6116 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:19.631476  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.636394  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.638852  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.639837  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.649581  6113 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:19.649672  6041 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:19.645000  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:19.590535  7342 raft_consensus.cc:993] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:24:19.649832  6038 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:19.568212  7269 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:19.644767  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:19.689306  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:19.654901  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:19.645123  7360 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:19.690289  6128 tablet_copy_service.cc:434] P 0069e2ba1f02412e8e1d6c20a1fb510f: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-5744a277c5a3409b95831573168daf3f on tablet 5744a277c5a3409b95831573168daf3f with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:19.654189  7279 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:19.691186  7342 raft_consensus.cc:1081] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Signalling peer 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:24:19.701620  7350 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:19.695464  6609 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:19.705051  7345 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.713284  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:19.716302  7364 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:19.716784  7364 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:19.717162  7364 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.717317  7330 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.700850  7314 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:19.777536  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 145219us
I20260709 12:24:19.783139  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.784791  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.786254  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.797046  7330 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:19.705188  6611 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:19.803434  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.706010  7279 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.704922  6126 tablet_copy_service.cc:342] P 0069e2ba1f02412e8e1d6c20a1fb510f: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-bd91034e550f4704be7f47b7aff3ed25 received from {username='slave'} at 127.0.0.1:42484
I20260709 12:24:19.807572  6126 tablet_copy_service.cc:434] P 0069e2ba1f02412e8e1d6c20a1fb510f: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-bd91034e550f4704be7f47b7aff3ed25 on tablet bd91034e550f4704be7f47b7aff3ed25 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:19.819043  6643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba1e2d6430774a629131a0953161507b"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:50472
I20260709 12:24:19.820463  6643 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:19.821214  6643 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.823770  7315 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:19.824673  7315 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.836030  7320 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:19.840605  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.841828  6041 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:19.842728  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.849246  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.850698  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.859665  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.861274  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.865782  7279 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:19.866637  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51746.7us
I20260709 12:24:19.866825  6043 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:19.868197  5934 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:19.870822  7365 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:19.821842  7360 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.870774  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.876133  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.877682  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:19.886240  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 186444us
W20260709 12:24:19.889254  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 96196.9us
I20260709 12:24:19.871373  7365 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:19.899293  7382 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:19.899863  7382 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:19.900276  7382 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.901062  7315 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:19.902521  5964 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:19.893714  7365 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.890699  7227 tablet_copy_client.cc:538] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:19.895835  6114 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:19.915947  6042 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:19.917645  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.919317  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.920708  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.921118  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.921448  7360 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:19.926715  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.927948  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:19.924352  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:19.936581  6117 raft_consensus.cc:2955] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:19.939460  7351 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:19.940229  7351 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.930869  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:19.941551  6110 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 2: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:19.944890  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:19.945209  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:19.945317  7351 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:19.945967  5965 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:19.950893  6608 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:19.953486  6006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.533s	user 0.009s	sys 0.005s
I20260709 12:24:19.954216  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:19.955441  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:19.956452  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:19.950264  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:19.956626  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:19.959081  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:19.946383  6084 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:19.960647  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:19.952432  7386 raft_consensus.cc:1064] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:19.964097  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:19.968200  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:19.969771  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:19.948203  7369 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:24:19.939379  6112 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:19.940817  6039 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:19.939419  6116 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:19.977524  6113 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:20.006100  6006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.011s	sys 0.006s
I20260709 12:24:19.968324  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:19.988181  5862 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 137) took 2513 ms. Trace:
I20260709 12:24:19.956496  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:19.985196  5960 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5744a277c5a3409b95831573168daf3f"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34548
I20260709 12:24:20.018254  5960 raft_consensus.cc:606] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:24:20.019475  7369 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:20.019969  7369 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:20.020004  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:20.021265  7369 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:19.988123  5863 catalog_manager.cc:5697] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 2, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:19.958014  7365 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.024133  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:20.025907  7365 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:19.974344  6036 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:19.982913  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:20.031280  7330 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:24:20.031863  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 75521us
I20260709 12:24:20.032231  7330 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.032867  7342 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:20.035214  7327 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:20.035573  7327 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:20.025779  7382 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:19.985188  7262 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:20.045805  7369 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.036437  7204 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:20.039781  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 619220us
I20260709 12:24:19.962370  7364 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.068382  7382 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:20.075759  6115 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:20.015298  5862 rpcz_store.cc:276] 0709 12:24:17.474555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.474708 (+   153us) service_pool.cc:224] Handling call
0709 12:24:19.987936 (+2513228us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:18.406081 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:18.487133 (+ 81052us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:18.494497 (+  7364us) write_op.cc:435] Acquired schema lock
0709 12:24:18.497138 (+  2641us) tablet.cc:662] Decoding operations
0709 12:24:18.671925 (+174787us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:18.680255 (+  8330us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:18.692290 (+ 12035us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:18.702176 (+  9886us) tablet.cc:701] Row locks acquired
0709 12:24:18.702887 (+   711us) write_op.cc:260] PREPARE: finished
0709 12:24:18.734079 (+ 31192us) write_op.cc:270] Start()
0709 12:24:18.747253 (+ 13174us) write_op.cc:276] Timestamp: P: 1783599858721798 usec, L: 0
0709 12:24:18.747295 (+    42us) op_driver.cc:348] REPLICATION: starting
0709 12:24:19.370452 (+623157us) spinlock_profiling.cc:243] Waited 15.5 ms on lock 0x7b54003a91a0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fd1520 00007f482105ab42 00007f482104ff67 00007f482104fda4 00007f4824a8a581 00007f4824a89d58 00007f4824a8e9f1 00007f4824a8e9a9 00007f4824a8e939 00007f4824a8e901
0709 12:24:19.371219 (+   767us) log.cc:844] Serialized 529 byte log entry
0709 12:24:19.564498 (+193279us) op_driver.cc:464] REPLICATION: finished
0709 12:24:19.699327 (+134829us) write_op.cc:301] APPLY: starting
0709 12:24:19.700566 (+  1239us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:19.706573 (+  6007us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:19.707634 (+  1061us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:19.722071 (+ 14437us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:19.722244 (+   173us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:19.722292 (+    48us) write_op.cc:312] APPLY: finished
0709 12:24:19.726921 (+  4629us) log.cc:844] Serialized 23 byte log entry
0709 12:24:19.727127 (+   206us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:19.727207 (+    80us) write_op.cc:454] Released schema lock
0709 12:24:19.727248 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:19.727750 (+   502us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:19.727781 (+    31us) write_op.cc:454] Released schema lock
0709 12:24:19.742635 (+ 14854us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:19.742674 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":351967,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":125716,"apply.run_cpu_time_us":2213,"apply.run_wall_time_us":32775,"num_ops":1,"prepare.queue_time_us":644088,"prepare.run_cpu_time_us":58707,"prepare.run_wall_time_us":1029555,"raft.queue_time_us":127024,"raft.run_cpu_time_us":43285,"raft.run_wall_time_us":142835,"replication_time_us":793336,"spinlock_wait_cycles":35610368,"thread_start_us":686909,"threads_started":4,"wal-append.queue_time_us":31804}]]}
I20260709 12:24:20.082867  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:20.084748  6112 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:20.088688  7366 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:20.089571  7366 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:20.091009  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:20.092765  7327 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.094051  7377 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:20.097160  6642 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:20.097846  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 266210us
I20260709 12:24:20.102820  7279 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.105297  7386 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.121181  7351 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:20.121953  7351 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:20.124039  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:20.124328  7351 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:20.106756  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 156200us
I20260709 12:24:20.134182  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:20.135155  6109 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 3: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:20.130674  6647 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:20.094218  7352 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:20.114115  7330 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:20.094682  5963 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5744a277c5a3409b95831573168daf3f"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34548
I20260709 12:24:20.094451  7327 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.147935  5963 raft_consensus.cc:606] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:24:20.094987  7377 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:20.132256  6608 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.098136  7364 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:20.095031  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 127035us
W20260709 12:24:20.157155  5850 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for 5744a277c5a3409b95831573168daf3f already in progress [suppressed 36 similar messages]
I20260709 12:24:20.149448  5965 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:20.161816  7352 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:20.171620  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:20.184720  7365 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:20.184994  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 52972.4us
I20260709 12:24:20.157819  7377 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:20.210489  7384 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
I20260709 12:24:20.221180  7204 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:20.223496  7346 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:20.223955  7346 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:20.224625  7352 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.225128  7346 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:20.228382  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:20.231541  7262 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:20.235987  7227 tablet_bootstrap.cc:492] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:20.235029  7346 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.261823  7260 raft_consensus.cc:993] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
W20260709 12:24:20.266105  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 85107.9us
I20260709 12:24:20.282740  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:20.289659  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:20.234407  6643 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:20.328058  5850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.LeaderStepDown -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 171065us
W20260709 12:24:20.336333  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 149127us
I20260709 12:24:20.336297  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:20.295109  7262 consensus_queue.cc:1059] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.035s
I20260709 12:24:20.340698  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:20.332814  7260 raft_consensus.cc:1081] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:20.341883  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:20.343863  5965 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:20.344861  6643 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:20.348469  7264 raft_consensus.cc:1064] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:20.349305  7262 raft_consensus.cc:3055] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:20.349756  7262 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:20.350009  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:20.343891  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.320230  7384 consensus_queue.cc:1059] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:24:20.356030  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:20.356575  7264 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:20.368837  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.375407  6611 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:20.376401  7377 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.378934  7366 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:20.379688  7366 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:20.380219  7366 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.383193  7377 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:20.355243  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 156542us
I20260709 12:24:20.386675  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:20.350847  7262 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:20.390797  7262 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.389770  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:20.389894  6040 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:20.398809  7331 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.400254  5865 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 244) took 2570 ms. Trace:
I20260709 12:24:20.402165  7384 consensus_queue.cc:1059] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:20.401881  6009 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.400693  5865 rpcz_store.cc:276] 0709 12:24:17.829538 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.839621 (+ 10083us) service_pool.cc:224] Handling call
0709 12:24:20.400078 (+2560457us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:19.440192 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:19.558717 (+118525us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:19.558753 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:24:19.558771 (+    18us) tablet.cc:662] Decoding operations
0709 12:24:19.559626 (+   855us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:19.559678 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:19.559705 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:24:19.560257 (+   552us) tablet.cc:701] Row locks acquired
0709 12:24:19.560276 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:24:19.560418 (+   142us) write_op.cc:270] Start()
0709 12:24:19.560542 (+   124us) write_op.cc:276] Timestamp: P: 1783599859560372 usec, L: 0
0709 12:24:19.560565 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:24:19.701624 (+141059us) log.cc:844] Serialized 2906 byte log entry
0709 12:24:19.704621 (+  2997us) op_driver.cc:464] REPLICATION: finished
0709 12:24:19.728209 (+ 23588us) write_op.cc:301] APPLY: starting
0709 12:24:19.728290 (+    81us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:19.728485 (+   195us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:19.738661 (+ 10176us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:19.738987 (+   326us) spinlock_profiling.cc:243] Waited 77.9 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482104fe28 00007f4824a8a581 00007f4824a89d58 00007f4824a8e9f1 00007f4824a8e9a9 00007f4824a8e939 00007f4824a8e901 00007f4824a8db2d 0000000000388634 0000000000388479
0709 12:24:19.739599 (+   612us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:19.739790 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:24:19.739834 (+    44us) write_op.cc:312] APPLY: finished
0709 12:24:19.740091 (+   257us) log.cc:844] Serialized 59 byte log entry
0709 12:24:19.740271 (+   180us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:19.740381 (+   110us) write_op.cc:454] Released schema lock
0709 12:24:19.740426 (+    45us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":74131,"reported_tablets":11,"child_traces":[["op",{"apply.queue_time_us":23375,"apply.run_cpu_time_us":2660,"apply.run_wall_time_us":12507,"mutex_wait_us":4557,"num_ops":7,"prepare.queue_time_us":247559,"prepare.run_cpu_time_us":5529,"prepare.run_wall_time_us":302789,"replication_time_us":143904,"spinlock_wait_cycles":179184512,"thread_start_us":37708,"threads_started":1}]]}
I20260709 12:24:20.406368  7315 raft_consensus.cc:1064] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
W20260709 12:24:20.409094  7315 raft_consensus.cc:1068] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741: Unable to promote non-voter 24012af7747d4c4ea89c3da2ff950099: Service unavailable: leader transfer in progress
I20260709 12:24:20.410602  7383 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.412743  6009 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.414059  6647 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:20.423771  7383 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.414867  7385 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:20.416103  7384 raft_consensus.cc:3055] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:20.424989  7384 raft_consensus.cc:740] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:20.420133  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.425354  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.422559  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.416960  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.426203  7383 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.428155  7384 consensus_queue.cc:260] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.429442  7384 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.430680  7201 raft_consensus.cc:3055] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:20.431505  7201 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:20.433050  7201 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.435073  7201 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.435737  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.436666  7383 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.441568  7204 raft_consensus.cc:3055] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:20.446403  7204 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:20.447444  7204 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:20.448769  7204 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.452875  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:20.441681  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.463137  7371 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:20.463213  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.463858  7371 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:20.458577  7271 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:20.462244  7315 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:20.465459  6112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5744a277c5a3409b95831573168daf3f"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:24:20.466542  6112 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:20.466904  6112 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.468019  5968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5744a277c5a3409b95831573168daf3f"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34548
I20260709 12:24:20.467909  7271 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:20.468753  5968 raft_consensus.cc:606] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Received request to transfer leadership
I20260709 12:24:20.469527  7315 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:20.475451  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.462692  7385 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:24:20.479341  7315 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:20.477645  7371 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:20.482626  5914 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:24:20.483741  5914 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for 5744a277c5a3409b95831573168daf3f already in progress
W20260709 12:24:20.484023  5914 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for 5744a277c5a3409b95831573168daf3f already in progress
I20260709 12:24:20.483129  7366 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.485509  6643 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:20.486824  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:20.487501  6036 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.489979  7315 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:20.491953  7277 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:20.492334  7277 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:20.493204  7277 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.494016  7383 consensus_queue.cc:1059] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:20.495380  7314 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:20.498869  7314 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:20.479503  5932 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:20.499972  7315 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.499817  7314 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.500458  5932 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:20.501106  7314 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.501605  7315 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:20.502553  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:20.503228  6040 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.504386  5932 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:20.505307  7315 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:20.505759  7315 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:20.506268  7315 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.507802  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:20.505832  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:20.513201  6040 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:20.511550  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:20.516281  7320 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:20.527376  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:20.516294  6112 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:20.529520  6117 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:20.537891  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:20.526890  7383 consensus_queue.cc:1059] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:24:20.544432  7351 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:20.545403  7376 raft_consensus.cc:3055] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:20.546840  6112 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:20.545795  7376 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:20.551579  7320 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.551930  6115 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:20.545776  7383 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:20.552889  7383 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:20.519480  7271 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:20.546802  7277 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.552177  7376 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:20.608273  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 262030us
I20260709 12:24:20.608515  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:20.610836  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:24:20.614776  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 236725us
W20260709 12:24:20.601385  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 187849us
I20260709 12:24:20.601817  6036 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:20.628417  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:20.633837  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:20.621135  7346 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.610292  7382 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.022s
I20260709 12:24:20.642247  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:20.624035  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.645851  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:20.654969  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:20.665012  6118 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 3: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:20.665942  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:20.672046  7315 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:20.674403  7315 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:20.681002  6112 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:20.689901  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:20.694952  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.697595  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:20.701771  6040 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.700394  6112 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:20.703065  7262 consensus_queue.cc:1059] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:20.649621  7366 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:20.706887  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:20.708113  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:20.709715  7416 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:20.710204  7416 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:20.711474  7416 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.718151  6647 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:20.696782  7376 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.719237  6645 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:20.720295  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.715772  6043 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
W20260709 12:24:20.721374  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 62734.4us
I20260709 12:24:20.725075  7346 raft_consensus.cc:3055] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:20.725572  7346 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:20.726552  7346 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:20.727891  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:20.730293  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.736405  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:20.736737  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.738507  5959 raft_consensus.cc:2410] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:24:20.742969  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 95654.9us
I20260709 12:24:20.743731  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.744990  6006 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.751008  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.751874  6608 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.752789  7423 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.753906  6006 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.728287  7277 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:24:20.755923  7412 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:20.756050  5968 raft_consensus.cc:1240] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:20.751008  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:20.757730  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:20.757289  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.770038  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.774935  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:20.741166  7331 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.756860  7423 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:20.656589  7383 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:20.778401  6040 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:20.783532  6044 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:24:20.784426  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.786108  7204 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:20.786736  7204 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.787230  7346 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:20.788414  7382 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:20.788937  7382 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:20.790900  7382 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:20.791356  7382 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:20.792025  7315 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:20.791923  7382 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:20.793367  7315 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:20.794761  7382 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:20.792542  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.810433  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:20.811453  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:20.812299  5961 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:20.810544  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:20.814246  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:20.781714  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.766625  7360 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.034s
W20260709 12:24:20.818897  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 48638.7us
I20260709 12:24:20.783159  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:20.800168  7364 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:20.802759  7315 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:20.838122  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:20.821761  7416 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:20.851716  6082 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.852454  6009 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.858978  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.859622  7204 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:20.863065  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:20.864626  7416 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.865716  5863 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 237) took 1715 ms. Trace:
I20260709 12:24:20.866874  7416 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:20.871038  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:20.873903  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 45113.4us
I20260709 12:24:20.879132  5966 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:20.800037  7314 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.037s
I20260709 12:24:20.826980  7377 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:20.866057  5863 rpcz_store.cc:276] 0709 12:24:19.150333 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:19.150506 (+   173us) service_pool.cc:224] Handling call
0709 12:24:19.559188 (+408682us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:24:20.865629 (+1306441us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:20.565653 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:20.566250 (+   597us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:20.566303 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:24:20.566325 (+    22us) tablet.cc:662] Decoding operations
0709 12:24:20.566789 (+   464us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:20.566878 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:20.566912 (+    34us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:20.567244 (+   332us) tablet.cc:701] Row locks acquired
0709 12:24:20.567279 (+    35us) write_op.cc:260] PREPARE: finished
0709 12:24:20.567461 (+   182us) write_op.cc:270] Start()
0709 12:24:20.567737 (+   276us) write_op.cc:276] Timestamp: P: 1783599860567397 usec, L: 0
0709 12:24:20.567782 (+    45us) op_driver.cc:348] REPLICATION: starting
0709 12:24:20.568589 (+   807us) log.cc:844] Serialized 538 byte log entry
0709 12:24:20.679867 (+111278us) op_driver.cc:464] REPLICATION: finished
0709 12:24:20.784656 (+104789us) write_op.cc:301] APPLY: starting
0709 12:24:20.784728 (+    72us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:20.784841 (+   113us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:20.784959 (+   118us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:20.785235 (+   276us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:20.785431 (+   196us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:20.785487 (+    56us) write_op.cc:312] APPLY: finished
0709 12:24:20.785745 (+   258us) log.cc:844] Serialized 23 byte log entry
0709 12:24:20.785919 (+   174us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:20.785999 (+    80us) write_op.cc:454] Released schema lock
0709 12:24:20.786047 (+    48us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:20.786476 (+   429us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:20.786511 (+    35us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":402399,"reported_tablets":10,"spinlock_wait_cycles":628233984,"child_traces":[["op",{"apply.queue_time_us":103418,"apply.run_cpu_time_us":1782,"apply.run_wall_time_us":1782,"num_ops":1,"prepare.queue_time_us":190645,"prepare.run_cpu_time_us":3386,"prepare.run_wall_time_us":8240,"replication_time_us":111875,"spinlock_wait_cycles":1408,"thread_start_us":211671,"threads_started":2}]]}
I20260709 12:24:20.885545  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:20.889320  6006 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.883714  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:20.900141  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:20.886579  7351 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:20.910530  7351 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:20.910784  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:20.891557  7330 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.915397  7366 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:20.915936  7366 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:20.916796  7366 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.917770  7383 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.919636  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:20.920665  5864 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 243) took 2980 ms. Trace:
I20260709 12:24:20.921018  5864 rpcz_store.cc:276] 0709 12:24:17.940090 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:17.940246 (+   156us) service_pool.cc:224] Handling call
0709 12:24:20.920477 (+2980231us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":302227,"reported_tablets":7}
I20260709 12:24:20.921758  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:20.922701  5961 raft_consensus.cc:2410] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:24:20.903743  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52109us
I20260709 12:24:20.932507  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:24:20.938040  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:20.935662  5865 catalog_manager.cc:5697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:20.943323  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 64336.6us
I20260709 12:24:20.944121  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.946492  6082 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.946719  7193 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:20.947976  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:20.948084  7193 consensus_queue.cc:1059] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:20.948673  5963 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:20.951465  7383 raft_consensus.cc:3055] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:20.893710  7377 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:20.929618  7351 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:20.956167  7377 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:20.957247  7383 raft_consensus.cc:740] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:20.959263  7330 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:20.959061  7429 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:20.960125  7331 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:20.953190  5959 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:20.937892  5932 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:20.959846  5964 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:20.949640  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:20.985477  5962 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
W20260709 12:24:20.986255  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 105517us
I20260709 12:24:20.894840  7423 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.073s
I20260709 12:24:20.988204  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.991346  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.992375  6043 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:24:20.992568  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.992928  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.993805  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:20.995428  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:20.996819  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:21.000545  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:21.002882  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:21.003247  5968 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:20.999867  7330 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:21.009737  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 64291.2us
I20260709 12:24:21.010510  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:21.011801  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 62225.6us
I20260709 12:24:21.012446  6608 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:20.987231  7384 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:21.017249  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 79414.7us
I20260709 12:24:21.018941  7352 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:21.025192  6006 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:21.026489  5932 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:21.025903  7412 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:21.012125  7369 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:24:21.029881  7427 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.171s	user 0.004s	sys 0.000s
I20260709 12:24:21.031520  6650 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:24:21.033758  6650 pending_rounds.cc:85] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 4
I20260709 12:24:21.029798  7383 consensus_queue.cc:260] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:21.034659  7383 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.034578  7412 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:21.038861  7369 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:21.039517  7412 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:21.033262  6082 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:21.034082  6650 pending_rounds.cc:107] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:24:21.041832  6650 raft_consensus.cc:2889] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:21.041214  7369 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:21.049440  6041 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:21.051474  7360 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.051940  7227 tablet_bootstrap.cc:492] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:21.052937  7227 tablet_bootstrap.cc:492] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:21.053759  7227 ts_tablet_manager.cc:1403] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.819s	user 0.030s	sys 0.004s
I20260709 12:24:21.053031  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:21.057922  7314 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.060725  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:21.066826  6035 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:21.063148  7314 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:21.067291  7227 raft_consensus.cc:359] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
W20260709 12:24:21.062295  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 44432.1us
I20260709 12:24:21.085675  5932 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:21.086890  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:21.080183  7351 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:21.098910  5932 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:24:21.093063  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 67952.4us
I20260709 12:24:21.091996  6608 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:24:21.102843  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 49914.1us
I20260709 12:24:21.098810  7204 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.105839  7369 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:21.054631  7346 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.110446  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:21.106395  7369 raft_consensus.cc:697] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:21.089879  7360 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:21.116564  6006 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:21.091531  7382 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.089534  7227 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:21.123106  6006 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:21.123917  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:21.125222  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:21.114245  7201 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.127349  5932 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:21.118220  7384 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:21.114956  5864 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 1 to 2, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 2 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:21.133499  7264 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.138928  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:21.130299  7360 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:21.140784  7360 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:21.135661  7351 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:21.143657  6082 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:21.145116  7436 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:21.144954  6082 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:21.127900  7386 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:21.135969  7320 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:21.146629  5932 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:21.144893  7264 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:21.146876  7227 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:21.137814  7423 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:21.159202  5959 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:21.159278  7369 consensus_queue.cc:237] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:21.146143  7330 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:21.175143  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:21.177170  7264 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:21.177870  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.178854  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:21.179646  7264 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.180018  7330 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:21.180672  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:21.181329  7330 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:21.182037  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:21.182796  7371 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:21.183446  7371 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:21.184707  7264 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:21.185128  7371 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:21.192466  6035 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:21.194535  7264 raft_consensus.cc:697] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:21.195624  7264 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:21.191346  7314 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:24:21.172020  7384 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:21.204381  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 57828.4us
I20260709 12:24:21.206881  5932 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:21.207746  7262 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.208484  5932 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:21.209846  5932 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:21.171104  7366 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:24:21.214066  5932 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:21.219853  5863 catalog_manager.cc:5697] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:21.221464  5932 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:21.216728  7384 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.213135  7262 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.222342  7204 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.247362  5932 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:21.268316  7346 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.226634  7271 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.288143  7227 ts_tablet_manager.cc:1434] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.234s	user 0.009s	sys 0.009s
I20260709 12:24:21.323129  5932 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:21.332427  7376 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:21.334476  7201 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:21.339191  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:21.340209  5865 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 1 to 3, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 3 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:21.341446  7429 consensus_queue.cc:1059] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:21.342554  7429 raft_consensus.cc:3055] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:21.343410  7429 raft_consensus.cc:740] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:21.341674  5865 catalog_manager.cc:5697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 1 to 2, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 2 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:21.345480  5865 catalog_manager.cc:5697] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 1 to 2, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 2 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:21.344415  7429 consensus_queue.cc:260] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:21.347436  7429 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.347362  5865 catalog_manager.cc:5697] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 1 to 2, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 2 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:21.388722  5959 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:21.392817  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:21.394328  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:21.395089  6112 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:21.396322  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:21.402412  7264 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:21.403046  7264 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:21.405184  7264 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:21.409404  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:21.410019  5962 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:21.411339  6126 tablet_copy_service.cc:342] P 0069e2ba1f02412e8e1d6c20a1fb510f: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-12ca0d61cb524660bae3b43f9f1c5389 received from {username='slave'} at 127.0.0.1:42484
I20260709 12:24:21.411827  6126 tablet_copy_service.cc:434] P 0069e2ba1f02412e8e1d6c20a1fb510f: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-12ca0d61cb524660bae3b43f9f1c5389 on tablet 12ca0d61cb524660bae3b43f9f1c5389 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:21.413075  5959 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:21.413065  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:21.414043  5961 raft_consensus.cc:2393] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 2: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:24:21.422430  6111 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:21.415395  7262 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.423395  7262 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:21.425757  7262 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:21.427605  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:21.431075  5961 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:21.433277  7412 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:21.472981  6042 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:21.474643  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:21.475471  7412 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.476670  6611 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:21.477387  7412 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.477985  6645 raft_consensus.cc:1217] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:21.480672  6611 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:21.481451  7369 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.485567  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:21.486930  5866 catalog_manager.cc:5697] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 2 to 3, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:21.488602  5866 catalog_manager.cc:5697] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 2 to 3, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:21.489717  7369 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.472334  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:21.490249  5866 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 2 to 3, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:21.500932  7201 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.501575  7201 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:21.502274  7412 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.503684  7201 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:21.503172  5866 catalog_manager.cc:5697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:21.504585  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:21.506529  7371 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:21.507516  6006 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:21.506471  6081 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:21.508795  6041 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:21.509351  7371 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:21.509725  7371 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:21.510092  7371 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.510171  7409 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:21.512807  7435 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:21.516752  7409 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:21.520264  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:21.523964  7371 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:21.531172  7451 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:21.537072  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:21.539361  7371 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:21.544448  7314 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.551011  5959 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:21.552371  7366 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:21.563827  6112 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.566032  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:21.573685  7386 raft_consensus.cc:2955] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:21.582078  6082 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:21.593592  7429 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:21.596810  6111 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:21.598439  6112 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:21.604018  7423 consensus_queue.cc:1059] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: INVALID_TERM, Last received: 1.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:21.607466  6035 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:21.611567  7451 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:21.614256  6645 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:24:21.602581  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 63699.8us
I20260709 12:24:21.615768  7412 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:21.617410  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:21.618059  7451 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:21.618569  7262 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:21.626629  6112 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:21.640470  6112 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:21.646343  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:21.649226  6035 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:21.648391  6649 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Advancing to term 3
I20260709 12:24:21.674038  5961 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:21.675535  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:21.678978  7320 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:21.679502  7320 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:21.681524  7320 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:21.682880  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:21.683604  6112 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:21.685721  5934 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:21.676460  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:21.711853  7262 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:21.732028  7453 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.201s	user 0.004s	sys 0.000s
I20260709 12:24:21.727936  7262 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:21.755606  7262 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:21.724706  7366 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:24:21.726312  7320 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:21.754309  6649 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:21.774595  7264 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:21.770967  7320 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:21.773227  7456 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
W20260709 12:24:21.773700  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 44725.5us
I20260709 12:24:21.789402  7320 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:21.827132  7369 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:21.831319  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 145682us
W20260709 12:24:21.832154  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 155763us
I20260709 12:24:21.846786  5959 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:21.846822  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:21.829909  7369 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:21.891208  6649 raft_consensus.cc:2955] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:24:21.907223  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 53411.6us
I20260709 12:24:21.889748  6035 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:21.919616  6116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:21.920269  6116 raft_consensus.cc:606] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:21.948823  7369 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:21.977645  6116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:21.978394  6116 raft_consensus.cc:606] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:24:21.972741  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 76236.6us
I20260709 12:24:21.953541  7320 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:22.020313  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 172799us
W20260709 12:24:22.024361  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 166227us
I20260709 12:24:22.046684  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:22.047366  6035 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:22.040313  7204 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.053879  7204 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:22.056908  7320 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:22.060393  7204 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:22.044340  7369 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:24:22.080652  6110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:22.088660  6110 raft_consensus.cc:606] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:22.090981  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:22.091667  5962 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:22.094681  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:22.095352  6039 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:22.096181  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:22.097384  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:22.101742  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:22.102582  6041 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.105397  5967 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:22.110607  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 170822us
I20260709 12:24:22.064380  7262 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:22.145061  6040 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
W20260709 12:24:22.163398  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 53987.4us
W20260709 12:24:22.167871  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 50830.9us
I20260709 12:24:22.166795  5967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
W20260709 12:24:22.241336  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 74697.2us
W20260709 12:24:22.244726  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 72286.3us
I20260709 12:24:22.248600  6041 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:22.122385  6609 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:22.281388  7476 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:22.290024  7412 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:22.310851  7412 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:22.287326  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 185183us
I20260709 12:24:22.311262  7412 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.290830  7476 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:22.324164  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 155831us
W20260709 12:24:22.368108  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 104498us
W20260709 12:24:22.314623  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 145341us
W20260709 12:24:22.359208  7487 log.cc:927] Time spent T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
W20260709 12:24:22.344966  7490 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:22.320212  7482 raft_consensus.cc:3055] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:22.358227  7262 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:22.392105  7472 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.010s
I20260709 12:24:22.404946  7472 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:24:22.410390  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 112980us
I20260709 12:24:22.423717  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:22.398764  7482 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:22.455997  7495 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:22.502799  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:24:22.503659  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 113238us
W20260709 12:24:22.504297  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 81446.8us
I20260709 12:24:22.514434  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:22.503221  7495 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.516000  6041 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:24:22.515404  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 103764us
I20260709 12:24:22.510757  7204 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:22.524174  6041 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:22.531136  7476 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:22.530886  7412 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:22.533129  7412 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:22.524936  7204 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:22.536366  7204 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:22.518910  7495 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.543704  6039 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:22.501488  7482 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:22.561930  7435 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.563109  5866 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:22.604354  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:22.567442  7279 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.606559  7279 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:22.610652  6112 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:22.562438  7435 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:22.616554  7435 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:22.620397  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:22.625157  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:22.625767  6039 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.626904  6043 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:22.630705  7279 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:22.631311  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:22.631966  6645 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:22.641920  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:22.642553  6043 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
W20260709 12:24:22.652643  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 141087us
I20260709 12:24:22.655083  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:22.655844  5961 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:22.626883  7493 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.022s
I20260709 12:24:22.629257  7495 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:22.657444  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:22.657245  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 138385us
I20260709 12:24:22.666980  7327 raft_consensus.cc:1064] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:22.683056  5967 raft_consensus.cc:606] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:22.683539  5967 raft_consensus.cc:614] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:22.670955  7511 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:22.688897  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 172809us
W20260709 12:24:22.686676  7327 raft_consensus.cc:1068] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: Unable to promote non-voter 24012af7747d4c4ea89c3da2ff950099: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:22.692204  6082 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:22.694146  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:22.690788  7511 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.697674  7511 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.697014  7494 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:22.700026  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 46657.8us
I20260709 12:24:22.703266  7495 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:22.698771  7470 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:22.700842  7494 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.719213  7494 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.719475  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:22.720110  5966 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:22.713629  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:22.732532  6036 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:22.734009  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:22.734624  6118 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.737632  7494 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:22.729094  7470 raft_consensus.cc:697] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:22.740401  7470 consensus_queue.cc:237] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:22.740871  6118 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:22.743851  5959 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:22.746958  7494 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:22.755255  6039 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:22.766640  7435 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:22.767130  7507 raft_consensus.cc:1064] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:22.767256  7435 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:22.772864  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:22.773650  6650 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.782724  7515 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:24:22.790349  6650 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:22.793072  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:22.794123  6039 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.796655  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:22.802366  7507 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:22.789667  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:22.788565  7435 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:22.806583  7511 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:22.813304  7327 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:22.813725  7327 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:22.814426  7511 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:22.814608  7327 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:22.815881  7327 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.818725  5963 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.820400  6039 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:22.836621  6609 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:24:22.837409  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 206450us
I20260709 12:24:22.839906  7478 raft_consensus.cc:2764] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 1: won
I20260709 12:24:22.856719  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:22.857375  6649 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:22.860958  5967 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:22.858862  6609 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:22.863170  7435 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:22.869524  7435 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:22.871837  7435 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:22.874040  7369 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:22.874603  7369 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:22.875414  7369 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:22.863338  7497 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.011s
I20260709 12:24:22.882155  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:22.882764  6649 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:22.887096  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:22.887866  6110 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:22.889636  7330 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:22.891404  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:22.891726  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:22.896173  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:22.859344  5963 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:22.904497  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:22.905215  5966 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.908294  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:22.910593  7477 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:22.911021  7477 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:22.911330  7477 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:22.917347  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:24:22.913781  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:22.894663  7279 consensus_queue.cc:1059] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.026s
I20260709 12:24:22.921377  7279 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:22.924015  5966 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:22.932310  7429 raft_consensus.cc:3055] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:22.939065  7429 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:22.941721  7429 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:22.942150  7491 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:22.942886  7429 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:22.942662  7491 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:22.944047  5934 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:22.944783  7491 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:22.934123  7279 raft_consensus.cc:697] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:22.948253  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:22.949384  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:22.949723  7320 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:22.950372  7320 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:22.951679  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:22.952392  5966 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 2: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:22.955260  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:22.956086  6039 raft_consensus.cc:2368] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3.
I20260709 12:24:22.961390  7477 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:22.968535  7201 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:22.986701  7529 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:24:22.948939  7279 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:22.997205  7482 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.000810  7320 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:23.001209  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:23.003824  6036 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:23.025637  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:23.028124  7264 raft_consensus.cc:1064] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:23.034746  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:23.035378  6118 raft_consensus.cc:2393] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 2: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:23.028393  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:23.036592  5963 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.039505  7264 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:23.051193  5934 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:23.053084  7204 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.056170  6038 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:23.038355  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:23.073594  7429 raft_consensus.cc:993] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:23.074163  7429 raft_consensus.cc:1081] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:23.074088  7204 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:23.078727  6645 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:23.085850  5963 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:23.087265  6006 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:23.088387  7423 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:23.088922  7327 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:23.099962  6082 leader_election.cc:400] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3.
I20260709 12:24:23.100435  6082 leader_election.cc:403] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:23.101327  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 54959.2us
I20260709 12:24:23.102209  7497 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.110113  7497 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3.
I20260709 12:24:23.111035  7477 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:23.112076  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:23.112713  6650 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.123085  7366 raft_consensus.cc:476] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Not starting pre-election -- already a leader
I20260709 12:24:23.127351  7330 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:23.137108  7507 raft_consensus.cc:993] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:23.137799  7472 raft_consensus.cc:1081] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:23.138832  5962 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:23.138752  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:23.141024  7423 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:23.141708  7423 raft_consensus.cc:697] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:24:23.143028  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 58756.9us
I20260709 12:24:23.143288  7423 consensus_queue.cc:237] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:23.151870  6038 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:23.160810  6035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36260
I20260709 12:24:23.161470  6035 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:23.161895  6035 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.169814  6110 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:23.171387  6041 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:23.184111  6650 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:23.196334  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:23.173722  7481 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:23.202255  7497 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:23.205538  7480 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:23.206581  6038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36260
I20260709 12:24:23.207170  6038 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:23.207535  7501 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:23.208150  7501 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:23.207561  6038 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.211656  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:23.212280  6111 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.209131  7501 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:23.216265  7472 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:24:23.237396  6038 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:23.268491  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:23.269309  5963 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.277015  6038 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:23.292897  5963 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:23.303722  6006 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:23.305359  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:23.305981  6118 raft_consensus.cc:3055] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:23.306293  6118 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:23.247399  6035 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:23.309867  6118 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:23.316505  7513 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:23.316681  6118 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:23.316991  7371 raft_consensus.cc:2955] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:23.320410  6111 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:23.322542  6117 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:24:23.322965  6117 pending_rounds.cc:85] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 2
I20260709 12:24:23.323181  6117 pending_rounds.cc:107] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:24:23.323393  6117 raft_consensus.cc:2889] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:23.328177  7260 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:23.339679  6118 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:23.353775  7513 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:23.354859  7513 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:23.361243  6035 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:23.365424  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:23.366014  6649 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.367202  6039 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:23.370023  6650 raft_consensus.cc:2955] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:23.341122  5962 raft_consensus.cc:2955] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:23.392303  6649 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:23.393872  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:23.406706  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:23.407473  6118 raft_consensus.cc:3055] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:23.407790  6118 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:23.380199  7514 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:24:23.408521  6118 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:23.416821  6118 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:23.335304  7264 raft_consensus.cc:2955] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:23.415191  7468 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:23.423012  7468 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:23.423926  7468 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:23.427546  5961 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:23.430836  7478 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:23.431438  6118 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:23.439349  5866 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 143) took 1397 ms. Trace:
I20260709 12:24:23.439764  5866 rpcz_store.cc:276] 0709 12:24:22.042176 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.042326 (+   150us) service_pool.cc:224] Handling call
0709 12:24:23.439286 (+1396960us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:22.779052 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:22.779642 (+   590us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:22.779674 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:24:22.779691 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:22.780032 (+   341us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:22.780090 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:22.780122 (+    32us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:22.780341 (+   219us) tablet.cc:701] Row locks acquired
0709 12:24:22.780358 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:24:22.780521 (+   163us) write_op.cc:270] Start()
0709 12:24:22.780640 (+   119us) write_op.cc:276] Timestamp: P: 1783599862780462 usec, L: 0
0709 12:24:22.780665 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:24:22.781463 (+   798us) log.cc:844] Serialized 595 byte log entry
0709 12:24:23.144886 (+363423us) op_driver.cc:464] REPLICATION: finished
0709 12:24:23.330614 (+185728us) write_op.cc:301] APPLY: starting
0709 12:24:23.330731 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:23.330823 (+    92us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:23.330932 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:23.331174 (+   242us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:23.331314 (+   140us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:23.331361 (+    47us) write_op.cc:312] APPLY: finished
0709 12:24:23.331540 (+   179us) log.cc:844] Serialized 23 byte log entry
0709 12:24:23.331711 (+   171us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:23.331786 (+    75us) write_op.cc:454] Released schema lock
0709 12:24:23.331823 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:23.332128 (+   305us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:23.332161 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":2,"child_traces":[["op",{"apply.queue_time_us":165015,"apply.run_cpu_time_us":1539,"apply.run_wall_time_us":1545,"num_ops":1,"prepare.queue_time_us":153359,"prepare.run_cpu_time_us":43046,"prepare.run_wall_time_us":83768,"raft.queue_time_us":207973,"raft.run_cpu_time_us":38547,"raft.run_wall_time_us":98720,"replication_time_us":363129,"thread_start_us":311496,"threads_started":4,"wal-append.queue_time_us":73350}]]}
I20260709 12:24:23.437803  5965 raft_consensus.cc:2955] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:23.525358  6650 raft_consensus.cc:2955] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:23.530294  6037 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:23.557487  7330 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.013s
I20260709 12:24:23.573112  6039 raft_consensus.cc:2955] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:24:23.629158  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 71108.7us
W20260709 12:24:23.632297  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 79714.3us
W20260709 12:24:23.632958  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 167874us
I20260709 12:24:23.659854  5962 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:23.661795  7468 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:23.680740  6645 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:23.683919  7507 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:23.686899  6037 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:23.711246  7502 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:24:23.747102  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 105077us
W20260709 12:24:23.750564  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 74478.1us
I20260709 12:24:23.755169  6038 raft_consensus.cc:2955] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:23.764760  6118 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:23.767771  6117 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:23.781287  5865 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 240) took 1050 ms. Trace:
I20260709 12:24:23.780539  5862 catalog_manager.cc:5697] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:23.781731  5865 rpcz_store.cc:276] 0709 12:24:22.731165 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:22.731314 (+   149us) service_pool.cc:224] Handling call
0709 12:24:22.842813 (+111499us) spinlock_profiling.cc:243] Waited 21.1 ms on lock 0x7b5400002490. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df300b2 00007f4826ea9759 00007f4826e41a76 00007f4826e12d58 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc
0709 12:24:22.920993 (+ 78180us) spinlock_profiling.cc:243] Waited 19.6 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:24:23.781217 (+860224us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":97487,"reported_tablets":4,"spinlock_wait_cycles":93612160}
I20260709 12:24:23.784143  5862 catalog_manager.cc:5697] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 4, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 4 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:23.785771  7515 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:23.809814  7482 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.023s
I20260709 12:24:23.843853  5967 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:23.830144  7515 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:23.950877  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 98322.9us
W20260709 12:24:23.956568  7559 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.111s	user 0.002s	sys 0.004s
I20260709 12:24:23.839694  7423 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:24:23.952859  7479 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:23.953498  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 108404us
I20260709 12:24:23.975237  5967 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:24.003263  7360 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.002s
W20260709 12:24:24.008527  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 189535us
I20260709 12:24:24.021378  6111 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:24.031147  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:24.032125  6041 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:24.033308  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:24.042730  6647 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:24.031039  7515 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:24.057711  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 45656.3us
I20260709 12:24:24.061770  7330 raft_consensus.cc:2955] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:24:24.075963  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 64347.7us
I20260709 12:24:24.036702  7566 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:24:24.110075  6645 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:24:24.112133  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 51868.8us
I20260709 12:24:24.176163  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:24.176878  5962 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:24.188946  6037 raft_consensus.cc:2955] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:24.192235  6643 raft_consensus.cc:2955] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:24.195504  7563 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:24.196086  7563 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:24.198221  7563 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:24.200070  7563 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:24.202913  6115 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:24.203526  7564 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:24.212586  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:24.213251  6118 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:24.219360  7501 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:24.230425  6081 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:24.231523  7429 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:24.231976  7429 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:24.232312  7429 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.239970  6009 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:24.246675  7564 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:24.247107  7564 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:24.247481  7564 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:24.265142  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:24.306834  7429 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:24.309707  7429 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:24.311259  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:24.313283  7564 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:24.313925  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:24.314730  5966 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:24.332892  7564 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:24.344856  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:24.348026  5966 raft_consensus.cc:2955] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:24.339709  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:24.353328  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:24.356030  5961 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.372699  5961 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:24.364604  6117 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:24.363636  6035 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.388490  6009 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:24.395285  6117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:24.395972  6117 raft_consensus.cc:606] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:24.390419  7423 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:24.420606  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:24.421531  5965 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:24.453198  5862 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 251) took 1392 ms. Trace:
I20260709 12:24:24.448788  7423 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:24.463284  7423 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:24.468638  7557 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:24.469324  7557 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:24.472543  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:24.472713  7557 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:24.473237  5961 raft_consensus.cc:2368] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3.
I20260709 12:24:24.475371  6608 leader_election.cc:400] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3.
I20260709 12:24:24.475684  6608 leader_election.cc:403] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:24.479161  7557 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.489137  5961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:24:24.489874  5961 raft_consensus.cc:606] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:24.453810  5862 rpcz_store.cc:276] 0709 12:24:23.060507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.060638 (+   131us) service_pool.cc:224] Handling call
0709 12:24:23.117544 (+ 56906us) spinlock_profiling.cc:243] Waited 4.17 ms on lock 0x7b5400002490. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df300b2 00007f4826ea9759 00007f4826e41a76 00007f4826e12d58 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc
0709 12:24:23.197354 (+ 79810us) spinlock_profiling.cc:243] Waited 35.1 ms on lock 0x7b5400002490. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df30640 00007f4826e07846 00007f4826f1190e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:24:24.453126 (+1255772us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:23.963615 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:23.964164 (+   549us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:23.964196 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:24:23.964210 (+    14us) tablet.cc:662] Decoding operations
0709 12:24:23.964604 (+   394us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:23.964656 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:23.964686 (+    30us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:23.965002 (+   316us) tablet.cc:701] Row locks acquired
0709 12:24:23.965015 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:24:23.965147 (+   132us) write_op.cc:270] Start()
0709 12:24:23.965258 (+   111us) write_op.cc:276] Timestamp: P: 1783599863965105 usec, L: 0
0709 12:24:23.965274 (+    16us) op_driver.cc:348] REPLICATION: starting
0709 12:24:24.005635 (+ 40361us) log.cc:844] Serialized 923 byte log entry
0709 12:24:24.180758 (+175123us) op_driver.cc:464] REPLICATION: finished
0709 12:24:24.216019 (+ 35261us) write_op.cc:301] APPLY: starting
0709 12:24:24.216080 (+    61us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:24.216161 (+    81us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:24.216255 (+    94us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:24.216518 (+   263us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:24.216670 (+   152us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:24:24.216711 (+    41us) write_op.cc:312] APPLY: finished
0709 12:24:24.216908 (+   197us) log.cc:844] Serialized 29 byte log entry
0709 12:24:24.258706 (+ 41798us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:24.280753 (+ 22047us) write_op.cc:454] Released schema lock
0709 12:24:24.290885 (+ 10132us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:24.310527 (+ 19642us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:24.310556 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":90986,"reported_tablets":7,"spinlock_wait_cycles":90257152,"child_traces":[["op",{"apply.queue_time_us":35056,"apply.run_cpu_time_us":1741,"apply.run_wall_time_us":94453,"num_ops":2,"prepare.queue_time_us":148733,"prepare.run_cpu_time_us":2813,"prepare.run_wall_time_us":45417,"replication_time_us":215338,"thread_start_us":168553,"threads_started":2}]]}
I20260709 12:24:24.499966  5866 catalog_manager.cc:5697] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 2 to 5, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:24.501633  6035 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:24.503724  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:24.504516  6037 raft_consensus.cc:2368] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3.
I20260709 12:24:24.505666  6609 leader_election.cc:400] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3.
I20260709 12:24:24.505741  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:24.509217  5864 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 248) took 1439 ms. Trace:
I20260709 12:24:24.509613  5864 rpcz_store.cc:276] 0709 12:24:23.058669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.058817 (+   148us) service_pool.cc:224] Handling call
0709 12:24:23.081679 (+ 22862us) spinlock_profiling.cc:243] Waited 1.04 ms on lock 0x7b5400002490. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df30640 00007f4826e07846 00007f4826f1190e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:24:24.498414 (+1416735us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":85779,"reported_tablets":5,"spinlock_wait_cycles":2388864}
I20260709 12:24:24.502450  5866 catalog_manager.cc:5697] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:24.515020  6082 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:24.517321  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:24.517896  6118 raft_consensus.cc:606] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:24.519897  5866 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:24.523764  7560 log.cc:927] Time spent T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.188s	user 0.003s	sys 0.000s
I20260709 12:24:24.533039  6110 raft_consensus.cc:2368] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3.
I20260709 12:24:24.537075  7360 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:24.537663  7360 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:24.538722  7360 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:24.551271  6117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:24.551847  6117 raft_consensus.cc:606] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:24.552181  6117 raft_consensus.cc:614] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:24.569811  5965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adcfbfcb66fd4891959337c005335841"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:24:24.570534  5965 raft_consensus.cc:606] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:24.584405  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:24.586030  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:24.590893  6611 leader_election.cc:400] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3.
I20260709 12:24:24.614748  7497 raft_consensus.cc:993] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:24.615345  7507 raft_consensus.cc:1081] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:24.619010  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:24.614789  7521 raft_consensus.cc:993] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:24.590253  7557 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3.
I20260709 12:24:24.634902  7330 raft_consensus.cc:1081] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:24.642037  6035 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36260
I20260709 12:24:24.655664  7556 raft_consensus.cc:993] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:24.656275  7556 raft_consensus.cc:1081] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:24.660813  6035 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:24.667842  6035 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.666303  6111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "adcfbfcb66fd4891959337c005335841"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:24:24.684309  6040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36260
I20260709 12:24:24.689289  6040 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:24.689700  6040 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.683252  6111 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:24.690596  6111 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.705369  6035 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:24.708930  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:24.709532  6110 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.709854  6110 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:24.711457  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:24.712085  6645 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.716406  6035 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:24.710632  6110 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:24.719079  6110 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.704356  6040 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:24.731765  6040 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:24.732374  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:24.721107  6645 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:24.712098  5865 catalog_manager.cc:5697] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 3, now has a pending config: VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65), VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66), VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67), VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:24.728251  5866 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 144) took 1011 ms. Trace:
I20260709 12:24:24.733546  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:24.734107  6117 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.734421  6117 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:24.735188  6117 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:24.729132  6111 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:24.733023  5965 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.740074  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:24.736224  6117 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.743928  6111 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:24.745890  5965 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:24.747303  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:24.747916  5963 raft_consensus.cc:3055] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:24.748087  6110 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:24.749197  7314 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:24.749792  7314 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:24.750639  7314 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:24.762709  6006 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:24.763538  7423 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:24.764050  7423 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:24.764554  7555 raft_consensus.cc:993] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:24.765106  7555 raft_consensus.cc:1081] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:24.764928  7423 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:24.766134  5963 raft_consensus.cc:740] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:24.766868  5963 consensus_queue.cc:260] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:24.768092  5963 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.768002  6111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:24:24.768733  6111 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:24.769079  6111 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.774765  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:24.775446  6040 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:24.783370  6111 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:24.733960  5866 rpcz_store.cc:276] 0709 12:24:23.716660 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:23.716776 (+   116us) service_pool.cc:224] Handling call
0709 12:24:23.792769 (+ 75993us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b5400002490. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df300b2 00007f4826ea9759 00007f4826e41a76 00007f4826e12d58 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc
0709 12:24:24.728186 (+935417us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:24.669071 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:24.669585 (+   514us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:24.669619 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:24:24.669636 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:24.670750 (+  1114us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:24.670826 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:24.670853 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:24:24.671997 (+  1144us) tablet.cc:701] Row locks acquired
0709 12:24:24.672017 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:24:24.675312 (+  3295us) write_op.cc:270] Start()
0709 12:24:24.675449 (+   137us) write_op.cc:276] Timestamp: P: 1783599864675239 usec, L: 0
0709 12:24:24.675471 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:24:24.676065 (+   594us) log.cc:844] Serialized 1417 byte log entry
0709 12:24:24.678085 (+  2020us) op_driver.cc:464] REPLICATION: finished
0709 12:24:24.678588 (+   503us) write_op.cc:301] APPLY: starting
0709 12:24:24.678687 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:24.678829 (+   142us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:24.678924 (+    95us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:24.679349 (+   425us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:24.679527 (+   178us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:24:24.679572 (+    45us) write_op.cc:312] APPLY: finished
0709 12:24:24.679776 (+   204us) log.cc:844] Serialized 35 byte log entry
0709 12:24:24.679951 (+   175us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:24.680042 (+    91us) write_op.cc:454] Released schema lock
0709 12:24:24.680081 (+    39us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:24.680393 (+   312us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:24.680431 (+    38us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":21923,"reported_tablets":7,"spinlock_wait_cycles":15792512,"child_traces":[["op",{"apply.queue_time_us":276,"apply.run_cpu_time_us":1778,"apply.run_wall_time_us":1778,"num_ops":3,"prepare.queue_time_us":136795,"prepare.run_cpu_time_us":2848,"prepare.run_wall_time_us":7358,"replication_time_us":2500,"thread_start_us":115572,"threads_started":1}]]}
I20260709 12:24:24.798182  6111 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:24.798791  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:24.801783  5966 raft_consensus.cc:3055] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:24.802096  5966 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:24.804085  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:24.804633  6041 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.805027  6117 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:24.802955  5966 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:24.807296  5966 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:24.819299  6041 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:24.820722  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:24.821950  7521 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:24.822747  7521 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:24.823545  7521 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:24.824270  5966 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:24.824678  6040 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:24.827340  5963 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:24.828475  6081 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:24.829276  7360 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:24.829733  7360 raft_consensus.cc:697] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:24.830826  7360 consensus_queue.cc:237] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:24.829751  5864 catalog_manager.cc:5697] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65), VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66), VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67), VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:24.839139  5864 catalog_manager.cc:5697] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 2 to 3, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 3 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:24:24.846341  6117 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:24.843540  6110 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:24.849494  6118 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:24.853457  7423 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:24.840500  5864 catalog_manager.cc:5697] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:24:24.883656  6645 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:24.886683  7507 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:24.896971  6040 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:24.899215  5862 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 3 to 4, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 4 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:24.901978  5862 catalog_manager.cc:5697] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.904250  5862 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 1 to 2, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 2 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:24.916806  7507 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:24.931028  6643 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:24.933220  7429 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:24.935578  6041 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:24.943077  5966 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:24.946345  7429 raft_consensus.cc:2955] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:24.950057  7497 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:24.952716  7473 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:24.953692  6643 raft_consensus.cc:2955] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:24.985268  6035 raft_consensus.cc:2955] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:25.003998  5963 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:24.997961  5864 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 3 to 2, term changed from 1 to 3, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from VOTER to NON_VOTER, now has a pending config: VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65), VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66), VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67), VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:25.025233  5864 catalog_manager.cc:5697] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 2 to 3, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:25.027137  5864 catalog_manager.cc:5697] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 2, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:25.030233  5853 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 12ca0d61cb524660bae3b43f9f1c5389 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:25.016589  7360 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
W20260709 12:24:25.120343  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 51753.4us
I20260709 12:24:25.121024  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35576
I20260709 12:24:25.122053  6118 raft_consensus.cc:606] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Received request to transfer leadership
I20260709 12:24:25.128042  5862 catalog_manager.cc:5697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 2 to 3, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 3 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.130041  5862 catalog_manager.cc:5697] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 2 to 3, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 3 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:25.150758  6040 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:25.160862  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35576
I20260709 12:24:25.161634  6118 raft_consensus.cc:606] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Received request to transfer leadership
W20260709 12:24:25.202415  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 64673us
W20260709 12:24:25.215930  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 91306.5us
W20260709 12:24:25.218509  5853 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for c087bb99e3b64274863f583bf7ae435f already in progress [suppressed 2 similar messages]
I20260709 12:24:25.221598  6036 raft_consensus.cc:2955] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:25.244901  7360 raft_consensus.cc:2955] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:24:25.209460  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 83389.8us
I20260709 12:24:25.303372  6117 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:25.319308  5863 catalog_manager.cc:5697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New cstate: current_term: 1 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:25.323153  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 97620.1us
I20260709 12:24:25.340351  6647 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:25.358530  5955 tablet_service.cc:1558] Processing DeleteTablet for tablet 12ca0d61cb524660bae3b43f9f1c5389 with delete_type TABLET_DATA_TOMBSTONED (TS f1bb8e63c2b448cdafd51f05d277c741 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34548
I20260709 12:24:25.361853  6112 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:25.365694  6038 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:25.369277  5962 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:25.371613  7479 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:25.373102  6112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35576
I20260709 12:24:25.373697  6112 raft_consensus.cc:606] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Received request to transfer leadership
I20260709 12:24:25.381157  6647 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:25.382889  7507 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:25.389200  5863 catalog_manager.cc:5697] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index 5 to 6, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:25.397861  7513 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:25.412554  6110 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:25.415333  7473 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:24:25.429862  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 105229us
I20260709 12:24:25.459141  5956 tablet_service.cc:1558] Processing DeleteTablet for tablet 5744a277c5a3409b95831573168daf3f with delete_type TABLET_DATA_TOMBSTONED (TS f1bb8e63c2b448cdafd51f05d277c741 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:34548
I20260709 12:24:25.459775  7314 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:25.459904  7497 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:25.472172  5965 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:25.484766  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 47118.6us
I20260709 12:24:25.486627  5853 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5744a277c5a3409b95831573168daf3f with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:25.491201  7616 tablet_replica.cc:333] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:24:25.490573  6645 raft_consensus.cc:2955] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:25.515898  6643 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:25.491654  7429 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:24:25.519958  6037 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:25.521996  7507 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:24:25.586846  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 58319.1us
W20260709 12:24:25.600800  7613 log.cc:927] Time spent T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 12:24:25.601492  5914 auto_rebalancer.cc:893] Removing replace marker failed: Service unavailable: leader transfer in progress
W20260709 12:24:25.601882  5914 auto_rebalancer.cc:901] Could not move replica: Remote error: Service unavailable: leadership transfer for c087bb99e3b64274863f583bf7ae435f already in progress
W20260709 12:24:25.602180  5914 auto_rebalancer.cc:330] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for c087bb99e3b64274863f583bf7ae435f already in progress
W20260709 12:24:25.603964  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 94232.5us
I20260709 12:24:25.621631  7603 raft_consensus.cc:993] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:24:25.596896  7615 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.020s
I20260709 12:24:25.714622  5965 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:25.719576  5962 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20260709 12:24:25.715875  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 95753.6us
I20260709 12:24:25.731045  7608 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.024s
I20260709 12:24:25.733831  7611 raft_consensus.cc:1081] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:24:25.760536  7614 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:25.761106  7429 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:24:25.796638  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 83323.6us
I20260709 12:24:25.808998  7616 raft_consensus.cc:2243] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:25.809546  7603 raft_consensus.cc:2955] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:25.816829  5961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:34550
I20260709 12:24:25.817476  5961 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:25.817839  5961 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:25.818953  7616 raft_consensus.cc:2272] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:24:25.825495  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 206285us
I20260709 12:24:25.832010  7616 ts_tablet_manager.cc:1916] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:24:25.857568  7620 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.258s	user 0.006s	sys 0.004s
I20260709 12:24:25.878360  5961 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:25.888144  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:25.897871  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:25.898814  5961 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:25.908290  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:24:25.963526  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 53756.9us
W20260709 12:24:26.028656  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 63911.3us
W20260709 12:24:26.043695  7595 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:24:26.037882  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:24:26.103813  7618 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.066s	user 0.001s	sys 0.000s
I20260709 12:24:26.164790  5963 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:26.181859  5963 raft_consensus.cc:2955] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:26.167786  7598 consensus_queue.cc:1059] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.4, Next index: 5, Last known committed idx: 2, Time since last communication: 0.001s
W20260709 12:24:26.221527  7621 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.470s	user 0.003s	sys 0.000s
I20260709 12:24:26.238775  7330 raft_consensus.cc:2955] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:24:26.250720  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 282390us
W20260709 12:24:26.426865  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 116532us
W20260709 12:24:26.437263  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 131810us
W20260709 12:24:26.448163  7642 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.271s	user 0.002s	sys 0.000s
I20260709 12:24:26.427220  7647 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:24:26.440078  7622 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:24:26.482442  5934 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:26.528674  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 102484us
W20260709 12:24:26.435807  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 119370us
W20260709 12:24:26.554189  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 85043.3us
I20260709 12:24:26.547125  7655 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.555842  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1004) took 1031 ms. Trace:
I20260709 12:24:26.484815  7647 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:26.593530  7648 log.cc:927] Time spent T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.413s	user 0.001s	sys 0.002s
W20260709 12:24:26.598426  7634 log.cc:927] Time spent T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.545s	user 0.002s	sys 0.000s
I20260709 12:24:26.576891  6037 rpcz_store.cc:276] 0709 12:24:25.524590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.525521 (+   931us) service_pool.cc:224] Handling call
0709 12:24:25.525814 (+   293us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:25.526185 (+   371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:25.526222 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:25.543986 (+ 17764us) log.cc:844] Serialized 26 byte log entry
0709 12:24:26.194097 (+650111us) spinlock_profiling.cc:243] Waited 3.79 ms on lock 0x7b18003c4900. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:24:26.431603 (+237506us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:26.434913 (+  3310us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:26.442118 (+  7205us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:26.484441 (+ 42323us) raft_consensus.cc:1685] finished
0709 12:24:26.484460 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:26.552380 (+ 67920us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":931,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":67145,"spinlock_wait_cycles":8710528,"thread_start_us":120095,"threads_started":1,"wal-append.queue_time_us":884568}
I20260709 12:24:26.627640  6643 raft_consensus.cc:2955] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 3 to 5, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:26.628605  7643 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:26.629190  7643 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:26.632289  7643 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:26.646315  7647 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:26.672144  6112 raft_consensus.cc:3055] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:26.672590  6112 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:24:26.673636  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51063.8us
I20260709 12:24:26.698591  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:26.689421  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:26.707188  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:26.748993  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:26.749356  6112 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:26.760706  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:26.766095  7616 ts_tablet_manager.cc:1929] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:26.772552  7616 log.cc:1199] T 12ca0d61cb524660bae3b43f9f1c5389 P f1bb8e63c2b448cdafd51f05d277c741: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/wals/12ca0d61cb524660bae3b43f9f1c5389
I20260709 12:24:26.773808  7616 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34548 (request call id 76) took 1417 ms. Trace:
I20260709 12:24:26.774173  7616 rpcz_store.cc:276] 0709 12:24:25.356178 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.358234 (+  2056us) service_pool.cc:224] Handling call
0709 12:24:25.490838 (+132604us) ts_tablet_manager.cc:1151] Deleting tablet 12ca0d61cb524660bae3b43f9f1c5389
0709 12:24:25.490939 (+   101us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:24:26.425679 (+934740us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:26.765936 (+340257us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:26.773718 (+  7782us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":219457,"tablet-delete.queue_time_us":124980,"thread_start_us":96226,"threads_started":1}
I20260709 12:24:26.775727  5850 catalog_manager.cc:5028] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): tablet 12ca0d61cb524660bae3b43f9f1c5389 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:26.769521  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:26.782823  7616 tablet_replica.cc:333] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
W20260709 12:24:26.761891  7666 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.003s
I20260709 12:24:26.800897  5934 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:26.801721  7320 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.795171  5965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:24:26.804447  5965 raft_consensus.cc:606] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:26.808439  6038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:26.809023  6038 raft_consensus.cc:606] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:26.812213  6009 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:26.812245  6038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:26.812963  6038 raft_consensus.cc:606] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:26.813268  7330 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35576 (request call id 75) took 1694 ms. Trace:
I20260709 12:24:26.814291  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:26.815970  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:26.816736  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:26.822052  7619 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:26.823995  6112 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:26.825222  7423 raft_consensus.cc:993] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:26.827384  5962 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:26.830993  7423 raft_consensus.cc:1081] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:26.832024  5865 catalog_manager.cc:5697] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 3 to 5, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:26.813678  7330 rpcz_store.cc:276] 0709 12:24:25.119213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.119704 (+   491us) service_pool.cc:224] Handling call
0709 12:24:25.207859 (+ 88155us) spinlock_profiling.cc:243] Waited 44.3 ms on lock 0x7b54000850a0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fd1520 00007f482105ab42 00007f4821059800 00007f48210529fa 00007f482601a4c9 00007f481f596c54 00007f481f596be2 00007f481f596b11 00007f481f596a8c 00007f481f595d42
0709 12:24:25.301591 (+ 93732us) spinlock_profiling.cc:243] Waited 5.94 ms on lock 0x7b54000850a0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fd14b1 00007f4821059863 00007f48210529fa 00007f482601a4c9 00007f481f596c54 00007f481f596be2 00007f481f596b11 00007f481f596a8c 00007f481f595d42 00007f481f38f48c
0709 12:24:25.305839 (+  4248us) log.cc:844] Serialized 494 byte log entry
0709 12:24:26.813178 (+1507339us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":30873,"raft.queue_time_us":43692,"raft.run_cpu_time_us":1320,"raft.run_wall_time_us":43430,"spinlock_wait_cycles":115614720,"thread_start_us":140364,"threads_started":1,"wal-append.queue_time_us":185884,"wal-append.run_cpu_time_us":2215,"wal-append.run_wall_time_us":1122381}
I20260709 12:24:26.843026  5853 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet bd91034e550f4704be7f47b7aff3ed25 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:26.851416  6118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35596
I20260709 12:24:26.852005  6118 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:26.852365  6118 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.857120  5863 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65), VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66), VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67), VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:26.860775  6118 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:26.864941  6112 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:26.872421  7624 raft_consensus.cc:993] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:26.873051  7624 raft_consensus.cc:1081] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:26.876195  6118 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:26.880756  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:26.906754  5966 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.908538  6044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36266
I20260709 12:24:26.909133  6044 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:26.909467  6044 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.882804  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:26.904927  7616 raft_consensus.cc:2243] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:26.915036  7616 raft_consensus.cc:2272] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:26.918123  7616 ts_tablet_manager.cc:1916] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:26.910777  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 1352) took 1002 ms. Trace:
I20260709 12:24:26.922855  6035 raft_consensus.cc:3055] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:26.923332  6035 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:26.927758  6035 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:26.928921  6035 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:26.922752  6112 rpcz_store.cc:276] 0709 12:24:25.907964 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.908066 (+   102us) service_pool.cc:224] Handling call
0709 12:24:26.713611 (+805545us) spinlock_profiling.cc:243] Waited 1.46 ms on lock 0x7b540014d320. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fd206f 00007f482104af60 00007f482104c7de 00007f482105827c 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2
0709 12:24:26.823562 (+109951us) spinlock_profiling.cc:243] Waited 31.6 ms on lock 0x7b580039d1d0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fb00aa 00007f4821032447 00007f482104afe7 00007f482104c7de 00007f482105827c 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c
0709 12:24:26.910599 (+ 87037us) spinlock_profiling.cc:243] Waited 763 ms on lock 0x7b54000910d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:26.910700 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1831193600}
I20260709 12:24:26.924000  6044 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:26.925215  5966 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:26.933606  6081 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:26.934652  7330 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:26.935153  7330 raft_consensus.cc:697] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:26.936204  7330 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:26.940805  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:26.950556  5966 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:26.954608  5966 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:26.955657  5966 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:26.958381  5966 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.959348  6035 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:26.962512  6044 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:26.963472  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:26.964083  6118 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:26.977800  5966 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:26.985230  6118 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:26.985776  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:26.988721  7501 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:26.989187  7501 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:26.989950  7501 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:26.993784  7566 raft_consensus.cc:993] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:24:26.994249  7566 raft_consensus.cc:1081] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:24:26.999478  5966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:34558
I20260709 12:24:27.000221  5966 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:27.003607  5966 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.013756  7616 ts_tablet_manager.cc:1929] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:24:27.018411  7616 log.cc:1199] T 5744a277c5a3409b95831573168daf3f P f1bb8e63c2b448cdafd51f05d277c741: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/wals/5744a277c5a3409b95831573168daf3f
I20260709 12:24:27.019658  7616 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34548 (request call id 77) took 1590 ms. Trace:
I20260709 12:24:27.020107  7616 rpcz_store.cc:276] 0709 12:24:25.429484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:25.458813 (+ 29329us) service_pool.cc:224] Handling call
0709 12:24:26.780005 (+1321192us) ts_tablet_manager.cc:1151] Deleting tablet 5744a277c5a3409b95831573168daf3f
0709 12:24:26.782537 (+  2532us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:24:26.946247 (+163710us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:27.013616 (+ 67369us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:27.019595 (+  5979us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":117216,"tablet-delete.queue_time_us":1315821}
I20260709 12:24:27.021713  5850 catalog_manager.cc:5028] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): tablet 5744a277c5a3409b95831573168daf3f (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:27.035454  5966 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:27.037122  5966 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:27.038141  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:27.038770  6111 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.042145  6025 tablet_service.cc:1558] Processing DeleteTablet for tablet bd91034e550f4704be7f47b7aff3ed25 with delete_type TABLET_DATA_TOMBSTONED (TS 0557a7246c8945b99e5215c99d4ddf9c not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:36246
I20260709 12:24:27.043458  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:27.044039  6038 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:27.044315  6038 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:27.046322  6111 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:27.047678  5934 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:27.048555  7624 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:27.049216  7624 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:27.050805  7624 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:27.044986  6038 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:27.053318  6038 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:27.074261  6038 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:27.113032  7676 tablet_replica.cc:333] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:24:27.125562  5864 catalog_manager.cc:5697] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:27.124188  5862 catalog_manager.cc:5697] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 2 to 3, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 3 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.132959  7676 raft_consensus.cc:2243] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:27.138690  7676 raft_consensus.cc:2272] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:27.144780  7676 ts_tablet_manager.cc:1916] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:27.185285  5865 catalog_manager.cc:5697] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 4, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 4 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:27.223754  7676 ts_tablet_manager.cc:1929] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.4
I20260709 12:24:27.224300  7676 log.cc:1199] T bd91034e550f4704be7f47b7aff3ed25 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/wals/bd91034e550f4704be7f47b7aff3ed25
I20260709 12:24:27.226384  5851 catalog_manager.cc:5028] TS 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): tablet bd91034e550f4704be7f47b7aff3ed25 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:27.373792  6112 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:27.374701  6037 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:27.375566  7638 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:27.376412  7663 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:27.448189  5962 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:27.449693  7664 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:27.503652  5962 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:27.505452  7663 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:27.592072  6110 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:27.593910  7624 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:27.607199  6037 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:27.609408  7600 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:28.127493  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:28.140866  7571 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:28.141552  7571 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:28.163905  7571 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:28.259961  7638 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:28.260617  7638 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:28.263697  7638 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:28.265215  7320 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:28.265837  7320 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:28.268945  7320 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:28.283355  6038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38df61ba407240499023581d9f885037"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:28.284005  6038 raft_consensus.cc:606] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:28.292240  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:28.292873  6038 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:28.304363  5966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:24:28.304993  5966 raft_consensus.cc:606] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:28.316838  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:28.317602  5966 raft_consensus.cc:2393] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:28.325246  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:28.325949  6645 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:28.331867  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:28.332543  6112 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:28.341454  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:28.342238  5966 raft_consensus.cc:2393] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:24:28.346109  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 73721.2us
I20260709 12:24:28.359843  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:28.360586  6645 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:28.369529  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:28.370411  6112 raft_consensus.cc:2393] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:28.393671  6112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:28.396229  6112 raft_consensus.cc:606] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Received request to transfer leadership to TS 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:28.416039  6038 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:28.429453  7603 raft_consensus.cc:993] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:24:28.432845  7663 raft_consensus.cc:1081] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Signalling peer 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:24:28.436583  6645 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:50472
I20260709 12:24:28.437284  6645 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:28.437741  6645 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:28.471868  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 63492.4us
I20260709 12:24:28.474236  5966 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:28.475111  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:28.475718  6044 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
W20260709 12:24:28.483100  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 79249.7us
I20260709 12:24:28.483799  5934 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:28.489401  6009 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:28.491230  7638 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:28.503607  7638 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:28.515441  7582 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:28.516011  7582 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:28.516422  7582 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:28.529903  7582 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:28.537580  7582 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:28.542186  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 58470.9us
I20260709 12:24:28.549691  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:28.550448  6112 raft_consensus.cc:2393] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:28.555907  7664 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:28.563185  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 49152.1us
I20260709 12:24:28.580070  6645 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:28.582794  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:28.583366  6038 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:28.590451  6038 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:28.591603  6609 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:28.592439  7571 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:28.592944  7571 raft_consensus.cc:697] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:28.593816  7571 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:28.609104  6009 consensus_peers.cc:597] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b1b3ddf896ce40f5b9c2632735843215. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:28.609910  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:28.610044  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:28.612486  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:28.614914  6112 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:28.614527  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:28.616268  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:28.614421  6611 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:28.617636  6643 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:24:28.619019  6645 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:28.644807  6118 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:28.651173  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:28.651844  6118 raft_consensus.cc:3055] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:28.652175  6118 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:28.653146  6118 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:28.654386  6118 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:28.661119  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 44773.6us
W20260709 12:24:28.662045  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 48679.3us
I20260709 12:24:28.665346  6118 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:28.681139  6112 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
W20260709 12:24:28.688205  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 69027.8us
W20260709 12:24:28.741475  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 109688us
W20260709 12:24:28.746407  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 44112.6us
I20260709 12:24:28.758342  5865 catalog_manager.cc:5697] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 1 to 2, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 2 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:28.767143  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 102483us
I20260709 12:24:28.782236  7708 raft_consensus.cc:993] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:28.783644  7708 raft_consensus.cc:1081] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:28.809163  6643 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:28.810602  7629 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:28.812642  5934 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:28.813987  7697 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:28.814577  7697 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:28.815577  7697 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:28.789975  7705 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:24:28.853150  7693 raft_consensus.cc:2955] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:28.871539  5965 raft_consensus.cc:2955] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:28.872155  6037 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
W20260709 12:24:28.878654  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 98750.9us
I20260709 12:24:28.890642  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:28.891258  6044 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:28.897781  6044 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:28.898320  5965 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:28.900327  7693 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:28.907723  6112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38df61ba407240499023581d9f885037"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35596
I20260709 12:24:28.908263  6112 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:28.908607  6112 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:28.910929  5862 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 3 to 2, term changed from 3 to 5, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from VOTER to NON_VOTER, now has a pending config: VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65), VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66), VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67), VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } } pending_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:28.921164  6113 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:24:28.925522  6112 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:28.927476  6111 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:28.934288  6009 consensus_peers.cc:597] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1d97a0d1272049469a8fe2111554686a. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:28.937738  6112 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:28.938158  7582 raft_consensus.cc:993] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:28.938839  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:28.939468  6647 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:28.939693  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:28.941835  6037 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:28.942198  6037 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:28.943277  7582 raft_consensus.cc:1081] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:28.944017  6037 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:28.949611  6037 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:28.948844  6647 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:28.955862  6084 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:28.956768  7690 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:28.957283  7690 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:28.958160  7690 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:28.968885  7705 raft_consensus.cc:2955] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:28.977890  6643 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:28.982645  6038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36266
I20260709 12:24:28.983237  6038 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:28.983587  6038 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:28.992936  7714 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:28.985476  5965 raft_consensus.cc:2955] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:29.001545  5962 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:28.998157  5864 catalog_manager.cc:5697] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:28.989933  6038 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:28.969996  6037 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:29.010397  6038 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:29.011082  6118 raft_consensus.cc:2955] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:29.012190  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:29.013533  5959 raft_consensus.cc:3055] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:29.013810  5959 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:29.017557  6111 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:29.019373  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:29.019944  6111 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:29.016460  5959 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:29.029999  5959 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:29.026516  7629 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.005s
I20260709 12:24:29.035480  6111 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:29.036381  5959 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:29.039146  6006 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:29.046267  6041 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:29.048367  7711 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:29.049022  7711 raft_consensus.cc:697] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:24:29.051450  5934 consensus_peers.cc:597] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0468d70863214876bf59fb3ea9474307. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:29.057997  6114 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:29.071318  7697 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:29.076910  7702 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:29.098651  7724 ts_tablet_manager.cc:933] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:29.049894  7711 consensus_queue.cc:237] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:29.101424  6038 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:29.110152  6112 raft_consensus.cc:2955] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:29.112527  7724 tablet_copy_client.cc:323] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:24:29.117529  5862 catalog_manager.cc:5697] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 4, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 3 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:29.120257  5864 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:29.109727  7629 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:24:29.134704  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet b1b3ddf896ce40f5b9c2632735843215 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:24:29.138593  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet b1b3ddf896ce40f5b9c2632735843215 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-b1b3ddf896ce40f5b9c2632735843215
I20260709 12:24:29.170607  6054 tablet_copy_source_session.cc:215] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:29.179514  5865 catalog_manager.cc:5697] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 1 to 2, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 2 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:29.192015  7724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b1b3ddf896ce40f5b9c2632735843215. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:29.226859  6037 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:29.233788  7320 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:24:29.243041  7725 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:24:29.246357  7731 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:29.250319  7702 raft_consensus.cc:2955] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:29.252140  6041 raft_consensus.cc:2955] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:29.257380  6113 raft_consensus.cc:2955] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:29.269707  6038 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:29.310788  6118 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:29.312072  5962 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:29.312264  7687 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:29.321765  7724 tablet_copy_client.cc:806] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:29.325950  7724 tablet_copy_client.cc:670] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:29.330413  7724 tablet_copy_client.cc:538] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:29.331568  6118 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:29.335444  7619 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:24:29.341256  6009 consensus_peers.cc:597] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1956c0a3a799470a83a524ca2ae0ce14. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:29.346747  7711 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:29.317642  5865 catalog_manager.cc:5697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:29.362897  7724 tablet_bootstrap.cc:492] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:29.364785  7711 raft_consensus.cc:2955] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:29.365501  5864 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER, no longer has a pending config: VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65), VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66), VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67), VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:29.380004  7320 raft_consensus.cc:2955] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:29.381441  6112 raft_consensus.cc:2955] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:29.406931  6042 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:29.412122  7690 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:29.435878  5862 catalog_manager.cc:5697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:29.447973  5962 raft_consensus.cc:2955] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:29.450846  6643 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:29.453511  7703 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:29.477687  7724 tablet_bootstrap.cc:492] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:29.478694  7724 tablet_bootstrap.cc:492] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:29.481137  7747 ts_tablet_manager.cc:933] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:29.486876  6645 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:29.488449  7702 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:29.479414  7724 ts_tablet_manager.cc:1403] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.117s	user 0.014s	sys 0.010s
I20260709 12:24:29.550674  7724 raft_consensus.cc:359] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:29.553543  7724 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:29.554296  7724 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:29.562683  6643 raft_consensus.cc:1217] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:29.563674  7724 ts_tablet_manager.cc:1434] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.072s	user 0.010s	sys 0.005s
I20260709 12:24:29.566529  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-b1b3ddf896ce40f5b9c2632735843215 received from {username='slave'} at 127.0.0.1:60122
I20260709 12:24:29.567025  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-b1b3ddf896ce40f5b9c2632735843215 on tablet b1b3ddf896ce40f5b9c2632735843215 with peer 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:29.574303  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 121190us
I20260709 12:24:29.580165  6112 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:29.587112  5966 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:29.588681  7619 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:29.596413  7747 tablet_copy_client.cc:323] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:24:29.598014  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet 1d97a0d1272049469a8fe2111554686a from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:24:29.598582  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet 1d97a0d1272049469a8fe2111554686a from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-1d97a0d1272049469a8fe2111554686a
I20260709 12:24:29.612716  6054 tablet_copy_source_session.cc:215] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:29.616175  7747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1d97a0d1272049469a8fe2111554686a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:29.619351  7724 ts_tablet_manager.cc:933] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:24:29.664252  7619 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:29.663126  7724 tablet_copy_client.cc:323] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.65:42981
I20260709 12:24:29.667268  5978 tablet_copy_service.cc:140] P f1bb8e63c2b448cdafd51f05d277c741: Received BeginTabletCopySession request for tablet 0468d70863214876bf59fb3ea9474307 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:37174)
I20260709 12:24:29.667829  5978 tablet_copy_service.cc:161] P f1bb8e63c2b448cdafd51f05d277c741: Beginning new tablet copy session on tablet 0468d70863214876bf59fb3ea9474307 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:37174: session id = 24012af7747d4c4ea89c3da2ff950099-0468d70863214876bf59fb3ea9474307
I20260709 12:24:29.673483  7747 tablet_copy_client.cc:806] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:29.674093  7747 tablet_copy_client.cc:670] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:29.680364  5978 tablet_copy_source_session.cc:215] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:29.689903  7747 tablet_copy_client.cc:538] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:29.691425  7724 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0468d70863214876bf59fb3ea9474307. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:29.726876  7747 tablet_bootstrap.cc:492] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:29.729148  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:29.731886  7724 tablet_copy_client.cc:806] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:29.732530  7724 tablet_copy_client.cc:670] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:29.737708  7724 tablet_copy_client.cc:538] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:29.782292  7753 ts_tablet_manager.cc:933] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:29.796334  7724 tablet_bootstrap.cc:492] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:29.811877  7753 tablet_copy_client.cc:323] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:24:29.813776  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet 1956c0a3a799470a83a524ca2ae0ce14 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:24:29.814263  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet 1956c0a3a799470a83a524ca2ae0ce14 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-1956c0a3a799470a83a524ca2ae0ce14
I20260709 12:24:29.821076  6054 tablet_copy_source_session.cc:215] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:29.833849  7753 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1956c0a3a799470a83a524ca2ae0ce14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:29.863034  7724 tablet_bootstrap.cc:492] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:29.864121  7724 tablet_bootstrap.cc:492] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:29.864876  7724 ts_tablet_manager.cc:1403] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.069s	user 0.024s	sys 0.003s
I20260709 12:24:29.870988  7747 tablet_bootstrap.cc:492] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:29.879518  7747 tablet_bootstrap.cc:492] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:29.881093  7747 ts_tablet_manager.cc:1403] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.154s	user 0.022s	sys 0.006s
I20260709 12:24:29.882081  6042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:29.867976  7724 raft_consensus.cc:359] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:29.882779  6042 raft_consensus.cc:606] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:29.882815  7724 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:29.885710  7724 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:29.886472  5962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:24:29.887108  5962 raft_consensus.cc:606] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:29.887270  7747 raft_consensus.cc:359] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:29.896409  6042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cf28639931bb43a58703f0afd043e166"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:29.908543  6042 raft_consensus.cc:606] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:29.910089  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:30.045148  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:30.046808  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:29.910181  7747 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:30.002351  7724 ts_tablet_manager.cc:1434] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.137s	user 0.033s	sys 0.053s
I20260709 12:24:30.144485  7747 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:30.183097  7747 ts_tablet_manager.cc:1434] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.302s	user 0.010s	sys 0.000s
I20260709 12:24:30.013087  7753 tablet_copy_client.cc:806] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:30.222671  7753 tablet_copy_client.cc:670] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:30.254897  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-1d97a0d1272049469a8fe2111554686a received from {username='slave'} at 127.0.0.1:60122
I20260709 12:24:30.255638  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-1d97a0d1272049469a8fe2111554686a on tablet 1d97a0d1272049469a8fe2111554686a with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:30.290871  5978 tablet_copy_service.cc:342] P f1bb8e63c2b448cdafd51f05d277c741: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-0468d70863214876bf59fb3ea9474307 received from {username='slave'} at 127.0.0.1:37174
I20260709 12:24:30.291546  5978 tablet_copy_service.cc:434] P f1bb8e63c2b448cdafd51f05d277c741: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-0468d70863214876bf59fb3ea9474307 on tablet 0468d70863214876bf59fb3ea9474307 with peer 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:30.380249  5850 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress
I20260709 12:24:30.390568  7711 raft_consensus.cc:993] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:24:30.390957  7753 tablet_copy_client.cc:538] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:30.391194  7711 raft_consensus.cc:1081] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
W20260709 12:24:30.432112  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 58622.7us
I20260709 12:24:30.451656  5966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cf28639931bb43a58703f0afd043e166"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:34558
I20260709 12:24:30.452414  5966 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:30.452913  5966 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:30.464473  5850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 84360.4us
I20260709 12:24:30.496626  5966 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:30.504326  5850 catalog_manager.cc:4755] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): ChangeConfig:REMOVE_PEER RPC failed for tablet c087bb99e3b64274863f583bf7ae435f: Remote error: Service unavailable: leader transfer in progress
I20260709 12:24:30.513909  6645 raft_consensus.cc:1217] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:30.531162  6645 raft_consensus.cc:1217] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4]   Dedup: 3.4->[]
I20260709 12:24:30.544864  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:30.545672  6038 raft_consensus.cc:3055] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:30.545987  6038 raft_consensus.cc:740] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:24:30.547102  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 74802.3us
I20260709 12:24:30.550851  6038 consensus_queue.cc:260] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:30.554677  6038 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:30.551445  7753 tablet_bootstrap.cc:492] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:30.561908  7761 raft_consensus.cc:993] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:30.562523  7761 raft_consensus.cc:1081] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:30.540059  5966 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:30.589613  7766 raft_consensus.cc:993] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:30.583250  6038 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:30.595661  7766 raft_consensus.cc:1081] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:30.600602  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:30.601251  6643 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:30.609676  6643 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:30.624482  5934 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:30.625384  7778 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:30.625880  7778 raft_consensus.cc:697] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:30.626847  7778 consensus_queue.cc:237] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:30.633430  6112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35596
I20260709 12:24:30.633999  6112 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:30.634339  6112 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:30.640555  7770 raft_consensus.cc:1064] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:30.648972  6041 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36266
I20260709 12:24:30.649631  6041 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:30.650013  6041 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:30.651652  7770 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:30.668227  6112 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:30.679373  6041 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:30.693037  6118 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:30.693288  5865 catalog_manager.cc:5697] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:30.704165  6112 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:30.705216  7711 raft_consensus.cc:1064] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:30.705329  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:30.705969  6038 raft_consensus.cc:3055] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:30.706274  6038 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:30.706972  6038 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:30.708002  6038 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:30.711292  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:30.711952  5965 raft_consensus.cc:3055] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:30.712240  5965 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:30.713068  5965 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:30.714293  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:30.714993  5966 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:30.715194  5965 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:30.718158  7711 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:30.723220  5967 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:30.725368  7770 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:30.730090  6038 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:24:30.739104  6082 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:30.740063  7744 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:30.740509  7744 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:30.741346  7744 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:30.750078  7753 tablet_bootstrap.cc:492] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:30.750275  6643 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:30.751125  7753 tablet_bootstrap.cc:492] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:30.736657  5965 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:24:30.752107  6112 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:30.737823  6041 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:30.755963  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:30.756493  6643 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:30.759523  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:30.760164  6112 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:30.766570  5966 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:24:30.792514  7753 ts_tablet_manager.cc:1403] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.241s	user 0.026s	sys 0.032s
I20260709 12:24:30.774065  7766 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.025s
W20260709 12:24:30.775810  5850 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c087bb99e3b64274863f583bf7ae435f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica f1bb8e63c2b448cdafd51f05d277c741 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:24:30.823431  5850 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 57891.9us
I20260709 12:24:30.832072  7771 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:24:30.889298  6643 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:24:30.882364  7753 raft_consensus.cc:359] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:30.900738  5862 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 4 to 5, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 5 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:30.917591  6112 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:24:30.900784  7753 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
W20260709 12:24:30.952227  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 120262us
I20260709 12:24:30.986227  6009 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:30.987285  7788 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:30.988036  7788 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:30.991643  7788 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:30.995388  6113 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:30.971067  7753 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:31.005725  7753 ts_tablet_manager.cc:1434] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.189s	user 0.004s	sys 0.004s
I20260709 12:24:31.008281  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-1956c0a3a799470a83a524ca2ae0ce14 received from {username='slave'} at 127.0.0.1:60122
I20260709 12:24:31.008708  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-1956c0a3a799470a83a524ca2ae0ce14 on tablet 1956c0a3a799470a83a524ca2ae0ce14 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:31.029328  5963 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:31.031798  7711 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:31.039422  7778 raft_consensus.cc:1064] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:31.040349  6645 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:31.050745  7770 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:31.060796  6647 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:31.042196  7778 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:31.071735  7770 raft_consensus.cc:2955] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:24:31.078305  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 64368.4us
I20260709 12:24:31.086489  6643 raft_consensus.cc:2955] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.095456  6041 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:31.097652  7788 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:31.100664  7763 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:31.101751  5967 raft_consensus.cc:2955] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.101606  7746 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:24:31.116343  7765 raft_consensus.cc:2955] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.127928  6643 raft_consensus.cc:2955] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.132165  6118 raft_consensus.cc:2955] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.154840  5863 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 5 to 6, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 6 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:31.174589  5967 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:31.176944  7769 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:31.179538  6647 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:31.181816  7746 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:31.187000  6038 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:31.199154  7763 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:31.215478  6112 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:31.215909  5967 raft_consensus.cc:2955] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.238687  5866 catalog_manager.cc:5697] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.272575  7702 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.042s
I20260709 12:24:31.331698  5865 catalog_manager.cc:5697] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index 4 to 5, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:31.351658  6114 raft_consensus.cc:2955] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.359977  7763 raft_consensus.cc:2955] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.423823  6037 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:31.426983  7796 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:31.459751  6041 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:31.476034  6038 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:31.496681  5967 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:31.504966  6643 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:31.530786  7770 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:24:31.535358  5965 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:31.539685  7788 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:31.540284  5967 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:31.558883  7788 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:31.561501  7788 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:31.562506  7792 raft_consensus.cc:2955] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.586131  6649 raft_consensus.cc:2955] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.607189  6118 raft_consensus.cc:2955] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.609114  5966 raft_consensus.cc:2955] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.626157  5865 catalog_manager.cc:5697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:31.635433  7823 raft_consensus.cc:2955] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.637022  5963 raft_consensus.cc:2955] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.660343  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1d97a0d1272049469a8fe2111554686a with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
W20260709 12:24:31.660935  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 96479.2us
I20260709 12:24:31.665148  6643 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:31.669895  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:31.688266  6643 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:31.688266  6645 raft_consensus.cc:2955] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.693843  6113 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:31.696668  6642 raft_consensus.cc:1217] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:31.708722  5963 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:31.715178  6042 raft_consensus.cc:2955] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.735249  6118 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:31.742841  5863 catalog_manager.cc:5697] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 5 to 6, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New cstate: current_term: 3 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.745083  6642 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:31.748024  7814 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:31.754731  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet b1b3ddf896ce40f5b9c2632735843215 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:31.755964  7771 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:31.761390  7761 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:31.770742  5863 catalog_manager.cc:5697] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.757761  7788 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:24:31.777181  7771 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:31.793506  7760 raft_consensus.cc:2955] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.802023  6113 raft_consensus.cc:2955] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.828507  6103 tablet_service.cc:1558] Processing DeleteTablet for tablet 1d97a0d1272049469a8fe2111554686a with delete_type TABLET_DATA_TOMBSTONED (TS 0069e2ba1f02412e8e1d6c20a1fb510f not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:35576
I20260709 12:24:31.828835  6106 tablet_service.cc:1558] Processing DeleteTablet for tablet b1b3ddf896ce40f5b9c2632735843215 with delete_type TABLET_DATA_TOMBSTONED (TS 0069e2ba1f02412e8e1d6c20a1fb510f not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:35576
W20260709 12:24:31.835398  5851 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet c087bb99e3b64274863f583bf7ae435f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER failed with leader 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) due to error UNKNOWN_ERROR; will retry: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:31.842981  6642 raft_consensus.cc:2955] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.865916  6645 raft_consensus.cc:2955] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:31.891395  5850 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 0468d70863214876bf59fb3ea9474307 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:31.973281  7828 tablet_replica.cc:333] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:24:31.974210  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:31.975035  6118 raft_consensus.cc:606] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:31.979637  5962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:24:31.980216  5962 raft_consensus.cc:606] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:31.984341  6037 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:31.984892  6037 raft_consensus.cc:606] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Received request to transfer leadership to TS 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:31.991873  7828 raft_consensus.cc:2243] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:31.994622  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:31.995437  7828 raft_consensus.cc:2272] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:31.996330  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:31.997118  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:32.009027  7828 ts_tablet_manager.cc:1916] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:32.012279  5863 catalog_manager.cc:5697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 3 to 4, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:24:32.033263  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52876.3us
I20260709 12:24:32.057595  6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 0468d70863214876bf59fb3ea9474307 with delete_type TABLET_DATA_TOMBSTONED (TS 0557a7246c8945b99e5215c99d4ddf9c not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:36246
I20260709 12:24:32.081730  7821 raft_consensus.cc:993] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:24:32.082300  7821 raft_consensus.cc:1081] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Signalling peer 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:24:32.085830  6643 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:50454
I20260709 12:24:32.086412  6643 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:32.086817  6643 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:32.073267  7828 ts_tablet_manager.cc:1929] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20260709 12:24:32.094843  7828 log.cc:1199] T 1d97a0d1272049469a8fe2111554686a P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/wals/1d97a0d1272049469a8fe2111554686a
I20260709 12:24:32.096747  7828 tablet_replica.cc:333] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:24:32.097070  5853 catalog_manager.cc:5028] TS 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): tablet 1d97a0d1272049469a8fe2111554686a (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:32.097808  7828 raft_consensus.cc:2243] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:32.115717  7828 raft_consensus.cc:2272] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:32.117101  6643 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:32.125193  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:32.125378  7828 ts_tablet_manager.cc:1916] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:32.125891  5966 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:32.100232  7830 tablet_replica.cc:333] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:24:32.142647  7792 raft_consensus.cc:1064] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:32.151103  7814 raft_consensus.cc:993] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:32.151665  7814 raft_consensus.cc:1081] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:32.153050  5966 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:32.153517  6113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:24:32.154268  6113 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:32.154721  6113 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:32.158809  6608 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:32.159822  7775 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:32.160436  7775 raft_consensus.cc:697] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:32.161556  7775 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:32.173745  7828 ts_tablet_manager.cc:1929] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:32.178401  7828 log.cc:1199] T b1b3ddf896ce40f5b9c2632735843215 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/wals/b1b3ddf896ce40f5b9c2632735843215
I20260709 12:24:32.187462  7792 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:32.188230  5853 catalog_manager.cc:5028] TS 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): tablet b1b3ddf896ce40f5b9c2632735843215 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
W20260709 12:24:32.196262  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 54745.9us
I20260709 12:24:32.200827  7830 raft_consensus.cc:2243] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:32.201674  7830 raft_consensus.cc:2272] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:32.208823  7830 ts_tablet_manager.cc:1916] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:32.210208  6113 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:32.220620  6643 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:32.221854  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:32.222636  6042 raft_consensus.cc:3055] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:32.222930  6042 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:32.223708  6042 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:32.224745  6042 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:32.231314  7830 ts_tablet_manager.cc:1929] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:32.232136  7830 log.cc:1199] T 0468d70863214876bf59fb3ea9474307 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/wals/0468d70863214876bf59fb3ea9474307
I20260709 12:24:32.234114  5851 catalog_manager.cc:5028] TS 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): tablet 0468d70863214876bf59fb3ea9474307 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:32.234370  6042 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:32.261488  6113 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:32.265930  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:32.269672  6037 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:32.273950  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:32.274623  5966 raft_consensus.cc:3055] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:32.274926  5966 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:32.291234  5966 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:32.313015  5966 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:32.329871  5962 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:32.340361  7771 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20260709 12:24:32.372875  5863 catalog_manager.cc:5697] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 2 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:32.377416  6037 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:32.382575  6649 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:32.414911  7824 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:32.420442  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:32.421728  7838 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:32.422287  7838 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:32.423254  7838 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:32.429816  6118 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:32.430713  5966 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:32.445037  7769 raft_consensus.cc:993] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:32.445531  7769 raft_consensus.cc:1081] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:32.447201  6037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36260
I20260709 12:24:32.447774  6037 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:32.448148  6037 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:32.474334  6037 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:32.477435  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:32.477651  6037 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:32.478024  5966 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:32.487010  7823 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:32.492432  5863 catalog_manager.cc:5697] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 2, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:32.496418  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:32.497052  6110 raft_consensus.cc:3055] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:32.497344  6110 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:32.499215  5966 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:24:32.501929  7824 raft_consensus.cc:2955] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:32.498071  6110 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:32.504487  6110 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:32.507182  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:32.508044  7826 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:32.508522  7826 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:32.509264  7826 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:32.525882  5962 raft_consensus.cc:2955] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:32.528527  5862 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 5 to 6, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 6 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:32.533242  6645 raft_consensus.cc:2955] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:32.549079  5863 catalog_manager.cc:5697] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:32.529325  6110 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:24:32.569914  6118 raft_consensus.cc:2955] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:32.629914  6037 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:32.635926  6044 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:32.637732  7833 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:32.653406  6118 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:32.654706  6645 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20260709 12:24:32.656646  7824 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:32.658530  7824 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:32.672659  7792 raft_consensus.cc:2955] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:32.683342  6118 raft_consensus.cc:2955] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:32.700870  6645 raft_consensus.cc:2955] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:32.703454  5863 catalog_manager.cc:5697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 3 to 4, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New cstate: current_term: 1 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:32.716949  5966 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:32.717618  5956 tablet_service.cc:1558] Processing DeleteTablet for tablet 1956c0a3a799470a83a524ca2ae0ce14 with delete_type TABLET_DATA_TOMBSTONED (TS f1bb8e63c2b448cdafd51f05d277c741 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:34548
I20260709 12:24:32.719358  7776 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:32.740461  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 1956c0a3a799470a83a524ca2ae0ce14 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:24:32.764815  7845 tablet_replica.cc:333] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:24:32.766059  7845 raft_consensus.cc:2243] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:32.766831  7845 raft_consensus.cc:2272] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:32.776935  7845 ts_tablet_manager.cc:1916] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:32.839303  7845 ts_tablet_manager.cc:1929] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20260709 12:24:32.839746  7845 log.cc:1199] T 1956c0a3a799470a83a524ca2ae0ce14 P f1bb8e63c2b448cdafd51f05d277c741: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/wals/1956c0a3a799470a83a524ca2ae0ce14
I20260709 12:24:32.841490  5850 catalog_manager.cc:5028] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): tablet 1956c0a3a799470a83a524ca2ae0ce14 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:32.871546  6044 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:32.892517  6649 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:32.895255  7792 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:32.897852  6118 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:32.916438  5962 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:32.917999  7836 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:32.905120  7792 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:24:32.953150  5966 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:24:32.957391  7823 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:32.965860  7824 raft_consensus.cc:2955] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:32.980258  6042 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:32.992905  7836 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:33.004598  6649 raft_consensus.cc:2955] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:33.122565  5966 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:24:33.141566  5862 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 3 to 7, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New cstate: current_term: 6 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:33.145457  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet c087bb99e3b64274863f583bf7ae435f with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 8)
I20260709 12:24:33.162719  7792 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:33.195581  5962 raft_consensus.cc:2955] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 3 to 7, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:33.199378  6103 tablet_service.cc:1558] Processing DeleteTablet for tablet c087bb99e3b64274863f583bf7ae435f with delete_type TABLET_DATA_TOMBSTONED (TS 0069e2ba1f02412e8e1d6c20a1fb510f not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:35576
I20260709 12:24:33.216253  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:33.224532  7856 tablet_replica.cc:333] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:24:33.225893  7856 raft_consensus.cc:2243] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:24:33.226711  7856 raft_consensus.cc:2272] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:24:33.245406  7856 ts_tablet_manager.cc:1916] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:24:33.264052  7856 ts_tablet_manager.cc:1929] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
I20260709 12:24:33.264564  7856 log.cc:1199] T c087bb99e3b64274863f583bf7ae435f P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/wals/c087bb99e3b64274863f583bf7ae435f
I20260709 12:24:33.266530  5853 catalog_manager.cc:5028] TS 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): tablet c087bb99e3b64274863f583bf7ae435f (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:24:33.335307  6113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:33.335912  6113 raft_consensus.cc:606] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:33.352133  6113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:33.352804  6113 raft_consensus.cc:606] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:33.362293  6044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:33.362932  6044 raft_consensus.cc:606] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:33.364527  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:33.366201  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:33.366991  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:33.643883  7769 raft_consensus.cc:993] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:24:33.644557  7769 raft_consensus.cc:1081] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:24:33.687413  5962 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:34550
I20260709 12:24:33.688097  5962 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:33.688484  5962 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:33.696312  5962 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:33.742702  7857 raft_consensus.cc:993] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:33.751276  7857 raft_consensus.cc:1081] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:33.816915  5962 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:33.818264  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:33.831552  6113 raft_consensus.cc:3055] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:33.833175  6113 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:24:33.838117  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 76825.9us
I20260709 12:24:33.839123  7792 raft_consensus.cc:993] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:24:33.852700  6113 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:33.858394  7792 raft_consensus.cc:1081] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:24:33.860322  6044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36260
I20260709 12:24:33.867738  6044 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:33.868124  6044 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.876926  6044 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:33.878839  6044 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:33.898995  6113 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:33.913107  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 47556.2us
I20260709 12:24:33.976126  5966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:34558
I20260709 12:24:33.976824  5966 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:33.977259  5966 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:33.984447  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:33.985091  5963 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:33.987483  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:33.988121  6118 raft_consensus.cc:3055] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:33.988415  6118 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:33.990440  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:33.991040  6044 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:33.992955  5966 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:33.998804  6113 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:34.000406  6118 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:34.014887  6118 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:34.019994  5934 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:34.021734  6044 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:34.022360  7760 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:34.024693  7760 raft_consensus.cc:697] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:34.025609  7760 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:34.023144  5963 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:34.028878  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:34.030241  7792 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:34.030857  7792 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:34.031936  7792 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:34.033522  6118 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:34.039817  5966 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:34.040848  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:34.041926  6645 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.070827  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:34.073351  6044 raft_consensus.cc:3055] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:34.073724  6044 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:34.074945  6044 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:34.076110  6044 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:34.077761  5863 catalog_manager.cc:5697] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 3 to 4, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 4 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:34.083227  6044 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:24:34.087366  5865 catalog_manager.cc:5697] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 2 to 3, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 3 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:34.091974  6645 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:24:34.106112  5934 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:34.107105  7810 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:34.107623  7810 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:34.108454  7810 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:34.096779  6118 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:34.137897  5966 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:34.138530  6044 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:34.139475  7857 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20260709 12:24:34.143761  7838 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:34.144992  6084 consensus_peers.cc:597] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec584257f9db451c965f6b092aa9069c. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.205457  5865 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 6 to 7, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 7 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:34.211382  7836 raft_consensus.cc:2955] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:34.224124  5966 raft_consensus.cc:2955] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:34.228031  6044 raft_consensus.cc:2955] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:34.252374  6118 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:34.245906  5863 catalog_manager.cc:5697] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 3, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:34.296972  6044 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20260709 12:24:34.298091  6084 consensus_peers.cc:597] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5a6d648272bf4bef9d5337acfc9d4a96. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.299413  5966 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:34.301350  7836 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:34.303277  7836 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:34.326027  7857 raft_consensus.cc:2955] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:34.340188  5966 raft_consensus.cc:2955] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:34.342324  6035 raft_consensus.cc:2955] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:34.353422  6114 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:34.356040  5865 catalog_manager.cc:5697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index -1 to 3, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:34.387197  6084 consensus_peers.cc:597] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 81efabae1bb448e3a8483e6231673c10. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.388793  6035 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:34.391782  5966 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:34.394078  7836 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:34.399974  7836 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:34.417615  7769 raft_consensus.cc:2955] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:34.424635  5966 raft_consensus.cc:2955] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:34.432906  6042 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:34.435400  7810 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:34.450775  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:34.458406  5963 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:34.463125  5864 catalog_manager.cc:5697] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 3, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
W20260709 12:24:34.473961  5934 consensus_peers.cc:597] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3fd6047b66ab4b4abc3fe659e8cff000. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:34.480883  6044 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:34.489114  7810 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:34.520527  6118 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260709 12:24:34.521898  6645 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:34.525513  5963 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:34.529083  7760 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:34.523928  7862 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:24:34.540652  7771 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:34.544579  6114 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:34.548858  7760 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:34.562345  7862 raft_consensus.cc:2955] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:34.565810  6044 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:24:34.567451  6118 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:34.583647  7771 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:34.585501  7812 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:34.585682  6035 raft_consensus.cc:2955] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:34.598486  6044 raft_consensus.cc:2955] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
W20260709 12:24:34.662288  7883 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:24:34.665362  6035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:34.666024  6035 raft_consensus.cc:606] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:34.712466  5962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:24:34.713204  5962 raft_consensus.cc:606] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:24:34.715337  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 56148.8us
W20260709 12:24:34.802968  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 74968.5us
W20260709 12:24:34.901032  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 170689us
W20260709 12:24:35.093433  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 161614us
I20260709 12:24:35.148362  6118 raft_consensus.cc:2955] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:24:35.174722  5959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:24:35.175303  5959 raft_consensus.cc:606] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:35.178838  7900 raft_consensus.cc:993] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:35.179457  7900 raft_consensus.cc:1081] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:35.188107  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:35.189869  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:35.190717  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:35.173722  5864 catalog_manager.cc:5697] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 2, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 1 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.194814  6110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35596
I20260709 12:24:35.195416  6110 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:35.195777  6110 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:35.203408  7862 raft_consensus.cc:993] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:35.204071  7904 raft_consensus.cc:1081] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:24:35.232676  7927 raft_consensus.cc:993] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:35.229779  6110 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:35.234493  7927 raft_consensus.cc:1081] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:24:35.235705  6110 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:35.238735  6044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36266
I20260709 12:24:35.248471  6044 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:35.248978  6044 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.267493  7930 ts_tablet_manager.cc:933] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:35.267239  6044 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:35.293031  6044 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:35.268923  7933 ts_tablet_manager.cc:933] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:35.306739  6110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:24:35.307286  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:35.307461  6110 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:35.307919  6110 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.307904  6112 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.324446  6112 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:35.330060  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:35.330713  6044 raft_consensus.cc:3055] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:24:35.331038  6044 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:35.331733  6044 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:35.332717  6044 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:35.335424  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:35.336136  5963 raft_consensus.cc:3055] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:35.336572  5963 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:35.337371  5963 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:35.337859  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:35.338407  5966 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:35.338559  5963 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:35.343055  7931 ts_tablet_manager.cc:933] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:35.364873  6044 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:24:35.372828  6110 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:35.375727  6110 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:35.376504  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:35.377094  5962 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:35.377379  5962 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:35.378232  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:35.378825  6642 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.384739  5962 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:35.386210  5962 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:35.394728  7933 tablet_copy_client.cc:323] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.67:39787
I20260709 12:24:35.397454  5966 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:24:35.399848  6081 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:35.400900  7838 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:35.401445  7838 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:35.402300  7838 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:35.415343  5963 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:35.440582  5962 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:35.442864  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:35.443836  7908 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:35.443939  7930 tablet_copy_client.cc:323] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.67:39787
I20260709 12:24:35.444446  7908 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:35.445436  7908 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:35.448431  6006 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:35.449875  6118 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:24:35.447016  7931 tablet_copy_client.cc:323] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.67:39787
I20260709 12:24:35.466260  7907 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:35.468079  6126 tablet_copy_service.cc:140] P 0069e2ba1f02412e8e1d6c20a1fb510f: Received BeginTabletCopySession request for tablet 81efabae1bb448e3a8483e6231673c10 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:42484)
I20260709 12:24:35.446882  6127 tablet_copy_service.cc:140] P 0069e2ba1f02412e8e1d6c20a1fb510f: Received BeginTabletCopySession request for tablet ec584257f9db451c965f6b092aa9069c from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:42484)
I20260709 12:24:35.496444  6642 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:35.481070  6126 tablet_copy_service.cc:161] P 0069e2ba1f02412e8e1d6c20a1fb510f: Beginning new tablet copy session on tablet 81efabae1bb448e3a8483e6231673c10 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:42484: session id = 24012af7747d4c4ea89c3da2ff950099-81efabae1bb448e3a8483e6231673c10
I20260709 12:24:35.499498  6127 tablet_copy_service.cc:161] P 0069e2ba1f02412e8e1d6c20a1fb510f: Beginning new tablet copy session on tablet ec584257f9db451c965f6b092aa9069c from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:42484: session id = 24012af7747d4c4ea89c3da2ff950099-ec584257f9db451c965f6b092aa9069c
I20260709 12:24:35.481658  7907 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:35.503342  7907 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:35.516400  6128 tablet_copy_service.cc:140] P 0069e2ba1f02412e8e1d6c20a1fb510f: Received BeginTabletCopySession request for tablet 5a6d648272bf4bef9d5337acfc9d4a96 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:42484)
I20260709 12:24:35.517036  6128 tablet_copy_service.cc:161] P 0069e2ba1f02412e8e1d6c20a1fb510f: Beginning new tablet copy session on tablet 5a6d648272bf4bef9d5337acfc9d4a96 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:42484: session id = 24012af7747d4c4ea89c3da2ff950099-5a6d648272bf4bef9d5337acfc9d4a96
I20260709 12:24:35.523077  7937 ts_tablet_manager.cc:933] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:24:35.526290  6128 tablet_copy_source_session.cc:215] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:35.522421  6126 tablet_copy_source_session.cc:215] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:35.532071  7933 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 81efabae1bb448e3a8483e6231673c10. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.562724  6127 tablet_copy_source_session.cc:215] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:35.564625  7931 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5a6d648272bf4bef9d5337acfc9d4a96. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.567822  7930 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec584257f9db451c965f6b092aa9069c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.597513  7937 tablet_copy_client.cc:323] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.65:42981
I20260709 12:24:35.599994  5978 tablet_copy_service.cc:140] P f1bb8e63c2b448cdafd51f05d277c741: Received BeginTabletCopySession request for tablet 3fd6047b66ab4b4abc3fe659e8cff000 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:37174)
I20260709 12:24:35.600497  5978 tablet_copy_service.cc:161] P f1bb8e63c2b448cdafd51f05d277c741: Beginning new tablet copy session on tablet 3fd6047b66ab4b4abc3fe659e8cff000 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:37174: session id = 24012af7747d4c4ea89c3da2ff950099-3fd6047b66ab4b4abc3fe659e8cff000
I20260709 12:24:35.604360  7933 tablet_copy_client.cc:806] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:35.605059  7933 tablet_copy_client.cc:670] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:35.624776  7933 tablet_copy_client.cc:538] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:35.622514  5978 tablet_copy_source_session.cc:215] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:24:35.645093  5865 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 6 to 7, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 7 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:35.646972  5865 catalog_manager.cc:5697] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 3 to 4, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 4 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.652326  7937 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fd6047b66ab4b4abc3fe659e8cff000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:24:35.665940  5862 catalog_manager.cc:5697] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 2 to 3, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 3 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:35.677393  7931 tablet_copy_client.cc:806] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:35.686935  7931 tablet_copy_client.cc:670] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:35.667554  7933 tablet_bootstrap.cc:492] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:35.687685  7930 tablet_copy_client.cc:806] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:35.688215  7930 tablet_copy_client.cc:670] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:35.717571  7930 tablet_copy_client.cc:538] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:35.725019  7931 tablet_copy_client.cc:538] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:35.745456  7937 tablet_copy_client.cc:806] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:24:35.746146  7937 tablet_copy_client.cc:670] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:24:35.752455  7937 tablet_copy_client.cc:538] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:24:35.762997  7937 tablet_bootstrap.cc:492] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:35.765172  7931 tablet_bootstrap.cc:492] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:35.767246  7930 tablet_bootstrap.cc:492] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:24:35.786230  7933 tablet_bootstrap.cc:492] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:35.797503  7933 tablet_bootstrap.cc:492] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:35.803409  7933 ts_tablet_manager.cc:1403] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.135s	user 0.023s	sys 0.046s
I20260709 12:24:35.823518  7933 raft_consensus.cc:359] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:35.827956  7933 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:35.840535  7933 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:35.851194  5962 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:35.852816  7908 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:35.885862  6642 raft_consensus.cc:1217] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:24:35.879863  7933 ts_tablet_manager.cc:1434] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.076s	user 0.008s	sys 0.000s
I20260709 12:24:35.903646  6044 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:24:35.904179  6128 tablet_copy_service.cc:342] P 0069e2ba1f02412e8e1d6c20a1fb510f: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-81efabae1bb448e3a8483e6231673c10 received from {username='slave'} at 127.0.0.1:42484
I20260709 12:24:35.904659  6128 tablet_copy_service.cc:434] P 0069e2ba1f02412e8e1d6c20a1fb510f: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-81efabae1bb448e3a8483e6231673c10 on tablet 81efabae1bb448e3a8483e6231673c10 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:35.911165  7908 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:35.957053  5963 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:35.979981  5963 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:35.986572  7945 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:24:35.993149  6642 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:35.964258  7909 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.024s
I20260709 12:24:35.994189  7920 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:24:36.024441  7949 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:36.044370  7937 tablet_bootstrap.cc:492] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:36.045805  7937 tablet_bootstrap.cc:492] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:36.049736  7930 tablet_bootstrap.cc:492] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:36.073364  7937 ts_tablet_manager.cc:1403] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.311s	user 0.043s	sys 0.017s
I20260709 12:24:36.076956  7937 raft_consensus.cc:359] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:36.081529  7937 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:36.082926  7937 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:36.086278  7937 ts_tablet_manager.cc:1434] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:24:36.135020  7930 tablet_bootstrap.cc:492] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:36.184746  7930 ts_tablet_manager.cc:1403] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.430s	user 0.036s	sys 0.001s
W20260709 12:24:36.220592  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 102718us
I20260709 12:24:36.224948  7930 raft_consensus.cc:359] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:36.226482  7930 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
W20260709 12:24:36.237751  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 117276us
I20260709 12:24:36.227087  7930 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:36.243351  6643 raft_consensus.cc:1217] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2]   Dedup: 1.2->[]
I20260709 12:24:36.243989  5978 tablet_copy_service.cc:342] P f1bb8e63c2b448cdafd51f05d277c741: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-3fd6047b66ab4b4abc3fe659e8cff000 received from {username='slave'} at 127.0.0.1:37174
I20260709 12:24:36.244455  5978 tablet_copy_service.cc:434] P f1bb8e63c2b448cdafd51f05d277c741: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-3fd6047b66ab4b4abc3fe659e8cff000 on tablet 3fd6047b66ab4b4abc3fe659e8cff000 with peer 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:36.989041  7965 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.740s	user 0.001s	sys 0.000s
I20260709 12:24:37.206224  7930 ts_tablet_manager.cc:1434] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 1.001s	user 0.005s	sys 0.003s
W20260709 12:24:37.206809  7930 ts_tablet_manager.cc:1467] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Tablet startup took 1003ms
W20260709 12:24:37.207239  7930 ts_tablet_manager.cc:1469] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Trace:
0709 12:24:35.188279 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:35.190179 (+  1900us) service_pool.cc:224] Handling call
0709 12:24:35.290632 (+100453us) ts_tablet_manager.cc:934] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
0709 12:24:35.566553 (+275921us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:24:35.594223 (+ 27670us) tablet_metadata.cc:665] Metadata flushed
0709 12:24:35.594339 (+   116us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:24:35.674621 (+ 80282us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:24:35.674890 (+   269us) tablet_replica.cc:206] Creating consensus instance
0709 12:24:35.675166 (+   276us) ts_tablet_manager.cc:989] Replica registered.
0709 12:24:35.675217 (+    51us) inbound_call.cc:177] Queueing success response
0709 12:24:35.754207 (+ 78990us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:24:36.206115 (+451908us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:24:36.215478 (+  9363us) tablet_replica.cc:261] Starting instrumentation
0709 12:24:36.216063 (+   585us) tablet_replica.cc:280] Starting consensus
Metrics: {"dns_us":4990,"mutex_wait_us":7150,"raft.queue_time_us":17422,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":149,"tablet-copy.queue_time_us":73854,"tablet-download-pool.queue_time_us":278,"tablet-download-pool.run_cpu_time_us":960,"tablet-download-pool.run_wall_time_us":7982,"thread_start_us":208517,"threads_started":2}
I20260709 12:24:37.396260  7931 tablet_bootstrap.cc:492] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:24:37.397480  7931 tablet_bootstrap.cc:492] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:24:37.726985  7931 ts_tablet_manager.cc:1403] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 1.962s	user 0.028s	sys 0.016s
I20260709 12:24:37.869518  7931 raft_consensus.cc:359] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:37.870523  7931 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:24:37.871282  7931 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:37.874428  7931 ts_tablet_manager.cc:1434] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.147s	user 0.006s	sys 0.000s
W20260709 12:24:38.179495  6083 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.939s	user 0.000s	sys 0.021s
W20260709 12:24:38.181121  6083 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.943s	user 0.000s	sys 0.022s
W20260709 12:24:38.207471  6609 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.423s	user 0.009s	sys 0.020s
W20260709 12:24:38.209776  6609 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.425s	user 0.009s	sys 0.021s
W20260709 12:24:38.802210  6083 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.619s	user 0.005s	sys 0.003s
W20260709 12:24:38.802752  6083 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.619s	user 0.005s	sys 0.003s
W20260709 12:24:38.862744  6611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.093s	user 0.012s	sys 0.018s
W20260709 12:24:38.863907  6611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.095s	user 0.012s	sys 0.018s
I20260709 12:24:38.942129  7978 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:38.942870  7978 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:38.960464  7978 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:38.979847  6644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 487) took 2939 ms. Trace:
I20260709 12:24:38.946647  7977 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:38.994751  7980 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:39.020756  7981 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.072214  7983 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:39.089352  7982 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:39.120730  7977 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.149089  7976 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:24:39.236088  6608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.449s	user 0.005s	sys 0.032s
I20260709 12:24:39.236670  7990 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:39.237342  7990 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.191527  7981 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:39.241847  6608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.458s	user 0.006s	sys 0.032s
W20260709 12:24:39.241143  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 125640us
I20260709 12:24:39.254216  7992 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.259091  7992 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.234823  7976 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.191169  7980 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.261502  7981 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.228682  7982 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.274513  7990 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.278673  7982 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:39.279239  6610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 2.492s	user 0.013s	sys 0.025s
I20260709 12:24:39.262126  7986 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:24:39.281001  6610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 2.497s	user 0.013s	sys 0.026s
I20260709 12:24:39.186524  7983 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.117295  6644 rpcz_store.cc:276] 0709 12:24:36.040256 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.043130 (+  2874us) service_pool.cc:224] Handling call
0709 12:24:36.043441 (+   311us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:36.043858 (+   417us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:36.043895 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:36.044388 (+   493us) log.cc:844] Serialized 26 byte log entry
0709 12:24:36.218833 (+174445us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:36.218889 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:36.218984 (+    95us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:38.979397 (+2760413us) raft_consensus.cc:1685] finished
0709 12:24:38.979419 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:38.979621 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1060,"raft.run_cpu_time_us":102,"raft.run_wall_time_us":103,"thread_start_us":134154,"threads_started":1,"wal-append.queue_time_us":204447,"wal-append.run_cpu_time_us":3288,"wal-append.run_wall_time_us":1894685}
I20260709 12:24:39.280207  7981 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:39.282373  7990 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:39.302055  7981 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.304549  7981 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:39.306208  7981 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:39.307044  7987 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:39.307595  7987 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.307960  7985 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:39.301338  7990 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.296464  7982 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:39.308835  7992 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.308634  7985 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:39.309454  7992 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:39.309238  7982 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.309999  7992 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.310981  7985 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.311510  7985 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.311600  7983 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.308729  7995 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.284868  7986 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.300607  7980 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.308022  7996 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:39.316731  7986 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.314782  7977 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.314049  8003 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:39.309996  7987 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.316831  7997 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.306789  7981 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.317113  7978 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.312014  7985 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.317481  8000 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.450810  7992 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.451316  7982 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:39.453776  7993 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.315431  7995 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.508266  7977 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.555727  8005 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:39.511066  7992 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:39.510743  7987 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:39.618516  7999 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:39.618237  7992 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:39.619225  7999 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.507604  7997 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.555066  7982 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:39.484839  7996 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.657858  7989 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.658483  7989 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.601109  7977 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.660564  7989 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.661633  8001 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:39.662153  8004 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:39.662261  8001 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.508484  7978 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.621973  7987 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.657276  7991 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:39.622970  8005 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.662781  8004 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.556914  8000 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.588841  7976 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.504004  8003 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.693476  7998 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:39.711156  8008 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.711424  7984 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.549291  7993 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.880721  7984 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:39.888995  6643 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.645s	user 0.019s	sys 0.028s
I20260709 12:24:39.718932  7990 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.714118  7979 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.799760  8001 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.791795  7978 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:39.712692  7989 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:39.888677  7898 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.846567  7981 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.712606  7997 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.821619  7987 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.903316  8011 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:39.903744  7999 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.904968  7985 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.902356  7990 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:39.906989  7990 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.907488  7993 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:39.892972  6643 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.647s	user 0.019s	sys 0.028s
I20260709 12:24:39.830441  8004 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:39.817866  8005 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.713833  7980 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.692241  7982 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.880314  7976 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.884654  7998 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.796355  8007 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.693694  7994 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.910658  6643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 344) took 3667 ms. Trace:
I20260709 12:24:39.693941  7991 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.902092  7986 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:39.916712  6643 rpcz_store.cc:276] 0709 12:24:36.242779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.242894 (+   115us) service_pool.cc:224] Handling call
0709 12:24:36.243269 (+   375us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:39.909649 (+3666380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:39.909683 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:39.909729 (+    46us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:39.910349 (+   620us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:39.910423 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:39.910585 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4161,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":82,"thread_start_us":3665122,"threads_started":1}
I20260709 12:24:39.880172  8008 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.901788  8000 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.911372  7992 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.908371  7989 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:39.921418  7984 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.903862  8011 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.919410  7976 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.907739  7898 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.918156  7994 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.923353  8006 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:39.923301  7986 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.928108  7981 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.902029  7979 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.924697  8005 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.916033  7980 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.938581  6644 raft_consensus.cc:1217] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:24:39.927354  8004 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:39.939033  8011 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:39.939455  7990 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.929772  7991 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:39.941905  7994 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:39.942291  7976 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:39.942200  8005 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.943166  8003 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:39.947345  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:39.948980  7995 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.933259  8006 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.945331  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:39.946404  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:39.946671  7989 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:39.948917  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 3.68363e+06us
I20260709 12:24:39.935297  8008 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.947522  8004 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.949054  6646 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:39.947388  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:39.951506  6649 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:39.940251  7998 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.942366  7986 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.952391  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:39.933542  7982 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:39.940367  7981 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.961380  8004 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.961890  8009 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:39.969203  7981 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.962831  7980 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.970213  6645 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:39.953892  7898 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:39.975325  6672 debug-util.cc:398] Leaking SignalData structure 0x7b0800324860 after lost signal to thread 4824
W20260709 12:24:39.975994  6672 debug-util.cc:398] Leaking SignalData structure 0x7b0800164c40 after lost signal to thread 5864
I20260709 12:24:39.977562  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:39.978312  6646 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:39.980036  6642 raft_consensus.cc:1217] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3]   Dedup: 2.3->[]
I20260709 12:24:39.983863  7967 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.984484  7967 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.986135  8000 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:39.958644  8005 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.987323  8000 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.988871  7967 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:39.990028  8000 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:39.990262  7999 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:39.991509  7760 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.992669  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:39.919695  8007 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.991429  7986 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:39.994807  7760 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.996878  8012 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:39.994880  7985 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:40.003077  7996 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:40.003549  6082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 3.764s	user 0.023s	sys 0.032s
W20260709 12:24:40.057385  6082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 3.818s	user 0.024s	sys 0.032s
I20260709 12:24:40.051956  7995 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:40.005123  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.062542  6118 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:39.990798  7999 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:40.008998  7986 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:39.969317  8009 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:39.992694  8000 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:24:40.038722  6672 debug-util.cc:398] Leaking SignalData structure 0x7b080032ec20 after lost signal to thread 5900
I20260709 12:24:40.054997  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.056198  7760 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.054877  8012 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.064342  8006 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.291064  8006 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:40.291404  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.292094  8012 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.292819  8012 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:40.291802  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.292109  6651 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:40.293483  6084 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:24:40.321056  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 352015us
I20260709 12:24:40.321403  8020 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.322116  8020 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.323010  6643 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:40.323944  8000 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.324836  8020 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.326009  8000 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.072404  7995 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:40.384642  6672 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9780 after lost signal to thread 5992
W20260709 12:24:40.385251  6672 debug-util.cc:398] Leaking SignalData structure 0x7b08002d9760 after lost signal to thread 5993
I20260709 12:24:40.364598  7976 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:40.367425  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:40.361442  6128 tablet_copy_service.cc:342] P 0069e2ba1f02412e8e1d6c20a1fb510f: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-ec584257f9db451c965f6b092aa9069c received from {username='slave'} at 127.0.0.1:42484
I20260709 12:24:40.158329  7996 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.293392  8012 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.388684  7760 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:24:40.386451  6672 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb540 after lost signal to thread 6068
W20260709 12:24:40.400143  6672 debug-util.cc:398] Leaking SignalData structure 0x7b08002bb520 after lost signal to thread 6069
I20260709 12:24:40.399519  7760 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.162092  7898 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:40.109349  7967 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.360416  8009 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.362891  7980 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:40.357281  8008 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.276944  7959 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.364220  7998 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.364432  7994 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:40.382587  7979 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:40.364388  7993 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.364537  7988 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:24:40.401178  6672 debug-util.cc:398] Leaking SignalData structure 0x7b0800384c60 after lost signal to thread 6142
I20260709 12:24:40.381731  7986 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.422668  7994 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.340567  8004 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:40.422744  7988 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.424217  8004 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:40.421178  7998 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.243156  7999 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.282871  7964 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.425537  7994 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.425431  7964 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.407711  7760 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.062628  7977 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.095455  7992 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:40.122691  8014 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:40.396606  8002 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:40.258025  8007 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.057410  7985 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.405277  8000 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.398052  7976 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.364032  7982 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.431434  8002 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:40.431295  8000 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.419190  7980 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.433658  7976 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:40.431704  8014 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.434082  7980 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:40.408551  7996 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.422634  7993 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.423168  8015 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.423499  7995 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.424642  8004 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.392359  8006 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.426928  8008 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.440655  8008 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:40.441710  7985 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.435066  7992 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.443922  8004 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.426214  7998 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.428609  7988 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:40.431618  7982 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.445647  8006 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.445829  8014 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.446837  7982 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.432030  8002 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.447217  8012 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.415805  8019 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.438067  7993 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:40.433658  8000 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.438597  8015 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.448319  8019 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.451053  8019 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.451100  8015 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.476920  5862 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 305) took 4254 ms. Trace:
I20260709 12:24:40.406694  6128 tablet_copy_service.cc:434] P 0069e2ba1f02412e8e1d6c20a1fb510f: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-ec584257f9db451c965f6b092aa9069c on tablet ec584257f9db451c965f6b092aa9069c with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:40.392578  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:24:40.503513  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 110905us
I20260709 12:24:40.505023  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.506795  6127 tablet_copy_service.cc:342] P 0069e2ba1f02412e8e1d6c20a1fb510f: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-5a6d648272bf4bef9d5337acfc9d4a96 received from {username='slave'} at 127.0.0.1:42484
I20260709 12:24:40.507632  6127 tablet_copy_service.cc:434] P 0069e2ba1f02412e8e1d6c20a1fb510f: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-5a6d648272bf4bef9d5337acfc9d4a96 on tablet 5a6d648272bf4bef9d5337acfc9d4a96 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:40.508213  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.107359  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.418308  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.535064  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.536698  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.537855  6109 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:40.447777  7996 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.408736  7898 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:40.422269  6672 debug-util.cc:398] Leaking SignalData structure 0x7b0800384dc0 after lost signal to thread 6143
I20260709 12:24:40.541652  5864 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 301) took 4307 ms. Trace:
I20260709 12:24:40.542191  5864 rpcz_store.cc:276] 0709 12:24:36.233891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.234045 (+   154us) service_pool.cc:224] Handling call
0709 12:24:40.541379 (+4307334us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3864652,"reported_tablets":1}
W20260709 12:24:40.542840  6672 debug-util.cc:398] Leaking SignalData structure 0x7b080036d520 after lost signal to thread 6675
I20260709 12:24:40.543591  7898 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:40.512243  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.513513  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.514999  7909 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.477885  5862 rpcz_store.cc:276] 0709 12:24:36.222330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.222494 (+   164us) service_pool.cc:224] Handling call
0709 12:24:40.476536 (+4254042us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":668719,"reported_tablets":1}
I20260709 12:24:40.506649  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.522042  7982 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:40.524291  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.527493  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.528039  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.528406  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.528515  8024 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.416816  7967 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.443936  7992 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.531276  7957 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.507287  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.539892  5865 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 291) took 4318 ms. Trace:
W20260709 12:24:40.543805  6672 debug-util.cc:398] Leaking SignalData structure 0x7b080037c740 after lost signal to thread 7930
I20260709 12:24:40.510223  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:40.498425  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 176299us
I20260709 12:24:40.543115  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.549584  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.554905  7909 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.575163  8020 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:40.576135  8020 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.577416  7909 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.555541  6115 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:40.558656  7964 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.579336  7964 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:40.579675  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.580309  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.580518  6113 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:40.581696  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.582110  8021 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.420841  7959 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.582526  6112 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:40.582937  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.583377  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.584159  6114 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:40.561458  8004 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.566228  7921 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.584882  7959 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.582958  8021 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.559453  6118 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:40.532429  7897 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.560417  6645 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:40.573886  7957 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.532346  8025 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.572218  5865 rpcz_store.cc:276] 0709 12:24:36.221825 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:36.221965 (+   140us) service_pool.cc:224] Handling call
0709 12:24:40.539663 (+4317698us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":417258,"reported_tablets":2}
I20260709 12:24:40.520825  6084 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:24:40.588657  6672 debug-util.cc:398] Leaking SignalData structure 0x7b0800373e40 after lost signal to thread 7931
I20260709 12:24:40.597205  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:40.597422  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 91123.8us
I20260709 12:24:40.602496  7957 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.585572  7921 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:40.578191  7909 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.607889  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.610244  7909 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:40.612062  8004 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:40.612538  8004 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:40.612908  8004 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.613029  7909 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.587962  7982 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:40.618686  7982 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.623047  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.624588  7967 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.633494  8020 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.604984  7897 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.625396  8025 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.634924  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.636487  6643 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:40.641388  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.642426  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.643358  6645 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:40.644492  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.599795  7964 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.648589  7964 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.650781  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.651503  6115 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:40.653823  8028 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.599285  8024 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.664656  7892 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.658900  6084 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:40.663527  8020 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.669917  8021 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.669740  8020 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.671627  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.671972  8020 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.672907  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.674831  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.676065  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.646181  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.680689  6651 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:40.681135  7921 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.635692  7967 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:40.681892  8028 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.632015  8027 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:24:40.690956  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 64724.2us
I20260709 12:24:40.692636  7993 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:40.693132  7993 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:40.693490  7993 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.693579  8026 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:40.696074  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.700089  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.700660  7897 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.688377  8022 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.665464  7892 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:40.705794  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.706270  8024 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.707274  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.710717  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.712596  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:40.713096  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.713629  7998 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:40.714165  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.716104  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.717142  6037 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:40.703910  8022 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.721784  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.722600  7967 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.714088  7998 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:40.726169  8029 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.726687  7998 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.726918  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.727166  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.728485  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.729321  6038 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:40.727713  6109 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:40.731577  7921 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.731947  7897 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.704308  8025 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.737020  7959 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.737843  7959 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.735070  8021 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.740144  7959 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.740428  8021 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.728718  8024 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.736799  7909 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.744200  8021 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.736975  8030 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.728384  7967 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.744917  7964 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.732620  7921 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:40.755591  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.755807  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.757236  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.750618  7909 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.759743  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.760509  6038 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:40.760784  7909 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.741943  7959 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:24:40.732761  7897 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.771783  7982 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.773379  7921 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.774060  7964 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.776288  7964 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.736196  8026 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.780206  8022 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:40.782110  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 49506.9us
I20260709 12:24:40.783499  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.761525  8030 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.786952  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.791160  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.768062  8028 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.792542  6038 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:40.798281  8030 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.793213  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.806540  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:40.793391  8002 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.810525  6111 raft_consensus.cc:2393] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:40.811520  7892 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.811384  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.780686  8029 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.814373  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:40.815747  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.742739  8027 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.818329  6038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:24:40.819247  6038 raft_consensus.cc:606] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:40.792325  8024 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:40.822221  8027 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.841048  8024 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.842978  8004 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.843631  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.844347  6037 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:24:40.844666  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.845283  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.847004  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.849900  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.853315  8032 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:40.855957  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.862836  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.813282  8031 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:40.820631  8026 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.871167  8029 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.871589  8004 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.890942  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:40.891636  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:40.879979  8002 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.854086  8032 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.874014  7993 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.899201  6609 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:40.903821  7836 raft_consensus.cc:1064] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:40.904887  7977 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:40.905224  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:40.906313  6609 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:40.907218  6609 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:40.907560  7898 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:40.908015  7898 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.908067  8005 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:40.908432  7898 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.908547  8005 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.908995  8005 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.910483  8034 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:40.910900  8034 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:40.911325  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:40.912050  6118 raft_consensus.cc:606] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:40.911270  8034 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.883054  8031 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.916486  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.911834  7977 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.923760  7977 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.919237  6111 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:40.920356  6109 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:40.921381  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.925325  6609 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:40.926594  6109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:40.927166  6109 raft_consensus.cc:606] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:40.921795  7836 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.935243  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:40.928967  7897 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:40.935931  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:24:40.937384  5934 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:40.943712  5959 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:40.943845  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:40.947243  8009 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:40.946177  5962 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:40.941555  7993 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:40.950170  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 92544.6us
I20260709 12:24:40.948545  8009 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.957149  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:40.952656  8026 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:40.962761  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:40.962960  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:40.955075  8009 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:40.963886  5962 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:24:40.965586  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:40.967864  5934 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:40.971252  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:40.967334  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:40.973085  6646 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:40.973285  7988 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:40.973845  7988 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:40.969655  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 44547.5us
I20260709 12:24:40.976071  5959 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:40.979061  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.979875  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.981169  6644 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:40.982537  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.983150  6038 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:40.985260  7982 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:40.964478  8026 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:41.002031  8026 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:40.990258  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.010723  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:40.990443  7988 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:40.951534  7998 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.995393  7977 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:40.998937  7992 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:40.999045  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.025527  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.000593  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.026371  5959 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:41.001536  8032 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:41.004530  8008 raft_consensus.cc:1064] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:41.002776  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:41.006732  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:41.008929  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.009262  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.010797  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:40.989316  8005 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.013072  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.013311  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.013805  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.014021  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.014397  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.015080  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.015810  8031 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:41.025192  5934 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:40.968101  8004 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:41.039556  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.039913  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.040654  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.035269  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:41.026674  7992 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:41.037952  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.038339  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.040988  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.042234  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.046671  6645 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:41.047036  5965 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:41.047137  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.047736  6041 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:41.047807  7967 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:41.048246  7967 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:41.048614  7967 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:41.042361  7992 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:41.010834  8034 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.054701  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.055231  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.055984  5960 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:41.056689  8034 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:41.057904  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.060187  6646 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:41.061303  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.061781  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.061875  6084 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:41.062659  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.062947  7993 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:41.063658  7993 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:41.053922  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.064734  7993 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.067140  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.054620  7977 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:41.044075  5959 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:24:41.068912  8009 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.060105  6648 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:41.125804  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.029856  8008 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.043514  6644 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:41.090626  7898 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.127174  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.128271  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.128600  7898 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:41.098927  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 63747.8us
I20260709 12:24:41.131832  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.132669  6611 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:41.099824  7977 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.133198  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.134322  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.135721  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.136349  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.137065  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.102588  7998 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:41.106899  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.109525  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.110316  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.111366  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.112402  7992 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:41.113837  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.115585  8005 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:41.118942  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.120106  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.121109  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.122269  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.040405  8004 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:41.137212  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.165267  5960 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:41.174196  5965 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:41.179071  5961 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:41.179548  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.180058  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.180680  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.176585  5966 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:41.181795  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.182385  5962 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
W20260709 12:24:41.182600  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.184355  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.183458  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.187772  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:41.188303  6644 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:41.191640  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.189724  7982 consensus_queue.cc:1059] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:24:41.193095  8002 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:41.193384  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:41.195393  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.196864  6642 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:41.197958  7977 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:41.079718  8026 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:41.402976  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.403662  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.418426  6117 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:41.386452  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:41.299113  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.184695  8005 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:41.232282  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:41.204030  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 71468.6us
I20260709 12:24:41.204651  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.314333  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.213793  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.248245  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:41.198869  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 145619us
W20260709 12:24:41.352763  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 306502us
I20260709 12:24:41.456318  6611 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:24:41.298388  6608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 2.019s (SENT) [suppressed 2 similar messages]
I20260709 12:24:41.411741  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.434549  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.232178  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.463750  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.463719  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:41.204403  7998 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:41.472164  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.473249  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.465852  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:41.474229  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.259269  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.479902  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.480458  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.480794  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.481020  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:41.481458  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.482031  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.482944  6645 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:41.483093  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.239187  7836 consensus_queue.cc:1059] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.245s
I20260709 12:24:41.477705  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.484115  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.484869  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:41.485216  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:41.486214  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.487496  5965 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:41.489430  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.280119  7992 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:41.476222  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.478528  8026 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:41.478819  8002 raft_consensus.cc:3055] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:41.479295  6646 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:41.479548  6611 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:41.456015  7988 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:24:41.483577  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.477509  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.397185  8004 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:41.478866  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.478225  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.482132  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:41.486382  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.491120  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.482856  8039 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:41.511761  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.514906  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.515969  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.517634  6115 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:41.518823  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.515287  5934 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:41.496958  8002 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:41.533259  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:41.510318  7967 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:41.538890  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:41.541181  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:41.541980  6649 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:41.542171  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.548393  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.527107  8009 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:41.549269  6611 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:41.550448  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.555240  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.559201  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:41.559922  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.560526  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:41.560799  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:41.561470  6044 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:41.560806  6646 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:41.563045  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.564705  8007 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:41.565166  8007 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:41.565523  8007 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.570778  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:41.585134  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:24:41.619550  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 70367.1us
I20260709 12:24:41.625402  7967 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:41.625630  8007 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:41.628535  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:41.630509  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:41.631376  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:41.586179  7898 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:41.630746  6644 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:41.562510  8002 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.634162  8002 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:41.635192  8043 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:41.635630  8043 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:41.635959  8043 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:41.642115  6117 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:41.643415  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:41.644868  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:41.646127  6611 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:41.646873  8009 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:41.647264  8009 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:41.647634  8009 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.648208  8007 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:41.649219  6040 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20260709 12:24:41.654731  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 179513us
I20260709 12:24:41.647387  7977 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:41.661065  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.661727  6115 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:41.642201  8002 raft_consensus.cc:1064] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:41.664069  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.663013  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:24:41.667434  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 206351us
I20260709 12:24:41.668385  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:41.673491  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.673687  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.675056  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:41.675611  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:41.680660  6611 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:41.682775  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.683437  8039 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:41.683732  6644 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:41.684087  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:41.684203  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.684748  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:41.685163  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.683013  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.682775  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:41.686414  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.687611  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:41.689666  6116 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:41.692759  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:41.697016  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:41.698622  8046 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:41.706354  6116 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:41.714661  6109 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
W20260709 12:24:41.694298  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 425414us
W20260709 12:24:41.717424  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 185587us
I20260709 12:24:41.692276  7982 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:41.681703  7998 raft_consensus.cc:697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:41.690948  8043 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:41.756387  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 69565.3us
W20260709 12:24:41.759172  8044 log.cc:927] Time spent T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
W20260709 12:24:41.760387  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 60441.2us
I20260709 12:24:41.766710  7836 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:41.767238  7836 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:41.767663  7836 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:41.770612  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 63031us
W20260709 12:24:41.771875  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 91303.2us
I20260709 12:24:41.773531  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:41.776122  6611 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:41.753310  7982 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:24:41.778079  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 81173.1us
I20260709 12:24:41.777878  8007 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:41.786154  7982 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.794960  5934 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:41.795955  8042 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:41.796361  8042 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:41.796689  8042 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:41.779925  8005 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:41.808645  8043 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:41.809151  8041 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:41.809674  8041 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:41.810746  8041 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.812160  8041 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:41.758719  7998 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.817114  6646 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:41.828639  7993 raft_consensus.cc:3055] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:41.829113  7993 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:41.785133  8002 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.841189  5932 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:41.842008  8038 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:41.843487  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:41.844180  7967 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:41.821141  8005 raft_consensus.cc:697] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:41.845583  8005 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:41.848781  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 77204.9us
I20260709 12:24:41.830008  7993 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.857311  8009 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.821307  8050 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:24:41.863965  8009 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:41.865772  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:41.876384  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:41.877188  6115 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:41.879191  7993 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.879752  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:41.880841  8036 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:41.883245  8045 raft_consensus.cc:993] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:24:41.885221  8045 raft_consensus.cc:1081] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:24:41.880405  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:41.888511  8050 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:41.887948  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:41.875605  5934 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:41.895372  8045 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:41.899441  8045 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:41.896869  7836 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.899852  8045 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:41.904495  8026 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:41.905092  8026 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:41.905503  8026 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.901289  8058 consensus_queue.cc:1059] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:24:41.915028  5934 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:41.921947  8058 raft_consensus.cc:3055] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:41.922605  8058 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:41.923637  8058 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.925220  8058 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:41.934136  6109 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:41.936883  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 123800us
I20260709 12:24:41.955789  7898 consensus_queue.cc:1059] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:41.955602  5862 catalog_manager.cc:5697] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 3 to 4, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 4 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:41.956933  7898 raft_consensus.cc:3055] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:41.957338  7898 raft_consensus.cc:740] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:41.958288  7898 consensus_queue.cc:260] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:41.961192  8042 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:41.961443  8061 consensus_queue.cc:1059] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:24:41.948177  8043 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:41.961447  7898 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:41.979367  8042 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:41.980511  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 65568.4us
I20260709 12:24:41.981279  5934 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:41.983378  7836 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:41.983906  6642 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:41.986541  7998 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:41.986738  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:41.989843  6006 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:41.991816  6006 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:41.996528  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:41.999413  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:42.006666  6081 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:42.009811  7993 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:42.010217  7993 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:42.010589  7993 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:41.936611  8060 consensus_queue.cc:1059] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:24:42.020058  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:42.023787  8042 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.024885  8041 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:42.030536  5959 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:42.002918  7967 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:42.030830  8046 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.013s
I20260709 12:24:41.991887  8026 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.043098  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:42.051674  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 55228.2us
W20260709 12:24:42.039613  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.063473  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.069427  6117 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:42.070062  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:42.041522  7967 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:24:42.081430  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 82061.3us
W20260709 12:24:42.099354  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.099665  6006 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:42.108588  5934 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:42.111316  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.111683  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.114770  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.115456  5965 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:42.117385  8041 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:42.120561  8070 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:42.121208  8070 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:42.121614  8070 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.083567  8061 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:42.051288  8045 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.100100  8068 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:42.125846  8061 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:42.131659  8061 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.083412  8038 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:42.124598  8069 raft_consensus.cc:3055] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:42.094672  7967 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.131111  8068 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:42.135377  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:42.138482  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 139231us
I20260709 12:24:42.135669  8052 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:42.141043  8052 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:42.141426  8052 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:42.142190  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.156701  8058 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:42.157176  8058 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:42.157544  8058 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.158063  5865 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 2 to 3, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:42.163205  5865 catalog_manager.cc:5697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.164501  8026 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:42.133988  8038 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:42.177641  8038 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.160986  8055 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:42.135124  8069 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:42.142621  8068 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.180454  5865 catalog_manager.cc:5697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 3 to 4, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 4 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:42.199360  8069 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.198640  8055 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:42.225119  8060 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:42.236464  8060 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:42.236865  8060 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.238821  8068 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.227720  8055 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:42.260854  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 125547us
I20260709 12:24:42.280532  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:42.303988  8068 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:42.306370  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 159983us
I20260709 12:24:42.319643  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:42.170625  7993 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.323673  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:42.339475  5961 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:42.353858  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.362941  8045 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:42.368994  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.369458  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.258540  8058 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:42.375238  5959 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:24:42.378935  6115 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:42.384807  6646 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:42.385782  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:42.386152  5965 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:34550
I20260709 12:24:42.386832  5965 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:42.388499  5965 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.388751  8075 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:42.377449  8069 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:42.412772  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.413066  6117 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:42.413975  8002 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:42.418815  8070 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:42.410025  8068 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.431368  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:42.435102  5961 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:42.425848  8060 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:42.448199  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 128636us
I20260709 12:24:42.437076  5965 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.449573  6645 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
W20260709 12:24:42.449172  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 364845us
I20260709 12:24:42.459771  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:42.462648  6038 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:42.456434  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 175958us
I20260709 12:24:42.464017  6040 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.413004  7993 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:42.465224  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:42.475394  6009 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:42.465026  7898 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:24:42.431823  8061 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:42.482021  5965 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:42.497784  6040 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:24:42.500603  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 81794.6us
I20260709 12:24:42.504611  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:42.505424  5964 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.503862  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:42.507349  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:42.508384  5965 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.459604  8075 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.042s
I20260709 12:24:42.497531  8081 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.519330  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:42.521198  8041 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:42.521595  8041 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:42.521941  8041 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.523825  8082 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:42.524259  8082 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:42.524632  8082 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:42.526176  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:42.524251  8051 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
W20260709 12:24:42.528388  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.517082  8080 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:42.529808  8051 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:42.530344  8051 raft_consensus.cc:697] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:42.531325  8051 consensus_queue.cc:237] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.532160  8075 raft_consensus.cc:3055] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:42.532517  8075 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:42.533337  8075 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.535153  8058 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:42.535859  8036 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:42.536283  8036 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:42.537151  8036 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.538239  8055 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:42.539606  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.541536  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:42.504614  8078 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:42.546454  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:42.501443  8050 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
W20260709 12:24:42.550668  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 88923us
I20260709 12:24:42.538403  8036 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.556100  5965 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:42.563598  8079 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.543718  8078 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:42.571060  8075 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.549212  8042 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:42.582595  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:42.574103  8078 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.548254  8041 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:42.590381  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 86583us
I20260709 12:24:42.570494  6642 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:42.591961  8083 consensus_queue.cc:1059] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
W20260709 12:24:42.592599  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.609582  6038 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:42.610881  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.593408  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:42.545585  8038 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.598992  8061 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:42.602689  5964 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:42.551445  7967 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.607368  6117 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:42.551225  8088 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.059s
I20260709 12:24:42.581648  7898 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.030s
I20260709 12:24:42.607389  6006 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:42.617478  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 101817us
I20260709 12:24:42.617429  6006 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:42.610450  8042 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.619029  5960 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:42.618325  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:42.617700  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 100425us
I20260709 12:24:42.671437  6081 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:42.648729  7967 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:42.675915  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.676714  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:42.654603  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 61265.1us
I20260709 12:24:42.618140  8070 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:42.625957  8061 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:42.619277  8079 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.662716  8034 raft_consensus.cc:3055] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:42.635022  8083 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.047s
I20260709 12:24:42.662817  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:42.665009  8060 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:42.637094  8038 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:42.666301  5967 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:42.641077  8052 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.694242  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:42.694813  5964 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.696174  8052 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:42.668071  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.672993  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 54742.7us
I20260709 12:24:42.686998  8034 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:42.700121  8034 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.701169  6009 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:42.701340  8034 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.673254  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:42.686446  7993 raft_consensus.cc:2955] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:42.703042  7836 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:42.618105  8005 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:24:42.684044  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.657954  8041 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:42.685328  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.703511  7836 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:42.703987  5959 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:42.704964  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:42.705408  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:42.705964  5963 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.706027  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:42.685776  5962 raft_consensus.cc:1240] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:42.687285  5966 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:42.682241  8009 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:42.710091  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:42.701220  5964 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:24:42.716355  6038 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:42.684711  8061 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:42.717206  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:42.709117  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:42.717991  5968 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.717221  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:42.718703  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:42.718909  6040 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:42.719308  6038 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:42.720402  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:42.720940  6038 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:42.721530  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:42.723259  5962 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:42.723471  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.682277  8069 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:42.724709  5964 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:42.704487  8005 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:42.684595  8045 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:24:42.702481  8084 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.001s
I20260709 12:24:42.714673  8009 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:42.720741  8061 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.726315  8069 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:42.740893  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:42.742694  5965 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:42.743157  8070 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:42.743278  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:42.744096  6041 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:42.740648  8091 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:42.745409  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:42.726632  8080 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:42.740556  8055 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:42.747605  6009 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:42.750660  5961 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:42.751047  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:42.753685  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:42.759145  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:42.758728  6042 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:42.760672  5968 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
W20260709 12:24:42.761736  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.752990  8005 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:42.753623  8045 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:42.768908  5961 raft_consensus.cc:2955] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:42.770594  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:42.758596  8069 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.772469  5963 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:42.766812  6036 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:42.777652  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:42.773923  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.774277  8009 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.778553  5963 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:42.774999  6009 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:42.775878  8070 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:42.780049  8080 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:42.780439  8080 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:42.780781  8045 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.772334  6035 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:42.780817  8080 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.777448  5965 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:42.758370  8091 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:42.773487  8055 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:42.787786  8055 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:42.788818  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:42.788656  8055 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.789866  8055 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.787371  8091 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.779153  5968 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:42.800156  8051 raft_consensus.cc:2955] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:42.757236  8050 consensus_queue.cc:1059] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.020s
I20260709 12:24:42.781363  8076 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:42.802397  8050 raft_consensus.cc:3055] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:42.802831  8050 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:42.803732  8050 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.804945  8050 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:42.704514  7836 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.780825  6009 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:42.819960  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:42.824427  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 43686us
I20260709 12:24:42.825016  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:42.825969  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:42.827144  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.827080  6009 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:42.828367  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:42.829030  5966 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:42.830621  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:42.781397  8009 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.833729  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:42.832278  8061 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:42.830451  8068 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.827615  8070 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:42.827452  8060 raft_consensus.cc:2764] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:42.830049  8071 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:42.863569  8101 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:42.864481  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.866639  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.867791  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.868655  5962 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:42.868800  5961 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:42.830837  8058 consensus_queue.cc:1059] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:24:42.871204  5968 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:42.871269  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.872289  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.873279  5963 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:42.896550  5959 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:24:42.877709  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:42.878425  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 44784us
I20260709 12:24:42.830252  8090 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:42.881501  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 50950.9us
I20260709 12:24:42.899258  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:42.881367  8078 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:42.886057  5960 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:42.869695  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.887534  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:42.827898  8076 consensus_queue.cc:1059] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:24:42.900115  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:42.889024  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:42.903409  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:42.891047  8102 consensus_queue.cc:1059] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.010s
I20260709 12:24:42.893761  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:42.894428  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:42.856271  8045 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:42.890592  8077 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:42.910207  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.910609  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.911240  5964 raft_consensus.cc:2393] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:42.911383  6009 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:42.912024  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:42.912221  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:42.912585  6643 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.912384  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:42.913323  6109 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:42.913417  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.913087  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:42.913645  6109 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:42.914156  6111 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.912755  6110 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:42.916150  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:42.914384  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.834313  8005 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:42.917392  5960 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:42.895637  8070 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:42.919207  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:42.928979  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:42.901261  8090 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:42.930430  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:42.931012  6118 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:42.933383  6009 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:42.935798  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:42.936352  6649 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:42.937016  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:42.914000  6644 raft_consensus.cc:1240] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:42.937981  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.943279  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.942704  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.942848  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.911208  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:42.944636  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.981439  5960 raft_consensus.cc:2393] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:42.987880  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:42.988967  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 55668.5us
I20260709 12:24:42.990494  6643 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:42.992482  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:43.005846  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.007189  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:43.015194  6110 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:42.936683  8090 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:43.016716  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 88099.3us
I20260709 12:24:43.017175  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:24:43.017171  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 159564us
I20260709 12:24:43.029227  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:43.021780  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:43.057657  5964 raft_consensus.cc:2393] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:42.945186  8045 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.078s
I20260709 12:24:42.996795  8101 raft_consensus.cc:3055] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:43.017797  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:24:43.040897  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.018815  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:43.019606  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:43.065090  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:42.994259  8077 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.050840  6082 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:42.918097  8060 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.044350  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:42.990775  8005 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.022397  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:43.066146  6006 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:43.067682  5960 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:42.937963  8050 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.073746  5965 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:43.047747  5959 raft_consensus.cc:2955] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:43.081187  8107 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:43.081746  6082 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.082919  6082 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:43.083276  8098 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:24:43.084009  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.049935  8104 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.088749  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:43.091050  6111 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:43.092028  6649 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:43.092315  8053 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:24:43.092723  8108 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.093427  8108 consensus_queue.cc:1059] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:43.094408  8108 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:43.095486  8108 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:43.095840  8108 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:43.096164  8108 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:43.101609  6114 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:43.063755  8101 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:43.049983  8096 consensus_queue.cc:1059] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.153s
I20260709 12:24:43.108014  7998 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:43.109339  6608 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.097440  7836 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:43.113380  8053 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:43.120476  7998 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:43.115672  8077 raft_consensus.cc:3055] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:43.123298  7836 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:24:43.133039  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 66973us
I20260709 12:24:43.082104  8107 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:24:43.123828  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:43.120684  8060 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:43.138626  6006 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:43.142549  7898 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.144465  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.144930  7836 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:43.146605  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 58010.4us
I20260709 12:24:43.132069  7998 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:43.123461  8061 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:43.158286  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:43.092034  8109 consensus_queue.cc:1059] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:24:43.136124  8077 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:43.164803  8096 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:43.150713  8080 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:43.165944  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.161249  6109 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.152488  8060 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:43.190119  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:43.191514  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:43.195751  8111 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:43.157487  8052 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:43.157009  8068 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:43.160953  7967 consensus_queue.cc:1059] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:24:43.202956  8034 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:43.203260  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:43.208504  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.217469  6643 raft_consensus.cc:2955] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:43.072722  8070 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.119697  8069 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:43.210361  6649 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:43.212590  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 55059.5us
W20260709 12:24:43.280949  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 115083us
I20260709 12:24:43.281308  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:43.213016  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 133630us
I20260709 12:24:43.137888  8053 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:24:43.260840  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 102628us
I20260709 12:24:43.207922  8076 consensus_queue.cc:1059] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.069s
I20260709 12:24:43.157828  8078 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:43.274591  6109 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.132140  8091 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:43.281598  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.273281  8107 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.276261  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:43.237401  6118 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:43.210321  7982 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.069s
I20260709 12:24:43.277484  8034 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:43.268363  8111 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:43.274924  8083 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.285262  8068 raft_consensus.cc:697] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:43.312372  6037 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:43.317315  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 311517us
I20260709 12:24:43.319070  8071 raft_consensus.cc:3055] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:43.319486  8053 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:43.321568  8082 consensus_meta.cc:287] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.797s	user 0.011s	sys 0.000s
I20260709 12:24:43.323834  6608 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.158324  8101 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:43.327445  6109 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
W20260709 12:24:43.328583  8075 consensus_meta.cc:287] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.751s	user 0.000s	sys 0.010s
W20260709 12:24:43.329392  8036 consensus_meta.cc:287] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.774s	user 0.002s	sys 0.009s
I20260709 12:24:43.329298  8068 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.273102  6644 raft_consensus.cc:2955] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:43.343080  5960 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:43.343813  8090 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:43.346107  8090 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:43.346913  8081 raft_consensus.cc:3055] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:43.347281  8081 raft_consensus.cc:740] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:43.348110  8081 consensus_queue.cc:260] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.349066  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:43.296036  8077 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:43.319088  8051 consensus_meta.cc:287] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.511s	user 0.007s	sys 0.011s
I20260709 12:24:43.312733  8038 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.363099  6642 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:43.363962  6040 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:43.295240  7998 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:43.310253  8111 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.331877  8091 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:43.332664  8034 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.332916  7836 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:43.311964  8060 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.325591  8071 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:24:43.332955  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50286.6us
I20260709 12:24:43.310577  8096 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:43.337522  5934 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:43.339818  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:43.340519  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:43.355604  6651 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:43.357467  5932 leader_election.cc:336] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 1.501s (SENT)
I20260709 12:24:43.359927  6649 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:43.386512  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:43.387199  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:43.386730  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 49260us
I20260709 12:24:43.389147  5934 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:43.353564  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:43.329257  8080 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:43.364908  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 72384.4us
I20260709 12:24:43.368839  7998 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:43.392701  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:43.351912  6646 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:43.335795  8082 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:43.371096  8036 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:43.370144  6608 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.404311  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:43.404465  6608 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.381878  8069 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:43.350440  8058 raft_consensus.cc:3055] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:43.351104  8109 raft_consensus.cc:3055] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:43.349383  8081 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:43.370100  8077 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.393982  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:43.394711  5932 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:43.394945  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:43.399369  6082 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:43.392258  8075 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:43.405059  6041 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:43.361057  8052 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:43.381647  8108 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:43.449363  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 56749.9us
I20260709 12:24:43.407498  8096 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.409650  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:43.451504  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.405479  8046 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.409900  8005 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:43.395529  8038 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:43.450917  5934 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:43.451341  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:43.450505  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:43.398301  8034 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:43.407691  8050 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.407276  8109 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:24:43.456130  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 46570.7us
I20260709 12:24:43.435403  8060 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:43.407089  8058 raft_consensus.cc:740] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:24:43.457405  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 58083.5us
I20260709 12:24:43.457500  6608 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.450819  7967 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:43.460764  6643 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:43.460664  5934 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:43.465291  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 107862us
I20260709 12:24:43.462357  6039 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:43.466073  5932 leader_election.cc:336] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 1.515s (SENT)
I20260709 12:24:43.463392  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.466495  5932 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:43.457546  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:43.452421  8071 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:43.467764  8106 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.469895  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.410351  7836 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:43.471323  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:43.472983  8120 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.473058  8096 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.454277  8075 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.540783  6645 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:43.475399  8107 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:43.463336  8083 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.483304  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:43.515543  8122 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:24:43.517292  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 47460.4us
I20260709 12:24:43.545259  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.475256  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.543149  8088 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:43.534734  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 74148.3us
I20260709 12:24:43.520095  8071 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:43.463905  8050 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.550549  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:43.551748  8117 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:43.554029  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.551903  8061 raft_consensus.cc:3055] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:43.555673  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:43.546963  8042 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.549288  8089 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.560918  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:43.565454  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:43.568297  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 102246us
W20260709 12:24:43.569406  5932 leader_election.cc:336] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 1.577s (SENT)
I20260709 12:24:43.549561  7898 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:43.553498  8122 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:24:43.583145  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 107946us
I20260709 12:24:43.545496  8109 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:43.560913  8121 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:43.595930  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:43.597123  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:24:43.597391  5932 leader_election.cc:336] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 1.663s (SENT)
I20260709 12:24:43.586076  8108 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:43.566869  8117 raft_consensus.cc:697] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:43.553869  6646 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:43.391261  7993 raft_consensus.cc:2955] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:43.562278  8083 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:43.548308  8058 consensus_queue.cc:260] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:43.555152  8061 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:43.594385  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:43.598110  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:43.592617  8009 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.562759  8046 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:43.601987  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:43.574426  8096 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.615983  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:43.592017  5960 raft_consensus.cc:2955] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:43.624406  5968 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:43.552197  8088 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.549674  8052 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.624166  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:43.592154  8053 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.599586  8082 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:43.633273  8096 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.598229  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:43.631270  8046 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:24:43.637669  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.593623  8042 consensus_queue.cc:1059] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:24:43.624224  8121 raft_consensus.cc:697] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:43.613176  8038 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:43.600293  8120 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.037s
I20260709 12:24:43.646345  8129 raft_consensus.cc:1064] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:43.646522  8123 consensus_queue.cc:1059] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:24:43.649461  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:43.649744  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:43.659814  6110 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:43.657979  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:43.643536  8058 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:43.649783  8126 log.cc:927] Time spent T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:24:43.673916  6111 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:43.671933  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:43.634776  8009 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.645673  8046 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.674786  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:43.678719  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:43.682083  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:43.679795  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:43.683579  8101 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:43.683898  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:43.684325  6651 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:43.684998  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:43.685667  6043 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:24:43.688210  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.693840  6009 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.695802  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:43.674907  7898 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.700898  6009 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.702096  8104 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.704924  6111 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:43.704959  8104 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.704284  6009 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.683077  7967 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:43.647966  8053 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.704093  8123 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.682724  6648 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
W20260709 12:24:43.710179  6006 service_pool.cc:136] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36260 dropped due to backpressure: service queue is full with 50 items
W20260709 12:24:43.722416  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 125054us
I20260709 12:24:43.722355  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:43.722821  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:43.725883  6043 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:24:43.723089  5932 leader_election.cc:336] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 1.665s (SENT)
I20260709 12:24:43.709017  7898 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.729528  7898 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:43.734581  6038 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:43.735769  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:43.736452  6647 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:43.710763  8082 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.734670  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.743258  5932 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:43.670782  8061 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.747260  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:43.722779  6006 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36260 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1604)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1342)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1625)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1621)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1346)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1348)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1630)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1340)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1349)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1632)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1350)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1352)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1353)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1605)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1608)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1610)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1611)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1613)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1614)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1615)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1616)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1617)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1618)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 340)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1631)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1359)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1365)
I20260709 12:24:43.751132  8083 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:43.752569  8108 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.753064  8108 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.755355  8108 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:43.746906  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:43.655010  8122 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.723364  8050 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:43.742663  7898 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:43.743903  8123 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:43.748498  8082 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:43.785486  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 76804.4us
I20260709 12:24:43.792048  5960 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:43.808043  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:43.681512  8117 consensus_queue.cc:237] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:43.810890  6110 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:43.787703  8123 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:43.744701  8038 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:43.821858  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:43.823812  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 71787.2us
I20260709 12:24:43.825918  6082 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:43.834753  6035 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:43.782650  8046 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:43.773952  8134 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:43.789155  7898 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.849267  8134 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.839491  8120 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:43.850605  8096 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:43.846894  8009 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:43.738781  8121 consensus_queue.cc:237] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:43.848558  8138 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:43.855046  8123 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.856452  8053 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:43.857296  8005 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.822525  6647 raft_consensus.cc:2955] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:43.878700  8111 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:43.849395  8143 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:43.858067  7898 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:43.822614  7967 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:43.895860  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:43.852854  8088 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:43.891871  6006 service_pool.cc:137] UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36260 dropped due to backpressure: service queue is full with 50 items Contents of service queue:
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1341)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1342)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1625)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1626)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1621)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1627)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1346)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1347)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1348)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1609)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1363)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1628)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1629)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1369)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1630)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1364)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1340)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1349)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1632)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1343)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1350)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1351)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1352)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1353)
Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1367)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1605)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1606)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1607)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1608)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1610)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1611)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1613)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1614)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1615)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1616)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1617)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1618)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 340)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1631)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1354)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1355)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1356)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1357)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1358)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1359)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1360)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1361)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1362)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1365)
Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1368)
I20260709 12:24:43.911708  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:43.915871  5964 raft_consensus.cc:1240] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:43.900926  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:24:43.958815  8077 consensus_meta.cc:287] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.509s	user 0.007s	sys 0.004s
I20260709 12:24:43.961167  8046 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:43.963677  6041 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:43.964947  8111 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:43.975731  8036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.563s	user 0.024s	sys 0.027s
W20260709 12:24:43.990096  8036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.025s	sys 0.027s
I20260709 12:24:43.955400  8129 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:43.998684  6648 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:44.000815  8109 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:44.006701  8150 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.111s	user 0.003s	sys 0.000s
I20260709 12:24:44.006968  8134 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:43.996985  8081 consensus_meta.cc:287] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.548s	user 0.008s	sys 0.003s
I20260709 12:24:44.011875  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.012742  6041 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:44.013616  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.013973  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:44.015046  6645 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:44.014169  6041 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:44.015384  6043 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:44.016988  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.017647  6041 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:44.018117  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.020012  6035 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:44.024330  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:44.024571  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.026435  6035 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:44.040177  8075 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:44.054924  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1333) took 1328 ms. Trace:
I20260709 12:24:44.055390  6037 rpcz_store.cc:276] 0709 12:24:42.718902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.719005 (+   103us) service_pool.cc:224] Handling call
0709 12:24:42.719297 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.323506 (+604209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.046685 (+723179us) spinlock_profiling.cc:243] Waited 593 ms on lock 0x7b5400270954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:24:44.046902 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1363564800}
I20260709 12:24:44.056839  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:44.071195  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:44.071417  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:44.071960  6113 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:44.099927  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:44.111651  6111 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:44.113139  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:44.115801  6649 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 1 LEARNER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20260709 12:24:44.117238  6117 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:44.117461  6037 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:44.120927  6109 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:44.074936  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:44.122637  6116 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:44.072165  6115 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:44.124756  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.129616  6037 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
W20260709 12:24:44.127347  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 380136us
I20260709 12:24:44.130996  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:44.124732  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:44.132068  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 63004.5us
I20260709 12:24:44.134157  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:44.135417  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:44.134886  6035 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:44.136525  8120 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.135520  5932 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:44.138840  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:44.140964  7967 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:44.142933  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:44.145951  6647 raft_consensus.cc:2393] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 3: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:24:44.148732  6036 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:44.149873  8036 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.150502  8036 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:44.150990  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:44.151273  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.152217  6038 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:44.153007  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.157127  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:24:44.148936  8131 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.515s	user 0.000s	sys 0.002s
I20260709 12:24:44.158715  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:44.163815  7998 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:44.164455  8042 raft_consensus.cc:2764] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:24:44.160380  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.165397  8141 raft_consensus.cc:3055] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:44.166188  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.161818  8117 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:44.161710  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:44.167439  5964 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:44.167632  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:44.153352  6035 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:44.168682  6611 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:44.168927  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:44.169523  6035 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:44.169713  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.170531  5932 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:44.171799  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.172540  6038 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:44.170531  8141 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:44.173739  8142 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:44.174558  8134 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:44.182288  6084 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:44.184211  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:44.175563  5932 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:44.171674  8120 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:24:44.179414  5862 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 188) took 2238 ms. Trace:
I20260709 12:24:44.152908  8036 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:44.133600  8106 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.046s
I20260709 12:24:44.165292  8042 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:24:44.212091  5932 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:44.212940  8096 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:44.277114  8096 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.277585  8096 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.214210  8142 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:44.214985  6116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:44.282666  8142 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:44.282881  6116 raft_consensus.cc:606] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.283138  8142 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:44.216744  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 337) took 1067 ms. Trace:
I20260709 12:24:44.284343  6039 rpcz_store.cc:276] 0709 12:24:43.149904 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:43.150162 (+   258us) service_pool.cc:224] Handling call
0709 12:24:43.409535 (+259373us) spinlock_profiling.cc:243] Waited 44.6 ms on lock 0x7b5800124298. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482602dfc0 00007f4826018929 00007f48260183d2 00007f481f58fbd4
0709 12:24:43.409781 (+   246us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:43.466019 (+ 56238us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.216510 (+750491us) spinlock_profiling.cc:243] Waited 52.4 ms on lock 0x7b5400172854. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:24:44.216684 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":223168000}
I20260709 12:24:44.285652  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.286281  6039 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:44.217478  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:44.218321  6041 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:44.219707  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:44.220494  5865 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 293) took 2109 ms. Trace:
I20260709 12:24:44.222021  5863 catalog_manager.cc:5697] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:44.223440  8082 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:44.224939  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:24:44.292181  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 67321.3us
I20260709 12:24:44.293191  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:44.172324  8121 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:44.227193  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.295689  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.214980  6035 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:44.228237  6042 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:44.184419  8111 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:44.298218  8111 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.185871  8088 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:44.230631  6114 raft_consensus.cc:1240] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:44.298710  8106 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:44.298868  8088 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.299192  8106 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:44.299320  8088 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.300019  8106 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:44.301214  8106 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.231176  6647 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:44.232743  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.302875  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.303506  6043 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:44.303476  6042 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:44.303804  8055 consensus_queue.cc:1059] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:44.304406  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.234709  5864 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 302) took 1587 ms. Trace:
I20260709 12:24:44.180594  8083 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:44.304898  8055 raft_consensus.cc:3055] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:44.298635  8111 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:44.305738  8042 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:44.243988  6643 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:44.304455  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.306912  6042 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:44.270715  5862 rpcz_store.cc:276] 0709 12:24:41.939851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:41.940017 (+   166us) service_pool.cc:224] Handling call
0709 12:24:44.178432 (+2238415us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:42.239903 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:42.366054 (+126151us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:42.366104 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:24:42.366134 (+    30us) tablet.cc:662] Decoding operations
0709 12:24:42.366592 (+   458us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:42.366666 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:42.366693 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:42.366997 (+   304us) tablet.cc:701] Row locks acquired
0709 12:24:42.367035 (+    38us) write_op.cc:260] PREPARE: finished
0709 12:24:42.367197 (+   162us) write_op.cc:270] Start()
0709 12:24:42.367330 (+   133us) write_op.cc:276] Timestamp: P: 1783599882367135 usec, L: 0
0709 12:24:42.367350 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:24:42.397301 (+ 29951us) log.cc:844] Serialized 533 byte log entry
0709 12:24:42.635815 (+238514us) op_driver.cc:464] REPLICATION: finished
0709 12:24:42.768675 (+132860us) write_op.cc:301] APPLY: starting
0709 12:24:42.795072 (+ 26397us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:42.829856 (+ 34784us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:42.843682 (+ 13826us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:42.943949 (+100267us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:43.021627 (+ 77678us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:43.043183 (+ 21556us) write_op.cc:312] APPLY: finished
0709 12:24:43.084604 (+ 41421us) log.cc:844] Serialized 23 byte log entry
0709 12:24:43.091700 (+  7096us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:43.091772 (+    72us) write_op.cc:454] Released schema lock
0709 12:24:43.091809 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:43.092164 (+   355us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:43.092192 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":313329,"reported_tablets":1,"spinlock_wait_cycles":80384,"child_traces":[["op",{"apply.queue_time_us":120368,"apply.run_cpu_time_us":2837,"apply.run_wall_time_us":330689,"num_ops":1,"prepare.queue_time_us":189697,"prepare.run_cpu_time_us":20137,"prepare.run_wall_time_us":289496,"raft.queue_time_us":67810,"raft.run_cpu_time_us":52809,"raft.run_wall_time_us":204338,"replication_time_us":268303,"thread_start_us":270618,"threads_started":4,"wal-append.queue_time_us":96833}]]}
W20260709 12:24:44.246292  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.248194  7967 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:44.249369  8104 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:44.250646  8141 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:44.316566  8141 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:44.239336  8162 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
W20260709 12:24:44.240032  6082 consensus_peers.cc:597] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: UpdateConsensus request on kudu.consensus.ConsensusService from 127.0.0.1:36260 dropped due to backpressure: service queue is full with 50 items. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:24:44.289512  5865 rpcz_store.cc:276] 0709 12:24:42.111312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.112736 (+  1424us) service_pool.cc:224] Handling call
0709 12:24:44.220424 (+2107688us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:42.492573 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:42.493125 (+   552us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:42.493152 (+    27us) write_op.cc:435] Acquired schema lock
0709 12:24:42.493166 (+    14us) tablet.cc:662] Decoding operations
0709 12:24:42.493685 (+   519us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:42.493729 (+    44us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:42.493762 (+    33us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:24:42.502519 (+  8757us) tablet.cc:701] Row locks acquired
0709 12:24:42.502542 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:24:42.527179 (+ 24637us) write_op.cc:270] Start()
0709 12:24:42.527295 (+   116us) write_op.cc:276] Timestamp: P: 1783599882527123 usec, L: 0
0709 12:24:42.527321 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:24:42.527958 (+   637us) log.cc:844] Serialized 1293 byte log entry
0709 12:24:42.830793 (+302835us) op_driver.cc:464] REPLICATION: finished
0709 12:24:43.017738 (+186945us) write_op.cc:301] APPLY: starting
0709 12:24:43.021352 (+  3614us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:43.021500 (+   148us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:43.060598 (+ 39098us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:43.273940 (+213342us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:43.285257 (+ 11317us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:24:43.294024 (+  8767us) write_op.cc:312] APPLY: finished
0709 12:24:43.297290 (+  3266us) log.cc:844] Serialized 35 byte log entry
0709 12:24:43.303611 (+  6321us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:43.303702 (+    91us) write_op.cc:454] Released schema lock
0709 12:24:43.303748 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:43.304077 (+   329us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:43.304118 (+    41us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":108335,"reported_tablets":5,"spinlock_wait_cycles":342400,"child_traces":[["op",{"apply.queue_time_us":113288,"apply.run_cpu_time_us":3503,"apply.run_wall_time_us":309860,"num_ops":3,"prepare.queue_time_us":266370,"prepare.run_cpu_time_us":4529,"prepare.run_wall_time_us":35676,"replication_time_us":299619,"thread_start_us":66417,"threads_started":1}]]}
I20260709 12:24:44.251598  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.255155  8123 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:44.326805  6044 raft_consensus.cc:2376] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5. Re-sending same reply.
I20260709 12:24:44.328022  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:44.328661  6044 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.257043  6649 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:44.258512  6645 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:44.264093  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.265545  8061 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.266798  6115 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:44.267326  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 44293us
I20260709 12:24:44.179471  6037 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:44.281239  6118 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:44.288375  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.287211  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.296316  6038 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:44.332823  6041 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:24:44.296293  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 84317us
I20260709 12:24:44.297083  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.333767  6035 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:44.333890  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:44.307801  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.307245  5864 rpcz_store.cc:276] 0709 12:24:42.647254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.647422 (+   168us) service_pool.cc:224] Handling call
0709 12:24:42.783641 (+136219us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:24:44.234625 (+1450984us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":165765,"reported_tablets":2,"spinlock_wait_cycles":234020736}
I20260709 12:24:44.305315  8055 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:44.335748  6609 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:44.316754  6117 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:44.319308  8104 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:44.305523  8151 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:44.305277  8083 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.295854  8082 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:44.295559  8146 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:44.319507  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 79532.9us
I20260709 12:24:44.348954  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.335001  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:44.335078  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.348547  6084 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:44.339949  6036 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:44.345315  6112 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:44.350543  6037 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:44.356508  8120 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:44.357025  8104 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:44.340956  7967 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:44.357832  5932 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:44.358379  8157 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:44.358625  8107 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:44.345619  8089 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.358379  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.346065  8151 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.359696  6043 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:44.362809  7982 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:44.348547  8146 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.348676  8083 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:44.361079  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:44.380223  6037 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:24:44.383381  6041 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:44.390489  6035 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:44.391639  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1615) took 1001 ms. Trace:
I20260709 12:24:44.295140  8036 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:24:44.391909  5932 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:44.392234  6035 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:44.390321  6114 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:44.388253  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.390295  6039 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:44.393301  6035 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:44.393236  6038 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:44.340245  8090 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:24:44.346222  8109 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:24:44.391991  6041 rpcz_store.cc:276] 0709 12:24:43.391461 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.382977 (+991516us) service_pool.cc:224] Handling call
0709 12:24:44.383234 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.391292 (+  8058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.391471 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.402794  6043 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:44.394830  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1614) took 1004 ms. Trace:
I20260709 12:24:44.405983  6039 rpcz_store.cc:276] 0709 12:24:43.390338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.389969 (+999631us) service_pool.cc:224] Handling call
0709 12:24:44.390176 (+   207us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.394429 (+  4253us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.394771 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.406704  8104 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:44.406630  6041 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:44.407320  8104 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:44.408141  6039 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:44.409444  8104 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:44.409615  6039 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:44.349805  8081 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.041s
W20260709 12:24:44.410729  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52414.4us
I20260709 12:24:44.368280  8141 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.034s
I20260709 12:24:44.404641  8055 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:44.374595  8107 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:44.383744  8151 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:44.420882  6035 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 12:24:44.412272  5932 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:44.413324  6038 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: [2.4-2.4]
I20260709 12:24:44.412272  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:44.382098  7982 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:44.389446  8146 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:44.460892  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 48692.4us
I20260709 12:24:44.415637  8082 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:44.402515  8079 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:24:44.405768  8140 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.059s
I20260709 12:24:44.465324  7982 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.418002  8141 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:44.487392  8141 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:44.488459  8142 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:44.490936  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1610) took 1101 ms. Trace:
I20260709 12:24:44.491417  6036 rpcz_store.cc:276] 0709 12:24:43.389737 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.388766 (+999029us) service_pool.cc:224] Handling call
0709 12:24:44.454652 (+ 65886us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.490511 (+ 35859us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.490559 (+    48us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.490615 (+    56us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:44.490667 (+    52us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.490734 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.490866 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:44.495265  8083 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:44.497529  8135 raft_consensus.cc:3055] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:44.497932  8135 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:44.501674  8157 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:44.418689  8107 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:44.503405  8111 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:44.505471  8111 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:44.411098  8145 consensus_queue.cc:1059] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.112s
I20260709 12:24:44.481662  7967 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:44.506759  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:44.507083  8135 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.3, Last appended by leader: 3, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:44.508062  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:44.508514  8135 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:44.509232  6650 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:44.506676  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1617) took 1114 ms. Trace:
I20260709 12:24:44.510823  6040 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
W20260709 12:24:44.445204  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:44.476487  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 64267.6us
I20260709 12:24:44.479540  5932 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:44.512281  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.413213  6648 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:44.465714  8052 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:44.420747  8053 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:44.415870  8147 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:44.414196  8088 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:44.483373  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:44.390787  8117 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:44.509769  6043 rpcz_store.cc:276] 0709 12:24:43.392679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.388521 (+995842us) service_pool.cc:224] Handling call
0709 12:24:44.395241 (+  6720us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.411228 (+ 15987us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.486445 (+ 75217us) spinlock_profiling.cc:243] Waited 3.7 ms on lock 0x7b540030e8d0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:44.506618 (+ 20173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8500096}
I20260709 12:24:44.413719  8036 raft_consensus.cc:3055] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:44.508769  6642 raft_consensus.cc:2393] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 8: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:24:44.417389  8055 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:44.418267  8042 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:44.555330  6650 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:44.546002  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:44.560951  6035 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:44.550791  6082 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.481853  8120 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:44.416126  8046 consensus_queue.cc:1059] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.129s
I20260709 12:24:44.543045  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:44.543877  8083 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:44.577348  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 97902.6us
I20260709 12:24:44.546689  8111 raft_consensus.cc:2764] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:24:44.578876  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:44.579365  6112 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:44.575233  6035 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
W20260709 12:24:44.581365  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 58086.4us
I20260709 12:24:44.583190  8081 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:44.583681  8081 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:44.584566  8081 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:44.586649  8157 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:44.594015  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.547111  8053 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:44.614820  6645 raft_consensus.cc:2368] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4.
I20260709 12:24:44.555737  8036 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:24:44.624356  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 73632.1us
I20260709 12:24:44.625319  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:44.488406  8141 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:44.631902  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:44.555441  8061 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
I20260709 12:24:44.620415  8053 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:44.615600  7993 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:44.662446  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.602371  8157 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:24:44.628648  8120 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:44.639498  8002 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.627743  8106 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.046s
I20260709 12:24:44.630605  8052 consensus_queue.cc:1059] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:24:44.666584  8079 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.650328  8038 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 2.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:24:44.696326  8096 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:44.703715  6082 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:44.704279  8157 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:44.740024  6647 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:24:44.708423  8132 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:44.712625  8002 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:44.713011  6650 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:44.691046  8142 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:44.735853  6044 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:24:44.737342  6082 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.688905  7998 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:44.731207  8052 raft_consensus.cc:3055] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:44.774495  6042 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:44.694491  7993 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:44.782876  7998 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:24:44.785476  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 48232.9us
I20260709 12:24:44.785668  7998 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:44.786324  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:44.789377  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 234141us
I20260709 12:24:44.739886  8157 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:44.779850  8134 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:44.778681  8052 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:44.738840  8079 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:44.802850  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:44.803900  6044 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 4
W20260709 12:24:44.804986  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 195343us
I20260709 12:24:44.806521  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.815066  6044 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:44.817976  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.774806  7982 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:44.823999  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.826238  6006 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.777228  8002 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:44.827771  6006 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.834736  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:44.835427  5967 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:44.835870  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.837163  5967 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:44.837790  8112 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:44.838660  8112 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:24:44.838932  5967 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:24:44.840667  5967 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:44.829244  6609 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:44.796058  7993 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:44.844153  8081 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:44.844437  8166 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:44.837112  6006 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.844861  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:44.845170  8166 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:44.845871  6006 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.844810  7993 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:44.846123  8166 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:44.829846  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 239855us
I20260709 12:24:44.847240  8104 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:44.847921  8104 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:44.846828  7993 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:44.848752  8052 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:44.864995  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.846487  6009 leader_election.cc:400] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4.
I20260709 12:24:44.868068  6009 leader_election.cc:403] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:44.868772  8104 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4.
W20260709 12:24:44.869725  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 44701.4us
I20260709 12:24:44.871109  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:44.871745  6044 raft_consensus.cc:2376] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5. Re-sending same reply.
I20260709 12:24:44.873879  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:44.874886  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:44.876416  5960 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:44.877899  5959 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:44.878834  5960 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:44.879088  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:44.826766  8088 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:44.826035  8075 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:44.884555  6043 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:24:44.872699  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:44.833066  8061 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:44.896690  8170 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:24:44.897073  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:44.898504  7982 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:44.887856  6040 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:44.899729  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:44.833281  8082 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:44.903211  8169 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.106s	user 0.000s	sys 0.000s
I20260709 12:24:44.904536  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:44.893445  6043 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:44.895342  5968 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:44.849364  8109 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:24:44.896263  5965 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:44.900139  8036 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:44.907541  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 108714us
W20260709 12:24:44.895800  8168 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
I20260709 12:24:44.891422  5967 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:24:44.914593  5964 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:24:44.821563  8145 consensus_queue.cc:1059] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.056s
I20260709 12:24:44.915567  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:44.918615  6035 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:44.921607  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:44.929773  6040 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:24:44.931226  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:44.889464  8142 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:24:44.926357  8167 log.cc:927] Time spent T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:24:44.864269  8132 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.063s
I20260709 12:24:44.936358  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:44.941996  8172 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.001s
W20260709 12:24:44.924770  8163 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.295s	user 0.000s	sys 0.001s
I20260709 12:24:44.896961  8061 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:24:44.919346  7982 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.934926  8038 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:44.951539  7967 raft_consensus.cc:3055] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:44.909466  8112 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:24:44.909207  8104 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:44.974485  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52995.9us
I20260709 12:24:44.976004  8177 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:44.977735  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 158639us
I20260709 12:24:44.991391  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 340) took 1540 ms. Trace:
I20260709 12:24:45.007189  6037 rpcz_store.cc:276] 0709 12:24:43.411942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.391382 (+979440us) service_pool.cc:224] Handling call
0709 12:24:44.391755 (+   373us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.391952 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:44.772163 (+380211us) log.cc:844] Serialized 14 byte log entry
0709 12:24:44.952146 (+179983us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:44.952197 (+    51us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:44.952239 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.952439 (+   200us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:44.952557 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":403741,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":9294,"raft.queue_time_us":22855,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":17745,"thread_start_us":437468,"threads_started":2}
W20260709 12:24:44.997721  8164 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.382s	user 0.002s	sys 0.000s
I20260709 12:24:44.863567  8120 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:44.924172  8144 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.050s
I20260709 12:24:44.926704  8052 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:44.923990  8147 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:24:44.974205  6036 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:45.020258  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1359) took 1390 ms. Trace:
I20260709 12:24:45.020687  6041 rpcz_store.cc:276] 0709 12:24:43.629369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.407749 (+778380us) service_pool.cc:224] Handling call
0709 12:24:44.408035 (+   286us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.408595 (+   560us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.408617 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.409103 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.623309 (+214206us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:44.795662 (+172353us) log.cc:844] Serialized 14 byte log entry
0709 12:24:44.795865 (+   203us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.795931 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.020014 (+224083us) raft_consensus.cc:1685] finished
0709 12:24:45.020032 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.020185 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5828,"prepare.queue_time_us":193219,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":39,"raft.queue_time_us":295,"raft.run_cpu_time_us":224,"raft.run_wall_time_us":11366,"spinlock_wait_cycles":31872,"thread_start_us":374114,"threads_started":2,"wal-append.queue_time_us":284859}
W20260709 12:24:45.003755  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.005970  6082 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:44.915305  8157 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:45.008693  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 163900us
I20260709 12:24:44.936851  8106 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:24:45.024237  8193 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:24:45.025054  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1368) took 1268 ms. Trace:
I20260709 12:24:45.026712  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:45.028365  6041 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:45.004027  7967 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:44.975081  8142 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.010121  8104 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:45.034093  6038 rpcz_store.cc:276] 0709 12:24:43.756314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.497929 (+741615us) service_pool.cc:224] Handling call
0709 12:24:44.498274 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.498624 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.498651 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.499107 (+   456us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.646656 (+147549us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:44.802870 (+156214us) log.cc:844] Serialized 14 byte log entry
0709 12:24:44.818719 (+ 15849us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.818842 (+   123us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.024823 (+205981us) raft_consensus.cc:1685] finished
0709 12:24:45.024843 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.024982 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":204059,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":26104,"raft.run_cpu_time_us":290,"raft.run_wall_time_us":37450,"thread_start_us":273542,"threads_started":2,"wal-append.queue_time_us":279457}
I20260709 12:24:45.044634  8194 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.012s
I20260709 12:24:45.045416  8141 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.019761  8177 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:45.063971  8174 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:45.043045  8104 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:45.066011  8107 consensus_meta.cc:287] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.563s	user 0.009s	sys 0.000s
I20260709 12:24:45.032742  8134 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:45.064664  8174 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:45.043413  8193 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:45.047983  8079 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:45.087872  8046 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:45.076697  8166 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.061069  8177 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:45.089171  8107 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:45.108089  8173 log.cc:927] Time spent T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.178s	user 0.000s	sys 0.000s
I20260709 12:24:45.140394  8106 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.121299  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:45.123212  6117 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:45.170351  5961 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:45.126196  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:45.132380  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:45.098958  8002 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:45.136431  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 117264us
W20260709 12:24:45.141425  8196 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.056s	user 0.001s	sys 0.000s
W20260709 12:24:45.120715  8186 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
I20260709 12:24:45.151352  8122 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:45.185879  6114 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:45.137562  8038 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:45.109061  7967 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:45.192534  5961 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:45.191397  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:45.156164  8193 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:24:45.157297  8166 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:45.206125  8117 consensus_meta.cc:287] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.651s	user 0.002s	sys 0.008s
W20260709 12:24:45.209612  8146 consensus_meta.cc:287] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.743s	user 0.008s	sys 0.000s
I20260709 12:24:45.168908  8046 raft_consensus.cc:697] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:24:45.225672  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 219774us
I20260709 12:24:45.185253  6646 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
W20260709 12:24:45.230484  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 198213us
I20260709 12:24:45.239287  8203 consensus_queue.cc:1059] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:45.240528  8203 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:24:45.245525  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 309457us
I20260709 12:24:45.247467  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:45.241962  8203 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.007s
I20260709 12:24:45.248961  8201 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:45.178615  8106 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:45.224227  8089 consensus_meta.cc:287] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.842s	user 0.013s	sys 0.000s
I20260709 12:24:45.220793  8090 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Stepping down as leader of term 3
W20260709 12:24:45.234928  8176 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:24:45.249502  8201 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:45.263574  8104 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.231616  8142 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:45.233117  8117 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:45.200966  8038 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:45.272627  8185 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:24:45.236032  8147 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:45.199105  8122 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:45.255048  8151 consensus_meta.cc:287] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.835s	user 0.011s	sys 0.000s
I20260709 12:24:45.279923  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:45.250907  8005 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:45.232873  8146 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.270444  8089 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:45.265944  8090 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:45.294365  8083 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:45.296799  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 47244.9us
I20260709 12:24:45.311591  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1616) took 1919 ms. Trace:
I20260709 12:24:45.312088  6042 rpcz_store.cc:276] 0709 12:24:43.391661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.387603 (+995942us) service_pool.cc:224] Handling call
0709 12:24:44.774308 (+386705us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:44.777156 (+  2848us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:45.311363 (+534207us) spinlock_profiling.cc:243] Waited 386 ms on lock 0x7b540030f2d0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:45.311516 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":888674048}
I20260709 12:24:45.318552  5963 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:45.322214  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1362) took 1685 ms. Trace:
I20260709 12:24:45.322722  6039 rpcz_store.cc:276] 0709 12:24:43.636935 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.456522 (+819587us) service_pool.cc:224] Handling call
0709 12:24:44.456829 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.457143 (+   314us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.457169 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.479911 (+ 22742us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.799146 (+319235us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:44.953836 (+154690us) log.cc:844] Serialized 14 byte log entry
0709 12:24:44.976038 (+ 22202us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.976119 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.321977 (+345858us) raft_consensus.cc:1685] finished
0709 12:24:45.321999 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:45.322145 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25679,"prepare.queue_time_us":75295,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":24902,"raft.run_cpu_time_us":265,"raft.run_wall_time_us":25400,"thread_start_us":362498,"threads_started":2,"wal-append.queue_time_us":405261}
I20260709 12:24:45.289263  8078 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.024s
I20260709 12:24:45.303174  8199 raft_consensus.cc:3055] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
W20260709 12:24:45.327234  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 150930us
W20260709 12:24:45.330057  8123 consensus_meta.cc:287] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 1.003s	user 0.012s	sys 0.000s
I20260709 12:24:45.331063  8096 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:45.327450  8211 raft_consensus.cc:3055] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:45.350667  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:45.275197  8174 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.357757  5963 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:45.300601  8005 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.299755  8151 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.289405  8134 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:45.313215  8083 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.300915  8046 consensus_queue.cc:237] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:45.298002  8147 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.342911  8107 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:45.343235  8199 raft_consensus.cc:740] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:45.369551  8211 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:45.380088  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:45.366652  8208 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:45.381246  6651 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 3: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:24:45.379580  8078 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.385632  8078 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
W20260709 12:24:45.379151  7993 consensus_meta.cc:287] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.530s	user 0.010s	sys 0.000s
I20260709 12:24:45.391728  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:45.393959  5962 raft_consensus.cc:2410] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:24:45.394133  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:45.394789  6039 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 3
W20260709 12:24:45.402704  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:45.405854  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 131638us
I20260709 12:24:45.328845  8201 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.381374  8166 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:45.411509  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:45.412261  6042 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.395184  8208 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:45.400131  8111 raft_consensus.cc:3055] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:45.380782  8120 consensus_queue.cc:1059] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
I20260709 12:24:45.419811  8215 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:45.388106  8195 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.400319  7993 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:45.436069  8146 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:45.425308  8151 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:45.442775  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:45.443395  5963 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:24:45.426088  8111 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:45.445230  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:45.447531  6608 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:45.449936  5966 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:45.452505  6113 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:45.453095  8151 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:45.453809  8135 consensus_meta.cc:287] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.945s	user 0.012s	sys 0.001s
I20260709 12:24:45.436698  8096 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:45.452979  8208 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:45.455127  6042 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:45.456629  6039 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
W20260709 12:24:45.448092  8055 consensus_meta.cc:287] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.880s	user 0.010s	sys 0.002s
I20260709 12:24:45.459055  6609 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:45.459929  6609 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:45.440613  8199 consensus_queue.cc:260] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:45.461994  8199 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.444482  8195 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.461400  8208 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.454619  8151 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.457106  8146 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:45.472025  7993 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:45.472280  7982 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:45.479038  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:45.464038  8083 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:45.465642  8089 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:45.463958  8166 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:45.482121  7993 consensus_queue.cc:1059] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:45.482755  7998 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:45.479836  8151 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.490667  8089 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:45.436514  8211 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:45.494779  8166 raft_consensus.cc:697] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:24:45.473495  8053 consensus_meta.cc:287] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.785s	user 0.004s	sys 0.007s
I20260709 12:24:45.471997  8195 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:45.483973  5966 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:45.480139  8146 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:45.462859  8096 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.507931  8083 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:45.510265  8146 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:24:45.511871  8179 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.689s	user 0.002s	sys 0.003s
I20260709 12:24:45.511576  8083 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.497390  7998 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:45.504776  8088 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.451531  8002 consensus_queue.cc:1059] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.063s
I20260709 12:24:45.512655  7993 raft_consensus.cc:3055] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:45.522819  6651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 591) took 1008 ms. Trace:
I20260709 12:24:45.523198  6651 rpcz_store.cc:276] 0709 12:24:44.514724 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.542748 (+ 28024us) service_pool.cc:224] Handling call
0709 12:24:45.522628 (+979880us) spinlock_profiling.cc:243] Waited 809 ms on lock 0x7b54006b6f54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:45.522763 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1861485824}
I20260709 12:24:45.524554  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:45.525171  5963 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:45.517846  8088 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.529223  8005 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:45.529743  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.531185  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:45.531936  5963 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:45.533715  7998 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.509204  8053 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:45.535622  8089 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.539078  8036 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.564965  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:45.568686  8053 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:45.520695  7993 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:45.544485  8146 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.547188  8199 raft_consensus.cc:3055] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:45.580487  8038 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:45.580802  8199 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:45.581729  8122 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:45.554700  8055 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:45.555289  8166 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.555990  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:45.570063  7993 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.577129  8083 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:45.580196  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:45.587087  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:45.581655  8199 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.480721  8111 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:45.600486  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 44573.9us
I20260709 12:24:45.604115  8202 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:45.604737  8202 raft_consensus.cc:697] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:24:45.610162  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.609140  8193 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.613421  8193 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:45.613263  8151 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.617056  8151 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:45.617643  8111 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.623685  8104 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:45.624747  8078 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:45.625910  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:45.626411  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:45.626969  5963 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.629513  8147 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:45.610834  7993 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:45.632694  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 399023us
I20260709 12:24:45.640288  5963 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:45.648869  5968 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:24:45.650341  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:45.605700  8202 consensus_queue.cc:237] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:45.642784  8199 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:45.624008  8177 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:45.657209  8192 raft_consensus.cc:993] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:24:45.664495  8053 consensus_queue.cc:1059] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:45.657959  8203 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:45.652937  8078 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:24:45.662037  8002 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:24:45.665302  8184 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.640s	user 0.004s	sys 0.000s
I20260709 12:24:45.665407  8192 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:45.666776  8053 raft_consensus.cc:1081] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:24:45.676138  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:45.676843  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:45.682721  8078 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:45.683882  8002 raft_consensus.cc:3055] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:45.663811  6081 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:45.685567  8157 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:45.681561  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:45.717545  6041 raft_consensus.cc:2393] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:24:45.718133  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 54395.2us
I20260709 12:24:45.719727  6110 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:45.702740  5863 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 309) took 2856 ms. Trace:
I20260709 12:24:45.723856  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:45.724509  5967 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:45.703161  5864 catalog_manager.cc:5697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.737793  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:45.738343  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:45.739455  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:45.726342  5864 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 2 to 3, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:45.740087  6042 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:45.719758  8002 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:45.717281  8109 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:45.896355  5960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.035s	sys 0.032s
W20260709 12:24:46.122165  5960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.038s	sys 0.040s
W20260709 12:24:46.055394  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.100075  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:46.062364  6082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.015s	sys 0.003s
W20260709 12:24:45.896010  5959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.577s	user 0.022s	sys 0.045s
W20260709 12:24:45.850163  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.123832  6082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.715s	user 0.015s	sys 0.003s
W20260709 12:24:46.124732  5959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.022s	sys 0.056s
W20260709 12:24:46.129724  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.741400  5864 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 2 to 3, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:46.138947  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.127220  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 718501us
I20260709 12:24:46.140544  5864 catalog_manager.cc:5697] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:45.947592  5967 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
W20260709 12:24:46.009218  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:45.854789  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:45.879385  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 130277us
I20260709 12:24:46.146209  5864 catalog_manager.cc:5697] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 2 to 3, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:45.900226  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:24:45.791359  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 420796us
I20260709 12:24:46.158825  6041 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:46.140810  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:46.162204  8221 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:46.163244  8221 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.164891  5967 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:34550
I20260709 12:24:46.165647  5967 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:24:46.165855  8221 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:46.166319  5967 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:46.167131  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 1735) took 1472 ms. Trace:
I20260709 12:24:46.168977  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:46.154227  5864 catalog_manager.cc:5697] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 2 to 3, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:45.726027  8203 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:46.068553  8121 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.770951  8082 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.899721  8104 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:45.973555  8075 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.720777  5863 rpcz_store.cc:276] 0709 12:24:42.846852 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:42.889594 (+ 42742us) service_pool.cc:224] Handling call
0709 12:24:43.261472 (+371878us) spinlock_profiling.cc:243] Waited 16.4 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:24:45.702655 (+2441183us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:44.405900 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:44.463025 (+ 57125us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:44.463090 (+    65us) write_op.cc:435] Acquired schema lock
0709 12:24:44.463108 (+    18us) tablet.cc:662] Decoding operations
0709 12:24:44.463431 (+   323us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:44.463483 (+    52us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:44.463510 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:24:44.463684 (+   174us) tablet.cc:701] Row locks acquired
0709 12:24:44.463701 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:24:44.463839 (+   138us) write_op.cc:270] Start()
0709 12:24:44.463962 (+   123us) write_op.cc:276] Timestamp: P: 1783599884463791 usec, L: 0
0709 12:24:44.463987 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:24:44.464643 (+   656us) log.cc:844] Serialized 595 byte log entry
0709 12:24:45.063266 (+598623us) op_driver.cc:464] REPLICATION: finished
0709 12:24:45.156525 (+ 93259us) spinlock_profiling.cc:243] Waited 14.9 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f481df4a0ac 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4824a8aef0
0709 12:24:45.314852 (+158327us) write_op.cc:301] APPLY: starting
0709 12:24:45.321303 (+  6451us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:45.332021 (+ 10718us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:45.334578 (+  2557us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:45.378262 (+ 43684us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:45.394947 (+ 16685us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:24:45.400478 (+  5531us) write_op.cc:312] APPLY: finished
0709 12:24:45.414999 (+ 14521us) log.cc:844] Serialized 23 byte log entry
0709 12:24:45.425637 (+ 10638us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:45.432042 (+  6405us) write_op.cc:454] Released schema lock
0709 12:24:45.433730 (+  1688us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:45.451277 (+ 17547us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:45.452311 (+  1034us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":549892,"reported_tablets":1,"spinlock_wait_cycles":37777664,"child_traces":[["op",{"apply.queue_time_us":235822,"apply.run_cpu_time_us":2332,"apply.run_wall_time_us":136963,"num_ops":1,"prepare.queue_time_us":63586,"prepare.run_cpu_time_us":76782,"prepare.run_wall_time_us":267602,"raft.queue_time_us":85164,"raft.run_cpu_time_us":28784,"raft.run_wall_time_us":189183,"replication_time_us":599126,"spinlock_wait_cycles":34166016,"thread_start_us":400954,"threads_started":4,"wal-append.queue_time_us":237026}]]}
I20260709 12:24:45.899250  8178 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:45.883718  8146 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:46.170819  6115 rpcz_store.cc:276] 0709 12:24:44.638338 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.638576 (+   238us) service_pool.cc:224] Handling call
0709 12:24:44.638973 (+   397us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:44.639328 (+   355us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:44.639356 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:44.639864 (+   508us) log.cc:844] Serialized 26 byte log entry
0709 12:24:44.807362 (+167498us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:44.807399 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:44.807458 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:45.662965 (+855507us) spinlock_profiling.cc:243] Waited 49.4 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:24:45.975209 (+312244us) raft_consensus.cc:1685] finished
0709 12:24:45.975234 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.110885 (+135651us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7522,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":15212,"spinlock_wait_cycles":113517440,"thread_start_us":131459,"threads_started":1,"wal-append.queue_time_us":291402}
I20260709 12:24:45.896096  8055 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:45.853255  6036 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:46.175964  5962 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:46.176491  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:45.898810  8193 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:46.159083  8143 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.158887  8061 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.175776  6608 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:46.285181  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 109482us
I20260709 12:24:46.286144  6608 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:46.174324  8212 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.775s	user 0.009s	sys 0.020s
I20260709 12:24:46.170840  8221 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:46.174435  8201 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.001s	sys 0.030s
I20260709 12:24:46.248611  8075 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.256114  6081 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:46.175565  8180 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:46.181094  8106 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:46.167184  8109 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.194777  8181 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:46.054636  8078 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:46.291657  8212 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.901s	user 0.009s	sys 0.021s
W20260709 12:24:46.315560  8201 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.872s	user 0.002s	sys 0.031s
I20260709 12:24:46.324440  8221 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.289249  8061 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.318555  8151 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:46.328766  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 72728.3us
I20260709 12:24:46.199200  8082 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.196065  8121 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.200371  8104 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.286880  8134 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.282987  8193 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.254293  8178 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.290575  8177 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:46.405921  8151 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.411116  6115 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.326017  8195 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:46.260378  8055 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.326435  8120 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:46.291699  8036 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.409646  5967 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.403060  8106 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.292941  8213 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.119s
I20260709 12:24:46.462595  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:46.473505  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:46.428332  8144 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.713s	user 0.041s	sys 0.053s
W20260709 12:24:46.413096  8188 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 1.313s	user 0.008s	sys 0.017s
W20260709 12:24:46.489949  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 325150us
I20260709 12:24:46.285809  8143 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.499341  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:46.459846  8202 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:46.506879  6113 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:24:46.519394  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:46.460305  8219 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.669s	user 0.015s	sys 0.032s
I20260709 12:24:46.530540  5934 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:46.489673  8227 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:46.545569  8036 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:46.494828  8089 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.819s	user 0.026s	sys 0.045s
I20260709 12:24:46.538086  5967 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:46.406493  8181 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.493032  8195 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:46.547497  6109 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:46.493294  8151 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:46.495457  8166 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.038s	sys 0.053s
W20260709 12:24:46.670203  8166 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.038s	sys 0.057s
W20260709 12:24:46.517071  8230 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.116s	user 0.000s	sys 0.000s
W20260709 12:24:46.517638  8238 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
W20260709 12:24:46.516433  8226 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
W20260709 12:24:46.532460  8144 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.837s	user 0.044s	sys 0.055s
W20260709 12:24:46.573158  8233 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:24:46.573848  8143 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:46.575110  7993 consensus_meta.cc:287] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.927s	user 0.009s	sys 0.000s
I20260709 12:24:46.576676  8038 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.491421  8134 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.588763  8214 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:46.589913  8090 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.591434  8145 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:46.594367  8122 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:46.595775  6648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 595) took 1588 ms (client timeout 1788 ms). Trace:
I20260709 12:24:46.596909  7998 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.603799  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 1741) took 1480 ms. Trace:
I20260709 12:24:46.671060  8195 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:46.605827  8096 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:46.612298  8088 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:46.613660  8234 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.150s	user 0.000s	sys 0.000s
W20260709 12:24:46.617302  8237 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:24:46.625032  8002 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.549831  8202 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.630065  8178 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:46.631451  8121 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:46.633191  8055 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:46.689257  8002 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:46.689492  8166 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:46.634321  8221 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:46.413800  8180 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:46.643332  8199 consensus_meta.cc:287] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.977s	user 0.010s	sys 0.000s
I20260709 12:24:46.692709  6116 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:46.694550  8180 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:46.694836  8096 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:24:46.558598  8219 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.768s	user 0.015s	sys 0.034s
I20260709 12:24:46.643951  8197 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:46.681417  8146 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:46.554373  8227 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:46.649129  8082 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:46.724114  8197 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.520272  8106 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.646176  8061 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:46.690205  8055 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.659204  8193 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:46.522384  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 236279us
W20260709 12:24:46.665539  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:46.666294  8089 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.991s	user 0.026s	sys 0.051s
I20260709 12:24:46.664093  7967 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:46.672582  8213 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:46.681654  6110 rpcz_store.cc:276] 0709 12:24:45.123468 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.123651 (+   183us) service_pool.cc:224] Handling call
0709 12:24:45.123962 (+   311us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:45.720217 (+596255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.603491 (+883274us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b54001031d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:24:46.603720 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1369714432}
W20260709 12:24:46.667702  8208 consensus_meta.cc:287] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 1.189s	user 0.004s	sys 0.008s
W20260709 12:24:46.681125  6648 rpcz_store.cc:269] 0709 12:24:45.007304 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.007447 (+   143us) service_pool.cc:224] Handling call
0709 12:24:46.595504 (+1588057us) spinlock_profiling.cc:243] Waited 741 ms on lock 0x7b54005ac154. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:46.595670 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1703729536}
I20260709 12:24:46.664636  8140 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:24:46.687546  6112 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:46.680651  8214 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:46.690076  8166 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.780092  8166 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:46.647795  8217 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:24:46.713872  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:46.781132  6649 raft_consensus.cc:2368] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9.
I20260709 12:24:46.782039  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 2132) took 1533 ms. Trace:
I20260709 12:24:46.782222  8214 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.783370  8214 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:46.715189  5931 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.555s	user 0.007s	sys 0.026s
W20260709 12:24:46.784735  5931 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.008s	sys 0.026s
W20260709 12:24:46.785578  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.696312  8090 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.653918  8104 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:46.713550  8111 consensus_meta.cc:287] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 1.091s	user 0.012s	sys 0.006s
I20260709 12:24:46.688040  8211 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:46.657219  8109 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:46.695796  8134 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:46.725497  8227 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:46.725526  8146 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.724759  8202 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:46.811916  8146 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:46.744679  8197 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:46.747771  8106 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:46.749064  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:46.682657  8038 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.814638  8192 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:46.712838  8174 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:46.766012  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:46.718756  8075 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:46.684520  8122 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.695451  8096 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.775763  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:46.823901  6643 raft_consensus.cc:2410] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:46.719280  8243 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:46.777593  8216 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
I20260709 12:24:46.675892  8120 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:46.789518  6115 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:46.786201  5959 rpcz_store.cc:276] 0709 12:24:45.248576 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.248721 (+   145us) service_pool.cc:224] Handling call
0709 12:24:45.249020 (+   299us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.288798 (+ 39778us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.288830 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.289290 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:24:45.541530 (+252240us) spinlock_profiling.cc:243] Waited 1.52 ms on lock 0x7b4800080058. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4825f7daa1 00007f4825f74b37 00007f4825f749ca 00007f482606c26f 00007f482606bf37 00007f482608055c 00007f4826080508 00007f4826080488 00007f4826080443 00007f482607f6ec 00007f4824fa9a96
0709 12:24:46.128228 (+586698us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:46.128277 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.128354 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:46.645849 (+517495us) spinlock_profiling.cc:243] Waited 3.94 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:24:46.781812 (+135963us) raft_consensus.cc:1685] finished
0709 12:24:46.781832 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.781951 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":27653,"raft.queue_time_us":35554,"raft.run_cpu_time_us":3238,"raft.run_wall_time_us":252701,"spinlock_wait_cycles":12554496,"thread_start_us":809497,"threads_started":1,"wal-append.queue_time_us":1098981}
I20260709 12:24:46.799294  8181 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:46.803215  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:46.687672  8145 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.821861  8192 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:46.824594  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 61249.6us
I20260709 12:24:46.844375  6608 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:46.825546  8187 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.834558  8213 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.809305  8208 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:46.809576  8107 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:46.836094  8036 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:46.768350  8055 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.838201  5960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 2131) took 1591 ms. Trace:
I20260709 12:24:46.836824  8243 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.822783  7998 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:46.822495  8038 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:46.857409  5960 rpcz_store.cc:276] 0709 12:24:45.247132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.247285 (+   153us) service_pool.cc:224] Handling call
0709 12:24:45.247637 (+   352us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.276566 (+ 28929us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.276592 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.283451 (+  6859us) log.cc:844] Serialized 26 byte log entry
0709 12:24:46.122745 (+839294us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:46.122792 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:46.122938 (+   146us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:46.837981 (+715043us) raft_consensus.cc:1685] finished
0709 12:24:46.838002 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:46.838140 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28510,"raft.queue_time_us":36824,"raft.run_cpu_time_us":191,"raft.run_wall_time_us":6630,"thread_start_us":818678,"threads_started":1,"wal-append.queue_time_us":1201443}
I20260709 12:24:46.841434  8146 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:46.856257  8034 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:24:46.849225  6611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.668s	user 0.017s	sys 0.062s
I20260709 12:24:46.861169  8088 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:46.868098  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:46.853231  8089 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:46.851841  8199 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.861272  8201 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:24:46.867182  6611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.017s	sys 0.062s
I20260709 12:24:46.870312  8034 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.885510  6084 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:46.886575  8243 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:46.839655  8174 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.886950  8089 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:24:46.895407  6609 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.714s	user 0.033s	sys 0.034s
W20260709 12:24:46.895733  6609 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.714s	user 0.033s	sys 0.034s
I20260709 12:24:46.852711  8195 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.858361  8208 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.904603  8208 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:46.858224  8107 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.887379  8036 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:46.907135  8107 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:46.898526  8203 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.011s	sys 0.035s
I20260709 12:24:46.882314  8088 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.906847  8036 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.887195  8034 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:46.869848  8146 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:46.870533  8187 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.958896  8088 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:46.912606  6006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.019s	sys 0.029s
I20260709 12:24:46.856890  8213 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:46.916070  8089 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.865614  7998 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.894177  8046 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:46.917001  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:46.961789  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:46.962399  7998 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:46.959969  8187 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:46.962920  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:46.923641  8145 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:46.890156  8199 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.983656  8151 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:46.985029  6644 raft_consensus.cc:2368] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4.
I20260709 12:24:46.925074  6609 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:46.925400  8096 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:46.897557  8166 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:46.911571  8120 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:46.952668  8203 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.690s	user 0.011s	sys 0.036s
I20260709 12:24:46.907362  8055 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:46.957342  8192 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:46.895174  8201 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:46.960815  6006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.663s	user 0.019s	sys 0.029s
W20260709 12:24:46.988587  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 63596.5us
I20260709 12:24:46.935381  8122 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:47.007354  5961 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.815s	user 0.015s	sys 0.045s
W20260709 12:24:47.040156  5961 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.016s	sys 0.045s
W20260709 12:24:47.043854  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.045974  6611 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.629s (SENT) [suppressed 62 similar messages]
I20260709 12:24:46.994743  8088 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:46.992587  8211 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:46.995519  8195 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:47.051225  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.052013  6645 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
W20260709 12:24:47.052563  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.039628  8254 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:24:47.034327  8203 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:46.998710  8166 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:47.084385  8213 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:47.130923  5963 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.247s	user 0.019s	sys 0.022s
W20260709 12:24:47.131672  5963 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.247s	user 0.019s	sys 0.022s
I20260709 12:24:47.060000  8211 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:47.153716  8203 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:47.155588  8211 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:47.051419  8146 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:47.199843  8199 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:47.203635  8036 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:47.204054  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.204811  8090 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:47.205186  8240 log.cc:927] Time spent T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:24:47.205924  8151 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:47.205569  8090 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:47.206619  8055 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.207248  8055 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:47.209570  8055 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:47.210129  8055 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.212266  8090 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:47.213119  8055 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:47.215512  8055 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:47.216368  8174 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:47.228766  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:47.237650  6650 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:47.257565  8166 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:47.157482  8227 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:47.266068  8227 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:47.270768  6082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.101s	user 0.019s	sys 0.029s
W20260709 12:24:47.299774  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 65863.5us
W20260709 12:24:47.300272  6082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.131s	user 0.019s	sys 0.029s
W20260709 12:24:47.301024  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 1.16022e+06us
I20260709 12:24:47.301617  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:24:47.282541  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.269711  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:47.311133  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:24:47.317128  6009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.013s	sys 0.020s
W20260709 12:24:47.319593  6009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.013s	sys 0.020s
W20260709 12:24:47.277884  6008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.867s	user 0.019s	sys 0.027s
W20260709 12:24:47.320466  6008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.020s	sys 0.027s
I20260709 12:24:47.297921  8201 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:47.318706  5864 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.884s	user 0.006s	sys 0.030s
W20260709 12:24:47.327711  5864 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.007s	sys 0.030s
I20260709 12:24:47.303807  8002 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.304067  8214 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:47.355329  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 53274.8us
I20260709 12:24:47.356864  8192 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:24:47.363440  8112 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.409s	user 0.036s	sys 0.027s
I20260709 12:24:47.363338  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:24:47.363857  8112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.409s	user 0.036s	sys 0.027s
I20260709 12:24:47.364184  6039 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 3: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:24:47.364856  8055 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:47.367444  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:47.368321  6039 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:24:47.327100  8251 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.375299  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:47.376092  6039 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:47.382872  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:47.383647  6042 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:47.385522  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:47.386080  6042 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:47.382340  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:47.392334  6041 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:47.397526  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:47.398227  6036 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:47.406680  6036 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:47.367164  8075 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.355177  8002 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:47.414165  6041 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
W20260709 12:24:47.415480  5932 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.953s	user 0.015s	sys 0.025s
W20260709 12:24:47.415881  5932 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.953s	user 0.015s	sys 0.025s
W20260709 12:24:47.416211  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 953474us
I20260709 12:24:47.362380  8199 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:24:47.357440  8192 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:47.361004  8214 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:47.368759  8055 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:47.425802  5934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.876s	user 0.010s	sys 0.014s
W20260709 12:24:47.426350  8212 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.936s	user 0.011s	sys 0.018s
W20260709 12:24:47.430987  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 385030us
W20260709 12:24:47.434485  5934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.885s	user 0.010s	sys 0.014s
I20260709 12:24:47.433014  8243 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:47.477797  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 947301us
I20260709 12:24:47.478542  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:47.373003  8251 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:47.425071  6042 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:47.432880  8090 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:47.418212  8075 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:47.432242  8199 consensus_queue.cc:1243] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer 24012af7747d4c4ea89c3da2ff950099 log is divergent from this leader: its last log entry 3.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:24:47.491022  6039 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
W20260709 12:24:47.492605  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.476217  8212 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.012s	user 0.011s	sys 0.019s
I20260709 12:24:47.489338  8213 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.495543  8122 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:47.496249  8122 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:47.434897  8255 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:24:47.498106  5933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.046s	user 0.013s	sys 0.016s
W20260709 12:24:47.521402  5933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.070s	user 0.013s	sys 0.017s
W20260709 12:24:47.504321  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:47.509950  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:47.496166  8213 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:47.522233  6115 raft_consensus.cc:2368] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4.
W20260709 12:24:47.498245  6007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.067s	user 0.012s	sys 0.039s
W20260709 12:24:47.523419  6007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.092s	user 0.012s	sys 0.039s
W20260709 12:24:47.524228  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 45786.9us
I20260709 12:24:47.524174  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:47.525317  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:47.526214  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:47.527932  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:47.528010  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:47.529399  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:47.531102  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:47.490381  8147 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.312s	user 0.000s	sys 0.038s
I20260709 12:24:47.532475  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:47.525223  5960 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:47.533171  5962 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:24:47.543339  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:47.547845  5960 raft_consensus.cc:2410] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:24:47.544528  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:47.548599  5967 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:47.549546  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:47.550129  5967 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:24:47.551597  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:47.555891  6116 raft_consensus.cc:2410] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:24:47.552381  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:47.551548  6651 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.690s	user 0.012s	sys 0.016s
I20260709 12:24:47.555097  5967 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:47.547760  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:47.530112  5959 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
W20260709 12:24:47.495165  8144 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.820s	user 0.003s	sys 0.021s
W20260709 12:24:47.519063  8078 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.855s	user 0.021s	sys 0.012s
W20260709 12:24:47.556524  6651 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.012s	sys 0.016s
I20260709 12:24:47.561053  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:47.518407  8244 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.495203  8090 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:47.494809  8243 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:47.656409  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:47.563269  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:47.563623  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:47.563668  6643 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.010s	sys 0.020s
W20260709 12:24:47.859403  6648 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.059s	user 0.000s	sys 0.028s
W20260709 12:24:47.564374  6647 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.793s	user 0.010s	sys 0.021s
W20260709 12:24:47.656453  5966 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.163s	user 0.021s	sys 0.032s
W20260709 12:24:47.644174  6649 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.025s	sys 0.012s
I20260709 12:24:47.536005  8255 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:47.841851  8002 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:47.641307  6118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.970s	user 0.015s	sys 0.035s
I20260709 12:24:47.610877  6109 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:47.655572  8199 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.549671  8212 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:47.661370  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:47.610435  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:47.592927  8259 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:47.609195  8262 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:47.550978  8147 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.379s	user 0.001s	sys 0.038s
I20260709 12:24:48.128925  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:47.805454  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:47.829276  8265 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:47.594400  5960 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 12:24:47.519377  8088 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:47.671114  6642 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.946s	user 0.016s	sys 0.032s
I20260709 12:24:48.123988  6115 raft_consensus.cc:2410] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
W20260709 12:24:47.752979  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 83615.4us
W20260709 12:24:48.127180  6647 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.356s	user 0.025s	sys 0.040s
W20260709 12:24:48.094102  8267 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.079s	user 0.000s	sys 0.000s
W20260709 12:24:48.123365  6643 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.254s	user 0.021s	sys 0.043s
I20260709 12:24:48.130226  6110 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 3: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:48.131873  5962 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:47.997038  8213 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:48.127379  5966 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.633s	user 0.030s	sys 0.049s
W20260709 12:24:48.127667  6649 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.261s	user 0.041s	sys 0.023s
I20260709 12:24:48.164495  6114 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:48.132954  6109 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:48.222882  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:48.133297  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:48.132483  6118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.462s	user 0.026s	sys 0.049s
W20260709 12:24:48.126915  6648 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.327s	user 0.004s	sys 0.040s
I20260709 12:24:48.117956  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:48.132069  8255 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:48.218864  6642 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.494s	user 0.020s	sys 0.058s
I20260709 12:24:48.119552  6082 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:48.191437  6116 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:24:48.134902  8144 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.451s	user 0.018s	sys 0.028s
W20260709 12:24:47.949366  8120 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.731s	user 0.011s	sys 0.026s
W20260709 12:24:47.644665  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:47.654857  6646 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.768s	user 0.007s	sys 0.031s
W20260709 12:24:48.032438  8256 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.197s	user 0.000s	sys 0.000s
W20260709 12:24:48.133719  8078 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.470s	user 0.031s	sys 0.018s
I20260709 12:24:48.032598  8260 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.247504  8260 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:48.043478  8214 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:48.169863  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:48.193430  5960 pending_rounds.cc:85] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 2
I20260709 12:24:48.118945  8055 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:48.251547  8260 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:48.251667  8055 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.224231  6118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 1754) took 1655 ms. Trace:
I20260709 12:24:48.191380  6117 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:24:48.252198  8055 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.252985  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:48.254081  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:48.224406  6112 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:48.254308  8055 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:48.252180  8260 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.255082  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:48.255285  8260 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.255692  6112 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:48.256546  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:48.257340  8260 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:48.257498  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:48.224977  6645 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:48.224767  5965 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
W20260709 12:24:48.228984  6009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.794s	user 0.023s	sys 0.028s
I20260709 12:24:48.232486  6114 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:48.192245  6111 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:48.227058  6109 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.261277  6117 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:48.261605  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:48.262387  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:47.864876  8146 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.596s	user 0.011s	sys 0.017s
W20260709 12:24:48.131201  8089 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.166s	user 0.025s	sys 0.043s
W20260709 12:24:48.073041  8252 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.408s	user 0.000s	sys 0.001s
I20260709 12:24:47.859200  8266 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:48.264241  5960 pending_rounds.cc:107] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:24:48.280869  5960 raft_consensus.cc:2917] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
W20260709 12:24:48.272502  8146 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.004s	user 0.012s	sys 0.018s
W20260709 12:24:48.235877  8120 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.017s	user 0.011s	sys 0.026s
I20260709 12:24:48.236299  8255 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.131872  8243 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:48.009771  8075 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:48.120446  8251 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:48.126569  8192 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:48.245298  5959 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:48.246609  8078 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:48.251044  8214 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:48.133379  8199 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:48.135063  8112 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.012s	sys 0.019s
W20260709 12:24:48.260826  6009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.826s	user 0.024s	sys 0.028s
W20260709 12:24:48.304200  5931 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.699s	user 0.003s	sys 0.010s
W20260709 12:24:48.304848  5931 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.700s	user 0.003s	sys 0.011s
I20260709 12:24:48.259570  6118 rpcz_store.cc:276] 0709 12:24:46.664659 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.666221 (+  1562us) service_pool.cc:224] Handling call
0709 12:24:46.670025 (+  3804us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.670239 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:46.670594 (+   355us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.223829 (+1553235us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.223881 (+    52us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:48.223921 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.223981 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.224095 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":239,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":26984,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"spinlock_wait_cycles":55040,"thread_start_us":1552913,"threads_started":1}
W20260709 12:24:48.305397  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.266749  6109 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:48.222658  8122 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:48.235217  8203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.078s	user 0.009s	sys 0.054s
W20260709 12:24:48.273187  5934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.726s	user 0.020s	sys 0.033s
I20260709 12:24:48.227841  8213 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.273370  6111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:48.274192  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:48.240901  6646 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.354s	user 0.012s	sys 0.057s
I20260709 12:24:48.191093  8259 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.273382  6112 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:48.272235  8089 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.308s	user 0.026s	sys 0.044s
I20260709 12:24:48.219295  8265 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.279259  8140 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:48.282590  5960 raft_consensus.cc:2889] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:48.283222  8090 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:48.283779  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1439) took 2543 ms. Trace:
I20260709 12:24:48.267257  8144 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:48.132066  8244 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:48.193095  8262 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:48.237756  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 118290us
I20260709 12:24:48.295837  8255 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:48.296804  8088 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:48.369345  8088 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.372359  8088 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:48.298688  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1441) took 2135 ms. Trace:
I20260709 12:24:48.373116  5966 rpcz_store.cc:276] 0709 12:24:46.163381 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.163507 (+   126us) service_pool.cc:224] Handling call
0709 12:24:46.163855 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.400394 (+236539us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.400431 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:46.408509 (+  8078us) log.cc:844] Serialized 26 byte log entry
0709 12:24:48.222589 (+1814080us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:48.235765 (+ 13176us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.241650 (+  5885us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.241734 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.298428 (+ 56694us) raft_consensus.cc:1685] finished
0709 12:24:48.298449 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.298622 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10809,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":3501,"raft.queue_time_us":153649,"raft.run_cpu_time_us":230,"raft.run_wall_time_us":24536,"thread_start_us":1964511,"threads_started":2,"wal-append.queue_time_us":1836789}
I20260709 12:24:48.307171  6037 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:48.376852  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.377523  6037 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:48.378392  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.379132  6037 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:48.379842  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.380501  6037 raft_consensus.cc:2393] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:48.381183  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.382138  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.307904  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.133792  8212 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.309331  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.306231  6039 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:48.395116  6035 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 2: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:48.396492  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.397188  6039 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:48.397109  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.397986  6035 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:48.310777  6044 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:48.315290  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:48.316883  6114 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:48.399045  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:48.318224  6084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.562s	user 0.011s	sys 0.015s
W20260709 12:24:48.302508  8112 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.851s	user 0.012s	sys 0.027s
W20260709 12:24:48.319725  6006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.862s	user 0.034s	sys 0.045s
W20260709 12:24:48.319511  6007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.758s	user 0.026s	sys 0.040s
W20260709 12:24:48.321168  5934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.774s	user 0.020s	sys 0.033s
W20260709 12:24:48.399603  6084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.011s	sys 0.015s
W20260709 12:24:48.321138  8203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.164s	user 0.009s	sys 0.054s
W20260709 12:24:48.329106  8107 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.000s	sys 0.012s
I20260709 12:24:48.339819  6118 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:24:48.317339  8243 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.388864  6036 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:24:48.318128  8260 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.346714  5961 rpcz_store.cc:276] 0709 12:24:45.740439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.740630 (+   191us) service_pool.cc:224] Handling call
0709 12:24:46.100673 (+360043us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:46.101063 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:46.101093 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:46.111921 (+ 10828us) log.cc:844] Serialized 26 byte log entry
0709 12:24:47.041111 (+929190us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:47.225148 (+184037us) log.cc:844] Serialized 14 byte log entry
0709 12:24:47.299148 (+ 74000us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.299264 (+   116us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:48.283560 (+984296us) raft_consensus.cc:1685] finished
0709 12:24:48.283579 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.283703 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73642,"prepare.queue_time_us":186465,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":50,"raft.queue_time_us":74188,"raft.run_cpu_time_us":361,"raft.run_wall_time_us":60533,"thread_start_us":848190,"threads_started":1,"wal-append.queue_time_us":1356214}
I20260709 12:24:48.358597  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:24:48.402400  8107 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.646s	user 0.000s	sys 0.013s
I20260709 12:24:48.361238  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:48.331699  8122 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.335912  8266 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.305745  5933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.759s	user 0.000s	sys 0.014s
W20260709 12:24:48.387166  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 261360us
I20260709 12:24:48.332429  8213 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:48.360755  8089 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:48.395670  6043 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:48.328356  6109 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 5. (term mismatch)
I20260709 12:24:48.460489  6109 pending_rounds.cc:85] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 4
I20260709 12:24:48.398240  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:48.456118  5933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.909s	user 0.000s	sys 0.014s
I20260709 12:24:48.461472  6039 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:48.399434  6111 raft_consensus.cc:606] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:48.400234  6118 pending_rounds.cc:85] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 5
I20260709 12:24:48.462739  6111 raft_consensus.cc:614] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:24:48.400290  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 874984us
W20260709 12:24:48.400730  6007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.839s	user 0.026s	sys 0.040s
I20260709 12:24:48.401039  6035 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:48.395004  6037 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:48.460834  6109 pending_rounds.cc:107] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:24:48.357632  8140 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.402093  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.301036  8078 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.417481  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:24:48.364619  6008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.932s	user 0.031s	sys 0.054s
W20260709 12:24:48.528539  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 64805.4us
W20260709 12:24:48.528899  6008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.096s	user 0.032s	sys 0.054s
W20260709 12:24:48.394563  8257 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.618s	user 0.007s	sys 0.028s
I20260709 12:24:48.455164  5962 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
W20260709 12:24:48.450534  6113 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.795s	user 0.007s	sys 0.028s
W20260709 12:24:48.530715  6113 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.876s	user 0.007s	sys 0.028s
W20260709 12:24:48.457479  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 96311.7us
I20260709 12:24:48.462790  6118 pending_rounds.cc:107] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:48.531575  6118 raft_consensus.cc:2889] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:24:48.399803  6006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.942s	user 0.034s	sys 0.045s
W20260709 12:24:48.534915  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 203941us
W20260709 12:24:48.535794  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.537643  6039 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:48.464941  6109 raft_consensus.cc:2889] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:48.465464  6044 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:48.543052  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:48.543802  6650 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
W20260709 12:24:48.450479  8227 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.644s	user 0.016s	sys 0.019s
I20260709 12:24:48.415236  8243 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:48.451133  8120 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:24:48.610837  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 66388.2us
I20260709 12:24:48.618489  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:24:48.618785  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 85311.8us
I20260709 12:24:48.419524  8260 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:48.620085  6643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 601) took 1761 ms. Trace:
W20260709 12:24:48.545670  8257 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.773s	user 0.008s	sys 0.029s
W20260709 12:24:48.535702  6009 connection.cc:256] RPC call timeout handler was delayed by -1.1590224689998649s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19090000000000001s for a response
W20260709 12:24:48.613318  8211 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 3 current term: 3 is higher.
I20260709 12:24:48.617514  6644 raft_consensus.cc:2410] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:48.626703  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:48.531013  8112 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.545683  8295 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:48.529592  8263 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:48.531163  8075 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.624130  6082 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:48.545200  8285 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.631716  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.545825  8288 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.626863  6009 leader_election.cc:400] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4.
W20260709 12:24:48.632484  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.622164  8227 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.859s	user 0.017s	sys 0.019s
W20260709 12:24:48.633849  6651 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.508s	user 0.051s	sys 0.060s
I20260709 12:24:48.458362  8122 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.642199  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:48.693588  6650 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:48.624850  6643 rpcz_store.cc:276] 0709 12:24:46.852196 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.852333 (+   137us) service_pool.cc:224] Handling call
0709 12:24:46.861931 (+  9598us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.862139 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:48.221929 (+1359790us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.613200 (+391271us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.613252 (+    52us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:48.613294 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.613361 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.613483 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4680,"prepare.queue_time_us":1436580,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"thread_start_us":1742283,"threads_started":2}
I20260709 12:24:48.643092  6117 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
W20260709 12:24:48.641646  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 404115us
I20260709 12:24:48.648123  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.695346  6043 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
W20260709 12:24:48.677240  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 53199.6us
I20260709 12:24:48.677789  6044 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:48.527688  8266 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.531599  8089 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.634172  8297 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.641341  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:48.702636  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:48.683509  6648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 600) took 1911 ms. Trace:
I20260709 12:24:48.685264  6647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 599) took 1916 ms. Trace:
I20260709 12:24:48.626929  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:24:48.687281  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.687554  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 60824.9us
I20260709 12:24:48.646165  8289 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:48.638078  8199 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:48.697820  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:48.678786  8090 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.704602  6648 rpcz_store.cc:276] 0709 12:24:46.772419 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.772566 (+   147us) service_pool.cc:224] Handling call
0709 12:24:46.772872 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.773088 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:48.223844 (+1450756us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.683167 (+459323us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.683223 (+    56us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:48.683265 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.683331 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.683439 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1524997,"prepare.run_cpu_time_us":25,"prepare.run_wall_time_us":25,"thread_start_us":1882796,"threads_started":3}
I20260709 12:24:48.692731  8147 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
W20260709 12:24:48.709358  8270 log.cc:927] Time spent T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.322s	user 0.000s	sys 0.001s
I20260709 12:24:48.686882  8146 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:24:48.711686  8283 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:24:48.712448  8212 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:48.712327  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:48.713217  8281 log.cc:927] Time spent T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
I20260709 12:24:48.705330  8286 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:48.714748  8282 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.354s	user 0.000s	sys 0.001s
I20260709 12:24:48.716727  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.690862  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.817451  6037 raft_consensus.cc:2393] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:48.726596  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.677839  8290 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.701745  6113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 298) took 1185 ms. Trace:
W20260709 12:24:48.793722  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:48.793936  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:48.818017  6044 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:48.703590  6647 rpcz_store.cc:276] 0709 12:24:46.769041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.769190 (+   149us) service_pool.cc:224] Handling call
0709 12:24:46.769503 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.769708 (+   205us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:48.219042 (+1449334us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.684951 (+465909us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.684995 (+    44us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:48.685037 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.685105 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.685213 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":1528213,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":31,"thread_start_us":1913643,"threads_started":3}
I20260709 12:24:48.687616  8293 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:48.640894  8112 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.700476  8288 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.693712  8285 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:48.824537  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:48.802801  6644 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:48.632118  8120 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.687541  8075 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.812215  8088 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:48.831284  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:48.812594  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 114784us
I20260709 12:24:48.806867  8214 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.815980  8244 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:48.705729  8295 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:48.826049  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.827284  6643 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:48.824592  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:48.699196  8291 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.133s
I20260709 12:24:48.676484  8263 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.823699  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:48.815187  8255 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:48.807960  8090 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:48.815742  8146 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.980522  6044 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:48.717535  8297 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:48.981635  6647 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:48.832458  6649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 391) took 1977 ms. Trace:
I20260709 12:24:48.988046  6037 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:48.823457  6646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 392) took 1963 ms. Trace:
W20260709 12:24:48.849148  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 225511us
I20260709 12:24:48.832321  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:48.819763  6113 rpcz_store.cc:276] 0709 12:24:47.516653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.535892 (+ 19239us) service_pool.cc:224] Handling call
0709 12:24:47.592507 (+ 56615us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:47.592715 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:48.531068 (+938353us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.701411 (+170343us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.701472 (+    61us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:48.701517 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.701579 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.701687 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":937513,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":1450,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":42321,"thread_start_us":1045870,"threads_started":2}
I20260709 12:24:48.990012  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:48.977358  8299 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
I20260709 12:24:48.807021  8289 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:48.988452  6649 rpcz_store.cc:276] 0709 12:24:46.854712 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.854846 (+   134us) service_pool.cc:224] Handling call
0709 12:24:46.855171 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.855373 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:48.223063 (+1367690us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.830279 (+607216us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.830317 (+    38us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:48.831745 (+  1428us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.831832 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.832391 (+   559us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6264,"prepare.queue_time_us":1443146,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":31,"thread_start_us":1963060,"threads_started":3,"wal-append.queue_time_us":763661}
I20260709 12:24:48.996057  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:49.009714  6037 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:49.013701  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.872308  8227 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.946404  8259 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.027488  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.970361  8213 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:48.976449  8260 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:48.968168  8005 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:48.825439  8286 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:49.009523  8244 raft_consensus.cc:3055] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:49.040475  8244 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:49.010941  8266 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.041339  8244 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:49.042384  8244 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:49.030645  6037 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:24:49.033877  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:49.044500  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:49.045631  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:48.991393  8295 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:49.047808  8297 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:49.048146  8295 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:49.049141  8285 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:49.049260  8120 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.049540  6037 raft_consensus.cc:3055] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:24:49.037416  6643 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 2 index: 3. (term mismatch)
I20260709 12:24:49.049917  6037 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:48.990588  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:48.937141  6035 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:48.988631  8312 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:48.990705  8078 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.009502  8187 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:24:48.994490  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 162226us
I20260709 12:24:49.028847  8199 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:48.817688  8314 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.050491  6643 pending_rounds.cc:85] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 2
I20260709 12:24:48.831965  8293 raft_consensus.cc:697] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:48.834693  8140 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.052436  8294 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.990140  8214 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:48.994908  8255 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:49.062582  6009 leader_election.cc:400] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9.
I20260709 12:24:49.090864  6009 leader_election.cc:400] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4.
I20260709 12:24:48.875340  8324 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:48.988142  8088 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:49.071439  6643 pending_rounds.cc:107] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 1.3
I20260709 12:24:49.050124  8111 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.035593  6642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 736) took 2317 ms. Trace:
I20260709 12:24:49.077384  8140 consensus_queue.cc:1059] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:49.078341  8199 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:49.075680  8314 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:49.079514  8257 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:24:49.079754  8300 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 12:24:49.080523  8306 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.096s	user 0.001s	sys 0.000s
I20260709 12:24:49.081035  8075 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.082115  8112 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.072991  8326 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:24:48.824592  8290 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:49.035833  8227 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:49.109431  6643 raft_consensus.cc:2917] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Aborting config change with OpId 1.3: Aborted: Op aborted by new leader
I20260709 12:24:49.135672  6643 raft_consensus.cc:2889] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:49.076035  8122 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.122128  8090 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:49.141506  8122 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:49.142159  8122 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:49.142549  8288 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.107234  8318 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:24:49.144348  8122 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.133145  8289 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.147991  8290 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.075599  8295 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:49.149163  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:49.093612  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 154450us
I20260709 12:24:49.072679  8187 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:24:49.095531  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 56177.1us
I20260709 12:24:49.093044  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:49.053732  8005 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:49.089583  8330 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.060s
I20260709 12:24:49.066592  8312 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:49.155045  8320 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.040s
I20260709 12:24:49.193547  6609 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:24:49.153324  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 60343.6us
I20260709 12:24:48.989845  6646 rpcz_store.cc:276] 0709 12:24:46.857047 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.857773 (+   726us) service_pool.cc:224] Handling call
0709 12:24:46.859621 (+  1848us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.865473 (+  5852us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:48.357953 (+1492480us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.725653 (+367700us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.803260 (+ 77607us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:48.807072 (+  3812us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.813559 (+  6487us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:48.820587 (+  7028us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":667,"prepare.queue_time_us":1429882,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":23,"raft.queue_time_us":233020,"raft.run_cpu_time_us":185,"raft.run_wall_time_us":94086,"thread_start_us":1768472,"threads_started":3}
I20260709 12:24:49.189193  8293 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:49.201025  6081 connection.cc:256] RPC call timeout handler was delayed by -1.1992758080000385s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17720000000000002s for a response
I20260709 12:24:49.202713  6644 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:49.119550  8286 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:49.203744  8192 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:24:49.194219  6645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 611) took 1961 ms (client timeout 2010 ms). Trace:
I20260709 12:24:49.190681  8289 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.014s
W20260709 12:24:49.204571  6645 rpcz_store.cc:269] 0709 12:24:47.232479 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.299394 (+ 66915us) service_pool.cc:224] Handling call
0709 12:24:49.194048 (+1894654us) spinlock_profiling.cc:243] Waited 922 ms on lock 0x7b5400468cd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:49.194155 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2121324416}
I20260709 12:24:49.205636  8318 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:49.205776  8296 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.206135  8318 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.183326  8290 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:49.207212  8311 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:49.116905  8111 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:49.207520  6651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 738) took 2509 ms. Trace:
I20260709 12:24:49.206542  8296 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:49.208611  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:49.209223  8111 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:49.209394  8296 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:49.148809  8295 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:49.207273  8290 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:49.210142  8296 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.183133  8187 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:49.210747  8296 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:49.211481  8295 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:49.211993  8295 consensus_queue.cc:1059] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:49.209682  8213 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:49.209441  8258 log.cc:927] Time spent T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 1.648s	user 0.002s	sys 0.003s
I20260709 12:24:49.094307  8294 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:49.213837  8213 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.092700  8325 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:24:49.210503  6038 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:49.215118  8088 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:49.186913  8227 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.216046  6038 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:49.206596  8318 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:49.217541  8304 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.235s	user 0.001s	sys 0.000s
I20260709 12:24:49.217700  6038 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:49.187402  8199 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:49.206137  8192 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:49.214274  8213 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:49.203580  8122 consensus_queue.cc:1059] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.011s
I20260709 12:24:49.207929  6651 rpcz_store.cc:276] 0709 12:24:46.698315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.698435 (+   120us) service_pool.cc:224] Handling call
0709 12:24:46.698779 (+   344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.853168 (+154389us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:24:48.125841 (+1272673us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.828516 (+702675us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.828863 (+   347us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:48.828904 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.207239 (+378335us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b5400515ed4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:24:49.207285 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.207464 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15234,"prepare.queue_time_us":1445101,"prepare.run_cpu_time_us":26,"prepare.run_wall_time_us":27,"raft.queue_time_us":328399,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":26255,"spinlock_wait_cycles":354404736,"thread_start_us":1966499,"threads_started":3,"wal-append.queue_time_us":689931}
I20260709 12:24:49.194131  8312 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:49.123580  6039 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:49.215569  6609 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:24:49.223115  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 125531us
W20260709 12:24:49.231168  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.241034  6609 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:49.137581  6036 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:49.155593  8262 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:49.241034  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.242717  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.242125  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:49.248658  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:49.249012  6113 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:49.249146  6039 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:49.244246  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.249454  8325 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:49.249912  8325 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.244527  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.245764  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.250857  6109 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:49.251015  6112 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:49.251695  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.250314  8325 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:49.247475  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1435) took 3526 ms. Trace:
I20260709 12:24:49.249579  8296 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.246085  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.210218  8290 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:49.252314  6109 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:49.257797  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.237548  6037 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:49.258843  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.259286  6110 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:49.255242  5963 rpcz_store.cc:276] 0709 12:24:45.720689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.720837 (+   148us) service_pool.cc:224] Handling call
0709 12:24:45.721175 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:45.723727 (+  2552us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:45.723755 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:45.731750 (+  7995us) log.cc:844] Serialized 26 byte log entry
0709 12:24:47.132140 (+1400390us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:47.132187 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:47.132266 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:49.204553 (+2072287us) spinlock_profiling.cc:243] Waited 47.4 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:24:49.219174 (+ 14621us) raft_consensus.cc:1685] finished
0709 12:24:49.219194 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.247403 (+ 28209us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":94,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":110,"spinlock_wait_cycles":108978048,"thread_start_us":1247746,"threads_started":1,"wal-append.queue_time_us":1593315}
I20260709 12:24:49.259907  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.257302  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.251765  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.260480  6109 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:49.253243  5932 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:49.250073  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.139237  8305 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.188776  8263 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:49.257181  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.269811  6116 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:49.269939  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:49.258953  6037 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:49.260908  6118 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:24:49.248055  8088 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:49.129974  8257 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:49.186383  8140 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.072s
I20260709 12:24:49.262156  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.252197  8312 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:49.261677  6113 raft_consensus.cc:2410] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 6 because replica has last-logged OpId of term: 5 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:24:49.239598  8111 raft_consensus.cc:3055] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:49.213476  8214 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:49.261535  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.275458  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.250514  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.282080  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.282670  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:49.254073  6609 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:24:49.303494  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 49536us
I20260709 12:24:49.304211  6110 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
W20260709 12:24:49.292766  5934 connection.cc:256] RPC call timeout handler was delayed by -1.4417487090004215s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1771s for a response
I20260709 12:24:49.295676  8147 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:49.306042  8307 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:49.305835  8147 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:49.306625  8307 raft_consensus.cc:697] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:49.307595  8307 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:49.308072  8147 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:49.303954  6039 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:49.295619  8243 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:49.309599  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:49.297500  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:49.311229  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.313808  8323 raft_consensus.cc:3055] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:49.304019  8111 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:49.315356  8111 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:49.287030  6112 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:49.112329  6642 rpcz_store.cc:276] 0709 12:24:46.697383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:46.713049 (+ 15666us) service_pool.cc:224] Handling call
0709 12:24:46.724240 (+ 11191us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:46.724477 (+   237us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:24:48.246329 (+1521852us) log.cc:844] Serialized 14 byte log entry
0709 12:24:48.831982 (+585653us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:48.871616 (+ 39634us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:48.874885 (+  3269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:48.983499 (+108614us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.014419 (+ 30920us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":35218,"prepare.queue_time_us":1573223,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":358575,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6158,"thread_start_us":2057632,"threads_started":3,"wal-append.queue_time_us":731142}
I20260709 12:24:49.262092  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.112139  8324 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:49.285522  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:49.317229  8319 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:49.318001  8005 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:49.293617  8330 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:49.315236  8328 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.003s
I20260709 12:24:49.298787  8263 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:49.316784  8089 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:49.412981  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.339644  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:49.352046  5960 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:50.011935  6113 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:50.012115  8140 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:49.349388  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:49.479348  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.348903  5959 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:49.463701  8146 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:24:49.444530  8055 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.015040  8055 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:50.015982  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 730420us
I20260709 12:24:50.016120  8212 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:50.016644  8212 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:49.303889  6109 raft_consensus.cc:2410] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:24:50.017055  8212 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:49.907863  8213 consensus_meta.cc:287] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.659s	user 0.008s	sys 0.000s
I20260709 12:24:50.017652  8055 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:50.017829  8213 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:50.018450  8257 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:49.349253  5967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1446) took 1803 ms. Trace:
W20260709 12:24:49.989815  8290 consensus_meta.cc:287] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.714s	user 0.005s	sys 0.003s
I20260709 12:24:49.314507  8323 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:49.333216  8337 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:49.337666  8192 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:49.581171  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 379309us
W20260709 12:24:50.043412  8325 consensus_meta.cc:287] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.768s	user 0.010s	sys 0.006s
I20260709 12:24:49.466558  8318 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:49.354977  8266 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:49.411677  8297 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.613s
W20260709 12:24:50.024176  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.351161  8122 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:49.277415  8305 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:49.445941  8286 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.287130  8088 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:49.320222  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50992 (request call id 14) took 1201 ms. Trace:
I20260709 12:24:49.349278  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.077149  5961 raft_consensus.cc:2410] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:24:49.349121  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.025986  5966 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 1.
I20260709 12:24:50.025566  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:50.077963  5962 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 2: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:24:50.078145  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52657.9us
I20260709 12:24:50.079109  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:50.075897  6111 rpcz_store.cc:276] 0709 12:24:48.119235 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.273233 (+153998us) service_pool.cc:224] Handling call
0709 12:24:49.320037 (+1046804us) spinlock_profiling.cc:243] Waited 76.7 ms on lock 0x7b540023aad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482104e853 00007f482601c60a 00007f481f5a27d4 00007f481f5a2762 00007f481f5a2691 00007f481f5a260c 00007f481f5a18c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:49.320148 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":176356224}
W20260709 12:24:49.826270  6041 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.006s	sys 0.006s
W20260709 12:24:50.081202  6041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.815s	user 0.006s	sys 0.010s
I20260709 12:24:50.012880  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:49.351441  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1450) took 1793 ms. Trace:
I20260709 12:24:49.290885  8331 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.780s
W20260709 12:24:50.012270  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 672649us
I20260709 12:24:50.028810  6115 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:50.026885  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1452) took 2467 ms. Trace:
I20260709 12:24:50.030579  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.355777  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 317) took 1256 ms. Trace:
I20260709 12:24:50.088754  5959 rpcz_store.cc:276] 0709 12:24:47.559120 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.303902 (+744782us) service_pool.cc:224] Handling call
0709 12:24:49.348719 (+1044817us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.014319 (+665600us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.026818 (+ 12499us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":69888}
I20260709 12:24:50.012880  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.031559  6118 raft_consensus.cc:2410] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:24:50.012467  5960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1453) took 2453 ms. Trace:
I20260709 12:24:49.320386  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.032903  6042 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:50.090307  5960 rpcz_store.cc:276] 0709 12:24:47.559357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.343586 (+784229us) service_pool.cc:224] Handling call
0709 12:24:49.351673 (+1008087us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.012197 (+660524us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.012412 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.090746  6112 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:24:50.091562  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.092240  6109 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 1.
I20260709 12:24:50.093185  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.093683  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.095257  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:50.096704  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.089178  6114 rpcz_store.cc:276] 0709 12:24:48.099421 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.293804 (+194383us) service_pool.cc:224] Handling call
0709 12:24:48.294122 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:48.399306 (+105184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.355503 (+956197us) spinlock_profiling.cc:243] Waited 22.5 ms on lock 0x7b540023aad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:24:49.355708 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":51635456}
I20260709 12:24:50.102587  6042 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:50.104842  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:50.036398  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:50.037357  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:50.038663  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:50.105719  6043 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:50.103724  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.105875  6044 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:50.106561  6114 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:50.041445  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:49.970809  8327 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.893s	user 0.010s	sys 0.027s
W20260709 12:24:50.019276  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 202336us
I20260709 12:24:50.042968  5967 rpcz_store.cc:276] 0709 12:24:47.546198 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:47.576415 (+ 30217us) service_pool.cc:224] Handling call
0709 12:24:48.384153 (+807738us) spinlock_profiling.cc:243] Waited 4.7 ms on lock 0x7b5800010598. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482602dfc0 00007f4826018929 00007f48260183d2 00007f481f58fbd4
0709 12:24:49.348719 (+964566us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.348911 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:49.348936 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:49.348978 (+    42us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:49.349002 (+    24us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.349070 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.349194 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":10813312}
I20260709 12:24:50.044878  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:50.045907  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:50.110140  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.022284  8324 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:50.112886  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:49.349467  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:49.336505  8314 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:49.297755  8288 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:49.444319  8287 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.026101  8320 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.125690  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.126291  6118 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:50.022657  8330 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.025986  8140 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:24:50.052423  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.491838  8265 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:50.056618  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.092742  8144 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:50.093677  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.057459  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.133323  6643 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:50.057941  6649 raft_consensus.cc:1240] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:50.050911  8337 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:50.061702  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:50.013531  8319 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:50.069864  6648 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:24:50.137231  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.050289  8111 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:24:49.615852  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:49.350636  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.082435  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1646) took 1778 ms. Trace:
I20260709 12:24:50.082222  5965 rpcz_store.cc:276] 0709 12:24:47.558566 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.259141 (+700575us) service_pool.cc:224] Handling call
0709 12:24:49.350906 (+1091765us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:49.351115 (+   209us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:49.351140 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:49.351181 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:49.351212 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:49.351265 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:49.351380 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.087056  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2153) took 1474 ms. Trace:
I20260709 12:24:50.087539  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2151) took 1518 ms. Trace:
I20260709 12:24:50.087867  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2152) took 1474 ms. Trace:
I20260709 12:24:50.098701  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.137930  6643 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:50.138204  5968 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:50.139717  5960 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:50.105077  6609 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:24:50.139993  5968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 1456) took 2462 ms (client timeout 2010 ms). Trace:
I20260709 12:24:50.140192  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.141156  6643 raft_consensus.cc:2410] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:50.138617  6041 rpcz_store.cc:276] 0709 12:24:48.303983 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.306449 (+  2466us) service_pool.cc:224] Handling call
0709 12:24:49.238100 (+931651us) spinlock_profiling.cc:243] Waited 1.75 ms on lock 0x7b5800124298. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482602dfc0 00007f4826018929 00007f48260183d2 00007f481f58fbd4
0709 12:24:49.238303 (+   203us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:49.241256 (+  2953us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:49.241285 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:49.247896 (+  6611us) log.cc:844] Serialized 26 byte log entry
0709 12:24:49.311787 (+ 63891us) spinlock_profiling.cc:243] Waited 6.89 ms on lock 0x7b480024c258. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4825f7daa1 00007f4825f74b37 00007f4825f749ca 00007f482606c26f 00007f482606bf37 00007f482608055c 00007f4826080508 00007f4826080488 00007f4826080443 00007f482607f6ec 00007f4824fa9a96
0709 12:24:50.081678 (+769891us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:50.081724 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.081799 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:50.081848 (+    49us) raft_consensus.cc:1685] finished
0709 12:24:50.081859 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.082376 (+   517us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3136,"raft.run_cpu_time_us":1361,"raft.run_wall_time_us":68959,"spinlock_wait_cycles":19868288,"thread_start_us":815794,"threads_started":1,"wal-append.queue_time_us":762881}
I20260709 12:24:50.138902  5966 rpcz_store.cc:276] 0709 12:24:48.608896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.609026 (+   130us) service_pool.cc:224] Handling call
0709 12:24:50.083298 (+1474272us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.039273  6039 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:24:50.106827  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:50.107309  6113 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:50.146241  5961 rpcz_store.cc:276] 0709 12:24:48.608146 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.608297 (+   151us) service_pool.cc:224] Handling call
0709 12:24:50.082225 (+1473928us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.063956  8325 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:50.061386  8266 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:50.081281  8286 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:50.046058  8263 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:50.072290  8227 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.108728  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.132953  8144 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.109364  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.110594  6035 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:50.110723  6042 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:50.105774  6037 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:50.162730  6116 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:50.047283  8290 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:50.111783  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 255870us
I20260709 12:24:50.103724  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.113240  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.113782  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:50.113925  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.070288  8122 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:50.114068  5964 raft_consensus.cc:2368] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3.
I20260709 12:24:50.118986  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.149580  8340 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.080332  8088 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:50.120945  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.177135  6115 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
W20260709 12:24:50.103832  8293 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.012s	sys 0.033s
I20260709 12:24:50.093005  8147 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:50.109428  8327 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.032s	user 0.010s	sys 0.028s
I20260709 12:24:50.131667  6651 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:50.164101  8144 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.181339  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.056819  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.094379  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:50.134806  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.134752  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:24:50.136618  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 74981.6us
I20260709 12:24:50.146402  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.183069  6043 raft_consensus.cc:2393] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:50.184233  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.180557  8147 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.186676  8295 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:24:50.140504  5968 rpcz_store.cc:269] 0709 12:24:47.677385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.251155 (+573770us) service_pool.cc:224] Handling call
0709 12:24:50.139932 (+1888777us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.131045  8287 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:50.035320  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:50.154084  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.188380  6648 raft_consensus.cc:2368] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4.
I20260709 12:24:50.153236  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.155166  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:50.154728  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.188974  6643 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:50.131922  8330 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:50.108006  6110 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:50.158946  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.139127  5962 rpcz_store.cc:276] 0709 12:24:48.560269 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.607361 (+ 47092us) service_pool.cc:224] Handling call
0709 12:24:50.078366 (+1471005us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:24:50.159492  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 131363us
I20260709 12:24:50.188170  6040 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:50.096716  8257 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.045s
I20260709 12:24:50.162190  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.107265  8187 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.046s
I20260709 12:24:50.163439  6112 raft_consensus.cc:2410] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:24:50.164521  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.199213  6116 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:50.200187  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.200767  6116 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:24:50.201542  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.167351  6035 pending_rounds.cc:85] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 8
I20260709 12:24:50.167961  6109 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:50.169430  6009 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:50.202318  6035 pending_rounds.cc:107] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:24:50.202661  6035 raft_consensus.cc:2889] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:50.153605  8341 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:50.170317  6041 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:50.167421  5959 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
W20260709 12:24:50.229013  5959 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2156) took 1618 ms (client timeout 2092 ms). Trace:
W20260709 12:24:50.229360  5959 rpcz_store.cc:269] 0709 12:24:48.610190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.103448 (+1493258us) service_pool.cc:224] Handling call
0709 12:24:50.228957 (+125509us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.230293  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.230909  5959 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:50.171806  6111 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:50.232667  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:50.114852  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.171216  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:50.175438  6611 leader_election.cc:336] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.629s (SENT)
I20260709 12:24:50.234238  6114 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
W20260709 12:24:50.235108  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 59699us
W20260709 12:24:50.235783  6611 leader_election.cc:336] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.684s (SENT)
I20260709 12:24:50.231848  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.236167  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:50.236724  5959 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
W20260709 12:24:50.237231  6611 leader_election.cc:336] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.755s (SENT)
W20260709 12:24:50.175199  5964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 1455) took 2615 ms (client timeout 1580 ms). Trace:
I20260709 12:24:50.178088  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:50.237720  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.161115  8314 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:50.238169  5964 rpcz_store.cc:269] 0709 12:24:47.559805 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:48.129701 (+569896us) service_pool.cc:224] Handling call
0709 12:24:48.384509 (+254808us) spinlock_profiling.cc:243] Waited 7.47 ms on lock 0x7b5800010598. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482601a0a0 00007f4826019984 00007f481f5946d4 00007f481f594662
0709 12:24:50.175120 (+1790611us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":17183488}
I20260709 12:24:50.133728  8288 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:50.182376  6645 raft_consensus.cc:2410] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:50.143666  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.188282  6036 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:50.187048  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.241837  6649 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:50.155345  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:50.180400  8293 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.849s	user 0.012s	sys 0.033s
I20260709 12:24:50.131289  8140 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:50.191718  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.191635  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.193476  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.248001  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.196847  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.186748  8147 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:50.190187  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.125188  8323 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:50.257707  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.223145  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.218039  8213 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:50.259552  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.222888  6643 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:50.202026  6116 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:50.166289  8227 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:50.226078  8331 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:50.132938  8320 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:50.240469  6111 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:50.243029  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 1466) took 1041 ms. Trace:
I20260709 12:24:50.186241  8266 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:50.244565  8192 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:50.245513  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:50.245779  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.288290  6114 raft_consensus.cc:2376] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3. Re-sending same reply.
I20260709 12:24:50.248853  6645 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:50.248169  5962 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:50.249068  6647 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:50.255556  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:50.289844  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.290012  6041 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:50.255867  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.291194  5959 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:24:50.291715  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2154) took 1682 ms. Trace:
I20260709 12:24:50.291990  5959 rpcz_store.cc:276] 0709 12:24:48.609436 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.255625 (+1646189us) service_pool.cc:224] Handling call
0709 12:24:50.291656 (+ 36031us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.292892  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.255556  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.294590  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.295339  6649 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:24:50.296159  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.296734  6649 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:50.273054  8331 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:50.297742  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.298367  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.298924  8331 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:50.299069  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:50.299736  8266 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:50.291219  5962 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:50.301985  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.302595  5962 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:50.303692  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.258781  6112 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:50.304656  8320 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:50.304814  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.304982  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:50.305603  6112 raft_consensus.cc:2376] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3. Re-sending same reply.
I20260709 12:24:50.305874  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.306715  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.306224  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:50.307601  6036 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:50.307804  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.308404  6112 raft_consensus.cc:2376] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3. Re-sending same reply.
I20260709 12:24:50.309190  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.309288  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.260273  5961 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:50.263633  6084 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:24:50.345679  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 86327.2us
W20260709 12:24:50.346071  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 265540us
I20260709 12:24:50.267663  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.267556  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.268463  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.239063  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:50.274112  5966 rpcz_store.cc:276] 0709 12:24:49.201206 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.155159 (+953953us) service_pool.cc:224] Handling call
0709 12:24:50.242967 (+ 87808us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.239084  8314 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:50.177947  8340 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:50.279484  6115 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:50.356864  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.358098  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.202913  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:50.359406  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:50.248000  8307 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:50.341956  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:50.363336  6036 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:50.257540  8318 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:50.341101  6114 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 3: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:50.297829  5968 raft_consensus.cc:2393] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:50.306629  6651 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:50.342177  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.368232  5962 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:50.319967  8263 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:50.332687  6111 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:50.232008  8341 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:50.343191  8305 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:50.351058  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.352413  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:50.391976  5961 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:50.356077  8314 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.365674  6609 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:50.369097  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.341867  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.376013  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:50.399866  6111 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:50.384758  6041 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:50.348316  6116 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
W20260709 12:24:50.389209  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 219835us
I20260709 12:24:50.239807  8122 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:50.418376  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52796us
I20260709 12:24:50.355563  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:50.419678  5966 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:50.396359  6113 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:50.407652  6009 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:50.422928  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.426082  5961 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
W20260709 12:24:50.412946  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 227337us
W20260709 12:24:50.413475  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 221934us
I20260709 12:24:50.442816  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:50.387769  8213 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:50.560173  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.771207  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:50.776823  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 334506us
I20260709 12:24:50.651087  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1460) took 1451 ms. Trace:
I20260709 12:24:50.779407  5961 rpcz_store.cc:276] 0709 12:24:49.199456 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.650147 (+1450691us) service_pool.cc:224] Handling call
0709 12:24:50.650549 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.650744 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.650768 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.650812 (+    44us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:50.650842 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.650892 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.651016 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:50.685462  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:24:50.530097  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:50.392479  8341 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:50.771152  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1400) took 1502 ms. Trace:
I20260709 12:24:50.500039  5966 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:50.787853  8354 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:50.788604  8352 raft_consensus.cc:2764] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:24:50.655071  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:50.433238  8319 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:50.790565  6038 rpcz_store.cc:276] 0709 12:24:49.271906 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.113282 (+841376us) service_pool.cc:224] Handling call
0709 12:24:50.133095 (+ 19813us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.770768 (+637673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.770797 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.770848 (+    51us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:50.770879 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.770947 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:50.771086 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":210093,"raft.run_cpu_time_us":158,"raft.run_wall_time_us":10567,"thread_start_us":255697,"threads_started":1}
W20260709 12:24:50.828394  6042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.016s	sys 0.009s
W20260709 12:24:50.855226  6042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.017s	sys 0.010s
W20260709 12:24:50.548772  6611 leader_election.cc:336] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.852s (SENT)
I20260709 12:24:50.815102  6081 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:50.421718  8337 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:50.432973  8295 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:51.092249  6647 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.675s	user 0.003s	sys 0.007s
I20260709 12:24:50.463392  8318 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:50.873445  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 430690us
W20260709 12:24:51.070645  6009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.013s	sys 0.008s
W20260709 12:24:51.149282  6647 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.732s	user 0.004s	sys 0.008s
I20260709 12:24:50.777578  8213 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:50.988263  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.071727  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:51.170953  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 393) took 1122 ms. Trace:
I20260709 12:24:51.171480  6042 rpcz_store.cc:276] 0709 12:24:50.048267 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.164256 (+115989us) service_pool.cc:224] Handling call
0709 12:24:50.164546 (+   290us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.164921 (+   375us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.164945 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.171974 (+  7029us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.148151 (+976177us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:51.148191 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.148256 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.170699 (+ 22443us) raft_consensus.cc:1685] finished
0709 12:24:51.170718 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.170885 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":958850,"threads_started":1,"wal-append.queue_time_us":986585}
W20260709 12:24:50.999198  8111 consensus_meta.cc:287] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.845s	user 0.009s	sys 0.000s
I20260709 12:24:51.178973  8213 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:51.180904  8330 consensus_meta.cc:287] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.982s	user 0.007s	sys 0.000s
I20260709 12:24:51.181428  8330 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:51.181850  6117 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
W20260709 12:24:51.057405  8214 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.008s	sys 0.008s
I20260709 12:24:51.182722  5965 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:24:51.182752  8214 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.864s	user 0.009s	sys 0.010s
I20260709 12:24:51.168469  8293 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:51.184248  8293 raft_consensus.cc:697] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:51.185434  8293 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:51.154357  6009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.713s	user 0.013s	sys 0.011s
I20260709 12:24:51.161577  6044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 400) took 1103 ms. Trace:
W20260709 12:24:50.940876  6040 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.709s	user 0.048s	sys 0.102s
I20260709 12:24:51.048283  8287 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:50.789291  8325 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:50.791363  8290 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:51.187723  6040 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.956s	user 0.053s	sys 0.106s
I20260709 12:24:51.187496  6044 rpcz_store.cc:276] 0709 12:24:50.058190 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.176084 (+117894us) service_pool.cc:224] Handling call
0709 12:24:50.176342 (+   258us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.391431 (+215089us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.391461 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.397600 (+  6139us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.008581 (+610981us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:51.008636 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.008706 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.161295 (+152589us) raft_consensus.cc:1685] finished
0709 12:24:51.161321 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.161508 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":263876,"raft.run_cpu_time_us":160,"raft.run_wall_time_us":180185,"thread_start_us":535666,"threads_started":2,"wal-append.queue_time_us":547053}
W20260709 12:24:51.149842  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 334809us
W20260709 12:24:51.192301  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 750802us
I20260709 12:24:50.811344  8286 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:50.832371  8354 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:51.124122  8144 consensus_meta.cc:287] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.933s	user 0.004s	sys 0.004s
W20260709 12:24:51.002708  8266 consensus_meta.cc:287] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.702s	user 0.003s	sys 0.007s
I20260709 12:24:51.053714  8227 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:51.146142  8140 consensus_meta.cc:287] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.882s	user 0.002s	sys 0.003s
W20260709 12:24:51.105167  8088 consensus_meta.cc:287] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.922s	user 0.006s	sys 0.000s
W20260709 12:24:51.105167  8212 consensus_meta.cc:287] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 1.088s	user 0.005s	sys 0.003s
W20260709 12:24:51.237154  6608 leader_election.cc:336] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.654s (SENT)
W20260709 12:24:51.195669  8314 consensus_meta.cc:287] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.699s	user 0.008s	sys 0.000s
I20260709 12:24:51.258728  8314 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:51.259950  6649 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:51.261819  8140 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:51.266439  8140 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:51.241992  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.264089  8088 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:51.267150  8212 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:50.973672  8352 consensus_queue.cc:1059] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.295s
I20260709 12:24:51.235328  8354 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:50.763969  8147 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:51.151361  8288 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:51.152943  8318 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:51.236960  8144 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:51.240541  6608 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:51.273890  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 725106us
I20260709 12:24:51.280126  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:24:51.335744  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 98610.8us
I20260709 12:24:51.314502  8359 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:51.276993  8122 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.297209  8323 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.341260  8352 raft_consensus.cc:3055] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:51.341696  8352 raft_consensus.cc:740] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:51.342518  8373 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.315338  8147 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:51.315488  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 1760) took 2061 ms. Trace:
I20260709 12:24:51.315972  6650 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:51.317160  8088 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:51.318133  8314 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:51.319837  8212 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:51.257865  8341 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:51.297120  8290 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:51.338124  6611 leader_election.cc:336] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.909s (SENT)
I20260709 12:24:51.333959  8318 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:51.346742  6608 leader_election.cc:336] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.634s (SENT)
I20260709 12:24:51.366348  8088 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:24:51.344074  6112 rpcz_store.cc:276] 0709 12:24:49.254244 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.310005 (+1055761us) service_pool.cc:224] Handling call
0709 12:24:50.310320 (+   315us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.341227 (+ 30907us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.341259 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.350660 (+  9401us) log.cc:844] Serialized 26 byte log entry
0709 12:24:50.828162 (+477502us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:50.828207 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:50.828286 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.315271 (+486985us) raft_consensus.cc:1685] finished
0709 12:24:51.315291 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.315420 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2367,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":6449,"thread_start_us":440647,"threads_started":1,"wal-append.queue_time_us":926427}
W20260709 12:24:51.368343  6608 leader_election.cc:336] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.657s (SENT)
I20260709 12:24:51.365414  8290 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:51.342511  8352 consensus_queue.cc:260] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:51.391655  8290 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:51.393025  8352 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:51.337765  8330 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:51.399911  8341 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:51.419531  8144 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:51.389863  6608 leader_election.cc:336] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.730s (SENT)
I20260709 12:24:51.424101  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:51.425033  8314 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:51.432075  8213 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:51.447374  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:51.448910  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:51.449572  6115 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:51.452836  8354 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:51.459718  8213 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:51.463414  8318 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:51.466379  8318 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:51.491669  8354 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:51.550058  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.572065  5960 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:51.575127  5961 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 5. Current term is 6. Ops: []
W20260709 12:24:51.575793  5960 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 1462) took 2375 ms (client timeout 1818 ms). Trace:
W20260709 12:24:51.576465  5960 rpcz_store.cc:269] 0709 12:24:49.199947 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.154506 (+954559us) service_pool.cc:224] Handling call
0709 12:24:51.575289 (+1420783us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400036954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:51.575629 (+   340us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3176476928}
I20260709 12:24:51.579228  5963 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:24:51.581209  5963 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2155) took 2971 ms (client timeout 1988 ms). Trace:
W20260709 12:24:51.581638  5963 rpcz_store.cc:269] 0709 12:24:48.609673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.260022 (+650349us) service_pool.cc:224] Handling call
0709 12:24:51.580924 (+2320902us) spinlock_profiling.cc:243] Waited 1.5 s on lock 0x7b540008b954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:51.581108 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3441213312}
I20260709 12:24:51.572554  5865 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 4 to 5, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 5 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:51.587045  5967 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:24:51.587448  5968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37174 (request call id 372) took 1498 ms (client timeout 1847 ms). Trace:
W20260709 12:24:51.588284  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.590586  6006 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:51.193701  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:51.593604  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 402) took 1451 ms. Trace:
I20260709 12:24:51.292781  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 397) took 1239 ms. Trace:
I20260709 12:24:51.594908  6037 rpcz_store.cc:276] 0709 12:24:50.052865 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.168383 (+115518us) service_pool.cc:224] Handling call
0709 12:24:50.168695 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.372857 (+204162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.372893 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.398160 (+ 25267us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.080262 (+682102us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:51.080315 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.080393 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.292556 (+212163us) raft_consensus.cc:1685] finished
0709 12:24:51.292577 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.292715 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":205531,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":6837,"thread_start_us":596088,"threads_started":2,"wal-append.queue_time_us":678011}
I20260709 12:24:51.597826  8294 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:51.599418  6109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 336) took 1345 ms. Trace:
I20260709 12:24:51.599893  6109 rpcz_store.cc:276] 0709 12:24:50.253853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.374056 (+120203us) service_pool.cc:224] Handling call
0709 12:24:50.789512 (+415456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.789744 (+   232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.789769 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:50.790222 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.094018 (+303796us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:51.094058 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.094152 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.598787 (+504635us) raft_consensus.cc:1685] finished
0709 12:24:51.598820 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.599162 (+   342us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":245407,"threads_started":1,"wal-append.queue_time_us":428668}
I20260709 12:24:51.601809  8144 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.603165  8144 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:51.605437  8349 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.385052  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:51.606480  8349 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:51.607666  6112 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:51.607828  8331 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.608837  8331 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:51.609040  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:51.609862  8349 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:51.610359  6645 raft_consensus.cc:2393] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 4: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:24:51.611192  8349 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:51.611621  8349 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.612109  8349 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.612341  8290 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:51.612814  8290 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.613230  8290 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:51.615219  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:51.615459  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:51.616070  8340 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:51.616864  6611 leader_election.cc:336] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 2.012s (SENT)
W20260709 12:24:51.587992  5968 rpcz_store.cc:269] 0709 12:24:50.089000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.257459 (+168459us) service_pool.cc:224] Handling call
0709 12:24:51.586990 (+1329531us) spinlock_profiling.cc:243] Waited 39.4 ms on lock 0x7b54001df454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:51.587253 (+   263us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":90553600}
W20260709 12:24:51.617939  6651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50470 (request call id 402) took 1463 ms (client timeout 1657 ms). Trace:
I20260709 12:24:51.584921  5865 catalog_manager.cc:5697] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 2 to 3, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 3 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:24:51.599668  6110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 2142) took 2351 ms (client timeout 2249 ms). Trace:
W20260709 12:24:51.622169  6110 rpcz_store.cc:269] 0709 12:24:49.247633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.310950 (+ 63317us) service_pool.cc:224] Handling call
0709 12:24:51.599188 (+2288238us) spinlock_profiling.cc:243] Waited 795 ms on lock 0x7b54000e29d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:51.599419 (+   231us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1828687744}
W20260709 12:24:51.593504  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 399704us
I20260709 12:24:51.625385  5966 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:51.626331  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 375) took 1536 ms. Trace:
W20260709 12:24:51.626937  6611 leader_election.cc:336] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 2.111s (SENT)
W20260709 12:24:51.627156  6043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60122 (request call id 392) took 1578 ms (client timeout 2012 ms). Trace:
W20260709 12:24:51.621017  6651 rpcz_store.cc:269] 0709 12:24:50.154663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.181107 (+ 26444us) service_pool.cc:224] Handling call
0709 12:24:51.617558 (+1436451us) spinlock_profiling.cc:243] Waited 125 ms on lock 0x7b5400468cd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:51.617756 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":286720256}
I20260709 12:24:51.629817  6039 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:51.630313  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:51.631335  5968 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:51.627373  6648 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
W20260709 12:24:51.627780  6043 rpcz_store.cc:269] 0709 12:24:50.048121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.106580 (+ 58459us) service_pool.cc:224] Handling call
0709 12:24:51.626633 (+1520053us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b540025bf54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:51.626928 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":67288320}
I20260709 12:24:51.627573  6611 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:51.639810  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:51.640237  6611 leader_election.cc:336] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 2.179s (SENT)
I20260709 12:24:51.642032  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:51.626720  5966 rpcz_store.cc:276] 0709 12:24:50.089771 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.791876 (+702105us) service_pool.cc:224] Handling call
0709 12:24:51.618956 (+827080us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.625937 (+  6981us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.626227 (+   290us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:51.644271  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:51.645393  8312 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:51.645983  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:51.594180  6040 rpcz_store.cc:276] 0709 12:24:50.141930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.192345 (+ 50415us) service_pool.cc:224] Handling call
0709 12:24:50.192584 (+   239us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.192759 (+   175us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:51.189339 (+996580us) log.cc:844] Serialized 14 byte log entry
0709 12:24:51.592580 (+403241us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:51.592716 (+   136us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:51.592880 (+   164us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.593018 (+   138us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.593305 (+   287us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":965790,"prepare.run_cpu_time_us":61,"prepare.run_wall_time_us":205,"raft.queue_time_us":18126,"raft.run_cpu_time_us":291,"raft.run_wall_time_us":290,"thread_start_us":1360008,"threads_started":2,"wal-append.queue_time_us":265171}
I20260709 12:24:51.651193  8354 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:51.651271  6650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 619) took 1595 ms. Trace:
I20260709 12:24:51.627977  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1463) took 2421 ms. Trace:
I20260709 12:24:51.659117  6645 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:51.666869  5965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 1458) took 2468 ms (client timeout 1683 ms). Trace:
W20260709 12:24:51.667369  5965 rpcz_store.cc:269] 0709 12:24:49.198867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.153714 (+954847us) service_pool.cc:224] Handling call
0709 12:24:51.666351 (+1512637us) spinlock_profiling.cc:243] Waited 987 ms on lock 0x7b54000f8a54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:51.666678 (+   327us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2269251328}
I20260709 12:24:51.668694  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:51.671428  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:51.673172  8214 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:24:51.675698  6110 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:51.676050  8341 raft_consensus.cc:1064] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
W20260709 12:24:51.676685  8341 raft_consensus.cc:1068] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Unable to promote non-voter 24012af7747d4c4ea89c3da2ff950099: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:51.677095  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:51.673185  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:51.670369  6649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 397) took 1542 ms. Trace:
I20260709 12:24:51.671115  8293 consensus_queue.cc:1059] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:24:51.655560  5961 rpcz_store.cc:276] 0709 12:24:49.200195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.781459 (+1581264us) service_pool.cc:224] Handling call
0709 12:24:50.781793 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.575669 (+793876us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.578256 (+  2587us) spinlock_profiling.cc:243] Waited 793 ms on lock 0x7b540008c354. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:24:51.621115 (+ 42859us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1823180160}
I20260709 12:24:51.654572  6650 rpcz_store.cc:276] 0709 12:24:50.055392 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.055555 (+   163us) service_pool.cc:224] Handling call
0709 12:24:50.055892 (+   337us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.357212 (+1301320us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.650671 (+293459us) spinlock_profiling.cc:243] Waited 1.26 s on lock 0x7b54000e01d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:24:51.651024 (+   353us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2897392384}
I20260709 12:24:51.678413  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:51.677846  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 384) took 1585 ms. Trace:
I20260709 12:24:51.677783  6110 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:51.682706  5959 rpcz_store.cc:276] 0709 12:24:50.092096 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.836748 (+744652us) service_pool.cc:224] Handling call
0709 12:24:51.676457 (+839709us) spinlock_profiling.cc:243] Waited 2.11 ms on lock 0x7b5800010598. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482602dfc0 00007f4826018929 00007f48260183d2 00007f481f58fbd4
0709 12:24:51.676857 (+   400us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.677313 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.677337 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:51.677400 (+    63us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:51.677427 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.677513 (+    86us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.677682 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4842880}
I20260709 12:24:51.684909  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:51.655571  8354 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.678773  6649 rpcz_store.cc:276] 0709 12:24:50.127885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.297329 (+169444us) service_pool.cc:224] Handling call
0709 12:24:50.342631 (+ 45302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.260338 (+917707us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.669797 (+409459us) spinlock_profiling.cc:243] Waited 917 ms on lock 0x7b5400607a54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:24:51.670165 (+   368us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2109193472}
I20260709 12:24:51.691144  5964 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:51.691250  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:24:51.710075  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:51.688839  8354 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:51.711113  5965 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:51.712404  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:51.713336  5965 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:51.714751  5963 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:51.715284  6110 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:51.715922  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:51.716866  5963 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:51.717803  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:51.703860  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:51.718389  6006 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:51.719158  5959 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:51.719530  6006 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:51.720093  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:51.720250  8361 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:51.720657  8358 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:51.720858  5959 raft_consensus.cc:2376] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3. Re-sending same reply.
I20260709 12:24:51.721191  8358 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.721706  8358 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:51.721762  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:51.715986  6608 leader_election.cc:336] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.847s (SENT)
I20260709 12:24:51.723121  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:51.724082  8318 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:51.722767  5963 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:51.727478  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:51.728473  5963 raft_consensus.cc:2376] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4. Re-sending same reply.
I20260709 12:24:51.721163  6118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 339) took 1450 ms. Trace:
I20260709 12:24:51.730679  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 385) took 1605 ms. Trace:
I20260709 12:24:51.731551  8358 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:51.731154  6118 rpcz_store.cc:276] 0709 12:24:50.271049 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.399959 (+128910us) service_pool.cc:224] Handling call
0709 12:24:51.272154 (+872195us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:51.272630 (+   476us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.272660 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:51.273184 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.603637 (+330453us) spinlock_profiling.cc:243] Waited 9.87 ms on lock 0x7b18003a8340. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f4820bfc4bc 00007f481df4a48b 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1
0709 12:24:51.604064 (+   427us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:51.604244 (+   180us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.604410 (+   166us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.693310 (+ 88900us) spinlock_profiling.cc:243] Waited 9.54 ms on lock 0x7b18003a8340. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:24:51.720799 (+ 27489us) raft_consensus.cc:1685] finished
0709 12:24:51.720821 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.721002 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4380,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":3791,"spinlock_wait_cycles":44762368,"thread_start_us":37002,"threads_started":1,"wal-append.queue_time_us":37341}
I20260709 12:24:51.734594  8358 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:51.733110  5959 rpcz_store.cc:276] 0709 12:24:50.125426 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.729372 (+1603946us) service_pool.cc:224] Handling call
0709 12:24:51.729914 (+   542us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.730240 (+   326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.730266 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:51.730337 (+    71us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:51.730392 (+    55us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.730476 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.730599 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:51.735910  8144 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:51.736598  8331 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:51.736840  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 387) took 1572 ms. Trace:
I20260709 12:24:51.738591  5959 rpcz_store.cc:276] 0709 12:24:50.164898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.735652 (+1570754us) service_pool.cc:224] Handling call
0709 12:24:51.736021 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.736528 (+   507us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.736556 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:51.736596 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:51.736640 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.736693 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.736791 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":745,"raft.run_cpu_time_us":239,"raft.run_wall_time_us":238}
I20260709 12:24:51.740273  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 386) took 1602 ms. Trace:
I20260709 12:24:51.741074  5963 rpcz_store.cc:276] 0709 12:24:50.138208 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:51.737036 (+1598828us) service_pool.cc:224] Handling call
0709 12:24:51.737426 (+   390us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.739828 (+  2402us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.739866 (+    38us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:51.739915 (+    49us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:51.739991 (+    76us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.740060 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.740188 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":412,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119}
I20260709 12:24:51.748170  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:51.724187  8356 raft_consensus.cc:3055] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:24:51.751246  8361 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:51.753556  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:51.731326  6608 leader_election.cc:336] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 2.036s (SENT)
I20260709 12:24:51.776492  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:51.782037  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1403) took 1754 ms. Trace:
I20260709 12:24:51.778748  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:51.778692  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 57127.4us
W20260709 12:24:51.783568  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 52303.8us
I20260709 12:24:51.782433  6039 rpcz_store.cc:276] 0709 12:24:50.027920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.159984 (+132064us) service_pool.cc:224] Handling call
0709 12:24:51.629286 (+1469302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:51.630344 (+  1058us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.781784 (+151440us) spinlock_profiling.cc:243] Waited 1.47 s on lock 0x7b540025bf50. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:51.781930 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3374967680}
W20260709 12:24:51.799059  6009 connection.cc:256] RPC call timeout handler was delayed by -1.4567104790003214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20670000000000002s for a response
W20260709 12:24:51.803095  6009 connection.cc:256] RPC call timeout handler was delayed by -1.4513104790003126s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2073s for a response
W20260709 12:24:51.804613  6009 connection.cc:256] RPC call timeout handler was delayed by -1.3667104790001758s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2167s for a response
I20260709 12:24:51.776223  8356 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:51.806093  5968 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:51.776055  8361 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:51.782907  8358 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:51.809274  6009 connection.cc:256] RPC call timeout handler was delayed by -1.2929104790000565s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22490000000000002s for a response
I20260709 12:24:51.777478  8290 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:51.812721  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 107588us
I20260709 12:24:51.817700  5965 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:51.819002  8055 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.818670  8111 consensus_queue.cc:1059] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:24:51.824738  6608 leader_election.cc:336] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 2.117s (SENT)
I20260709 12:24:51.826282  8295 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:51.826880  8295 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.829568  8356 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:51.830567  6113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 2156) took 1696 ms (client timeout 2051 ms). Trace:
I20260709 12:24:51.831187  8356 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:24:51.831043  6113 rpcz_store.cc:269] 0709 12:24:50.133895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.152994 (+ 19099us) service_pool.cc:224] Handling call
0709 12:24:51.830173 (+1677179us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400163d54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:51.830360 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":477070080}
I20260709 12:24:51.833945  5864 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 294) took 7444 ms. Trace:
I20260709 12:24:51.818709  6611 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:51.809429  8358 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:51.840035  6006 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:51.841239  8359 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:51.841739  8359 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:51.842028  8358 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:51.841822  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:51.843802  8367 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:24:51.844224  8367 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:51.844534  8367 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:51.848518  8290 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:51.852612  5960 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:51.842298  8359 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:51.841720  8055 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:51.877214  6609 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:51.878600  8324 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:51.879330  8324 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:51.881289  8295 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:51.885637  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:51.886480  8318 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:51.886631  6649 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:24:51.887075  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:51.898984  6645 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:51.887066  8318 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:51.902619  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:51.903486  5962 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
W20260709 12:24:51.904210  8347 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 1.728s	user 0.014s	sys 0.028s
I20260709 12:24:51.904932  6642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 620) took 1849 ms. Trace:
I20260709 12:24:51.905665  6651 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:51.913394  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:51.909740  8312 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:51.918083  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 117815us
I20260709 12:24:51.898038  8354 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:51.905390  6642 rpcz_store.cc:276] 0709 12:24:50.055704 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.060902 (+  5198us) service_pool.cc:224] Handling call
0709 12:24:50.067137 (+  6235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:50.173975 (+106838us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.175835 (+  1860us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:50.179325 (+  3490us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:24:50.181195 (+  1870us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.904478 (+1723283us) spinlock_profiling.cc:243] Waited 96.7 ms on lock 0x7b5400532d54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:24:51.904541 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.904764 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":222432128}
W20260709 12:24:51.940361  8386 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:24:51.834378  5864 rpcz_store.cc:276] 0709 12:24:44.376140 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.376290 (+   150us) service_pool.cc:224] Handling call
0709 12:24:51.813173 (+7436883us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:47.609786 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:47.857283 (+247497us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:47.859809 (+  2526us) write_op.cc:435] Acquired schema lock
0709 12:24:47.865427 (+  5618us) tablet.cc:662] Decoding operations
0709 12:24:48.102125 (+236698us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:48.102198 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:48.102229 (+    31us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:24:48.227686 (+125457us) tablet.cc:701] Row locks acquired
0709 12:24:48.234721 (+  7035us) write_op.cc:260] PREPARE: finished
0709 12:24:48.258612 (+ 23891us) write_op.cc:270] Start()
0709 12:24:48.258748 (+   136us) write_op.cc:276] Timestamp: P: 1783599888258534 usec, L: 0
0709 12:24:48.258773 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:24:48.259534 (+   761us) log.cc:844] Serialized 2554 byte log entry
0709 12:24:49.077617 (+818083us) op_driver.cc:464] REPLICATION: finished
0709 12:24:49.249120 (+171503us) spinlock_profiling.cc:243] Waited 7.55 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f481df4a0ac 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4824a8aef0
0709 12:24:50.085849 (+836729us) write_op.cc:301] APPLY: starting
0709 12:24:50.094271 (+  8422us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:50.132429 (+ 38158us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:50.135761 (+  3332us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:50.272000 (+136239us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:50.272183 (+   183us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:24:50.272233 (+    50us) write_op.cc:312] APPLY: finished
0709 12:24:50.272470 (+   237us) log.cc:844] Serialized 53 byte log entry
0709 12:24:50.386703 (+114233us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:50.390895 (+  4192us) write_op.cc:454] Released schema lock
0709 12:24:50.408808 (+ 17913us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:50.815187 (+406379us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:50.832806 (+ 17619us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":124491,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":986694,"apply.run_cpu_time_us":10440,"apply.run_wall_time_us":582375,"num_ops":6,"prepare.queue_time_us":1180373,"prepare.run_cpu_time_us":29366,"prepare.run_wall_time_us":1009693,"raft.queue_time_us":345347,"raft.run_cpu_time_us":38911,"raft.run_wall_time_us":1119646,"replication_time_us":818680,"spinlock_wait_cycles":17362688,"thread_start_us":2554061,"threads_started":5,"wal-append.queue_time_us":1458399,"wal-append.run_cpu_time_us":9841,"wal-append.run_wall_time_us":1161226}]]}
W20260709 12:24:51.949160  6117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 1757) took 2695 ms (client timeout 2217 ms). Trace:
W20260709 12:24:51.949721  6117 rpcz_store.cc:269] 0709 12:24:49.253310 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:49.309294 (+ 55984us) service_pool.cc:224] Handling call
0709 12:24:51.948738 (+2639444us) spinlock_profiling.cc:243] Waited 1.86 s on lock 0x7b54001b9254. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:51.948916 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4286155520}
W20260709 12:24:51.952013  8348 log.cc:927] Time spent T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 1.761s	user 0.015s	sys 0.026s
W20260709 12:24:51.955420  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 132301us
W20260709 12:24:51.960791  6082 connection.cc:256] RPC call timeout handler was delayed by -2.2224261549999937s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18460000000000001s for a response
W20260709 12:24:51.962658  8390 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:24:51.967218  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:51.967367  6114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 328) took 1774 ms (client timeout 2179 ms). Trace:
W20260709 12:24:51.967798  6114 rpcz_store.cc:269] 0709 12:24:50.194145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.298832 (+104687us) service_pool.cc:224] Handling call
0709 12:24:51.966982 (+1668150us) spinlock_profiling.cc:243] Waited 35.7 ms on lock 0x7b540023aad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:51.967197 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":82130176}
I20260709 12:24:51.968987  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:51.969681  5962 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:51.976727  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:51.977599  6114 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
W20260709 12:24:51.978205  5967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 1464) took 2777 ms (client timeout 2331 ms). Trace:
W20260709 12:24:51.978633  5967 rpcz_store.cc:269] 0709 12:24:49.200457 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.170951 (+970494us) service_pool.cc:224] Handling call
0709 12:24:51.977986 (+1807035us) spinlock_profiling.cc:243] Waited 1.35 s on lock 0x7b54001def54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:51.978144 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3108385024}
I20260709 12:24:51.978803  8318 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:51.982035  6082 connection.cc:256] RPC call timeout handler was delayed by -2.2206261549999908s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18480000000000002s for a response
W20260709 12:24:51.964131  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 155152us
I20260709 12:24:51.964852  8089 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:51.982790  6608 leader_election.cc:336] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 2.186s (SENT)
I20260709 12:24:51.987869  8227 raft_consensus.cc:3055] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:51.988338  8227 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:51.989100  6608 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:51.989387  8227 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:51.990445  8055 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:51.962090  8324 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:51.990898  8227 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:51.962404  8295 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:51.992616  8314 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:51.993304  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:51.994194  5967 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
W20260709 12:24:51.994478  8339 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 1.818s	user 0.008s	sys 0.032s
I20260709 12:24:51.945911  8349 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:51.996061  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:51.996556  8314 raft_consensus.cc:670] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: failed to trigger leader election: Illegal state: only voting members can start elections: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:51.997200  6609 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:51.998515  8373 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:52.003067  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:52.004105  6039 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:52.003950  8295 consensus_queue.cc:1059] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:24:52.005538  8295 raft_consensus.cc:3055] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:52.005995  8295 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:52.008234  8358 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.012272  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:51.996565  8349 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:52.012991  6648 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:52.013176  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:51.986330  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 394) took 1854 ms. Trace:
W20260709 12:24:52.014787  6082 connection.cc:256] RPC call timeout handler was delayed by -2.1729261549999137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19010000000000002s for a response
I20260709 12:24:52.018379  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 345) took 1624 ms. Trace:
W20260709 12:24:52.019397  6608 leader_election.cc:336] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 2.209s (SENT)
I20260709 12:24:52.019915  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:52.020720  8325 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:52.020815  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:52.021545  6043 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:52.031208  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:52.033775  6039 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:52.034996  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.033907  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:52.014037  6035 rpcz_store.cc:276] 0709 12:24:50.052098 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.164682 (+112584us) service_pool.cc:224] Handling call
0709 12:24:50.164966 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:50.222866 (+ 57900us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:50.222895 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:51.664400 (+1441505us) spinlock_profiling.cc:243] Waited 920 us on lock 0x7b2c00000238. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f94da11 00007f481f95d372 00007f482108fa01 00007f482105443a 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2
0709 12:24:51.665273 (+   873us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.810667 (+145394us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:24:51.810712 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.813513 (+  2801us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.884804 (+ 71291us) raft_consensus.cc:1685] finished
0709 12:24:51.884817 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:51.906254 (+ 21437us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2114944,"thread_start_us":139596,"threads_started":1,"wal-append.queue_time_us":186276}
I20260709 12:24:52.018797  6111 rpcz_store.cc:276] 0709 12:24:50.394400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:50.402057 (+  7657us) service_pool.cc:224] Handling call
0709 12:24:51.831386 (+1429329us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:51.838976 (+  7590us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:51.839007 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:51.839566 (+   559us) log.cc:844] Serialized 26 byte log entry
0709 12:24:51.922917 (+ 83351us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:24:51.922954 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:51.923020 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:51.991463 (+ 68443us) raft_consensus.cc:1685] finished
0709 12:24:51.991480 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:52.018028 (+ 26548us) spinlock_profiling.cc:243] Waited 683 ms on lock 0x7b5400163d50. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:52.018217 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7018,"raft.queue_time_us":9333,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":134,"spinlock_wait_cycles":1570670464,"thread_start_us":82944,"threads_started":1,"wal-append.queue_time_us":118970}
I20260709 12:24:52.036293  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:52.038939  6117 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.038743  8295 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:52.039127  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:52.040059  8295 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:52.041738  6082 connection.cc:256] RPC call timeout handler was delayed by -2.0748261549997551s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.20099999999999998s for a response
W20260709 12:24:52.042150  6082 connection.cc:256] RPC call timeout handler was delayed by -2.0658261549997405s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.202s for a response
W20260709 12:24:52.043336  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.037289  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.041756  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.045401  5962 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:52.040211  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:52.044996  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:52.045989  5967 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
W20260709 12:24:52.050619  6082 connection.cc:256] RPC call timeout handler was delayed by -1.7769551279998268s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 12:24:52.051030  6082 connection.cc:256] RPC call timeout handler was delayed by -1.6293551279995881s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1683s for a response
W20260709 12:24:52.055878  6082 connection.cc:256] RPC call timeout handler was delayed by -1.5078551279998464s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18180000000000002s for a response
W20260709 12:24:52.049144  6009 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.889s (SENT) [suppressed 65 similar messages]
I20260709 12:24:52.054704  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:52.057740  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:52.059526  6648 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:24:52.061189  6082 connection.cc:256] RPC call timeout handler was delayed by -1.1559261550000883s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.30310000000000004s for a response
I20260709 12:24:52.054230  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.066741  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:52.067461  6111 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:52.068706  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.074777  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.075556  5967 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:52.076980  6114 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.083314  6043 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:24:52.088387  5965 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:52.092752  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:52.094224  5967 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:52.094748  6611 leader_election.cc:336] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.573s (SENT)
I20260709 12:24:52.095387  6611 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:24:52.088114  6009 connection.cc:256] RPC call timeout handler was delayed by -1.0859104790001766s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2479s for a response
W20260709 12:24:52.098295  6009 connection.cc:256] RPC call timeout handler was delayed by -1.0627272229999107s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1526s for a response
W20260709 12:24:52.099383  6009 connection.cc:256] RPC call timeout handler was delayed by -1.0348272229998656s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1557s for a response
I20260709 12:24:52.097272  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:52.099601  6111 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:52.105767  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:52.112645  6040 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.052922  8227 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.048s
I20260709 12:24:52.120698  6609 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:52.122686  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:52.122823  5960 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.123421  8089 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:52.089159  8367 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.123994  8089 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:52.124835  8227 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:52.125262  8227 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:52.125351  8089 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:52.088984  8354 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:52.112399  8324 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:52.121204  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:52.101446  8358 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:52.135496  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:52.139438  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:52.138314  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:52.121637  8318 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:52.139690  8367 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:52.141185  6035 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:52.147688  5967 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 6: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:24:52.148728  6608 leader_election.cc:336] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.573s (SENT)
I20260709 12:24:52.132026  8324 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.126289  8227 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.168740  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:52.175920  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 47007.8us
I20260709 12:24:52.194413  5960 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:24:52.196583  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:52.198793  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51041us
I20260709 12:24:52.200721  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:52.201524  6114 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:52.201311  6039 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:24:52.202853  8297 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:52.203486  8297 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:52.204020  8297 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:52.206710  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.146780  8359 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:52.215269  8395 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:24:52.235097  6037 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:52.257642  6117 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
W20260709 12:24:52.258342  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 47070.7us
I20260709 12:24:52.254274  5934 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:52.251721  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:52.260041  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.260532  6609 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:52.240001  8312 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:52.270109  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:52.272006  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.271019  5960 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:52.279582  8088 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:52.283106  8227 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.283816  8361 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.286070  8361 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:52.291621  8088 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:24:52.296013  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.295610  6115 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:52.296947  8088 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:52.297825  6006 connection.cc:256] RPC call timeout handler was delayed by -1.5268722769997112s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1988s for a response
I20260709 12:24:52.292292  8263 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:52.302490  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.303421  5965 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:52.304699  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.302491  8263 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:52.308132  8263 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.308485  8192 raft_consensus.cc:1064] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
W20260709 12:24:52.309069  8192 raft_consensus.cc:1068] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Unable to promote non-voter 24012af7747d4c4ea89c3da2ff950099: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:24:52.311298  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.313503  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.314446  5966 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:52.320706  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:52.321547  6038 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:24:52.319501  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.324223  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.324548  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.324862  5965 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:52.317081  6611 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:24:52.332677  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 130255us
I20260709 12:24:52.333734  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:52.336532  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 66483.7us
I20260709 12:24:52.340938  6038 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:52.341713  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.342636  5965 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:52.332334  8359 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:52.344682  8395 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:24:52.349970  6039 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:52.350551  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:52.351001  8395 raft_consensus.cc:3055] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:52.351351  6044 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:52.316136  8312 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:52.351605  8395 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:52.344113  8324 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:52.360266  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:52.361111  6035 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:52.362959  8395 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:52.364456  8395 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:52.365650  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:52.366453  6041 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:52.375650  6039 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:52.379671  8312 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:52.380904  6009 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:52.382405  6648 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:52.383538  6009 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:52.381153  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.400208  8361 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:52.400002  8263 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.401465  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:52.404213  8318 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:52.405129  8361 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:52.405586  8361 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.405997  8361 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.402117  8263 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:52.389029  6040 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:52.389840  8227 consensus_queue.cc:1059] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:52.393234  8359 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:52.411974  8227 consensus_queue.cc:1243] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer 24012af7747d4c4ea89c3da2ff950099 log is divergent from this leader: its last log entry 5.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:24:52.411844  8359 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:52.395926  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:52.412639  8227 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:52.413038  8227 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:52.414418  5934 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:52.414708  8367 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:52.413962  8227 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:52.416078  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45883us
I20260709 12:24:52.424620  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:52.430933  6609 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:52.394212  8297 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:52.411195  8089 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:52.441787  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:52.442521  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.424746  8263 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:52.448571  6040 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:52.424418  8359 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.457087  5965 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:52.459079  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:52.441789  8324 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:52.449915  8089 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.454090  8227 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:52.479343  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:52.452526  8263 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.484511  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:52.487361  8214 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:24:52.487867  8263 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:52.487386  8356 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:52.500200  8263 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:52.502157  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:52.482530  6035 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.504156  5965 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:52.505368  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:52.505712  6043 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:52.484340  8318 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:52.506951  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:52.507840  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 95336.6us
I20260709 12:24:52.465236  8324 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.481539  8089 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.515076  8361 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.520237  8297 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:52.525437  6044 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:52.528848  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:52.530488  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:52.520159  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:52.541540  6042 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 6: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:52.548110  6041 raft_consensus.cc:2410] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 4 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:52.542477  8324 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.552999  8318 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:24:52.564081  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.564374  8318 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:52.565359  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 45308.8us
I20260709 12:24:52.566311  6081 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:52.566685  5865 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 303) took 7155 ms. Trace:
I20260709 12:24:52.564296  8361 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:52.568066  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.567134  6038 raft_consensus.cc:2410] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:24:52.567967  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:52.568519  8192 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:52.565935  8359 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:52.575814  5932 leader_election.cc:336] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 1.549s (SENT)
I20260709 12:24:52.576797  5932 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:52.580334  8293 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:52.580840  8293 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:52.567027  5865 rpcz_store.cc:276] 0709 12:24:45.411037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:45.413240 (+  2203us) service_pool.cc:224] Handling call
0709 12:24:52.566625 (+7153385us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:51.849870 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:51.850706 (+   836us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:51.850759 (+    53us) write_op.cc:435] Acquired schema lock
0709 12:24:51.850794 (+    35us) tablet.cc:662] Decoding operations
0709 12:24:51.851305 (+   511us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:51.851394 (+    89us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:51.851427 (+    33us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:24:51.910293 (+ 58866us) tablet.cc:701] Row locks acquired
0709 12:24:51.917412 (+  7119us) write_op.cc:260] PREPARE: finished
0709 12:24:51.928883 (+ 11471us) write_op.cc:270] Start()
0709 12:24:51.938827 (+  9944us) write_op.cc:276] Timestamp: P: 1783599891922900 usec, L: 0
0709 12:24:51.956585 (+ 17758us) op_driver.cc:348] REPLICATION: starting
0709 12:24:51.981447 (+ 24862us) log.cc:844] Serialized 913 byte log entry
0709 12:24:52.131689 (+150242us) op_driver.cc:464] REPLICATION: finished
0709 12:24:52.426888 (+295199us) write_op.cc:301] APPLY: starting
0709 12:24:52.426982 (+    94us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:52.427130 (+   148us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:52.427258 (+   128us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:52.450631 (+ 23373us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:52.466551 (+ 15920us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:24:52.484223 (+ 17672us) write_op.cc:312] APPLY: finished
0709 12:24:52.499836 (+ 15613us) log.cc:844] Serialized 29 byte log entry
0709 12:24:52.500033 (+   197us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:52.500132 (+    99us) write_op.cc:454] Released schema lock
0709 12:24:52.500185 (+    53us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:52.500623 (+   438us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:52.500650 (+    27us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":3,"child_traces":[["op",{"apply.queue_time_us":280956,"apply.run_cpu_time_us":2783,"apply.run_wall_time_us":73721,"num_ops":2,"prepare.queue_time_us":193448,"prepare.run_cpu_time_us":4621,"prepare.run_wall_time_us":184519,"replication_time_us":154083,"thread_start_us":303262,"threads_started":2}]]}
I20260709 12:24:52.574723  8192 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.587345  8192 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:52.581239  8293 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.592079  6039 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 2: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:24:52.590979  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 103963us
I20260709 12:24:52.552484  5864 catalog_manager.cc:5697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 4 to 5, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.599440  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:52.598935  6081 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:52.603081  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 97702.2us
I20260709 12:24:52.606817  5864 catalog_manager.cc:5697] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 4 to 5, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.602649  8111 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:52.610770  8227 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:52.611783  5862 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 189) took 8232 ms. Trace:
I20260709 12:24:52.610337  8361 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:52.601930  8297 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:52.618978  8227 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.619032  5862 rpcz_store.cc:276] 0709 12:24:44.359029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:44.359820 (+   791us) service_pool.cc:224] Handling call
0709 12:24:44.511442 (+151622us) spinlock_profiling.cc:243] Waited 5.46 ms on lock 0x7b5400002490. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df30640 00007f4826e07846 00007f4826f1190e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:24:52.579904 (+8068462us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":68858,"reported_tablets":7,"spinlock_wait_cycles":12561280}
I20260709 12:24:52.620208  8227 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:52.624878  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 49529us
W20260709 12:24:52.625555  5932 leader_election.cc:336] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 1.608s (SENT)
I20260709 12:24:52.625943  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:52.622790  5864 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 2, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.619553  8359 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:52.618825  8111 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.630888  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.632331  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:52.633288  5967 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:52.635121  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.636400  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.637367  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.637869  5960 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:52.639103  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.639169  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.640269  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.639739  5960 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:52.640882  5964 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:52.642633  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.644294  5966 raft_consensus.cc:1240] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:52.644678  6038 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:52.645215  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.645294  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.640214  5864 catalog_manager.cc:5697] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 4, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 4 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.646524  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.646564  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.647169  5864 catalog_manager.cc:5697] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 4, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 4 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.647230  5963 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:52.651131  8373 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:52.632663  8111 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.655040  6081 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:52.655372  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:52.657244  5968 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:52.648809  5864 catalog_manager.cc:5697] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 2 to 3, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 3 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:24:52.655747  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.656090  8359 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:52.666889  8359 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:52.667366  8359 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:52.670047  5967 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
W20260709 12:24:52.677727  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48259.9us
I20260709 12:24:52.681860  6081 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:52.672621  5934 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:52.685145  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.671427  8420 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:52.682403  5864 catalog_manager.cc:5697] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 4, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 4 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:24:52.680970  8214 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:52.680691  8263 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:52.665004  8324 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.696792  5864 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 7 to 9, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 9 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:52.704284  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:52.704092  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:52.705792  5967 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:52.702555  8356 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.004s
I20260709 12:24:52.703670  5864 catalog_manager.cc:5697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 3, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 3 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:52.708595  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:52.709599  6082 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:52.710156  8356 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:52.711081  8356 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:52.711498  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:52.726054  5965 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:52.701010  8214 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.727054  5962 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:52.725592  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.728667  5967 raft_consensus.cc:2410] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 4 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:24:52.700373  8419 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:52.729470  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 51009.2us
I20260709 12:24:52.681308  8293 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.711480  8356 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:52.703876  8297 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election won for term 3
W20260709 12:24:52.728837  8416 log.cc:927] Time spent T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:24:52.701359  8295 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.029s
I20260709 12:24:52.728648  8214 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:52.729871  8361 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:52.751840  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:52.753957  5967 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:24:52.741677  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:52.733669  6009 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:52.757525  8429 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:52.758038  8429 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:52.758414  8429 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:52.765762  8430 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:24:52.767179  6009 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:52.730700  8419 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:52.770188  5962 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:52.770144  5965 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:52.732944  8297 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.706123  8089 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:52.790043  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:52.769600  8367 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:52.772991  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 60512us
I20260709 12:24:52.753513  8361 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.775738  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:52.797056  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:52.797901  5961 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:24:52.799525  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 126995us
I20260709 12:24:52.797010  5960 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:52.800383  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:52.802446  5965 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:52.803886  6006 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:52.804347  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:52.755779  8111 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.804042  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:52.794173  8297 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:52.800203  8361 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:52.801748  8290 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:52.839049  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 129512us
W20260709 12:24:52.840682  8422 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:52.850521  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:52.790427  8419 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:52.851161  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 45173.3us
I20260709 12:24:52.854874  8431 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:24:52.855590  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 62040.9us
W20260709 12:24:52.855716  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 50818.9us
W20260709 12:24:52.856482  5932 leader_election.cc:336] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 1.657s (SENT)
I20260709 12:24:52.857012  5966 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:52.798771  8367 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:52.868449  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 75067.9us
I20260709 12:24:52.870297  5962 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:52.872083  8111 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:52.880630  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 76839us
I20260709 12:24:52.882304  8434 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:52.882756  8434 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.883075  8434 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:52.880857  8367 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.857512  8430 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.025s
I20260709 12:24:52.900182  8192 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.880208  8290 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:52.901492  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:52.902746  8432 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:52.903986  6041 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:24:52.904091  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:52.904572  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:52.904973  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:52.901717  6039 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:24:52.907498  5967 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:52.909154  6006 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:52.911213  8425 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:52.911856  5960 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:24:52.915766  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:52.904181  8432 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:52.883594  8359 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:52.911662  8425 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.879714  8429 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.888732  8295 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.028s
I20260709 12:24:52.928542  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:52.881525  8431 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:52.928547  8293 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:52.954286  5934 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:52.925464  8425 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:52.946771  8418 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:52.944633  8192 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:52.962539  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 82695.8us
W20260709 12:24:52.966424  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:52.950018  8430 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:52.975821  6608 leader_election.cc:336] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.541s (SENT)
I20260709 12:24:52.970481  8435 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:24:52.976509  6608 leader_election.cc:336] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.582s (SENT)
I20260709 12:24:52.930056  8356 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.981372  8290 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:53.001420  8290 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:52.976053  8420 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:53.001840  8290 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:53.002779  5934 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:53.003116  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:53.004135  8359 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:53.005466  5934 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:53.006924  8263 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:52.981227  8434 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.985184  8227 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:52.996130  8325 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:24:52.996929  8318 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:52.997311  8431 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:52.970947  8297 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:52.998663  8433 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:53.000276  6608 leader_election.cc:336] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 2.876s (SENT)
I20260709 12:24:53.012137  8434 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:53.007522  8439 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:52.974272  8214 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:53.049860  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 54559.5us
I20260709 12:24:52.994848  8418 raft_consensus.cc:697] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:53.007695  8420 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:24:53.065568  6611 leader_election.cc:336] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.541s (SENT)
I20260709 12:24:53.066098  6611 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:53.081139  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 131531us
I20260709 12:24:53.083024  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:53.091302  6611 leader_election.cc:336] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.582s (SENT)
I20260709 12:24:53.092101  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:53.095506  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 88935.8us
I20260709 12:24:53.077453  8314 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.054921  8433 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:53.098671  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 193752us
I20260709 12:24:53.102308  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:53.103431  8359 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:53.103857  8324 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:53.104884  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:53.106333  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:53.107734  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:53.110764  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 110507us
I20260709 12:24:53.110832  6082 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:53.167227  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:53.100723  8395 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:53.099601  8434 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:24:53.170749  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 60040.1us
W20260709 12:24:53.168462  6608 leader_election.cc:336] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.667s (SENT)
I20260709 12:24:53.103890  8359 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:53.168149  8429 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:53.182163  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 67113.1us
W20260709 12:24:53.184803  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 83417.9us
I20260709 12:24:53.096890  8419 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:53.123221  8263 raft_consensus.cc:697] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:53.113793  8361 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:53.200909  6082 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:53.202834  6611 leader_election.cc:336] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.667s (SENT)
I20260709 12:24:53.203399  6611 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:53.205543  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 97936.9us
I20260709 12:24:53.175923  8434 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:24:53.207258  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 91346.4us
I20260709 12:24:53.199267  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:53.187230  8359 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:53.186862  8446 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.208437  8356 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:53.212064  8295 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:53.210549  8434 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.218858  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.228830  6039 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.229899  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.219197  8314 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:53.230706  6039 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.231673  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.232362  6039 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 2: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.233108  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.221567  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.234678  8443 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:24:53.235163  6040 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:53.235752  8314 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:53.236073  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:53.236884  8441 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:24:53.237277  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:53.222805  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.238104  8314 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:53.224629  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.221875  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.219323  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.222164  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.223160  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.237850  8263 consensus_queue.cc:237] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:53.238785  6038 raft_consensus.cc:2368] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3.
I20260709 12:24:53.219658  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.219552  8111 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:53.234203  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.238020  6040 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 6: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.239710  5934 leader_election.cc:400] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4.
I20260709 12:24:53.250702  5934 leader_election.cc:403] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:24:53.198292  8450 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.235255  8361 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:53.212749  8373 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:24:53.246848  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 47626.7us
I20260709 12:24:53.208498  8429 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.040s
I20260709 12:24:53.247516  6035 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.223067  8457 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:53.252547  6042 raft_consensus.cc:2393] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.252588  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.257180  8361 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.258693  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:53.268085  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.261173  6040 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:53.262807  8450 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4.
I20260709 12:24:53.263252  6038 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:24:53.262236  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:24:53.247279  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51059.7us
I20260709 12:24:53.270514  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.216429  8445 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:53.268947  8297 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:53.266090  8214 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:53.273013  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.284626  6040 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.274991  5934 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:53.275249  8111 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:24:53.275703  8453 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:53.291343  8453 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:53.291448  8293 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:53.291807  8453 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:53.294991  5932 leader_election.cc:336] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 2.434s (SENT)
I20260709 12:24:53.295501  5932 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:53.297482  8089 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:53.300757  5934 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:53.301277  8367 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:53.302179  8450 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:53.195638  8418 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:53.306826  6044 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.307673  8419 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:53.308410  8227 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:53.308854  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:53.308373  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:53.310231  8452 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:53.310572  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:53.311223  6651 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:53.276402  8432 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:53.276648  8446 consensus_queue.cc:1059] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:53.198091  8420 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:53.314503  8446 raft_consensus.cc:3055] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:53.314920  8446 raft_consensus.cc:740] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:53.315814  8446 consensus_queue.cc:260] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:53.317308  8297 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:53.317776  8297 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:53.318171  8297 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:53.322364  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:53.278620  6041 raft_consensus.cc:2410] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:53.287093  8454 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:53.286559  8439 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:53.289137  6042 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:53.327692  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.333422  5960 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:53.337980  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:53.339092  5962 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:53.347349  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.349443  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:53.351801  5965 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.353426  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:53.317255  8446 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:53.349506  6036 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
W20260709 12:24:53.355527  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 458087us
I20260709 12:24:53.355908  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:53.356621  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:53.357357  5966 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 2: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:53.360746  8419 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:53.361225  8439 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:53.362040  8419 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:53.346782  8227 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:53.363531  8227 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:53.306900  8433 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:53.321615  8293 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:53.310657  8452 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:53.371809  6036 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:53.372289  6651 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:53.327105  8454 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:53.335307  8432 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:53.379317  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 95841.8us
I20260709 12:24:53.383531  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:53.384418  5962 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 3: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:53.388836  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:53.392315  8359 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:53.394253  8314 consensus_queue.cc:1059] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:24:53.395306  8314 raft_consensus.cc:3055] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:53.395637  8314 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:24:53.392874  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.398178  8293 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:53.398833  8297 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:53.399739  8367 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:53.400650  8450 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:53.401396  5962 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:53.401943  8297 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:53.401717  8290 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:53.396530  8314 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:53.403760  8290 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:53.405129  8314 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:53.405082  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:53.382079  8454 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:53.406024  5965 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.406829  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:24:53.407581  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 51294.4us
I20260709 12:24:53.408389  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:53.381847  8452 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:53.418506  8425 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:53.386626  8434 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:53.421218  8434 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:53.387217  8432 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:53.423242  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:53.424458  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:53.425655  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:53.408262  8453 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:53.426571  6006 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:53.427666  8111 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.428066  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:53.426337  8356 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:53.429141  8356 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.429713  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:53.430718  8227 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:53.431737  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:53.432518  5965 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:53.417930  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:53.440029  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:53.443483  6081 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:53.444151  5962 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:53.452400  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:53.454177  5959 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:24:53.433030  6043 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:53.460491  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:53.461158  6650 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:53.430550  8359 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:53.384629  8089 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.068s
I20260709 12:24:53.428414  8111 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.471057  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:53.471961  5959 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:53.468127  5966 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:53.481590  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:24:53.482214  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 67435us
I20260709 12:24:53.482928  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:53.485993  6081 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:53.421228  8425 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:53.488760  6044 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.488914  6081 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:53.489684  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.452190  8367 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:53.493197  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.493844  6042 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 2: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.460175  8227 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:53.463013  8290 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:53.501008  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 67519.2us
I20260709 12:24:53.464630  8434 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.503420  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.481878  8293 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:53.482182  8297 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:53.518281  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.519199  6039 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:53.527812  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:53.522065  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.493886  8450 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:24:53.532013  8461 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:24:53.532876  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:53.588781  6040 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:53.535238  6114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38df61ba407240499023581d9f885037"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:53.527297  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:53.589645  6114 raft_consensus.cc:606] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:53.535928  8459 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.534056  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:53.536500  8440 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:53.527163  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.538533  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:53.518911  8297 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:53.545213  6036 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:53.547935  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.601380  6037 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.570986  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:53.504994  8419 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:53.494171  8367 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:53.575512  8453 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:53.625211  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.640882  6036 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:53.641829  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.624874  8367 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:53.643123  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.643837  6040 raft_consensus.cc:2393] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.644191  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:53.644610  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:24:53.644891  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 117674us
I20260709 12:24:53.645373  6040 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.646138  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:53.646872  6040 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.647608  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:53.648370  6040 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.649216  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:53.649904  6040 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.590281  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.630452  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:53.632725  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.637583  8359 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:53.592422  6114 raft_consensus.cc:614] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:24:53.595110  6042 raft_consensus.cc:2410] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:53.650863  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:53.654848  6042 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:53.655222  6043 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:53.603199  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 78553.5us
I20260709 12:24:53.656642  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:53.657724  6006 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:53.658645  8434 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:53.529114  6044 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:53.588407  8450 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:53.659566  8450 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:53.662374  8359 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:53.649709  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:53.663489  8359 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.663877  8359 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:53.650830  6115 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:53.681774  6043 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:53.688262  6650 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:53.606267  5959 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:53.726766  6116 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:53.689915  6110 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 2: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:53.728232  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:53.698010  6109 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:24:53.741756  6044 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:53.743772  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:53.744832  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:53.640338  8440 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:53.748167  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:53.748417  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 81033us
I20260709 12:24:53.622328  8297 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:53.766861  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:53.628700  8439 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:53.622049  8419 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:53.753440  6116 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 2: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:53.747723  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:53.754369  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:53.857867  5961 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:24:53.758193  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:53.805428  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 47526us
I20260709 12:24:53.816483  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:53.861781  6111 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:53.812896  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:53.808480  6040 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 6: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.755764  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:53.806146  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:53.638959  8433 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.116s
W20260709 12:24:53.841248  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 84847.8us
I20260709 12:24:53.844063  6109 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:53.850871  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:53.851383  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:53.868187  5963 raft_consensus.cc:2376] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4. Re-sending same reply.
I20260709 12:24:53.873502  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:53.878324  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:53.878549  6611 leader_election.cc:336] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 2.166s (SENT)
I20260709 12:24:53.882392  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:53.839989  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:53.752271  8454 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:53.864362  6645 raft_consensus.cc:2368] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4.
I20260709 12:24:53.889211  6608 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:53.872941  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:53.883162  8465 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:24:53.898247  6118 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 4: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:53.953318  6116 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:53.953419  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:53.960168  6035 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:53.960968  5965 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:53.627789  8452 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:53.858693  8325 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:24:53.881518  8356 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:53.989221  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:53.990795  6115 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:54.051321  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:54.052240  5965 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:53.869690  8450 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:54.057569  5964 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:54.000666  8419 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:54.063180  6114 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
W20260709 12:24:54.066257  8469 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:24:54.066694  6084 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:54.107148  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 267362us
W20260709 12:24:54.068065  8314 consensus_meta.cc:287] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.624s	user 0.006s	sys 0.002s
I20260709 12:24:54.074265  8443 raft_consensus.cc:1064] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:24:53.886335  8423 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.461s
I20260709 12:24:54.079922  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.053138  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:53.966876  8432 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:53.989315  8451 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:24:54.117025  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 244312us
I20260709 12:24:54.135672  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:54.105348  8470 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.259s	user 0.001s	sys 0.000s
I20260709 12:24:54.142201  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:54.146744  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.148162  6041 raft_consensus.cc:2376] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3. Re-sending same reply.
W20260709 12:24:54.151582  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:54.142513  8473 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.166s	user 0.000s	sys 0.002s
I20260709 12:24:54.138526  8227 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:54.156474  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:54.108075  8434 consensus_queue.cc:1059] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.041s
I20260709 12:24:54.157737  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:54.158224  6111 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:54.167608  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:54.169493  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:54.169713  8420 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:54.174672  8476 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.281s	user 0.001s	sys 0.000s
W20260709 12:24:54.175784  8464 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 12:24:54.175930  5963 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:54.176328  5963 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:54.177104  5963 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:54.180968  8480 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
W20260709 12:24:54.181605  8367 consensus_meta.cc:287] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.538s	user 0.006s	sys 0.002s
I20260709 12:24:54.182181  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:54.183965  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:54.178361  5963 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:54.187366  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 318145us
I20260709 12:24:54.189908  6041 raft_consensus.cc:2393] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:54.190749  6608 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:54.151363  8451 raft_consensus.cc:697] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:54.182039  8367 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:54.218892  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:54.220674  5934 leader_election.cc:400] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4.
I20260709 12:24:54.221040  5934 leader_election.cc:403] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:54.228262  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:54.231741  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:54.116554  8440 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:54.245615  6042 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:54.251932  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.252909  6043 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:54.212391  8423 consensus_queue.cc:1059] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.025s
W20260709 12:24:54.258172  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 137359us
I20260709 12:24:54.215051  8420 consensus_queue.cc:1059] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.029s
I20260709 12:24:54.217435  8314 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.031s
I20260709 12:24:54.268639  6118 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:24:54.249140  8312 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:24:54.274761  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 47157us
I20260709 12:24:54.278748  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:54.279045  8450 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:54.279610  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:54.279790  8434 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:54.280383  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:54.281791  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.282524  6043 raft_consensus.cc:2393] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:54.274344  8227 raft_consensus.cc:697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:54.284586  8454 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:54.271934  8439 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4.
W20260709 12:24:54.301739  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 81216.2us
I20260709 12:24:54.281669  8432 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.306622  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:54.310247  5967 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:54.312152  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.313133  6043 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:54.264155  8489 consensus_queue.cc:1059] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:24:54.322976  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:54.324942  5864 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 310) took 2242 ms. Trace:
I20260709 12:24:54.306342  8312 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.326264  5864 rpcz_store.cc:276] 0709 12:24:52.078746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.078954 (+   208us) service_pool.cc:224] Handling call
0709 12:24:52.413184 (+334230us) spinlock_profiling.cc:243] Waited 320 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:24:54.320539 (+1907355us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:52.872709 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:52.873235 (+   526us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:52.873270 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:24:52.873287 (+    17us) tablet.cc:662] Decoding operations
0709 12:24:52.874273 (+   986us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:52.874331 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:52.874355 (+    24us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:24:52.875721 (+  1366us) tablet.cc:701] Row locks acquired
0709 12:24:52.875741 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:24:52.875873 (+   132us) write_op.cc:270] Start()
0709 12:24:52.876001 (+   128us) write_op.cc:276] Timestamp: P: 1783599892875829 usec, L: 0
0709 12:24:52.876029 (+    28us) op_driver.cc:348] REPLICATION: starting
0709 12:24:52.926119 (+ 50090us) log.cc:844] Serialized 3594 byte log entry
0709 12:24:53.113748 (+187629us) op_driver.cc:464] REPLICATION: finished
0709 12:24:53.240543 (+126795us) spinlock_profiling.cc:243] Waited 2.83 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f481df4a0ac 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4824a8aef0
0709 12:24:53.588843 (+348300us) write_op.cc:301] APPLY: starting
0709 12:24:53.592896 (+  4053us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:53.635948 (+ 43052us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:53.635971 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:53.641747 (+  5776us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:53.641959 (+   212us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=9
0709 12:24:53.642007 (+    48us) write_op.cc:312] APPLY: finished
0709 12:24:53.642274 (+   267us) log.cc:844] Serialized 71 byte log entry
0709 12:24:53.642430 (+   156us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:53.642590 (+   160us) write_op.cc:454] Released schema lock
0709 12:24:53.642637 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:53.642986 (+   349us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:53.643015 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5708,"reported_tablets":17,"spinlock_wait_cycles":736399616,"child_traces":[["op",{"apply.queue_time_us":406327,"apply.run_cpu_time_us":3173,"apply.run_wall_time_us":112971,"num_ops":9,"prepare.queue_time_us":161263,"prepare.run_cpu_time_us":4264,"prepare.run_wall_time_us":72926,"replication_time_us":221784,"spinlock_wait_cycles":6504064,"thread_start_us":438478,"threads_started":2}]]}
I20260709 12:24:54.325872  6118 raft_consensus.cc:2376] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4. Re-sending same reply.
I20260709 12:24:54.307888  8452 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:54.355082  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:54.363157  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:54.364523  6117 raft_consensus.cc:2376] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5. Re-sending same reply.
I20260709 12:24:54.318938  8454 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:54.365979  6043 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:54.368994  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:54.369583  6651 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:54.371531  6110 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:24:54.374151  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 67343us
I20260709 12:24:54.374361  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:54.375941  6118 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:54.322741  8487 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:54.379698  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:54.386121  6117 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:54.381313  6110 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:54.381410  8429 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:54.381872  8146 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:54.382725  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:54.316426  8432 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:54.307382  8451 consensus_queue.cc:237] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:54.382761  8488 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
W20260709 12:24:54.418305  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.372481  8434 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:54.420444  6651 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
W20260709 12:24:54.402086  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.378255  8452 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:54.422546  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 142215us
W20260709 12:24:54.422608  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 194394us
W20260709 12:24:54.426573  5853 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ec584257f9db451c965f6b092aa9069c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0069e2ba1f02412e8e1d6c20a1fb510f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 3 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:54.430723  6044 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:54.440807  6117 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:54.368849  8312 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:54.445185  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 75671.8us
I20260709 12:24:54.447119  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:54.416201  8367 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:54.450857  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.451562  6044 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:54.454092  8434 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:54.455022  8367 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:24:54.455605  8367 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:54.456516  8367 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:54.450857  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.459456  6043 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:54.449415  5934 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:54.477345  8501 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.477986  8501 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:54.481484  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:54.482182  6651 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:54.488370  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:54.485961  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:54.497089  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:54.497510  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.497869  6043 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:24:54.498693  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 51659.8us
I20260709 12:24:54.451697  8146 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:24:54.487340  8487 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:54.486323  8501 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:54.488616  8489 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:54.506191  6608 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:54.515601  8490 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.146s	user 0.000s	sys 0.002s
I20260709 12:24:54.415845  8227 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:54.512122  6117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:54.516758  8449 raft_consensus.cc:3055] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:54.514796  8505 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:24:54.494243  8314 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:54.498081  8420 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.065s
I20260709 12:24:54.514267  8500 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:54.524190  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:54.519914  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:54.521660  8486 raft_consensus.cc:3055] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:54.533152  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:54.677002  5968 raft_consensus.cc:2368] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 2. Current term is 3.
I20260709 12:24:54.531136  6109 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:54.600522  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 94515.4us
I20260709 12:24:54.601120  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:54.601887  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:54.604405  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1515) took 1263 ms. Trace:
I20260709 12:24:54.605762  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:54.606509  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:54.606738  8450 raft_consensus.cc:3055] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:54.607344  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:54.525640  8432 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:54.610555  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:54.613634  8487 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:54.522449  8359 consensus_meta.cc:287] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.858s	user 0.006s	sys 0.005s
I20260709 12:24:54.531764  8504 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:54.525970  8297 consensus_meta.cc:287] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.661s	user 0.011s	sys 0.000s
I20260709 12:24:54.615588  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:54.700592  6651 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
W20260709 12:24:54.530365  8483 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.424s	user 0.003s	sys 0.000s
I20260709 12:24:54.620326  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:54.598348  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:54.496708  8089 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 12:24:54.515213  8492 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:24:54.645742  5963 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
W20260709 12:24:54.663058  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 155993us
I20260709 12:24:54.680979  6118 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:54.680859  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:54.680001  6038 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:54.684736  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:54.687070  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:54.597270  8449 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:24:54.648576  8459 consensus_meta.cc:287] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 1.011s	user 0.011s	sys 0.000s
I20260709 12:24:54.599193  8489 raft_consensus.cc:697] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:54.699075  6113 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:54.680502  5964 rpcz_store.cc:276] 0709 12:24:53.340875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.410941 (+ 70066us) service_pool.cc:224] Handling call
0709 12:24:53.451881 (+ 40940us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.102491 (+650610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.604127 (+501636us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b54000b9354. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:24:54.604309 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392436608}
I20260709 12:24:54.731885  5967 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:54.731696  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:54.654421  8395 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:54.707818  6084 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:54.704489  8297 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:54.710340  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.676663  8486 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:54.735743  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.746616  6036 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:54.736850  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.747411  6038 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 6: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:54.680066  8455 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.739467  6651 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:54.741456  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:54.741734  6043 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:54.735422  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:54.742229  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.740484  6611 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:54.754944  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.755677  6036 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:24:54.756317  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:54.756894  5967 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:54.686293  8450 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:54.529539  8508 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:54.760377  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.760512  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:54.773406  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:54.528781  8506 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.705250  8359 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:54.758621  6037 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:54.764777  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:54.780450  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:54.764954  5959 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
W20260709 12:24:54.743338  8453 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 5 current term: 5 is higher.
I20260709 12:24:54.771066  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:54.731995  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:54.771159  8499 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:54.759476  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.778401  6043 raft_consensus.cc:2368] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5.
I20260709 12:24:54.779125  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:54.788360  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:54.749192  8459 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:54.785591  6113 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:54.765452  8500 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:54.789131  6114 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 3: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:54.789520  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.795269  6036 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:54.800004  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:54.802795  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:54.772696  8508 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.806741  6044 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:54.806300  5967 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:54.808386  5967 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
W20260709 12:24:54.809442  6009 connection.cc:256] RPC call timeout handler was delayed by -1.390241554000113s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
W20260709 12:24:54.810957  6009 connection.cc:256] RPC call timeout handler was delayed by -1.257941553999899s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1904s for a response
W20260709 12:24:54.812117  6009 connection.cc:256] RPC call timeout handler was delayed by -1.0401415540000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
W20260709 12:24:54.812742  6009 connection.cc:256] RPC call timeout handler was delayed by -1.0401415540000016s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2146s for a response
I20260709 12:24:54.813473  6037 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:54.814097  6043 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:54.787972  8499 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:54.826017  5967 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:24:54.822024  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:54.817094  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:54.823982  6117 raft_consensus.cc:606] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:54.828821  6037 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:24:54.829847  6113 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:24:54.830543  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.772063  8146 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:24:54.835474  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:54.739387  8504 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:54.836306  6037 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:54.831468  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:54.837976  6114 raft_consensus.cc:2368] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 2. Current term is 3.
I20260709 12:24:54.762861  8455 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:54.816998  8500 raft_consensus.cc:697] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:54.812630  8508 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:54.820842  8312 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:54.837226  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:54.783799  8449 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:54.853786  6039 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:24:54.830181  8499 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:54.858860  6041 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:54.859455  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:54.834286  8460 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.786695  8506 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:54.840829  8486 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:54.834169  8495 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.106s
I20260709 12:24:54.862582  8505 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:54.834093  8522 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.117s
I20260709 12:24:54.871855  8449 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:54.883095  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 122526us
I20260709 12:24:54.886484  8297 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:54.887073  8506 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:54.884191  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:54.888134  8459 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:54.887933  8500 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 4, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:54.888630  8459 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:54.896371  8290 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:54.940124  6649 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:54.943094  8290 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:54.943753  8526 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.944269  8526 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:54.948302  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 134665us
I20260709 12:24:54.949186  6009 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:54.857223  8450 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:54.831486  8489 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:54.982909  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:54.946861  8433 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:54.873338  8460 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:54.888639  8519 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.141s
I20260709 12:24:54.891582  8505 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.433248  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:55.441738  6038 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:55.442888  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:55.443485  6038 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:55.020217  8290 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:55.041824  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.020748  8533 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:55.446242  8533 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.446511  8433 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:55.421222  6642 consensus_meta.cc:287] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.545s	user 0.007s	sys 0.000s
W20260709 12:24:55.448768  6608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.501s	user 0.005s	sys 0.005s
W20260709 12:24:55.449306  6608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.005s	sys 0.006s
W20260709 12:24:55.027845  8419 consensus_meta.cc:287] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.907s	user 0.012s	sys 0.000s
I20260709 12:24:55.448904  6642 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:55.452904  8419 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:55.457841  8314 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:55.458349  8314 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:55.459668  8314 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.461362  8314 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:55.312444  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.466074  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.468768  6113 consensus_meta.cc:287] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.580s	user 0.010s	sys 0.000s
I20260709 12:24:55.470044  6113 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:55.474017  5967 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
W20260709 12:24:55.469298  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.440660  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 479166us
W20260709 12:24:55.481885  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 532755us
I20260709 12:24:55.488668  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:55.495236  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:55.252242  8455 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:55.007437  8359 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:55.502369  8290 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:55.502395  8530 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:55.503288  8290 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:55.503218  8530 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.503847  8290 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.505169  8418 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.505752  8290 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:55.505650  8418 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.437431  8504 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:55.508430  6039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1695) took 2085 ms (client timeout 1853 ms). Trace:
W20260709 12:24:55.510371  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.510251  6039 rpcz_store.cc:269] 0709 12:24:53.423337 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.527561 (+104224us) service_pool.cc:224] Handling call
0709 12:24:55.508235 (+1980674us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540030f2d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:55.508355 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2981056256}
W20260709 12:24:55.511193  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.514528  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:55.473743  8459 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:55.517589  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:55.518617  6039 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:55.505694  8530 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:55.487155  8146 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:55.497628  8419 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:55.531090  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:24:55.539664  6041 consensus_meta.cc:287] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.671s	user 0.011s	sys 0.000s
I20260709 12:24:55.540243  6041 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:55.546010  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:55.548475  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:55.550186  6039 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 3: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:55.532450  8459 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:55.525210  8504 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:55.553400  6009 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:55.553454  6113 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:24:55.527287  8359 consensus_queue.cc:1059] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:24:55.557904  6009 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:55.559690  6009 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:55.561283  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:24:55.565079  5961 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.691s	user 0.018s	sys 0.037s
W20260709 12:24:55.566383  5961 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.694s	user 0.018s	sys 0.037s
I20260709 12:24:55.547974  8419 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:55.560223  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:55.552294  8530 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:55.567698  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 453) took 2027 ms. Trace:
I20260709 12:24:55.567893  8418 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:55.570716  6042 rpcz_store.cc:276] 0709 12:24:53.539991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.655630 (+115639us) service_pool.cc:224] Handling call
0709 12:24:53.655897 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.251152 (+595255us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.567408 (+1316256us) spinlock_profiling.cc:243] Waited 589 ms on lock 0x7b540021f2d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:24:55.567620 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1355798400}
I20260709 12:24:55.555083  8293 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.532956  8146 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.571306  6039 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:55.573997  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:55.559095  8514 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:55.576761  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:55.564361  8460 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:55.571604  8459 raft_consensus.cc:3055] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:55.570092  8505 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:55.583238  6009 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:55.576141  8359 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:55.564878  8487 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:55.577877  8533 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:55.588025  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:55.599035  6039 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:55.575203  8433 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:55.578245  6113 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:55.574330  8504 raft_consensus.cc:697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:24:55.633569  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 50388.2us
I20260709 12:24:55.635670  8530 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:55.574640  8419 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.637138  8540 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:55.637880  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:55.588527  8459 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:55.645116  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:55.641865  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:55.577100  8293 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.646435  6113 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 3: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:55.649287  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:55.649923  5967 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:55.654331  5964 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:55.655431  8547 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:24:55.655733  8508 consensus_meta.cc:287] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.792s	user 0.007s	sys 0.002s
I20260709 12:24:55.656046  8547 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:55.660315  8534 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:24:55.661979  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:55.662827  6036 raft_consensus.cc:2410] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 5 because replica has last-logged OpId of term: 4 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:24:55.663614  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:55.664095  6036 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:55.666900  8459 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.668278  8459 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:55.670861  6036 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:55.656172  8508 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:55.679226  8499 consensus_meta.cc:287] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.803s	user 0.009s	sys 0.000s
I20260709 12:24:55.679692  8499 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.683506  8146 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:55.685272  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:55.685984  6113 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:55.686709  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:55.687357  6113 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:24:55.687987  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.646077  8540 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:55.674139  6038 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:24:55.691037  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1728) took 1090 ms. Trace:
I20260709 12:24:55.691447  6038 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:55.644404  8542 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:55.695381  8542 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.639865  8504 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.692103  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:55.692610  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:55.696769  5964 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:24:55.693267  6608 leader_election.cc:336] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 2.428s (SENT)
I20260709 12:24:55.694198  6043 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: [2.3-2.3]
I20260709 12:24:55.694168  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:55.698385  5967 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:55.697772  6039 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:24:55.699755  6039 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:55.695895  8472 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 1.555s	user 0.008s	sys 0.012s
I20260709 12:24:55.701995  6009 leader_election.cc:400] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 2. Current term is 3.
I20260709 12:24:55.704171  6009 leader_election.cc:403] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Cancelling election due to peer responding with higher term
I20260709 12:24:55.704880  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:55.691411  6041 rpcz_store.cc:276] 0709 12:24:54.600587 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.600849 (+   262us) service_pool.cc:224] Handling call
0709 12:24:55.690884 (+1090035us) spinlock_profiling.cc:243] Waited 180 ms on lock 0x7b540025ba54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:55.690985 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":413073152}
I20260709 12:24:55.705381  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:35576 (request call id 85) took 1163 ms. Trace:
I20260709 12:24:55.688053  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:55.706225  6113 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:24:55.707696  8546 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election lost for term 2. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 2. Current term is 3.
I20260709 12:24:55.709703  8533 consensus_queue.cc:1059] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:55.710073  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:55.710525  8533 consensus_queue.cc:1059] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:55.710880  8146 raft_consensus.cc:3055] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:55.712535  8542 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:55.713979  8511 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 1.189s	user 0.005s	sys 0.012s
I20260709 12:24:55.714370  6110 rpcz_store.cc:276] 0709 12:24:54.538213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.538342 (+   129us) service_pool.cc:224] Handling call
0709 12:24:55.685823 (+1147481us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b540020c954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482105a735 00007f48210529fa 00007f482601a4c9 00007f481f596c54 00007f481f596be2 00007f481f596b11 00007f481f596a8c 00007f481f595d42 00007f481f38f48c 00007f481f38e8c6
0709 12:24:55.701252 (+ 15429us) inbound_call.cc:177] Queueing failure response
Metrics: {"spinlock_wait_cycles":665012096}
I20260709 12:24:55.743624  6110 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:55.744216  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 1815) took 1096 ms. Trace:
I20260709 12:24:55.744489  6110 rpcz_store.cc:276] 0709 12:24:54.647697 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.743174 (+1095477us) service_pool.cc:224] Handling call
0709 12:24:55.743461 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.744011 (+   550us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.744165 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.691421  8540 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:55.716603  6009 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:55.729113  8146 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:55.747748  8146 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.733790  8519 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:55.748391  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:55.748677  8519 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:55.749095  8519 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:55.749542  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:55.750677  8359 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:55.751160  8359 raft_consensus.cc:697] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:55.751302  8530 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:55.751845  8487 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:55.752085  8359 consensus_queue.cc:237] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:55.752593  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:55.734004  8528 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
I20260709 12:24:55.753517  8530 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:55.729575  8546 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:55.753924  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:55.754725  8546 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:55.740278  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1519) took 2398 ms. Trace:
I20260709 12:24:55.755314  5962 rpcz_store.cc:276] 0709 12:24:53.341562 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.494139 (+152577us) service_pool.cc:224] Handling call
0709 12:24:53.494624 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:53.745440 (+250816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:53.745477 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:53.747305 (+  1828us) log.cc:844] Serialized 26 byte log entry
0709 12:24:54.258760 (+511455us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:54.258801 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.258980 (+   179us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.715641 (+1456661us) spinlock_profiling.cc:243] Waited 7.82 ms on lock 0x7b240011ab18. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481dded9c4 00007f481ddebacb 00007f481dfa6dc9 00007f481dfa6a55 00007f481dfa5fb0 00007f4820c1c488 00007f4820c1cbe8 00007f4820bf4398 00007f4820bef76a 00007f4820beebb6
0709 12:24:55.739923 (+ 24282us) raft_consensus.cc:1685] finished
0709 12:24:55.739944 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.740187 (+   243us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10253,"raft.queue_time_us":26993,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":6788,"spinlock_wait_cycles":17975552,"thread_start_us":623401,"threads_started":2,"wal-append.queue_time_us":560216}
I20260709 12:24:55.770537  8528 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.771173  8528 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.704591  8547 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:55.780292  8146 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:55.782298  6113 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:24:55.782913  6113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 2181) took 1089 ms. Trace:
I20260709 12:24:55.783217  6113 rpcz_store.cc:276] 0709 12:24:54.693091 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.687838 (+994747us) service_pool.cc:224] Handling call
0709 12:24:55.782850 (+ 95012us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:24:55.784818  8547 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.791589  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:55.792513  8542 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:55.792855  6082 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:55.794524  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:55.796726  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:55.793731  8542 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:55.799635  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:55.800266  6113 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:24:55.801259  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 1816) took 1052 ms. Trace:
I20260709 12:24:55.802124  6110 rpcz_store.cc:276] 0709 12:24:54.745907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.745322 (+999415us) service_pool.cc:224] Handling call
0709 12:24:55.745606 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.745954 (+   348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.745991 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:55.746437 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:24:55.797270 (+ 50833us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:24:55.797309 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.797372 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.797414 (+    42us) raft_consensus.cc:1685] finished
0709 12:24:55.797424 (+    10us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.798023 (+   599us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":872,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":133,"thread_start_us":45026,"threads_started":1,"wal-append.queue_time_us":37149}
I20260709 12:24:55.803915  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:55.805059  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:55.807417  8508 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:55.809307  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:55.810060  6035 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:55.810444  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1731) took 1208 ms. Trace:
I20260709 12:24:55.810771  6035 rpcz_store.cc:276] 0709 12:24:54.601834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.603808 (+  1974us) service_pool.cc:224] Handling call
0709 12:24:55.809172 (+1205364us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b5800124298. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482601a0a0 00007f4826019984 00007f481f5946d4 00007f481f594662
0709 12:24:55.810386 (+  1214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":40737024}
I20260709 12:24:55.813561  6117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50992 (request call id 16) took 1310 ms. Trace:
I20260709 12:24:55.785403  8547 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.814013  6117 rpcz_store.cc:276] 0709 12:24:54.503589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.506191 (+  2602us) service_pool.cc:224] Handling call
0709 12:24:55.813362 (+1307171us) spinlock_profiling.cc:243] Waited 261 ms on lock 0x7b540020c954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482104e853 00007f482601c60a 00007f481f5a27d4 00007f481f5a2762 00007f481f5a2691 00007f481f5a260c 00007f481f5a18c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:55.813455 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":601286528}
W20260709 12:24:55.820207  6044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1726) took 1323 ms (client timeout 1677 ms). Trace:
I20260709 12:24:55.821623  6038 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: [2.2-2.2]
W20260709 12:24:55.840272  6044 rpcz_store.cc:269] 0709 12:24:54.497145 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.497269 (+   124us) service_pool.cc:224] Handling call
0709 12:24:55.820000 (+1322731us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54000d8754. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:55.820146 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":709182336}
I20260709 12:24:55.828822  8439 raft_consensus.cc:3055] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:55.831641  8545 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.834793  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 367) took 1616 ms. Trace:
I20260709 12:24:55.834970  8427 consensus_queue.cc:1059] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:55.843526  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:55.844308  6113 raft_consensus.cc:2393] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:55.841790  6111 rpcz_store.cc:276] 0709 12:24:54.218758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.224491 (+  5733us) service_pool.cc:224] Handling call
0709 12:24:54.224809 (+   318us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:54.225023 (+   214us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:54.239862 (+ 14839us) log.cc:844] Serialized 14 byte log entry
0709 12:24:55.834359 (+1594497us) spinlock_profiling.cc:243] Waited 2.47 ms on lock 0x7b1800418d80. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f4820bfc4bc 00007f481df4a48b 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df64455 00007f482104c060 00007f482105e716 00007f482106f287
0709 12:24:55.834451 (+    92us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.834525 (+    74us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:55.834567 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.834637 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.834738 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11266,"prepare.queue_time_us":19070,"prepare.run_cpu_time_us":41,"prepare.run_wall_time_us":43,"raft.queue_time_us":39829,"raft.run_cpu_time_us":90,"raft.run_wall_time_us":90,"spinlock_wait_cycles":5690752,"thread_start_us":247580,"threads_started":2,"wal-append.queue_time_us":248367,"wal-append.run_cpu_time_us":1261,"wal-append.run_wall_time_us":1040669}
I20260709 12:24:55.848280  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:55.839668  8111 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:55.838290  8508 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:55.850766  6112 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:55.850729  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:55.869421  6111 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:55.837951  8526 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:55.846199  8545 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:55.851961  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 55314.1us
I20260709 12:24:55.873636  6082 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:55.857637  8528 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:55.857839  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:55.848944  8542 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:55.876379  8542 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.868444  8554 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.858928  8477 raft_consensus.cc:3055] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:24:55.857640  8486 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.863904  8547 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:55.843641  8429 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.840878  8540 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:55.842648  8439 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:55.872241  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:55.884055  6113 raft_consensus.cc:2368] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4.
I20260709 12:24:55.875690  5961 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:55.879910  6082 leader_election.cc:400] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5.
I20260709 12:24:55.849474  8519 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.878657  8542 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:55.891788  6112 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:55.892103  6082 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:55.880781  8477 raft_consensus.cc:740] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:55.870661  8111 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.883230  8427 consensus_queue.cc:1059] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:24:55.881901  8555 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:55.904853  6116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 374) took 1132 ms. Trace:
W20260709 12:24:55.905673  8367 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.382s	user 0.034s	sys 0.043s
W20260709 12:24:55.906289  8367 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.382s	user 0.035s	sys 0.043s
I20260709 12:24:55.905485  6116 rpcz_store.cc:276] 0709 12:24:54.772827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:55.755744 (+982917us) service_pool.cc:224] Handling call
0709 12:24:55.756067 (+   323us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.756263 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:24:55.838251 (+ 81988us) log.cc:844] Serialized 14 byte log entry
0709 12:24:55.904471 (+ 66220us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.904528 (+    57us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:55.904578 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.904646 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.904787 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5339,"prepare.queue_time_us":122482,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"thread_start_us":120210,"threads_started":2}
I20260709 12:24:55.898947  8430 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:55.907646  8430 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:55.907872  6112 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:55.908205  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:55.908524  8430 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.909554  8430 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:55.882750  8554 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.917035  6113 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:55.888139  8429 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.890000  8540 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.921710  8477 consensus_queue.cc:260] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:55.933271  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:55.964561  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:55.934185  8555 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:55.904899  8542 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:55.965456  8545 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:55.958288  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50169.5us
I20260709 12:24:55.966725  8519 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:55.967147  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:55.969040  8555 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:55.969748  8555 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:55.971060  8555 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:55.971760  8430 raft_consensus.cc:3055] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:55.915620  8439 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:55.961158  8451 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:55.962060  8429 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:55.962288  6040 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:24:55.963826  8540 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:55.972136  8430 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:55.972746  8451 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.973289  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1732) took 1371 ms. Trace:
I20260709 12:24:55.973467  8430 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:55.973650  6040 rpcz_store.cc:276] 0709 12:24:54.602211 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.604216 (+  2005us) service_pool.cc:224] Handling call
0709 12:24:55.961771 (+1357555us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b5800124298. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482602dfc0 00007f4826018929 00007f48260183d2 00007f481f58fbd4
0709 12:24:55.961977 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.973048 (+ 11071us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.973237 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":38682496}
I20260709 12:24:55.974434  8430 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:55.975234  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:55.975656  6110 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:55.975777  5960 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:55.976755  5862 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 2 to 4, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 4 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:55.981629  8451 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:55.981963  5960 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:55.983197  8439 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:55.983566  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:55.983913  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:55.984612  6040 raft_consensus.cc:2368] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4.
I20260709 12:24:55.983927  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:55.985909  6044 raft_consensus.cc:2410] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 6 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
W20260709 12:24:55.986155  8535 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.454s	user 0.003s	sys 0.000s
I20260709 12:24:55.989811  8312 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:55.990320  8312 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:55.991417  8312 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:55.983566  8477 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:55.992395  8312 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:55.978277  5862 catalog_manager.cc:5697] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 1 to 3, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 3 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:55.998435  6082 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:55.992349  6646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 659) took 1639 ms. Trace:
I20260709 12:24:56.003628  5862 catalog_manager.cc:5697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 1 to 3, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 3 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:56.002916  8547 consensus_queue.cc:1059] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.005s
W20260709 12:24:56.007895  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 43639us
I20260709 12:24:56.008435  8547 raft_consensus.cc:3055] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:56.008242  8501 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:24:56.008873  8547 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:56.006896  6646 rpcz_store.cc:276] 0709 12:24:54.353385 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.361629 (+  8244us) service_pool.cc:224] Handling call
0709 12:24:55.991597 (+1629968us) spinlock_profiling.cc:243] Waited 2.96 ms on lock 0x7b5800085b98. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482602dfc0 00007f4826018929 00007f48260183d2 00007f481f58fbd4
0709 12:24:55.991803 (+   206us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:55.991990 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:55.992023 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:24:55.992066 (+    43us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:24:55.992104 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:55.992162 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:55.992289 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6815488}
I20260709 12:24:56.009961  8554 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:56.009684  8547 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:56.010367  5932 leader_election.cc:336] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 1.664s (SENT)
I20260709 12:24:56.011059  8501 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:56.018929  8501 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.020973  8501 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:56.021261  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:56.018976  8547 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:56.005613  5862 catalog_manager.cc:5697] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 4 to 5, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 5 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:24:56.016505  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 425) took 1321 ms. Trace:
I20260709 12:24:56.017382  8540 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:56.022992  8293 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:56.023249  8429 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:56.023658  8429 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:56.024027  8429 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:56.012277  6038 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
W20260709 12:24:56.027510  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.025982  5862 catalog_manager.cc:5697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 1 to 3, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 3 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:56.027890  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:56.028306  6037 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:56.022403  5966 rpcz_store.cc:276] 0709 12:24:54.695331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.794454 (+ 99123us) service_pool.cc:224] Handling call
0709 12:24:54.819591 (+ 25137us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:54.819841 (+   250us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:54.819872 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:54.834944 (+ 15072us) log.cc:844] Serialized 26 byte log entry
0709 12:24:54.879503 (+ 44559us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:24:54.885490 (+  5987us) log.cc:844] Serialized 14 byte log entry
0709 12:24:54.941997 (+ 56507us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:54.942082 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:55.985588 (+1043506us) spinlock_profiling.cc:243] Waited 1.8 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:24:56.016239 (+ 30651us) raft_consensus.cc:1685] finished
0709 12:24:56.016328 (+    89us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:56.016448 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10565,"prepare.queue_time_us":6039,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":40,"raft.queue_time_us":57584,"raft.run_cpu_time_us":97,"raft.run_wall_time_us":98,"spinlock_wait_cycles":4138240,"thread_start_us":15704,"threads_started":1,"wal-append.queue_time_us":639306}
I20260709 12:24:56.046223  5862 catalog_manager.cc:5697] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 1 to 3, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 3 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:56.048817  8439 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.052433  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 1809) took 1905 ms. Trace:
W20260709 12:24:56.051985  5932 leader_election.cc:336] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 1.671s (SENT)
W20260709 12:24:56.053606  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 70940.5us
I20260709 12:24:56.053041  6115 rpcz_store.cc:276] 0709 12:24:54.146963 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.190997 (+ 44034us) service_pool.cc:224] Handling call
0709 12:24:56.052256 (+1861259us) spinlock_profiling.cc:243] Waited 597 ms on lock 0x7b540020c954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:56.052375 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1373442816}
W20260709 12:24:56.053905  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.055789  5932 connection.cc:256] RPC call timeout handler was delayed by -1.127704427000026s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.33190000000000003s for a response
W20260709 12:24:56.056177  5932 connection.cc:256] RPC call timeout handler was delayed by -1.1252451819996168s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.171s for a response
W20260709 12:24:56.056442  5932 connection.cc:256] RPC call timeout handler was delayed by -1.1126451820000511s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1724s for a response
I20260709 12:24:56.056519  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1438) took 1264 ms. Trace:
W20260709 12:24:56.056778  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.057195  6043 rpcz_store.cc:276] 0709 12:24:54.791779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.825387 (+ 33608us) service_pool.cc:224] Handling call
0709 12:24:55.693971 (+868584us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:55.697647 (+  3676us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:56.056337 (+358690us) spinlock_profiling.cc:243] Waited 854 ms on lock 0x7b540025ba50. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:56.056464 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1963544320}
I20260709 12:24:56.058051  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:56.060616  5960 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:56.060936  5968 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:56.062084  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:56.062829  5963 raft_consensus.cc:2393] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 3: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:56.061838  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:56.063341  6082 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:56.064415  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:56.068279  8453 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.068403  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:56.069074  5964 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:24:56.069681  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:24:56.070164  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.070269  5965 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.072243  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:56.078089  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:24:56.078749  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.078980  8486 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:56.079471  8486 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:56.079882  8486 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:56.059257  8477 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.062881  8312 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.068917  8453 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
W20260709 12:24:56.090706  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.128014  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:56.128731  6645 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:56.129196  8486 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:56.130970  5959 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37174 (request call id 421) took 2139 ms (client timeout 2428 ms). Trace:
W20260709 12:24:56.131433  5959 rpcz_store.cc:269] 0709 12:24:53.992361 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.135392 (+143031us) service_pool.cc:224] Handling call
0709 12:24:56.130745 (+1995353us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b54001cb6d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:56.130892 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1442868992}
I20260709 12:24:56.093307  8477 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.134863  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.054179  8429 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.143138  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.135900  6115 raft_consensus.cc:2393] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 3: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:56.087517  8519 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:56.136926  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:56.145265  6114 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:56.150398  8477 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:56.088302  8501 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
W20260709 12:24:56.167832  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.172428  6645 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
W20260709 12:24:56.181460  6645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50470 (request call id 426) took 1819 ms (client timeout 1624 ms). Trace:
I20260709 12:24:56.178483  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.183465  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.184003  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.184137  6116 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
W20260709 12:24:56.181921  6645 rpcz_store.cc:269] 0709 12:24:54.362532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.375285 (+ 12753us) service_pool.cc:224] Handling call
0709 12:24:56.127832 (+1752547us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b5800085b98. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482601a0a0 00007f4826019984 00007f481f5946d4 00007f481f594662
0709 12:24:56.181385 (+ 53553us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6995840}
I20260709 12:24:56.187083  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.190284  6114 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:56.190858  6112 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:56.187716  6115 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:56.196770  8498 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.197410  8498 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.199324  6611 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:56.199580  8498 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:56.201573  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 64726.2us
I20260709 12:24:56.154743  8486 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:56.210191  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.155019  8519 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:56.189178  8451 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:56.211210  8451 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.211603  8519 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.213618  8451 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:56.217227  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:56.222021  6611 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:56.223104  6611 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:56.224910  6611 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:56.227051  6112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:24:56.227559  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:56.226328  8373 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:56.228106  8512 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:56.228634  8512 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.228986  8512 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:56.229565  5932 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:56.230407  8427 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.231146  8427 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:56.225987  8395 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.232527  5932 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:56.235149  8373 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.237521  8373 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:56.242882  8498 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:24:56.242873  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:56.244544  5932 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:56.245677  5965 raft_consensus.cc:2410] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:56.231262  8146 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:56.251634  8146 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:56.252032  8146 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:56.136394  8312 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.256043  8498 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:56.251242  8429 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:56.251273  8536 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.700s	user 0.004s	sys 0.000s
I20260709 12:24:56.258574  8312 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:56.194743  8477 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.261310  8450 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.263015  8499 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:56.266556  8524 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:56.267158  8524 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:56.269394  8524 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:56.275174  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.279548  8395 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.282546  8522 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:56.283221  8522 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:56.272322  8146 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.279629  8419 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:56.281260  8512 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:56.283806  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.289536  5932 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:56.290608  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:56.291029  8524 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:56.291260  6043 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:56.292403  6038 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:56.293373  8146 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:56.293720  6044 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:56.284034  8522 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:56.294965  8512 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:56.298130  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1440) took 1466 ms. Trace:
I20260709 12:24:56.298543  6037 rpcz_store.cc:276] 0709 12:24:54.832076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:54.836951 (+  4875us) service_pool.cc:224] Handling call
0709 12:24:56.297971 (+1461020us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b54001aa754. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:56.298073 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2676730112}
I20260709 12:24:56.307719  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:56.308480  5959 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:56.310341  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:56.310724  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.306277  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:56.315131  5934 leader_election.cc:400] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4.
I20260709 12:24:56.315415  5934 leader_election.cc:403] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Cancelling election due to peer responding with higher term
I20260709 12:24:56.269752  8453 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:56.327899  6036 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:24:56.328366  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:56.316497  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:24:56.336659  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.336560  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:56.337818  6037 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:24:56.328377  6036 pending_rounds.cc:85] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 5
I20260709 12:24:56.340827  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:56.342923  5932 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:56.343927  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.344803  6006 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:56.345019  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:56.345331  5962 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:56.345706  6037 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:56.340227  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.349808  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:56.350574  6037 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:56.353368  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:56.267172  8111 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:56.328725  8439 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:56.354831  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:56.340958  6036 pending_rounds.cc:107] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:24:56.360531  6036 raft_consensus.cc:2889] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:56.357153  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:56.362900  6044 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:56.321784  8486 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:56.360076  6040 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:56.347256  8538 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:56.340440  8325 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:56.369925  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:56.360692  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.370784  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.371169  8290 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:56.371553  5932 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:56.372339  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:56.347401  8450 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:56.376178  6040 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:56.390642  6649 raft_consensus.cc:2376] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6. Re-sending same reply.
I20260709 12:24:56.377125  6037 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:56.347684  8477 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:56.352613  8537 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:56.355234  8453 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:56.355412  8524 raft_consensus.cc:697] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:56.346930  8517 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:56.359277  8498 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:24:56.361462  8439 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.393976  6648 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:24:56.387571  8427 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:24:56.375219  8538 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:56.362491  8452 consensus_queue.cc:1059] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.035s
I20260709 12:24:56.375839  8486 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:56.389894  6646 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:56.413071  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.414804  6609 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:24:56.413615  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 221373us
I20260709 12:24:56.403635  8439 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:56.416677  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.417783  6609 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:56.418274  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:56.392064  8325 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.410061  8450 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:56.419670  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 186391us
W20260709 12:24:56.470572  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.471076  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:56.471414  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.414886  6645 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:56.436242  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.398556  8477 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.416139  6642 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:56.485983  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.442587  6037 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:56.401028  8537 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.408378  8089 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:24:56.456393  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 68261.6us
I20260709 12:24:56.475666  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:56.480994  6646 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:56.481148  6109 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20260709 12:24:56.481402  8571 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:24:56.482056  6113 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:56.432248  8512 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:56.424525  8427 raft_consensus.cc:3055] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:56.406093  8517 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:56.440840  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 69349.6us
W20260709 12:24:56.486989  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 142252us
I20260709 12:24:56.519476  6006 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:56.486287  6040 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:56.436197  8318 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:56.492146  6118 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:56.494503  6112 raft_consensus.cc:606] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:56.423342  8524 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:56.444193  8290 raft_consensus.cc:2764] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election decision vote started in defunct term 3: won
I20260709 12:24:56.500640  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:56.482355  8455 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.481971  8495 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.511482  8429 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:56.491039  8367 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.023s
I20260709 12:24:56.516203  8522 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.517484  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.518013  8325 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:56.523892  6609 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:56.490247  8519 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:24:56.566826  8517 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:56.567478  8517 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:56.568444  8519 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:56.569000  8519 raft_consensus.cc:697] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:24:56.569197  5853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 482275us
I20260709 12:24:56.541772  8495 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.572647  8495 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:56.573328  8522 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:56.570377  5853 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ec584257f9db451c965f6b092aa9069c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0069e2ba1f02412e8e1d6c20a1fb510f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:56.574915  8429 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:56.575284  8429 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:56.576035  8429 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:56.577105  8429 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.443537  8532 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.055s
I20260709 12:24:56.543943  8537 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:56.579586  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:24:56.579788  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 79227.9us
I20260709 12:24:56.580375  6040 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:56.508090  8512 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.583554  8512 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:56.583992  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.499375  8555 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:56.507288  8427 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:56.586795  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:56.521348  8318 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.548602  8452 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:56.551716  8578 log.cc:927] Time spent T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:24:56.561934  8455 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.587391  6037 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:24:56.595602  6650 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:24:56.588227  8318 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:56.597048  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:56.588373  8452 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.588817  6118 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:56.599104  8452 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:56.596933  8439 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:56.553434  8573 log.cc:927] Time spent T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
W20260709 12:24:56.554687  8570 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.158s	user 0.001s	sys 0.000s
I20260709 12:24:56.551996  8477 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:56.542006  8089 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:56.558770  8486 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:56.559428  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.516062  8453 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election lost for term 3. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4.
I20260709 12:24:56.443725  8538 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:56.544878  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.582384  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.587292  8427 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.595240  6644 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:56.552691  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.588024  6036 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:56.602051  6118 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:56.623677  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:56.590296  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:56.624217  6113 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 4
I20260709 12:24:56.519639  8499 consensus_queue.cc:1059] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.039s
I20260709 12:24:56.607076  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:56.596948  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.610054  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.626551  6643 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:24:56.613137  6650 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
W20260709 12:24:56.614002  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 121758us
I20260709 12:24:56.628264  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:56.605659  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:56.591559  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.615866  8452 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:56.588332  8419 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:56.619443  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:56.596132  8455 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:56.591015  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:56.632056  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.634709  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.635373  6650 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:56.636204  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:56.642330  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:56.645364  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.645396  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.648936  6040 raft_consensus.cc:2955] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:24:56.651432  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.651547  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.661026  6650 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:56.632745  8395 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:56.633101  8477 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:56.663465  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.664225  6110 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:56.617156  8089 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.665752  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:56.665992  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:56.663162  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:56.666580  5961 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:56.637174  8325 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
I20260709 12:24:56.670145  8586 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.008s
I20260709 12:24:56.663125  8519 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.672830  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:56.652719  8427 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.681648  5966 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
W20260709 12:24:56.628566  8451 consensus_queue.cc:1175] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" responder_term: 3 status { last_received { term: 3 index: 5 } last_committed_idx: 5 last_received_current_leader { term: 3 index: 5 } }
I20260709 12:24:56.683362  6113 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:56.647025  8419 raft_consensus.cc:697] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:56.685160  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:56.656054  8439 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:56.688936  5962 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
W20260709 12:24:56.687748  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 168357us
I20260709 12:24:56.691265  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.652469  8290 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.032s
I20260709 12:24:56.675441  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.692579  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.637311  8452 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.696208  6643 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 1.
I20260709 12:24:56.660246  8537 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:56.674348  8395 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.651072  8367 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.033s
W20260709 12:24:56.673619  5853 catalog_manager.cc:4755] TS 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): ChangeConfig:REMOVE_PEER RPC failed for tablet 5a6d648272bf4bef9d5337acfc9d4a96: Remote error: Service unavailable: leader transfer in progress
I20260709 12:24:56.654330  8486 consensus_queue.cc:1059] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.037s
I20260709 12:24:56.673877  8477 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.735893  8477 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:56.699828  6650 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:56.705739  6006 leader_election.cc:400] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 2 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 2. Current term is 3.
I20260709 12:24:56.676263  8582 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:56.707722  6084 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:56.716754  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:24:56.739215  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.739434  8582 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.740763  6084 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:56.718195  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.741466  6647 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:24:56.724535  6608 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:56.731389  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.741822  6084 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:56.742645  8433 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:56.743194  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:56.743325  8433 raft_consensus.cc:697] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:56.742388  8508 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:56.744556  8508 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:56.744923  8508 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:56.742707  8312 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:56.746541  8312 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.746901  8312 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:56.748453  8585 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.200s	user 0.000s	sys 0.001s
I20260709 12:24:56.751108  8433 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.752403  8495 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:56.753541  8582 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:56.758673  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 62469.8us
I20260709 12:24:56.695686  8524 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:56.764788  6084 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:56.769649  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:56.769784  5959 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:24:56.712738  8580 log.cc:927] Time spent T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.050s	user 0.001s	sys 0.000s
I20260709 12:24:56.771688  8524 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.715131  8395 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:56.784238  8499 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:56.793191  8499 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:56.793238  8517 raft_consensus.cc:3055] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:56.793648  8499 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.794517  6006 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:56.752764  8512 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.796475  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.790195  8524 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:24:56.765272  5853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 103095us
I20260709 12:24:56.759001  8495 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:56.672957  8443 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:56.797079  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 138828us
W20260709 12:24:56.806178  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 133409us
W20260709 12:24:56.806740  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 172750us
I20260709 12:24:56.810899  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:56.811986  6651 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:56.793740  8517 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:56.800745  8486 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:24:56.816722  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 115087us
I20260709 12:24:56.817186  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.817554  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:56.819921  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:56.820609  6643 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:56.810489  8495 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:56.791765  8588 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:24:56.799093  8359 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:24:56.829638  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.831676  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:56.827126  8597 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:56.840951  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:56.847028  6112 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:56.804069  8318 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:56.855597  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:56.811520  8522 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.019s
I20260709 12:24:56.852350  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.824542  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:56.864123  5961 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:24:56.864362  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:56.865123  5932 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:56.813890  8455 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.031s
I20260709 12:24:56.830761  8290 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:56.868263  5966 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 1.
I20260709 12:24:56.872507  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:56.879393  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 83764.6us
I20260709 12:24:56.881453  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:56.881536  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:56.881101  6006 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:56.865900  8494 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:56.822129  8419 consensus_queue.cc:237] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:56.924362  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:24:56.929177  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 97583.8us
I20260709 12:24:56.930096  5932 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:56.926172  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.931465  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:56.919425  8563 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:24:56.883428  8586 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:56.928512  8290 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:56.939549  8498 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:56.939973  8450 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:24:56.940117  8592 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:24:56.931906  6118 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
W20260709 12:24:56.941517  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 126462us
W20260709 12:24:56.939561  8594 log.cc:927] Time spent T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:24:56.877367  8587 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.054s
W20260709 12:24:56.946372  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 65349.2us
I20260709 12:24:56.961289  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:56.961831  6042 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:56.883877  8598 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:56.954845  6611 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:56.943928  8452 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:56.939168  8423 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.027s
I20260709 12:24:56.978843  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:56.956007  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:56.923034  8089 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:56.978727  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:56.928885  8582 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:24:56.940719  8449 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:56.962643  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:56.963850  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:56.982221  6035 raft_consensus.cc:2368] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4.
I20260709 12:24:56.923656  8602 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.086s
I20260709 12:24:56.962157  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:56.945951  8439 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:56.967162  6608 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:56.940356  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:24:56.946842  8586 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:56.955757  5932 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:24:57.113507  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 157816us
I20260709 12:24:56.928714  8581 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:24:56.978278  6044 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:56.980922  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:56.980906  6043 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:56.981518  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:57.123430  6116 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:24:56.951982  8498 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:56.983217  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:56.965216  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:56.978144  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:24:57.086102  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.135838  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:57.002888  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.091578  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:57.093187  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:57.096047  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.141156  6117 raft_consensus.cc:2393] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:57.107329  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:57.134639  6041 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 3: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:57.135905  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:57.142875  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:56.974187  8604 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:57.143994  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:57.111461  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:56.978329  8598 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:56.957401  8450 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:57.145771  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:57.150868  6036 raft_consensus.cc:2376] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4. Re-sending same reply.
I20260709 12:24:57.160667  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:57.153386  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:56.982400  8449 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:57.158239  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:57.114207  8290 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:57.085424  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:57.159821  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:57.122543  8452 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:57.176223  6035 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:24:57.122822  8586 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:56.975555  8455 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.177s
I20260709 12:24:57.170779  6043 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:57.162353  6044 raft_consensus.cc:2376] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6. Re-sending same reply.
I20260709 12:24:57.144037  8498 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:57.173902  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:57.185945  6035 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:24:57.187260  6082 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:57.106047  8439 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:57.144837  8608 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:57.185267  8089 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:24:57.160694  8609 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:57.169992  8449 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:57.191329  8440 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:57.192622  8439 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:57.168689  8524 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.198952  8477 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:57.201967  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 234877us
I20260709 12:24:57.202137  8605 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:57.203708  6112 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:57.179764  8452 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.186488  6644 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:57.195247  8089 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:57.241001  8089 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:57.208777  8602 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:57.239825  8452 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.244481  6042 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:24:57.214571  8512 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:57.220811  8318 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:57.275632  8606 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:57.266019  8517 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:57.280133  8312 consensus_meta.cc:287] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.533s	user 0.007s	sys 0.003s
I20260709 12:24:57.280582  8312 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:57.282567  8607 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:24:57.285259  8367 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.285818  8367 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.286407  8600 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:57.286944  8600 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:57.288167  8494 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.288657  8494 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.292023  8367 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:57.255071  8598 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.298781  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:57.287839  8600 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:24:57.238597  8609 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:57.309649  8450 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:57.310907  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:57.316378  6044 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.312211  8555 raft_consensus.cc:3055] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:57.318226  8555 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:57.319267  8597 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:57.319109  8555 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:57.319715  8597 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:57.320134  8555 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.320626  8597 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.322032  8597 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.322736  8373 raft_consensus.cc:3055] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:57.323136  8373 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:57.323947  8373 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.324968  8373 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:57.326526  8609 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.329047  8609 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:57.331905  8508 consensus_meta.cc:287] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.587s	user 0.002s	sys 0.007s
I20260709 12:24:57.332387  8508 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.333323  8545 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.333890  8545 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:57.335204  8615 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:57.336099  8545 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:57.336443  8612 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:57.337057  8612 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.340241  8612 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:57.341359  8538 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:57.344676  8601 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.462s	user 0.001s	sys 0.001s
I20260709 12:24:57.348446  6043 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:57.356956  6648 raft_consensus.cc:2410] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
W20260709 12:24:57.364429  8495 consensus_meta.cc:287] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.514s	user 0.001s	sys 0.007s
I20260709 12:24:57.300275  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:57.414422  6037 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.323849  8524 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:57.371887  8517 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:57.306592  6042 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:57.426138  8494 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.430994  8439 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:57.313819  8427 consensus_meta.cc:287] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.619s	user 0.000s	sys 0.010s
I20260709 12:24:57.387164  8429 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:57.443176  8429 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:57.445358  8429 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:57.371920  8477 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:57.270761  8499 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.449926  6118 raft_consensus.cc:2368] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3.
I20260709 12:24:57.452925  6037 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:24:57.437191  8498 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:57.438373  8508 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:57.380024  6081 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.676s (SENT) [suppressed 52 similar messages]
I20260709 12:24:57.398138  6044 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:24:57.293109  8395 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:57.472288  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 156525us
W20260709 12:24:57.485311  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.484449  6609 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:57.451728  8494 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:57.452039  8495 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.472306  8449 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.485998  8089 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:57.608055  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 420883us
I20260709 12:24:57.611923  6082 leader_election.cc:400] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4.
I20260709 12:24:57.612286  6082 leader_election.cc:403] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:24:57.617662  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:57.600320  8499 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:57.625800  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:57.626959  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:57.587395  8452 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.630349  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:24:57.644778  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45791.4us
I20260709 12:24:57.597858  8586 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:57.648168  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:57.648778  6036 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.648836  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:57.649077  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:57.649454  5959 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.650247  6118 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:57.647656  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:57.656692  6082 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:57.662559  6115 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:24:57.646003  8588 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.769s	user 0.002s	sys 0.023s
I20260709 12:24:57.624963  6646 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:24:57.629711  8429 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 3. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4.
I20260709 12:24:57.645323  8312 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:57.666451  5959 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:24:57.685745  6082 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:57.687798  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:57.688220  6084 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:57.636706  8494 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.032s
I20260709 12:24:57.747860  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:57.748620  6039 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:24:57.652539  8579 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.142s	user 0.011s	sys 0.011s
W20260709 12:24:57.666304  8588 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.792s	user 0.003s	sys 0.023s
I20260709 12:24:57.691982  8610 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.199s
I20260709 12:24:57.692423  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:57.692516  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:57.751579  6649 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:57.692853  8616 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.693239  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:57.693400  8617 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:24:57.694236  8619 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:24:57.694700  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:24:57.695091  6647 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:57.695600  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:57.691929  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:57.756093  6643 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:57.707036  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:57.707568  8452 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:57.708160  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:57.708998  8586 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:57.714792  8498 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:57.654021  8604 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:24:57.726845  6611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.018s	sys 0.006s
I20260709 12:24:57.727717  6038 raft_consensus.cc:2410] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:24:57.688891  8430 raft_consensus.cc:3055] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:57.689472  8499 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:24:57.725831  8290 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.014s	sys 0.019s
I20260709 12:24:57.691054  8508 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:57.731092  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 79803.9us
I20260709 12:24:57.731020  6113 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
W20260709 12:24:57.731904  5932 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.000s	sys 0.044s
W20260709 12:24:57.849649  5932 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.683s	user 0.000s	sys 0.044s
W20260709 12:24:57.850236  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 689621us
W20260709 12:24:57.732921  6040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.009s	sys 0.019s
W20260709 12:24:57.851130  6040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.656s	user 0.009s	sys 0.019s
W20260709 12:24:57.724711  8532 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.013s	sys 0.014s
W20260709 12:24:57.852366  8532 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.644s	user 0.013s	sys 0.014s
I20260709 12:24:57.728348  8439 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:57.743323  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 55173.2us
W20260709 12:24:57.750289  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 64631.7us
W20260709 12:24:57.753748  6109 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.620s	user 0.010s	sys 0.047s
I20260709 12:24:57.753403  8111 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:57.854851  6084 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:57.755237  8605 raft_consensus.cc:697] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:24:57.853768  6109 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.720s	user 0.011s	sys 0.048s
W20260709 12:24:57.754303  6007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.500s	user 0.016s	sys 0.012s
I20260709 12:24:57.819388  6039 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
W20260709 12:24:57.843447  6611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.661s	user 0.018s	sys 0.006s
W20260709 12:24:57.860970  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 678490us
I20260709 12:24:57.761955  6036 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:24:57.846020  6649 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
W20260709 12:24:57.752648  8579 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.239s	user 0.012s	sys 0.011s
I20260709 12:24:57.749702  8395 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:57.859565  6082 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:57.855988  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:24:57.860442  6007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.627s	user 0.016s	sys 0.020s
I20260709 12:24:57.862084  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:57.757017  6642 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:57.868032  6082 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:57.751029  8433 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:57.861632  6611 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:57.872745  6611 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:57.869632  6084 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:57.874289  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:57.874977  6115 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.875962  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:57.877282  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:57.878443  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:57.879587  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:57.882510  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:57.885840  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:57.886870  6608 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:57.857133  8290 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.015s	sys 0.019s
I20260709 12:24:57.840737  8517 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:57.890014  8522 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:57.890118  8373 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:57.890321  8359 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.890339  8538 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.889914  8312 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:57.848918  8449 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:57.845824  8430 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:24:57.896664  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45727.3us
I20260709 12:24:57.893309  8443 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:57.893167  8555 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:57.897143  8524 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.895691  8290 raft_consensus.cc:697] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:57.857259  8508 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:57.856995  8617 raft_consensus.cc:697] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:57.919477  8433 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:24:57.914429  8605 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.914805  8522 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:57.921584  8089 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:57.887945  8111 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:57.885365  8429 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:24:57.924898  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 544883us
I20260709 12:24:57.885406  8608 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.902038  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:57.901453  8499 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:24:57.892918  8612 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.898963  8584 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:57.905652  6036 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:57.933887  5932 leader_election.cc:400] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4.
W20260709 12:24:58.005970  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 72215us
I20260709 12:24:57.757591  8616 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:57.943209  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:57.937988  8452 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.066s
I20260709 12:24:57.937899  8555 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:57.929301  8600 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.516s	user 0.014s	sys 0.007s
I20260709 12:24:57.984218  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1466) took 1017 ms. Trace:
I20260709 12:24:57.955698  6115 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:57.985061  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1460) took 1023 ms. Trace:
I20260709 12:24:57.848347  8604 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:57.978091  8373 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:57.936069  8538 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.021325  8538 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:57.996400  8627 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:24:57.929807  8359 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.024505  8359 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:57.938192  8312 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:24:57.998450  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50506.3us
W20260709 12:24:57.999730  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:58.026872  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.026410  8312 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:58.000697  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 98740.7us
I20260709 12:24:57.918038  8517 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:57.978542  8430 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.4, Last appended by leader: 4, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:58.001739  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:57.938853  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 52059.7us
I20260709 12:24:57.956264  8631 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.030531  8430 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:57.955190  8443 raft_consensus.cc:697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:58.008329  5932 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:58.030896  8599 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:58.031369  8599 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:24:58.032199  8599 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.033347  8599 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.034611  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.035365  5963 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:58.036000  5959 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:58.037860  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:58.039004  5961 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 5. Ops: []
I20260709 12:24:58.039816  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:58.040349  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:58.034453  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:58.040930  5966 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.041946  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:57.993541  8111 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:57.997184  8579 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:57.994243  8522 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:57.997113  8433 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:57.991892  6642 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:24:58.001451  8620 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:24:58.017211  6006 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.564s	user 0.015s	sys 0.041s
I20260709 12:24:58.005842  8499 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:58.015942  6038 rpcz_store.cc:276] 0709 12:24:56.962073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.962267 (+   194us) service_pool.cc:224] Handling call
0709 12:24:57.984828 (+1022561us) spinlock_profiling.cc:243] Waited 584 ms on lock 0x7b540025bf54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:57.984969 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1342630272}
I20260709 12:24:57.986616  8524 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.040443  5960 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:24:58.042331  6116 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:58.043915  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:58.015051  6040 rpcz_store.cc:276] 0709 12:24:56.966689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.162910 (+196221us) service_pool.cc:224] Handling call
0709 12:24:57.163255 (+   345us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:57.163589 (+   334us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:57.163643 (+    54us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:57.170581 (+  6938us) log.cc:844] Serialized 26 byte log entry
0709 12:24:57.851517 (+680936us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:57.851841 (+   324us) log.cc:844] Serialized 14 byte log entry
0709 12:24:57.852051 (+   210us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.852137 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:57.983981 (+131844us) raft_consensus.cc:1685] finished
0709 12:24:57.984014 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:57.984156 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":67879,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":37,"raft.queue_time_us":51494,"raft.run_cpu_time_us":1769,"raft.run_wall_time_us":33233,"thread_start_us":656714,"threads_started":1,"wal-append.queue_time_us":733270}
I20260709 12:24:58.044413  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:57.956995  8508 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:24:58.016162  8600 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.601s	user 0.014s	sys 0.007s
I20260709 12:24:58.053602  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:58.053929  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:58.039882  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:58.038422  5959 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.014761  8555 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:24:58.060701  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:58.061419  6006 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.016s	sys 0.041s
I20260709 12:24:58.051870  8111 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.062371  5962 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:58.026369  8616 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:58.011467  8612 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:58.084323  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 634133us
I20260709 12:24:58.223613  8443 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.084434  5965 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:58.058717  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.388044  5964 raft_consensus.cc:2410] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 3 because replica has last-logged OpId of term: 2 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 4.
I20260709 12:24:58.388314  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.389109  5968 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 3: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:58.085829  5961 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:58.086541  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 216966us
I20260709 12:24:58.389993  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:58.087229  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 201449us
I20260709 12:24:58.052788  8584 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:24:58.393548  8612 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:58.394820  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.399138  6084 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:58.401834  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.403152  8494 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:58.403666  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.404417  5968 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:24:58.405174  8494 consensus_queue.cc:1059] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:24:58.405355  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.406299  8612 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.375098  8477 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.407140  8612 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.394846  8429 consensus_queue.cc:1059] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.014s
I20260709 12:24:58.409493  8429 raft_consensus.cc:3055] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:58.409824  8429 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:58.411468  8612 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:58.109269  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.406690  8648 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.010s
I20260709 12:24:58.431809  8524 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:58.088069  5960 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 2.
I20260709 12:24:58.062750  8579 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.223541  8625 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:58.271879  8636 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 12:24:58.244065  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.230229  8586 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:58.143544  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 44807us
I20260709 12:24:58.083262  8621 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.136s
W20260709 12:24:58.273113  8637 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.093s	user 0.000s	sys 0.001s
I20260709 12:24:58.069175  8499 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.088563  8598 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:58.005628  8608 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.057737  8602 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.079s
I20260709 12:24:58.128111  8623 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:58.210600  8640 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.297683  8538 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:58.030954  8631 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.070567  8495 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:58.056527  8373 raft_consensus.cc:697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:24:58.140172  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 56514.5us
I20260709 12:24:58.069543  8617 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.154291  8517 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:58.260249  8604 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:58.085148  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:58.499648  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 414561us
I20260709 12:24:58.500389  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:58.504091  6608 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:58.390909  5962 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:58.407269  8477 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.411240  8429 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.244879  8433 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.414927  5961 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
W20260709 12:24:58.402325  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.452211  8586 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.508903  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.509440  5965 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:24:58.074398  8290 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:58.394757  8629 log.cc:927] Time spent T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.327s	user 0.001s	sys 0.000s
I20260709 12:24:58.441440  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:58.474278  8579 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:58.438380  5960 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:58.456907  5959 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:24:58.460610  6645 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:58.520690  5962 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:58.521136  5960 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
W20260709 12:24:58.463398  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.451753  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:58.469295  8623 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:58.481734  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.505249  6116 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
W20260709 12:24:58.508009  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 116990us
I20260709 12:24:58.510370  5934 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:58.512127  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:58.513062  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.204118  8359 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:58.532055  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:24:58.513439  8613 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:24:58.512763  8419 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.526404  5968 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:24:58.475581  8598 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:58.533954  5961 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:58.545624  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.514530  6642 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.550160  6608 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:58.472414  8640 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.536247  5966 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:24:58.538632  6084 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:58.540009  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:24:58.540832  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.513780  8524 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:24:58.556994  8524 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:58.557188  8615 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:24:58.557967  8524 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.537395  6651 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEARNER]: Advancing to term 3
I20260709 12:24:58.521574  5959 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:58.475234  8538 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.567840  6644 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.569244  8538 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:24:58.570124  6651 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEARNER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20260709 12:24:58.593719  8657 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:24:58.514673  8498 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:24:58.552484  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:58.547029  8429 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.530161  8579 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.535127  8359 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:24:58.573706  8641 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:24:58.608597  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:24:58.649258  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 65231.2us
I20260709 12:24:58.541427  8632 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:24:58.541678  8626 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:58.552789  8419 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.611933  8659 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:58.572918  8373 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.553838  8111 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.662899  8608 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:58.613483  6644 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:58.663707  8622 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:24:58.664072  8111 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:58.613679  8443 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:24:58.614228  8494 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:58.615819  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 44046.5us
I20260709 12:24:58.656293  8450 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.009s
I20260709 12:24:58.650638  8584 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:58.617586  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:58.666935  5960 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:58.667685  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.668475  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.669267  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:58.618216  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:58.621266  8555 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.623256  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:58.624626  8430 consensus_meta.cc:287] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.594s	user 0.008s	sys 0.001s
I20260709 12:24:58.445058  8625 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.583025  8495 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:58.627223  6645 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEARNER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:24:58.542424  8508 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.631950  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.674814  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:58.632243  8522 consensus_meta.cc:287] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.562s	user 0.009s	sys 0.000s
I20260709 12:24:58.634783  6109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 2207) took 1685 ms. Trace:
I20260709 12:24:58.635288  8598 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.676692  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.635800  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:58.637312  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:58.638682  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:58.679809  6039 raft_consensus.cc:2393] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:58.641558  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:58.642750  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:58.680224  6040 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:58.645020  6647 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:58.645896  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:24:58.645987  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 82758.5us
I20260709 12:24:58.646643  8665 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:58.682094  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:58.675693  6109 rpcz_store.cc:276] 0709 12:24:56.949412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:56.949646 (+   234us) service_pool.cc:224] Handling call
0709 12:24:56.949972 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:56.955050 (+  5078us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:56.955087 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:56.974579 (+ 19492us) log.cc:844] Serialized 26 byte log entry
0709 12:24:57.860396 (+885817us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:24:57.860437 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:57.860507 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:24:58.634547 (+774040us) raft_consensus.cc:1685] finished
0709 12:24:58.634572 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:24:58.634717 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4672,"raft.queue_time_us":8482,"raft.run_cpu_time_us":179,"raft.run_wall_time_us":18059,"thread_start_us":726883,"threads_started":1,"wal-append.queue_time_us":1024269}
I20260709 12:24:58.682893  6037 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:58.650903  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:58.683530  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:58.684085  6039 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.647267  8604 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.653733  8623 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:58.654184  8632 raft_consensus.cc:697] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:58.552605  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:58.648479  8359 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.690939  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:58.692587  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:58.693138  6044 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:24:58.693904  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:58.682899  8494 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:58.658807  6035 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:24:58.692055  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:58.662595  8659 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.616887  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.670177  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:58.613165  8631 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:58.671490  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:58.672716  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.655110  8626 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:58.738752  8626 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.739070  8632 consensus_queue.cc:237] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.680269  6041 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:58.642690  6642 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:58.681164  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:58.684762  5963 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:58.673815  8498 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.690619  6038 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 2: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:58.655453  8579 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.745734  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:24:58.676646  8443 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:58.733778  6039 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:24:58.732640  6115 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:58.733140  5960 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:58.734180  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:58.687276  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:58.746764  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:58.747656  6041 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:24:58.742925  5966 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:24:58.743381  5959 raft_consensus.cc:2376] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7. Re-sending same reply.
I20260709 12:24:58.674304  8517 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:58.738023  8359 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.751533  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.751511  8498 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.760705  6611 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:58.762136  6611 leader_election.cc:400] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3.
I20260709 12:24:58.727416  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:58.743654  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:58.745623  8669 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.021s
I20260709 12:24:58.766880  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:58.730036  8495 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:24:58.741775  8612 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:58.738042  8524 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:24:58.749439  8623 consensus_queue.cc:1059] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:24:58.676236  8608 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:58.751014  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.810294  5960 raft_consensus.cc:2393] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:58.811220  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.811779  5960 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:24:58.812539  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:58.813243  5960 raft_consensus.cc:2410] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:24:58.698449  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.742738  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.742712  8586 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:58.815554  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.682539  8599 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:58.767563  6035 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:58.772048  8359 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:58.817535  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:58.751377  8667 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.695186  8604 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.773460  8499 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.682765  8522 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.775426  8419 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:58.778090  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.768487  8318 raft_consensus.cc:2764] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:24:58.779109  8669 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.741575  6646 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:24:58.779549  8429 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:58.783867  5959 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:24:58.787220  6041 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20260709 12:24:58.787473  8625 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:58.766113  8664 consensus_queue.cc:1059] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:24:58.788316  8508 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:58.788856  8579 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:58.818560  8667 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.790211  8640 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:58.790911  8623 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:58.783025  8631 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:58.689445  8665 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.792935  8555 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:58.825730  8623 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:58.784009  8524 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:58.826975  6642 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.826713  8623 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.827055  8524 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.827944  8623 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.828395  8604 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:58.828742  8524 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.795634  8498 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:58.826224  8631 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:58.832484  8631 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:58.795912  8659 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:58.797046  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:58.779606  8626 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.836324  6642 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:24:58.836964  8626 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:58.820550  8499 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:58.821081  8522 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:58.839164  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:58.839607  8665 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:58.803120  8663 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.840453  8663 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.752470  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.822168  8666 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.843079  8666 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.843396  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:58.844051  5966 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.826290  8667 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:58.845274  8666 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:24:58.752727  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 65549.7us
I20260709 12:24:58.822269  8669 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.847007  5932 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:58.848021  6109 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
W20260709 12:24:58.822335  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.849377  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:58.849795  8499 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.850406  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:58.851255  6110 raft_consensus.cc:2410] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:24:58.852622  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:58.853080  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:24:58.756888  8616 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:58.853574  8498 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:24:58.853710  8616 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:24:58.854156  8616 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:58.752254  8111 consensus_queue.cc:1059] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.058s
I20260709 12:24:58.854305  8498 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.854823  8666 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:58.757706  8517 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.855376  8666 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.856220  6044 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.858081  8669 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:58.814771  5962 raft_consensus.cc:2410] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:24:58.822959  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:58.859272  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.823136  8429 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:58.860354  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:58.860762  8429 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.861330  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.818766  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:58.855065  8111 raft_consensus.cc:3055] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:58.862540  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:58.862891  8111 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:58.821659  6647 raft_consensus.cc:2410] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:58.865833  6113 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:58.866119  6112 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:58.866964  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:58.867558  5934 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:58.867724  6113 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:58.868388  8613 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:24:58.868847  8613 raft_consensus.cc:697] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:58.869630  8613 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.873034  6035 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:58.874992  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:58.850330  8499 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.877583  8499 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:58.878798  8429 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.879179  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:58.880321  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:24:58.880923  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 139923us
I20260709 12:24:58.881440  8517 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:58.853251  6118 raft_consensus.cc:2368] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3.
I20260709 12:24:58.883576  8680 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:24:58.884574  5932 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:24:58.885356  8427 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:58.885617  8623 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:24:58.886037  8623 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:58.886518  5932 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:58.883800  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:58.887127  8623 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.888442  8623 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:58.889498  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:58.894596  5932 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:58.895267  8613 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:58.895569  8616 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.862372  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.752283  6039 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:24:58.909283  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:58.909654  6039 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:24:58.910924  6039 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:24:58.896974  6044 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:24:58.899096  5966 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:24:58.913136  5966 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:58.880888  6110 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:58.808936  8495 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 4, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:58.902231  8631 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:58.913800  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.914484  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:58.919806  6110 raft_consensus.cc:2410] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:24:58.905674  8427 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:58.921504  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:24:58.923413  8671 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:24:58.810076  8621 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:58.926136  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:58.927814  6110 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:58.915789  5966 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:24:58.902096  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:58.924471  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:58.916649  5963 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.917491  8663 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:24:58.918968  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.926656  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:58.932237  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.933416  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:58.931339  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:58.934685  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:24:58.936239  5960 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:24:58.938515  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:58.774259  8494 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:58.950790  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.939991  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:58.944491  6645 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
W20260709 12:24:58.948408  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:58.955756  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:24:58.956394  6115 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:58.957397  6115 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:58.935415  8615 consensus_queue.cc:1059] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.029s
I20260709 12:24:58.969055  8498 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:58.974032  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:58.978626  8680 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:24:58.983072  8650 raft_consensus.cc:3055] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:58.983570  8650 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:24:58.986209  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 182404us
I20260709 12:24:58.930547  8602 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:58.988026  6081 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:58.991788  6084 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:58.992377  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:24:58.993130  6006 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:58.996224  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:58.996356  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:58.997364  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.997941  5962 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:24:58.998047  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:24:59.001828  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:58.905778  8608 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:58.952097  8613 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:24:58.905815  8599 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:59.048094  6651 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: [4.5-4.5]
I20260709 12:24:59.003724  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:59.049254  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 51252.7us
I20260709 12:24:58.954427  8663 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:24:59.051746  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 64554.4us
I20260709 12:24:59.056071  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:59.056777  5966 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
W20260709 12:24:59.057072  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 64841.9us
I20260709 12:24:59.057653  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:59.057888  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:59.096684  6040 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.058418  5966 raft_consensus.cc:2393] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:59.078364  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:24:59.150609  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:59.152884  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:59.153750  5966 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:59.056109  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:59.154968  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:59.157248  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:24:59.155176  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 99135.9us
I20260709 12:24:59.164520  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:24:59.158798  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 80468.4us
I20260709 12:24:59.196606  5966 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:24:59.197767  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:59.199090  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:59.199791  5966 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:24:59.203461  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:59.216352  5966 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:59.217765  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:24:59.002729  5962 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
W20260709 12:24:59.022543  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.005575  8359 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:24:58.918021  8443 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:59.235108  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:59.003813  8499 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:59.228046  5966 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:24:59.050369  8613 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.243172  5963 raft_consensus.cc:2393] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 3: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:24:58.994262  8517 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:59.088534  8419 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:24:59.210733  8604 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:24:59.061190  8555 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:24:59.192337  8290 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:58.998996  8524 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.247s
I20260709 12:24:59.194782  8663 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:24:59.258033  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 466) took 1221 ms. Trace:
I20260709 12:24:58.939302  8621 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:59.240648  8499 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.319384  5965 rpcz_store.cc:276] 0709 12:24:58.036972 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.410403 (+373431us) service_pool.cc:224] Handling call
0709 12:24:58.509180 (+ 98777us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.509888 (+   708us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.257806 (+747918us) spinlock_profiling.cc:243] Waited 98.4 ms on lock 0x7b5400277ed0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:59.257966 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226223872}
I20260709 12:24:59.246622  8613 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:59.333056  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.349252  8681 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:59.350773  8633 raft_consensus.cc:2764] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:24:59.284833  8419 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:24:59.312481  8604 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:59.315685  8669 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:59.317781  8588 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:58.984462  8650 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:59.350033  8681 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:59.429302  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:24:59.431383  6036 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:24:59.320837  8555 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:59.334431  8499 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:59.346674  8615 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.437177  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:59.264504  8517 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:59.438172  6036 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:59.363607  8659 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.364933  8419 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:24:59.334757  8359 consensus_queue.cc:1059] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 1.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.095s
I20260709 12:24:59.442214  6036 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: [2.4-4.5]
W20260709 12:24:59.388386  6035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.029s	sys 0.045s
I20260709 12:24:59.230638  6040 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
W20260709 12:24:59.563714  6035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.686s	user 0.030s	sys 0.046s
I20260709 12:24:59.443728  8650 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:59.565173  6036 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: [2.4-4.5]
W20260709 12:24:59.509330  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 451491us
W20260709 12:24:59.501694  8429 consensus_meta.cc:287] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.622s	user 0.000s	sys 0.009s
I20260709 12:24:59.543686  8427 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.467187  8659 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:59.509835  8632 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.022s	sys 0.002s
I20260709 12:24:59.604014  6118 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:24:59.414777  8669 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:59.445199  8602 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:59.441531  8615 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:59.367048  6646 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:24:59.443887  8616 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:59.428946  8325 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.365954  8604 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:59.661305  6081 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:59.438203  8681 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:59.646414  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.658565  5961 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
W20260709 12:24:59.659261  5934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.610s	user 0.023s	sys 0.025s
W20260709 12:24:59.665760  5934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.616s	user 0.024s	sys 0.025s
W20260709 12:24:59.666055  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 664743us
W20260709 12:24:59.659525  6110 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.656s	user 0.015s	sys 0.033s
W20260709 12:24:59.656991  8632 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.024s	sys 0.003s
I20260709 12:24:59.603286  8427 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:24:59.659009  5933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.000s	sys 0.015s
W20260709 12:24:59.666877  6110 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.664s	user 0.016s	sys 0.033s
W20260709 12:24:59.673426  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:59.676692  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:24:59.673964  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:24:59.676807  5933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.000s	sys 0.015s
I20260709 12:24:59.676954  6111 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 3 index: 4. (term mismatch)
I20260709 12:24:59.677799  6111 pending_rounds.cc:85] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 3
I20260709 12:24:59.678027  6111 pending_rounds.cc:107] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 2.4
I20260709 12:24:59.678253  6111 raft_consensus.cc:2917] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Aborting config change with OpId 2.4: Aborted: Op aborted by new leader
W20260709 12:24:59.661974  8598 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.678s	user 0.013s	sys 0.023s
I20260709 12:24:59.605448  8670 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:24:59.689256  6649 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:24:59.691016  6111 raft_consensus.cc:2889] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:24:59.664681  8599 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:59.698249  6006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.009s	sys 0.040s
I20260709 12:24:59.667256  8290 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:24:59.705732  6006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.514s	user 0.010s	sys 0.040s
W20260709 12:24:59.706496  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 514932us
W20260709 12:24:59.719180  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:24:59.693775  8598 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.013s	sys 0.023s
I20260709 12:24:59.688740  8429 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:24:59.700892  8433 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.008s	sys 0.013s
I20260709 12:24:59.692660  8664 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:24:59.670583  8325 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:24:59.733071  8579 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.003s	sys 0.025s
W20260709 12:24:59.798614  5932 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.736s	user 0.023s	sys 0.046s
I20260709 12:24:59.697782  8508 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:24:59.800606  5932 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.745s	user 0.023s	sys 0.046s
I20260709 12:24:59.720387  8599 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:59.788995  8680 consensus_meta.cc:287] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.810s	user 0.007s	sys 0.005s
I20260709 12:24:59.706409  8682 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:59.797119  8644 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 1.576s	user 0.012s	sys 0.017s
I20260709 12:24:59.803912  6081 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:59.674778  8555 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:59.809769  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:24:59.724762  8616 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:24:59.804248  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:24:59.821586  6036 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:24:59.818454  6081 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:24:59.818403  8599 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:59.825433  6081 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:24:59.800374  8579 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.003s	sys 0.025s
I20260709 12:24:59.799706  8429 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:24:59.723905  8290 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:59.801218  8621 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:24:59.798445  8664 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:59.871073  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:59.703612  8670 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:59.882697  6036 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:24:59.822813  8694 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:24:59.862985  8623 consensus_meta.cc:287] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.974s	user 0.005s	sys 0.007s
I20260709 12:24:59.892973  6036 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:24:59.865473  8648 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:24:59.906203  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:59.815826  8508 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:24:59.871483  8494 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:24:59.817169  8680 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:24:59.914011  8325 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:24:59.918973  8477 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:24:59.919976  8708 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:24:59.891223  8690 log.cc:927] Time spent T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.401s	user 0.001s	sys 0.000s
I20260709 12:24:59.819730  8682 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:59.872328  8586 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.044s
I20260709 12:24:59.797930  8602 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:24:59.924799  8687 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.425s	user 0.001s	sys 0.000s
I20260709 12:24:59.895140  8704 consensus_queue.cc:1059] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:24:59.950133  8704 raft_consensus.cc:3055] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:24:59.950520  8704 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:24:59.951375  8704 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:59.923684  8706 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:24:59.956112  8499 consensus_meta.cc:287] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.512s	user 0.003s	sys 0.007s
I20260709 12:24:59.881064  8579 consensus_queue.cc:1059] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.047s
I20260709 12:24:59.940375  5963 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 5. Current term is 6. Ops: []
I20260709 12:24:59.935854  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:59.920315  8290 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:59.921279  8517 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:59.923549  8494 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:24:59.863037  8698 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.105s
I20260709 12:24:59.927804  8669 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:59.834532  8616 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:24:59.828456  8663 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:24:59.934412  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 109044us
I20260709 12:24:59.965809  6642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 693) took 1300 ms. Trace:
I20260709 12:24:59.909476  8694 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:00.019531  5966 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:24:59.957396  8706 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.022221  6081 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:00.023895  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:00.022063  6642 rpcz_store.cc:276] 0709 12:24:58.665001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.745510 (+ 80509us) service_pool.cc:224] Handling call
0709 12:24:59.965631 (+1220121us) spinlock_profiling.cc:243] Waited 80.7 ms on lock 0x7b54000e0e54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:24:59.965747 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":185510272}
I20260709 12:25:00.026211  5963 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:00.026582  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 518) took 1355 ms. Trace:
I20260709 12:25:00.030334  6035 rpcz_store.cc:276] 0709 12:24:58.670843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.876101 (+205258us) service_pool.cc:224] Handling call
0709 12:24:58.876392 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.876710 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.876737 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:58.877268 (+   531us) log.cc:844] Serialized 26 byte log entry
0709 12:24:59.564144 (+686876us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:24:59.564186 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.564257 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.026339 (+462082us) raft_consensus.cc:1685] finished
0709 12:25:00.026358 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.026507 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":96,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":175,"thread_start_us":686507,"threads_started":1,"wal-append.queue_time_us":490004}
I20260709 12:25:00.032311  5966 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:00.033349  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:24:59.994716  8689 log.cc:927] Time spent T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.296s	user 0.000s	sys 0.001s
I20260709 12:25:00.033998  6642 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:24:59.960813  8704 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:24:59.995774  8691 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:24:59.947804  8429 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:00.004693  8675 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.402s	user 0.001s	sys 0.000s
I20260709 12:24:59.994535  8494 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:00.044492  6650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 684) took 2351 ms (client timeout 2111 ms). Trace:
I20260709 12:25:00.037333  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:00.006973  8579 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.021440  8663 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.035064  8433 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:00.049497  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:24:59.996722  8508 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:00.050802  6642 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:00.022511  8659 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:24:59.994755  8615 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:00.048184  6650 rpcz_store.cc:269] 0709 12:24:57.687439 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.687539 (+   100us) service_pool.cc:224] Handling call
0709 12:25:00.038344 (+2350805us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b5400535554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:00.038499 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1316879744}
I20260709 12:25:00.040441  8681 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:00.062546  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:00.054584  8664 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:00.056725  5966 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:00.029273  8706 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:00.042009  8517 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:24:59.989880  8499 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:00.057444  8663 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:00.064906  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:25:00.078930  8712 log.cc:927] Time spent T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
W20260709 12:25:00.080374  8693 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.287s	user 0.000s	sys 0.001s
I20260709 12:25:00.081653  6645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 452) took 1414 ms. Trace:
I20260709 12:25:00.082012  6645 rpcz_store.cc:276] 0709 12:24:58.666846 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.960973 (+294127us) service_pool.cc:224] Handling call
0709 12:24:58.961320 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.961649 (+   329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.961676 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:58.991035 (+ 29359us) log.cc:844] Serialized 26 byte log entry
0709 12:24:59.437532 (+446497us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:59.437572 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:59.437634 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.081420 (+643786us) raft_consensus.cc:1685] finished
0709 12:25:00.081440 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.081593 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":102,"raft.run_cpu_time_us":199,"raft.run_wall_time_us":198,"thread_start_us":446202,"threads_started":1,"wal-append.queue_time_us":684291}
I20260709 12:25:00.084237  6645 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:00.084686  8682 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:00.085315  8697 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:00.085857  8697 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:00.097893  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.099282  8692 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.146s	user 0.000s	sys 0.001s
I20260709 12:25:00.070631  6642 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
W20260709 12:25:00.060731  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 125166us
I20260709 12:25:00.075640  8517 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:00.058295  8433 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:00.111266  8433 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:00.076720  8715 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:25:00.077140  8650 consensus_meta.cc:287] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.513s	user 0.005s	sys 0.006s
I20260709 12:25:00.102353  6642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 700) took 1092 ms. Trace:
I20260709 12:25:00.114403  6645 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:25:00.116184  6642 rpcz_store.cc:276] 0709 12:24:59.010035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.064144 (+1054109us) service_pool.cc:224] Handling call
0709 12:25:00.064396 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.102112 (+ 37716us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.102299 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:00.056813  8579 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:00.134130  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1745) took 1476 ms. Trace:
W20260709 12:25:00.136595  8710 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.066s	user 0.001s	sys 0.001s
I20260709 12:25:00.134598  6043 rpcz_store.cc:276] 0709 12:24:58.657340 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.657457 (+   117us) service_pool.cc:224] Handling call
0709 12:24:58.665316 (+  7859us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.665659 (+   343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.665688 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:58.666212 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:24:58.987915 (+321703us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:24:58.988076 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:24:58.988147 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:00.133896 (+1145749us) raft_consensus.cc:1685] finished
0709 12:25:00.133915 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.134061 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5381,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":13545,"thread_start_us":321337,"threads_started":1,"wal-append.queue_time_us":772529}
I20260709 12:25:00.113621  8682 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:25:00.148169  8613 consensus_meta.cc:287] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.780s	user 0.008s	sys 0.004s
I20260709 12:25:00.157997  6648 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: [4.7-4.7]
I20260709 12:25:00.130141  8524 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
W20260709 12:25:00.163362  5964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 1538) took 2129 ms (client timeout 1820 ms). Trace:
W20260709 12:25:00.164893  5964 rpcz_store.cc:269] 0709 12:24:58.033931 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.034192 (+   261us) service_pool.cc:224] Handling call
0709 12:25:00.157625 (+2123433us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b54001df454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:00.163272 (+  5647us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":797051136}
I20260709 12:25:00.138136  8615 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.022s
I20260709 12:25:00.151991  8670 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:00.177763  8713 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.129979  8663 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:00.161283  8682 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:00.162686  8616 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:00.188090  8427 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:00.189731  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:00.168044  8622 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.022s
I20260709 12:25:00.194509  6650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 699) took 1184 ms. Trace:
I20260709 12:25:00.160666  8613 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:00.199725  5965 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:00.195158  6650 rpcz_store.cc:276] 0709 12:24:59.009655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.062501 (+1052846us) service_pool.cc:224] Handling call
0709 12:25:00.062790 (+   289us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.062998 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:00.161514 (+ 98516us) log.cc:844] Serialized 14 byte log entry
0709 12:25:00.193664 (+ 32150us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.193715 (+    51us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:00.193752 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.194306 (+   554us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:00.194425 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":662,"thread_start_us":120898,"threads_started":2}
I20260709 12:25:00.207407  8608 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:00.208137  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1553) took 1663 ms. Trace:
I20260709 12:25:00.222887  5961 rpcz_store.cc:276] 0709 12:24:58.544763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.544885 (+   122us) service_pool.cc:224] Handling call
0709 12:24:58.545138 (+   253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.665484 (+1120346us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.207861 (+542377us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b54000b9354. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:00.208062 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2560097536}
I20260709 12:25:00.210146  6039 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:00.215579  6035 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20260709 12:25:00.225661  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:00.226325  6035 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:00.216287  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:00.210059  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1753) took 1550 ms. Trace:
W20260709 12:25:00.218696  6647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50454 (request call id 783) took 1551 ms (client timeout 1921 ms). Trace:
I20260709 12:25:00.227993  6041 rpcz_store.cc:276] 0709 12:24:58.659930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.748153 (+ 88223us) service_pool.cc:224] Handling call
0709 12:24:58.748338 (+   185us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.823435 (+ 75097us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.209812 (+1386377us) spinlock_profiling.cc:243] Waited 38.6 ms on lock 0x7b540025ba54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:00.209994 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88670464}
W20260709 12:25:00.230145  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.235345  8694 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:00.170449  8517 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:00.228066  6036 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
W20260709 12:25:00.236584  8725 log.cc:927] Time spent T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:25:00.243750  6035 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:00.178505  8713 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:00.258087  6647 rpcz_store.cc:269] 0709 12:24:58.667532 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.691843 (+ 24311us) service_pool.cc:224] Handling call
0709 12:25:00.209190 (+1517347us) spinlock_profiling.cc:243] Waited 87.9 ms on lock 0x7b54003354d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:00.218624 (+  9434us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202265856}
I20260709 12:25:00.269654  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:00.224915  8717 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.255949  8697 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:00.268373  8517 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:00.260746  8499 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:00.281080  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:00.303037  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.283682  6609 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:25:00.327251  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 43771.8us
I20260709 12:25:00.330670  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:00.364845  8494 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:00.365892  8579 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:00.278699  8587 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.088s
I20260709 12:25:00.367193  8663 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:00.369320  8419 consensus_meta.cc:287] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.875s	user 0.007s	sys 0.002s
W20260709 12:25:00.370198  8730 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:25:00.371109  8604 consensus_meta.cc:287] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.695s	user 0.008s	sys 0.002s
W20260709 12:25:00.372378  8728 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.104s	user 0.000s	sys 0.000s
W20260709 12:25:00.409265  8726 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 12:25:00.410481  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 79895.1us
I20260709 12:25:00.329340  8608 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:00.424955  8718 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:00.419173  8722 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:00.272320  8717 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:00.341529  8325 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:00.262223  8682 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:00.419096  8602 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:25:00.515672  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.610562  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:00.690474  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:00.450275  8419 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:00.456092  8604 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:00.915583  6609 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:00.930423  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 1545) took 2546 ms. Trace:
I20260709 12:25:00.930946  5968 rpcz_store.cc:276] 0709 12:24:58.383710 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.405053 (+ 21343us) service_pool.cc:224] Handling call
0709 12:25:00.930206 (+2525153us) spinlock_profiling.cc:243] Waited 120 ms on lock 0x7b54000f6c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:00.930347 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":276781312}
W20260709 12:25:00.969971  6611 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.020s	sys 0.024s
W20260709 12:25:00.970513  6611 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.020s	sys 0.025s
W20260709 12:25:00.971103  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 671011us
I20260709 12:25:00.682081  8613 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:00.894048  8433 consensus_meta.cc:287] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.782s	user 0.007s	sys 0.004s
W20260709 12:25:00.852643  8732 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.325s	user 0.000s	sys 0.000s
W20260709 12:25:00.874325  8704 consensus_meta.cc:287] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.830s	user 0.008s	sys 0.000s
I20260709 12:25:00.748751  8724 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:00.968954  8703 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:00.944631  8494 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:00.972353  8517 consensus_meta.cc:287] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.687s	user 0.002s	sys 0.007s
I20260709 12:25:00.848294  8717 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:00.998000  8717 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.800215  8579 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:00.502782  8608 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.001474  8608 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.002085  8600 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:00.817929  8612 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:00.687428  8325 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:00.999267  8613 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.002655  8631 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.003872  8734 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:00.998557  8717 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:00.749643  8722 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:00.994091  8703 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:00.973788  8706 consensus_meta.cc:287] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.878s	user 0.006s	sys 0.005s
I20260709 12:25:00.714155  8718 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:01.018751  6118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 2215) took 2159 ms (client timeout 1921 ms). Trace:
I20260709 12:25:01.006778  8427 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:01.022446  6118 rpcz_store.cc:269] 0709 12:24:58.859039 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.883584 (+ 24545us) service_pool.cc:224] Handling call
0709 12:25:01.018547 (+2134963us) spinlock_profiling.cc:243] Waited 716 ms on lock 0x7b5400207954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:01.018671 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1647579520}
I20260709 12:25:00.983546  8433 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:01.012392  8325 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:01.019345  8703 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:00.999449  8579 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.011755  8600 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:01.007982  8724 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.013201  8613 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.041054  8631 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:01.014025  8612 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.019557  8734 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:01.044263  8694 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.025s	sys 0.025s
I20260709 12:25:01.023659  8706 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:01.050371  8694 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.560s	user 0.025s	sys 0.026s
W20260709 12:25:01.063627  6642 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.811s	user 0.025s	sys 0.099s
W20260709 12:25:01.064116  6642 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.026s	sys 0.099s
W20260709 12:25:01.069404  6650 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.812s	user 0.059s	sys 0.043s
W20260709 12:25:01.071354  6650 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.814s	user 0.059s	sys 0.043s
W20260709 12:25:01.094666  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.050719  8631 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:01.101125  6041 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:25:01.108162  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.108723  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.110031  6084 connection.cc:256] RPC call timeout handler was delayed by -1.780500241000027s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21110000000000004s for a response
I20260709 12:25:01.110778  8613 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.112323  8579 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.112864  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:01.114123  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:01.114342  8631 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.115248  8111 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:01.116433  8111 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.119778  8612 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.067703  8419 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:01.120645  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:01.110800  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.095341  8395 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.790s	user 0.002s	sys 0.009s
I20260709 12:25:01.120501  8604 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:01.154942  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 241152us
W20260709 12:25:01.134107  8395 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.854s	user 0.002s	sys 0.009s
I20260709 12:25:01.129128  8419 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.175431  6037 raft_consensus.cc:2955] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:01.156484  8427 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:01.157025  8613 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:01.179003  8694 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.182366  8747 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.189644  8718 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.192376  8433 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:01.180038  8419 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.188733  8427 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.191942  8613 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.237789  8494 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.248471  6650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 461) took 1027 ms. Trace:
I20260709 12:25:01.246683  8752 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:01.248857  6650 rpcz_store.cc:276] 0709 12:25:00.220971 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.221100 (+   129us) service_pool.cc:224] Handling call
0709 12:25:00.221426 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:00.236444 (+ 15018us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.236478 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:00.236991 (+   513us) log.cc:844] Serialized 26 byte log entry
0709 12:25:01.071805 (+834814us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:01.071853 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.071923 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:01.248249 (+176326us) raft_consensus.cc:1685] finished
0709 12:25:01.248269 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.248401 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14611,"raft.queue_time_us":29254,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":2406,"thread_start_us":814630,"threads_started":1,"wal-append.queue_time_us":906347}
I20260709 12:25:01.239321  8600 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.238160  8724 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.242267  8433 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:01.252756  8735 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:25:01.255651  6646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 694) took 2460 ms (client timeout 1717 ms). Trace:
W20260709 12:25:01.280191  6646 rpcz_store.cc:269] 0709 12:24:58.795638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.822674 (+ 27036us) service_pool.cc:224] Handling call
0709 12:25:01.255436 (+2432762us) spinlock_profiling.cc:243] Waited 503 ms on lock 0x7b54004e2fd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:01.255568 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1157716864}
I20260709 12:25:01.257562  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1580) took 1435 ms. Trace:
I20260709 12:25:01.244096  8746 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.281508  5965 rpcz_store.cc:276] 0709 12:24:59.821738 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:59.827178 (+  5440us) service_pool.cc:224] Handling call
0709 12:24:59.827495 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.200212 (+372717us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.257304 (+1057092us) spinlock_profiling.cc:243] Waited 372 ms on lock 0x7b5400036454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:01.257501 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":855642496}
W20260709 12:25:01.262178  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.242609  8722 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.268134  6648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 443) took 3582 ms. Trace:
I20260709 12:25:01.269537  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1483) took 2505 ms. Trace:
I20260709 12:25:01.287564  6039 rpcz_store.cc:276] 0709 12:24:58.764589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.911624 (+147035us) service_pool.cc:224] Handling call
0709 12:25:00.209968 (+1298344us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.224236 (+ 14268us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.269267 (+1045031us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b540025ba50. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:01.269445 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2985332480}
I20260709 12:25:01.228267  8747 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:01.270452  5967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1557) took 2654 ms. Trace:
W20260709 12:25:01.270865  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.251963  8739 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:25:01.228091  8694 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:01.282929  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.265477  8622 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:01.286952  6648 rpcz_store.cc:276] 0709 12:24:57.686142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:57.686295 (+   153us) service_pool.cc:224] Handling call
0709 12:24:57.703082 (+ 16787us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:00.158537 (+2455455us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.267826 (+1109289us) spinlock_profiling.cc:243] Waited 2.45 s on lock 0x7b5400515ed4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:01.268041 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5645142400}
I20260709 12:25:01.303421  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:01.304065  5964 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:01.289358  5967 rpcz_store.cc:276] 0709 12:24:58.615784 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.615896 (+   112us) service_pool.cc:224] Handling call
0709 12:25:00.157935 (+1542039us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:00.158251 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:25:00.158280 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:00.158319 (+    39us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:00.158345 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:00.158407 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.270271 (+1111864us) spinlock_profiling.cc:243] Waited 1.54 s on lock 0x7b54001df450. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:01.270383 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1920,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":16446,"spinlock_wait_cycles":3545627520}
I20260709 12:25:01.301816  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:01.281980  8706 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.309196  5961 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.300562  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:01.300232  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:01.310937  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.311419  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:01.312124  5965 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:01.312229  5964 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:01.313704  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:01.314296  5967 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:01.272518  8494 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.312568  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:01.324045  5966 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.292451  8753 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:01.282738  8433 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:01.274760  8752 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.296344  8734 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.364459  8747 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.367736  6642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 459) took 1170 ms. Trace:
I20260709 12:25:01.368244  6642 rpcz_store.cc:276] 0709 12:25:00.197522 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:00.197678 (+   156us) service_pool.cc:224] Handling call
0709 12:25:00.197995 (+   317us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:00.198241 (+   246us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:00.198268 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:00.201697 (+  3429us) log.cc:844] Serialized 26 byte log entry
0709 12:25:01.064550 (+862853us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:01.064589 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.064656 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:01.367469 (+302813us) raft_consensus.cc:1685] finished
0709 12:25:01.367493 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.367665 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":811901,"threads_started":1,"wal-append.queue_time_us":912189}
I20260709 12:25:01.373103  8588 raft_consensus.cc:3055] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:25:01.373667  8588 raft_consensus.cc:740] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:25:01.374044  6644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50470 (request call id 448) took 2931 ms (client timeout 1919 ms). Trace:
W20260709 12:25:01.374490  6644 rpcz_store.cc:269] 0709 12:24:58.442490 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.445017 (+  2527us) service_pool.cc:224] Handling call
0709 12:25:01.373825 (+2928808us) spinlock_profiling.cc:243] Waited 37.9 ms on lock 0x7b5400515254. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:01.373965 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87056640}
I20260709 12:25:01.373288  8419 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:01.375757  6044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1751) took 2716 ms (client timeout 2162 ms). Trace:
I20260709 12:25:01.375689  6643 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:01.322705  8748 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.323079  8622 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.289546  8746 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.343987  8753 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.379490  5960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 2204) took 2704 ms. Trace:
I20260709 12:25:01.413030  5960 rpcz_store.cc:276] 0709 12:24:58.674928 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.908793 (+233865us) service_pool.cc:224] Handling call
0709 12:24:58.909047 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:58.936595 (+ 27548us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.379135 (+2442540us) spinlock_profiling.cc:243] Waited 21.3 ms on lock 0x7b54001c98d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:01.379410 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":49099008}
W20260709 12:25:01.381067  6044 rpcz_store.cc:269] 0709 12:24:58.659388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.695296 (+ 35908us) service_pool.cc:224] Handling call
0709 12:25:01.375556 (+2680260us) spinlock_profiling.cc:243] Waited 109 ms on lock 0x7b54001f2f54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:01.375658 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":251212032}
W20260709 12:25:01.390421  6109 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 1868) took 2593 ms (client timeout 2077 ms). Trace:
W20260709 12:25:01.415741  6109 rpcz_store.cc:269] 0709 12:24:58.796648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.796795 (+   147us) service_pool.cc:224] Handling call
0709 12:25:01.390242 (+2593447us) spinlock_profiling.cc:243] Waited 13 ms on lock 0x7b5400207454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:01.390350 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":29884800}
W20260709 12:25:01.392367  6040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1749) took 2733 ms (client timeout 1881 ms). Trace:
W20260709 12:25:01.417124  6040 rpcz_store.cc:269] 0709 12:24:58.658898 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.680954 (+ 22056us) service_pool.cc:224] Handling call
0709 12:25:01.392170 (+2711216us) spinlock_profiling.cc:243] Waited 355 ms on lock 0x7b540030e3d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:01.392283 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":815524736}
I20260709 12:25:01.420063  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:01.394948  6651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 690) took 2774 ms. Trace:
I20260709 12:25:01.397915  5959 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
W20260709 12:25:01.413756  6608 connection.cc:256] RPC call timeout handler was delayed by -1.0228762710003139s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15710000000000002s for a response
W20260709 12:25:01.378449  5932 leader_election.cc:336] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 2.191s (SENT)
I20260709 12:25:01.422667  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:01.395926  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.424008  5932 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:01.424209  6650 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:25:01.416616  5961 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:01.424578  6036 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:01.340847  5966 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:01.423143  6651 rpcz_store.cc:276] 0709 12:24:58.620449 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.634604 (+ 14155us) service_pool.cc:224] Handling call
0709 12:24:58.634924 (+   320us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:59.048594 (+413670us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.394669 (+2346075us) spinlock_profiling.cc:243] Waited 413 ms on lock 0x7b540080b954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:01.394883 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":949468544}
I20260709 12:25:01.389657  8427 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.393613  8713 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.425678  8450 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:01.388451  8746 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.390832  8439 raft_consensus.cc:3055] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:01.426787  8450 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.391639  8666 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.423592  6608 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:01.428869  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50442.6us
I20260709 12:25:01.430707  5965 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:01.435335  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:01.438537  6040 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:25:01.391479  8494 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.383198  8419 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.442886  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:01.443699  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.429608  8373 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.173s	user 0.016s	sys 0.016s
W20260709 12:25:01.455657  8373 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.208s	user 0.016s	sys 0.016s
I20260709 12:25:01.441944  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:01.457229  8746 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:01.457645  8746 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.457978  8746 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.458503  5968 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 7. (term mismatch)
I20260709 12:25:01.437991  8439 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:01.458899  5968 pending_rounds.cc:85] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 6
I20260709 12:25:01.459178  5968 pending_rounds.cc:107] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 4.7
I20260709 12:25:01.459419  5968 raft_consensus.cc:2889] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:01.407851  8717 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.444797  8753 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.394351  8433 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:01.447196  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.477275  6036 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:01.448125  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.445333  8318 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:01.478420  8318 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.478893  8318 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.440564  8722 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:01.451378  5960 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:25:01.451301  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:01.452965  5963 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:01.455121  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:01.396292  8694 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.393019  8752 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.435313  5967 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:25:01.331640  8703 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.427698  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:01.402562  8613 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.406761  8622 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.449613  8450 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.440804  8713 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:01.483842  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1744) took 2832 ms. Trace:
I20260709 12:25:01.494736  6042 rpcz_store.cc:276] 0709 12:24:58.651923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.652056 (+   133us) service_pool.cc:224] Handling call
0709 12:24:58.652368 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:24:58.656277 (+  3909us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:24:58.656307 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:24:58.671372 (+ 15065us) log.cc:844] Serialized 26 byte log entry
0709 12:24:58.688837 (+ 17465us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:01.271390 (+2582553us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b1800144a60. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f4820bfc4bc 00007f481df4a48b 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df64455 00007f4824a4c3c7 00007f482105e9a7 00007f482106e0bf
0709 12:25:01.271590 (+   200us) log.cc:844] Serialized 14 byte log entry
0709 12:25:01.473166 (+201576us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.473247 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:01.473291 (+    44us) raft_consensus.cc:1685] finished
0709 12:25:01.483593 (+ 10302us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:01.483774 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3122,"prepare.queue_time_us":209741,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":2747,"raft.queue_time_us":3691,"raft.run_cpu_time_us":287,"raft.run_wall_time_us":14941,"spinlock_wait_cycles":3100032,"thread_start_us":367714,"threads_started":3,"wal-append.queue_time_us":91388,"wal-append.run_cpu_time_us":1714,"wal-append.run_wall_time_us":1020969}
I20260709 12:25:01.441183  8359 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:25:01.472383  8427 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.505409  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.482702  8706 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.031s
I20260709 12:25:01.384672  8748 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.485796  8722 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:01.516487  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.517424  6040 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:01.493077  8584 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:01.460371  8419 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.481954  8395 consensus_queue.cc:1059] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
I20260709 12:25:01.524494  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.374500  8588 consensus_queue.cc:260] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.528335  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.529982  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:01.530654  6041 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:01.521539  6084 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:01.522955  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 220948us
I20260709 12:25:01.494246  8373 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:25:01.534543  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:01.535346  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:01.540979  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.547330  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:01.520318  8722 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:01.548183  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:01.549897  6040 raft_consensus.cc:2376] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3. Re-sending same reply.
I20260709 12:25:01.550267  6036 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:01.550864  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.551528  6040 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:01.507827  8737 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:25:01.552686  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:01.556978  6040 raft_consensus.cc:2376] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3. Re-sending same reply.
I20260709 12:25:01.504501  8325 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.558007  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:01.521836  8584 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:01.559144  8584 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:01.555323  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.564438  6043 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:25:01.565366  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.565692  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.566686  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.567581  6043 raft_consensus.cc:2410] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:25:01.565650  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 70543.7us
I20260709 12:25:01.568454  8325 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:01.558765  6040 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:25:01.571126  6038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1737) took 2934 ms (client timeout 2191 ms). Trace:
I20260709 12:25:01.571461  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:01.574524  6038 rpcz_store.cc:269] 0709 12:24:58.636927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.637075 (+   148us) service_pool.cc:224] Handling call
0709 12:25:01.570946 (+2933871us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b54001aa754. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:01.571062 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":24930688}
I20260709 12:25:01.511090  8427 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.546064  8494 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.597524  6041 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:01.546339  8752 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:01.546303  8433 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.602902  6036 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:01.607997  8584 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.552342  8111 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.066s
I20260709 12:25:01.623907  8703 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.627403  8419 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.555335  8588 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:25:01.635563  8395 raft_consensus.cc:3055] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:01.577447  6644 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:01.671905  6109 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:25:01.639313  8748 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.641212  8427 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.513200  8439 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:01.552143  8666 consensus_queue.cc:1059] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.097s
W20260709 12:25:01.662854  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 93926.1us
I20260709 12:25:01.663195  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:01.686821  6041 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:01.668753  8752 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.669726  8111 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.670046  8584 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.683797  6109 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
W20260709 12:25:01.695315  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 147153us
I20260709 12:25:01.696561  6084 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:01.695883  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:01.698801  6116 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 7: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:01.699517  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:01.708138  6109 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:01.708918  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:01.709550  5961 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:01.714071  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:01.715467  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:01.716373  6116 raft_consensus.cc:2410] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 6 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:25:01.717468  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:01.662814  8395 raft_consensus.cc:740] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:01.725623  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:01.725931  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:01.726682  6109 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 7: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:01.726719  6113 raft_consensus.cc:2410] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 10 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:25:01.668781  8373 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.030s
I20260709 12:25:01.745869  8769 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:01.746547  8769 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:01.694618  8770 consensus_queue.cc:1059] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.146s
I20260709 12:25:01.707921  8111 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:01.747838  8770 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.748350  8770 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:01.744259  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:01.746758  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:01.748782  8769 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:01.751837  6113 raft_consensus.cc:2410] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 5 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:25:01.775380  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:01.777009  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 225436us
I20260709 12:25:01.779071  6081 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:01.749313  8111 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:01.790045  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:01.753170  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:01.781599  6112 raft_consensus.cc:2393] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:01.792968  6109 raft_consensus.cc:2410] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 3 because replica has last-logged OpId of term: 2 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
I20260709 12:25:01.794931  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:01.798329  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:01.798744  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:01.799226  6118 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:01.799515  6112 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:25:01.801008  6116 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:01.802527  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:01.767807  6041 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:01.721186  8667 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:01.809240  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.660120  8433 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.819456  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:01.844300  6040 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 7: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:01.845132  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.845731  6040 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
W20260709 12:25:01.790992  8758 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:25:01.698583  8752 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:01.835636  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:01.837769  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.725219  8325 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:01.814261  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:01.898382  6039 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
W20260709 12:25:01.840211  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 61202.3us
I20260709 12:25:01.899835  6081 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:01.842509  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.658607  8494 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.846931  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.732337  8419 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:01.781369  8290 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:01.900640  6043 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:01.904800  8769 raft_consensus.cc:3055] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:01.809244  8395 consensus_queue.cc:260] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.845475  8111 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:01.848825  8450 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.083s
I20260709 12:25:01.902858  8325 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:01.940207  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:01.944763  6043 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:01.897709  8622 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:25:01.847285  8667 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:01.909330  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 73792.5us
I20260709 12:25:01.954294  6082 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:01.941663  8769 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:01.947576  8325 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:01.931676  8290 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:01.920282  8419 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.953456  8111 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:25:01.964391  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 182401us
I20260709 12:25:01.968573  8667 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.970760  8752 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:01.971517  8746 consensus_meta.cc:287] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
I20260709 12:25:01.993628  8746 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.994408  8773 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:01.995152  8773 raft_consensus.cc:697] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:01.996119  8773 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:01.974505  6649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 781) took 3436 ms. Trace:
I20260709 12:25:01.997767  6649 rpcz_store.cc:276] 0709 12:24:58.537763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.537861 (+    98us) service_pool.cc:224] Handling call
0709 12:24:58.538122 (+   261us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:24:59.697490 (+1159368us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:01.974253 (+2276763us) spinlock_profiling.cc:243] Waited 1.15 s on lock 0x7b540060b154. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:01.974424 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2646943104}
W20260709 12:25:02.000196  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 303693us
I20260709 12:25:02.001408  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:01.974897  8318 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:01.963624  8777 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:01.976915  8494 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.972230  8769 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:01.978042  8770 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:01.996014  8746 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.981212  8767 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:01.985363  8599 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.988186  8419 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:01.990080  8290 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:01.972116  8616 raft_consensus.cc:1064] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:25:01.979830  8433 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:02.007110  8621 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.008817  8722 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.023658  8707 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:02.027940  8774 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:02.035423  8774 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:02.036024  8774 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:02.033576  8769 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.040292  8722 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:02.032311  8616 raft_consensus.cc:1068] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Unable to promote non-voter 24012af7747d4c4ea89c3da2ff950099: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:25:02.033231  8621 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:02.075716  5853 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5a6d648272bf4bef9d5337acfc9d4a96 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0069e2ba1f02412e8e1d6c20a1fb510f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:25:02.078317  5853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 229432us
I20260709 12:25:02.082058  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:02.100212  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.101110  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:01.821053  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:02.103842  6042 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20260709 12:25:01.874526  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.901477  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:02.105934  6036 raft_consensus.cc:2368] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5.
I20260709 12:25:02.107543  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:02.109895  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:01.898494  6037 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:02.114307  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 99433.9us
W20260709 12:25:02.005123  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.121730  8586 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:02.123950  8111 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:02.050613  8774 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.115767  8325 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.119513  6040 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:02.119758  8621 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:02.120272  8427 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.025158  8318 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:01.836759  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:02.137651  6041 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:24:59.707070  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:02.146994  8774 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:02.148290  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.149711  6082 connection.cc:256] RPC call timeout handler was delayed by -1.7068392040000617s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1553s for a response
W20260709 12:25:02.150223  6082 connection.cc:256] RPC call timeout handler was delayed by -1.6960392040000443s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1565s for a response
W20260709 12:25:02.160257  6082 connection.cc:256] RPC call timeout handler was delayed by -1.5826392039998609s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16910000000000003s for a response
W20260709 12:25:02.160691  6082 connection.cc:256] RPC call timeout handler was delayed by -1.5592392039998231s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17170000000000002s for a response
I20260709 12:25:02.151533  8777 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.163962  8777 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.152254  8784 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.167567  8784 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:02.153399  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:02.105342  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:02.171159  6082 connection.cc:256] RPC call timeout handler was delayed by -1.5277392040002269s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17520000000000002s for a response
I20260709 12:25:02.158159  8621 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:02.134860  8427 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.150816  8433 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:02.125844  8111 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:02.175213  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:02.181002  6039 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:02.183923  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:02.193125  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:02.157675  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.199375  8777 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:02.198877  8312 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:25:02.201256  6082 connection.cc:256] RPC call timeout handler was delayed by -1.5223392040002182s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1758s for a response
W20260709 12:25:02.207603  6082 connection.cc:256] RPC call timeout handler was delayed by -1.516039204000208s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1765s for a response
I20260709 12:25:02.211064  8427 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:02.212146  8433 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:02.213519  6643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 696) took 3388 ms. Trace:
I20260709 12:25:02.213871  8621 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:02.218436  6082 connection.cc:256] RPC call timeout handler was delayed by -1.4728392040001381s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.18130000000000002s for a response
I20260709 12:25:02.203178  8784 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:02.228820  6082 connection.cc:256] RPC call timeout handler was delayed by -1.4584392040001148s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1829s for a response
W20260709 12:25:02.233023  6082 connection.cc:256] RPC call timeout handler was delayed by -1.3477392039999359s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1952s for a response
W20260709 12:25:02.235322  6082 connection.cc:256] RPC call timeout handler was delayed by -1.3450392039999315s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1955s for a response
W20260709 12:25:02.237901  6082 connection.cc:256] RPC call timeout handler was delayed by -1.3234392039998966s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19790000000000002s for a response
W20260709 12:25:02.238297  6082 connection.cc:256] RPC call timeout handler was delayed by -1.3072392039998704s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.19970000000000002s for a response
W20260709 12:25:02.240154  6082 connection.cc:256] RPC call timeout handler was delayed by -1.2910392039998442s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2015s for a response
I20260709 12:25:02.242987  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:02.243970  6114 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:02.243152  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:02.244848  6082 connection.cc:256] RPC call timeout handler was delayed by -1.1812392040001214s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2137s for a response
I20260709 12:25:02.245688  6039 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:02.247802  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:02.219364  6643 rpcz_store.cc:276] 0709 12:24:58.824567 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.967017 (+142450us) service_pool.cc:224] Handling call
0709 12:25:01.375513 (+2408496us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.382558 (+  7045us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.212948 (+830390us) spinlock_profiling.cc:243] Waited 2.41 s on lock 0x7b5400515250. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:02.213258 (+   310us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5538283392}
W20260709 12:25:02.249764  6082 connection.cc:256] RPC call timeout handler was delayed by -1.1758392040001127s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2143s for a response
I20260709 12:25:02.247498  6036 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:02.258805  6035 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:25:02.259900  8433 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:02.260028  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:02.261386  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:02.261608  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:02.270509  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:02.263361  6040 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:25:02.294919  6082 connection.cc:256] RPC call timeout handler was delayed by -1.1650392040000952s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2155s for a response
W20260709 12:25:02.295461  6082 connection.cc:256] RPC call timeout handler was delayed by -1.1344392040000457s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2189s for a response
I20260709 12:25:02.276119  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1561) took 3651 ms. Trace:
I20260709 12:25:02.285188  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:02.299741  6038 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:02.262889  8667 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:25:02.300513  8618 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:02.300982  8618 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.301362  8618 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:02.296396  5959 rpcz_store.cc:276] 0709 12:24:58.624400 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:58.903632 (+279232us) service_pool.cc:224] Handling call
0709 12:25:00.208830 (+1305198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:01.397761 (+1188931us) spinlock_profiling.cc:243] Waited 66.8 ms on lock 0x7b54003ca3a0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fcbdc0 00007f48210561c0 00007f4821057231 00007f4821053d8f 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c
0709 12:25:01.422625 (+ 24864us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.275642 (+853017us) spinlock_profiling.cc:243] Waited 1.3 s on lock 0x7b54000b9350. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:02.275867 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3154717824}
W20260709 12:25:02.299058  6082 connection.cc:256] RPC call timeout handler was delayed by -1.1074392040000021s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2219s for a response
I20260709 12:25:02.300765  6043 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:02.305934  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:02.310772  6082 connection.cc:256] RPC call timeout handler was delayed by -1.0939392039999802s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22340000000000002s for a response
W20260709 12:25:02.311568  6082 connection.cc:256] RPC call timeout handler was delayed by -1.0588392039999235s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.22730000000000003s for a response
I20260709 12:25:02.309935  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:02.321795  6036 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:02.322674  6040 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 5. Current term is 6. Ops: []
W20260709 12:25:02.323037  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.327188  8395 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:02.307436  8621 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:02.330113  8776 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.361s	user 0.002s	sys 0.000s
I20260709 12:25:02.335855  6081 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:02.338822  8602 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.339435  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:25:02.340129  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.344008  8452 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.347450  8768 raft_consensus.cc:3055] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:02.348276  8707 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.348428  6609 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:02.352703  8771 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.433s	user 0.000s	sys 0.003s
I20260709 12:25:02.347460  8667 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:25:02.344274  6037 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:02.362102  6038 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:02.368019  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:02.370327  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:02.370944  8325 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:02.371654  8602 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.372491  8452 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.374289  8602 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:02.374740  8722 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.374931  8452 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:02.375485  5961 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:02.375614  8722 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:02.378176  8707 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.380550  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:02.380832  8707 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:02.381700  6643 raft_consensus.cc:2410] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 6.
I20260709 12:25:02.374490  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:02.387084  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 51680.1us
I20260709 12:25:02.388347  6081 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:02.389571  8784 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:02.389755  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:02.390231  8784 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:02.391456  8784 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:02.367043  8768 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:02.396677  8602 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:25:02.396975  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 57848.2us
I20260709 12:25:02.397389  8602 raft_consensus.cc:697] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:02.398923  8704 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:02.399055  8602 consensus_queue.cc:237] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:02.403192  8433 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:02.403072  8111 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:02.404362  8703 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:02.404687  8433 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:25:02.402436  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 54099us
I20260709 12:25:02.400098  8722 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:02.406605  8433 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:02.409269  5932 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:02.396872  8768 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:02.422195  5961 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:02.428541  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:02.410799  8111 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:25:02.421417  6611 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 2.083s (SENT) [suppressed 40 similar messages]
I20260709 12:25:02.438351  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:02.442847  8449 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:02.447505  6609 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:02.448316  8768 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:02.450018  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.406946  8704 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:25:02.450754  6113 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
W20260709 12:25:02.460095  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45004.4us
I20260709 12:25:02.461244  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:02.461520  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:02.462190  5967 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:02.465133  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:02.466077  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.466971  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.468578  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.468807  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:02.469336  6118 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:25:02.469830  6116 raft_consensus.cc:2410] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
I20260709 12:25:02.469614  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.470873  6111 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:02.472260  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.467128  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:02.473037  6112 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:25:02.462141  5962 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:25:02.482683  8667 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:02.483038  5965 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:25:02.485201  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:02.486141  6041 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:02.442399  8618 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:02.487605  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 78725.9us
I20260709 12:25:02.489051  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:02.489051  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:02.490617  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 69248.3us
I20260709 12:25:02.494151  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:02.494891  6110 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:02.495214  8667 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:02.495591  8744 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:02.479738  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:02.496255  8667 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.506125  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:02.507156  6648 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:02.507388  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:02.509460  6648 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:02.510391  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:02.511832  6648 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:02.513896  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:02.515149  6114 raft_consensus.cc:2410] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 5 because replica has last-logged OpId of term: 4 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 4.
W20260709 12:25:02.515470  8789 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
W20260709 12:25:02.515741  8762 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.009s	sys 0.018s
I20260709 12:25:02.518235  6044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1764) took 1081 ms. Trace:
I20260709 12:25:02.522156  6649 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 6: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:02.522886  5932 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:02.524135  5965 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:02.524689  6109 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
W20260709 12:25:02.523587  8762 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.853s	user 0.009s	sys 0.019s
I20260709 12:25:02.535566  6644 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:02.548388  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.556110  5862 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 304) took 9699 ms. Trace:
I20260709 12:25:02.561643  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:02.565009  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.575389  8754 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:02.576458  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.522746  6044 rpcz_store.cc:276] 0709 12:25:01.436399 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:01.436519 (+   120us) service_pool.cc:224] Handling call
0709 12:25:01.436855 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:01.438675 (+  1820us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:01.438704 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:01.439128 (+   424us) log.cc:844] Serialized 26 byte log entry
0709 12:25:02.040486 (+601358us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b480024c258. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4825f7daa1 00007f4825f74b37 00007f4825f749ca 00007f482606c26f 00007f482606bf37 00007f482608055c 00007f4826080508 00007f4826080488 00007f4826080443 00007f482607f6ec 00007f4824fa9a96
0709 12:25:02.279498 (+239012us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b18001e2f80. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:25:02.424073 (+144575us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:02.429682 (+  5609us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:02.429801 (+   119us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:02.517846 (+ 88045us) raft_consensus.cc:1685] finished
0709 12:25:02.517865 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:02.518054 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1389,"raft.queue_time_us":2175,"raft.run_cpu_time_us":2774,"raft.run_wall_time_us":600341,"spinlock_wait_cycles":36696192,"thread_start_us":82219,"threads_started":1,"wal-append.queue_time_us":1040201}
I20260709 12:25:02.558625  8722 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:02.594436  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:02.595407  6109 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:02.595928  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.596433  8788 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:25:02.598044  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:02.599327  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.599798  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:02.599999  6118 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:02.600657  6036 raft_consensus.cc:2393] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:02.541906  8111 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:02.603804  8722 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.606864  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.610580  6648 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:25:02.594543  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 102529us
I20260709 12:25:02.612783  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.613704  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.620482  5965 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:02.616639  5967 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:02.623518  6038 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
W20260709 12:25:02.663708  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.665907  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:02.675053  6109 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:02.683018  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.691075  6114 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:02.702857  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:02.709780  8797 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
I20260709 12:25:02.714094  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:02.780491  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.705781  8586 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:02.781807  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 63244.5us
W20260709 12:25:02.391197  8616 consensus_queue.cc:1175] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" responder_term: 4 status { last_received { term: 3 index: 3 } last_committed_idx: 3 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:02.780493  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:02.792241  6110 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:02.718022  8722 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:02.798525  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 84566.4us
I20260709 12:25:02.559526  5862 rpcz_store.cc:276] 0709 12:24:52.856397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:52.858036 (+  1639us) service_pool.cc:224] Handling call
0709 12:24:52.979468 (+121432us) spinlock_profiling.cc:243] Waited 67.1 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:25:02.555846 (+9576378us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:24:56.399650 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:24:56.535036 (+135386us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:24:56.541728 (+  6692us) write_op.cc:435] Acquired schema lock
0709 12:24:56.545173 (+  3445us) tablet.cc:662] Decoding operations
0709 12:24:56.568778 (+ 23605us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:24:56.568841 (+    63us) write_op.cc:641] Partition lock acquired for write op
0709 12:24:56.568869 (+    28us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:24:56.569378 (+   509us) tablet.cc:701] Row locks acquired
0709 12:24:56.569394 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:24:56.569537 (+   143us) write_op.cc:270] Start()
0709 12:24:56.569648 (+   111us) write_op.cc:276] Timestamp: P: 1783599896569488 usec, L: 0
0709 12:24:56.569669 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:24:56.570293 (+   624us) log.cc:844] Serialized 2439 byte log entry
0709 12:24:57.174547 (+604254us) op_driver.cc:464] REPLICATION: finished
0709 12:24:57.932913 (+758366us) write_op.cc:301] APPLY: starting
0709 12:24:57.936017 (+  3104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:24:57.980427 (+ 44410us) spinlock_profiling.cc:243] Waited 6.46 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482105132a 00007f4820fd6f14 00007f4820fd6ec3 00007f4820fd6e38 00007f4820fd6df3 00007f4820fd60dc 00007f4820fffe16 00007f4820fe7cbb 00007f4820fd239d 00007f4820fd5d75
0709 12:24:58.007970 (+ 27543us) tablet.cc:1370] finished BulkCheckPresence
0709 12:24:58.011327 (+  3357us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:24:58.074864 (+ 63537us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:24:58.180340 (+105476us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=6
0709 12:24:58.212097 (+ 31757us) write_op.cc:312] APPLY: finished
0709 12:24:58.276465 (+ 64368us) log.cc:844] Serialized 53 byte log entry
0709 12:24:58.525720 (+249255us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:58.541470 (+ 15750us) write_op.cc:454] Released schema lock
0709 12:24:58.543268 (+  1798us) write_op.cc:341] FINISH: Updating metrics
0709 12:24:58.653867 (+110599us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:24:58.653917 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":18,"spinlock_wait_cycles":154422528,"child_traces":[["op",{"apply.queue_time_us":708096,"apply.run_cpu_time_us":133918,"apply.run_wall_time_us":729230,"num_ops":6,"prepare.queue_time_us":314824,"prepare.run_cpu_time_us":28011,"prepare.run_wall_time_us":302433,"raft.queue_time_us":236473,"raft.run_cpu_time_us":26503,"raft.run_wall_time_us":984932,"replication_time_us":574419,"spinlock_wait_cycles":14852352,"thread_start_us":931943,"threads_started":5,"wal-append.queue_time_us":485338,"wal-append.run_cpu_time_us":17453,"wal-append.run_wall_time_us":2194385}]]}
W20260709 12:25:02.804059  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.804896  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:02.806807  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.807734  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.825811  6040 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:02.831765  6111 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 5. (term mismatch)
I20260709 12:25:02.832253  6111 pending_rounds.cc:85] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 4
I20260709 12:25:02.832518  6111 pending_rounds.cc:107] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 12:25:02.832782  6111 raft_consensus.cc:2889] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:02.833076  8808 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:02.835256  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:02.847764  6611 leader_election.cc:336] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.571s (SENT)
I20260709 12:25:02.847123  8598 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:02.856240  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:02.860718  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.866907  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:02.836442  8586 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.873327  8586 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:02.874228  8796 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.257s	user 0.005s	sys 0.000s
I20260709 12:25:02.833817  8808 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.876430  8722 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:02.877065  8722 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.855240  8598 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:02.878824  8598 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:02.879894  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.881561  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:02.882697  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:02.883100  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.883571  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.882772  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.885670  6113 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:02.886634  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:02.887149  8805 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:25:02.887282  6112 raft_consensus.cc:2376] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5. Re-sending same reply.
I20260709 12:25:02.887665  8746 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.098s
W20260709 12:25:02.888945  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 95577.2us
I20260709 12:25:02.889482  8746 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:02.889846  8746 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:02.890818  8746 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.891816  8746 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:02.894055  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:02.848317  6611 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:02.893639  6038 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:02.897207  6118 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:02.892843  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:02.904963  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 201549us
I20260709 12:25:02.916381  6040 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:02.923136  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.927862  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.892259  8808 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:02.923890  6111 raft_consensus.cc:2376] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5. Re-sending same reply.
I20260709 12:25:02.977666  6114 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 2. Current term is 3. Ops: []
W20260709 12:25:02.972580  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:02.966642  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:03.063079  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.065613  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:02.990872  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 154575us
I20260709 12:25:02.929826  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:03.045032  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:02.993337  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.978439  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:02.976076  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:02.930439  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:03.064101  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:02.929644  6043 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:25:03.012992  6645 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5. Ops: []
W20260709 12:25:03.013164  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 154694us
I20260709 12:25:03.069890  6115 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:03.021150  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:03.074572  6651 raft_consensus.cc:2410] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:25:03.076161  6118 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
W20260709 12:25:02.931212  8806 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:25:03.072739  6113 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
W20260709 12:25:02.994014  8798 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.317s	user 0.000s	sys 0.001s
I20260709 12:25:03.035051  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:02.976989  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:02.992844  8618 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:03.103292  6611 leader_election.cc:336] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.647s (SENT)
I20260709 12:25:02.994124  8722 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:02.992599  8817 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:03.120010  8813 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:03.125689  8813 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:02.965282  8586 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:03.110044  8744 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:03.128189  8744 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:03.131897  6116 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:25:03.133267  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.134150  6116 raft_consensus.cc:2393] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:03.134616  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:02.993652  8617 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:25:03.135366  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:03.136720  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:03.118052  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:03.138609  6006 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.4.181.126:41341, user_credentials={real_user=slave}} blocked reactor thread for 89924.4us
I20260709 12:25:03.119861  5865 catalog_manager.cc:5697] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 4 to 5, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 5 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:03.139403  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.120781  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:03.140978  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 77016.7us
I20260709 12:25:03.141963  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:03.142408  8449 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:03.143172  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:03.143392  8754 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:03.140702  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.144841  8704 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:03.144971  8754 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:03.145615  8754 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.145967  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:03.122908  6642 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:03.147713  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:03.148582  8704 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:03.124532  6650 raft_consensus.cc:2393] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:03.149858  6647 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:03.150017  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:03.149770  8704 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:03.151777  8704 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.140743  5865 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 3 to 4, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 4 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:03.143180  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:03.146157  8754 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.155493  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.156872  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.157910  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.134871  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.151825  6650 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:03.159480  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.072196  6041 raft_consensus.cc:2955] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:03.160768  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.161898  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.159474  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.164047  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:03.120285  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:03.115867  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:03.171361  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.155493  6643 raft_consensus.cc:2393] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 7: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:03.146739  6116 raft_consensus.cc:2368] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6.
I20260709 12:25:03.154040  5865 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 3 to 4, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 4 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:03.148911  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:03.120752  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:03.173693  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 54698.4us
I20260709 12:25:03.140640  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.112401  8616 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:03.192039  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.193800  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.152455  8439 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:03.196456  6113 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:03.129590  8744 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:03.201661  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:03.216735  5932 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:03.220147  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.222316  6113 raft_consensus.cc:2410] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:25:03.124859  8817 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:03.234731  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.232431  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:03.207893  8813 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:03.224606  8586 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:03.239961  8825 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.062s	user 0.001s	sys 0.000s
I20260709 12:25:03.247349  8598 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:03.266263  8586 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:03.267280  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.240934  8449 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:03.268904  8449 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:03.270139  8449 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:03.260852  8762 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:25:03.274077  8756 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:03.274534  8756 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:03.275415  8756 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:03.276753  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:03.276687  8756 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:03.278849  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.279268  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.251859  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.280007  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.280380  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.280751  6113 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Stepping down as leader of term 4
W20260709 12:25:03.240641  8822 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
I20260709 12:25:03.281128  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.280766  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.282397  6118 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:03.249751  8817 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:03.258131  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 54293.6us
I20260709 12:25:03.256891  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.247969  8754 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:03.281172  6113 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:03.285018  5932 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:03.287976  6116 raft_consensus.cc:2410] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 6 because replica has last-logged OpId of term: 2 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 3.
I20260709 12:25:03.289912  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:03.290498  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.290660  6109 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
W20260709 12:25:03.297503  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 153128us
I20260709 12:25:03.268963  8586 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:03.303078  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 236966us
I20260709 12:25:03.301301  5865 catalog_manager.cc:5697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 1 to 2, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:25:03.297492  8704 raft_consensus.cc:2764] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:25:03.311000  5865 catalog_manager.cc:5697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:03.261543  8111 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:25:03.319393  5932 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:03.320354  6113 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:03.346213  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.361893  5865 catalog_manager.cc:5697] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 4 to 5, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 5 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:03.370826  8586 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:03.372452  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:03.384196  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 73876.9us
W20260709 12:25:03.408130  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 145102us
I20260709 12:25:03.412072  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:03.412879  6041 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
W20260709 12:25:03.421181  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.438892  6611 leader_election.cc:336] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.857s (SENT)
I20260709 12:25:03.439422  6611 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:03.439721  6009 leader_election.cc:336] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.595s (SENT)
I20260709 12:25:03.440255  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:03.404850  8586 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:03.456255  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:03.453469  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:03.457139  6110 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:25:03.450886  5865 catalog_manager.cc:5697] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 3 to 4, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 4 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:03.459347  6042 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 6: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:25:03.457744  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 157108us
I20260709 12:25:03.393565  8770 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.115s
I20260709 12:25:03.454593  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:03.458338  8813 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:03.474222  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:03.465592  8621 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:25:03.485751  8826 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:25:03.466993  8598 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:03.490011  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:03.476698  8754 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:03.486269  8373 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:03.493381  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 84360.8us
W20260709 12:25:03.499289  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 90741.9us
W20260709 12:25:03.592543  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 153696us
I20260709 12:25:03.501102  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:03.502420  8318 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:03.500442  6645 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
W20260709 12:25:03.638351  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.640703  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 321377us
W20260709 12:25:03.575801  8824 log.cc:927] Time spent T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:25:03.504927  8373 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:03.642491  8828 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.239s	user 0.001s	sys 0.000s
W20260709 12:25:03.642973  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 141947us
W20260709 12:25:03.643316  8846 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.167s	user 0.000s	sys 0.000s
I20260709 12:25:03.652287  6608 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:03.643997  8836 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.175s	user 0.000s	sys 0.000s
W20260709 12:25:03.644647  8829 log.cc:927] Time spent T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.189s	user 0.000s	sys 0.001s
W20260709 12:25:03.652209  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 167096us
W20260709 12:25:03.650727  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 348267us
I20260709 12:25:03.658704  8538 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:03.626222  8318 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:03.666095  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:03.665671  6611 leader_election.cc:336] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 2.186s (SENT)
I20260709 12:25:03.672724  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:03.664583  8538 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:03.663710  8318 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:03.666301  8617 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:03.674916  6084 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:03.685197  8373 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:03.685856  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:03.686651  8598 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
W20260709 12:25:03.689019  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.690284  8704 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:03.698685  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:25:03.698879  6009 leader_election.cc:336] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.663s (SENT)
I20260709 12:25:03.699913  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:03.698393  8844 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.181s	user 0.001s	sys 0.000s
I20260709 12:25:03.696025  8528 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:03.710320  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:03.779892  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 87078.2us
I20260709 12:25:03.712497  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:03.710980  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:03.794510  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.717747  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:03.818395  6110 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.817950  6645 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:03.676108  8586 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:03.818760  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:03.820990  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:03.825920  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 163338us
I20260709 12:25:03.828032  5932 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:03.832713  5962 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 6: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:03.832551  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:03.834436  8840 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:03.834898  8840 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:03.835278  8840 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:03.838812  8843 raft_consensus.cc:2764] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election decision vote started in defunct term 4: won
I20260709 12:25:03.709430  8617 raft_consensus.cc:697] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:03.820910  8528 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:03.706763  8845 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:03.853232  8617 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:03.711045  8538 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:03.857784  8843 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:03.858636  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 159780us
I20260709 12:25:03.840528  8830 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:03.861766  6110 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:03.866329  6645 raft_consensus.cc:2410] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 6 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
W20260709 12:25:03.867607  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.869460  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:03.869884  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.868031  8845 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:03.877209  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 64629.3us
W20260709 12:25:03.882519  8839 log.cc:927] Time spent T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.405s	user 0.001s	sys 0.001s
I20260709 12:25:03.885218  5934 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:03.874426  6115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:03.887756  6115 raft_consensus.cc:606] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:03.888157  6115 raft_consensus.cc:614] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:03.889704  8843 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:03.894613  8845 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:03.895496  6009 leader_election.cc:336] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.711s (SENT)
W20260709 12:25:03.896641  6009 leader_election.cc:336] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.740s (SENT)
I20260709 12:25:03.897032  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:03.897974  8830 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:03.900019  8756 consensus_meta.cc:287] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.622s	user 0.007s	sys 0.002s
I20260709 12:25:03.914356  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:03.928443  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 49166us
I20260709 12:25:03.932632  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:03.934319  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:03.938449  6009 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:03.913194  8813 consensus_queue.cc:1059] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.030s
I20260709 12:25:03.943490  6082 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:03.946635  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 118699us
I20260709 12:25:03.947654  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:03.944080  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:03.944182  6042 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:03.947674  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:03.965214  6041 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:03.936467  8830 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:03.967276  6044 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:25:03.944255  8858 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:03.977144  6042 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:03.944408  8817 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:03.979805  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:03.980675  6041 raft_consensus.cc:2368] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5.
I20260709 12:25:03.995095  6044 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:25:03.994673  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:03.942446  8840 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:03.997336  6042 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:25:03.996423  5932 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:03.936697  8528 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:03.948318  8845 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.003489  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:03.989907  8861 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.005789  6036 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:04.009934  6042 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:25:04.011098  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 69380.6us
I20260709 12:25:04.011180  6044 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:04.015404  6036 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:04.015826  6036 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:04.007045  8813 raft_consensus.cc:3055] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:03.975823  8830 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:03.998811  8817 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.013s
I20260709 12:25:03.999589  8318 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.026350  6044 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:25:03.983325  8858 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.011274  8586 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:04.019833  8813 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:04.041678  8845 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:04.036545  6009 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:04.039481  6036 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:04.066320  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 83247.3us
I20260709 12:25:04.075341  6036 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:04.075189  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:04.076555  6642 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:04.080255  6611 leader_election.cc:336] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.617s (SENT)
I20260709 12:25:04.052862  8869 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:04.082971  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 51665.1us
W20260709 12:25:04.083942  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.088129  8869 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:04.089725  8863 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
I20260709 12:25:04.091077  8840 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:04.098340  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:04.099499  8830 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:04.099530  8765 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:04.073899  8762 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:04.104857  6611 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:04.105996  8765 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.110637  8395 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:04.112885  8858 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:04.116993  8318 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:04.119432  8856 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.135s	user 0.001s	sys 0.000s
I20260709 12:25:04.081849  8845 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:04.121639  8845 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:04.122207  8845 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:04.123730  8853 log.cc:927] Time spent T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.303s	user 0.002s	sys 0.000s
I20260709 12:25:04.079509  8868 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:04.127170  8868 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:04.128460  8869 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:04.128279  8868 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:04.132076  8837 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.646s	user 0.003s	sys 0.000s
I20260709 12:25:04.138386  6642 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:04.141348  6042 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:04.145149  6040 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:04.150583  6611 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:04.132912  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 57735.4us
I20260709 12:25:04.169394  6649 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:04.169706  6084 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:04.172444  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:04.173472  6115 raft_consensus.cc:2393] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:04.150426  8765 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:04.182781  5932 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:25:04.186553  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.188795  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 241244us
I20260709 12:25:04.189881  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:04.194505  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:04.194676  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.190565  8770 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.010s	sys 0.018s
W20260709 12:25:04.199481  8770 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.722s	user 0.010s	sys 0.019s
I20260709 12:25:04.192502  8325 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:04.205958  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:04.192442  8756 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:04.209370  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:04.183993  8845 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:04.200757  8754 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:25:04.222056  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 114447us
I20260709 12:25:04.224908  6036 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:04.226405  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:04.206666  8861 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:04.208423  6646 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:04.206847  8874 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:04.147244  8813 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.236056  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:04.237046  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:04.234264  8834 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.720s	user 0.004s	sys 0.010s
I20260709 12:25:04.198693  8762 consensus_queue.cc:1059] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:25:04.260366  6651 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 6: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:04.246975  8873 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:04.248202  5932 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:04.249022  8858 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:04.273986  8754 raft_consensus.cc:697] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:04.252581  6645 raft_consensus.cc:2393] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:04.275121  8754 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.277477  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:04.252445  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:04.229266  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:04.231042  8756 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:25:04.258962  8834 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.769s	user 0.005s	sys 0.010s
W20260709 12:25:04.279217  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 70520.2us
I20260709 12:25:04.250844  8373 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:04.280284  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:04.283349  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 54163.7us
I20260709 12:25:04.274226  8858 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:04.259395  8861 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:04.286835  5932 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:04.283808  8584 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:04.288726  8881 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:04.286566  8873 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:04.291472  8618 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:04.293606  8618 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:25:04.294659  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 68318.2us
I20260709 12:25:04.295370  6611 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:04.284775  8874 raft_consensus.cc:3055] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:04.295945  8874 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:04.296823  8874 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:04.297565  6009 leader_election.cc:336] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.921s (SENT)
I20260709 12:25:04.298178  6009 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:04.259773  8843 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.028s
I20260709 12:25:04.285204  8813 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.311347  8756 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.313506  8868 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:04.305958  8840 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:04.315044  8840 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:04.315375  8845 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:04.315510  8840 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.296844  8762 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:25:04.317700  6115 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:04.314658  6113 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.302911  8874 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:04.329330  8858 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:04.332000  8861 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:04.344698  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 57931.6us
I20260709 12:25:04.345834  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:04.323448  8618 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election won for term 5
W20260709 12:25:04.353932  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 58624.4us
I20260709 12:25:04.366889  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:04.367827  5967 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:04.362272  8111 consensus_queue.cc:1059] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:25:04.369804  8598 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:04.370492  8111 raft_consensus.cc:3055] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:04.370922  8111 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:04.372175  8111 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.373612  8111 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.362237  8744 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.375497  8744 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:04.378597  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.379230  8744 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:04.380247  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.381520  6036 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:04.383358  6609 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:25:04.384584  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.385629  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 101636us
I20260709 12:25:04.386886  6082 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:25:04.390496  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.392700  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 46961.7us
W20260709 12:25:04.398111  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 100570us
I20260709 12:25:04.399652  6082 leader_election.cc:400] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5.
I20260709 12:25:04.399996  6082 leader_election.cc:403] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Cancelling election due to peer responding with higher term
I20260709 12:25:04.399263  8618 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:25:04.404081  6009 leader_election.cc:336] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.921s (SENT)
I20260709 12:25:04.405378  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:04.404318  8618 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.413506  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.414194  5959 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:04.396535  8703 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:04.419291  8703 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.419679  8703 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:04.421696  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 66237.6us
I20260709 12:25:04.397238  8883 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:04.427444  8868 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:04.434208  8840 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.435708  5961 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:04.428364  8883 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:04.438647  8883 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:04.439973  8840 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:04.443202  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:04.445261  8522 consensus_queue.cc:1059] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:25:04.445744  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.428732  8845 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election lost for term 4. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5.
I20260709 12:25:04.446408  8522 raft_consensus.cc:3055] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:04.446833  8522 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:04.447299  8843 raft_consensus.cc:1064] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:25:04.447583  8598 raft_consensus.cc:1064] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:25:04.446229  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:04.447732  8522 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.445833  8834 raft_consensus.cc:1064] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:25:04.449873  8843 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.454442  8439 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.455264  8704 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.455044  8439 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.455721  8704 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:04.458004  8704 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:04.362185  8584 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.051s
I20260709 12:25:04.471851  5967 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:25:04.473431  6113 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:25:04.474006  6113 pending_rounds.cc:85] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 5
I20260709 12:25:04.474288  6113 pending_rounds.cc:107] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:25:04.474509  6113 raft_consensus.cc:2889] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:04.457392  8439 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:04.449330  8522 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.479867  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:04.481791  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:04.484267  6113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 2263) took 1200 ms. Trace:
I20260709 12:25:04.484771  6113 rpcz_store.cc:276] 0709 12:25:03.278387 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:03.280218 (+  1831us) service_pool.cc:224] Handling call
0709 12:25:03.280554 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:03.722413 (+441859us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b58006101d0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fb00aa 00007f4821032447 00007f482104afe7 00007f482104c7de 00007f4821056b49 00007f4821057416 00007f4821053d8f 00007f482105383e 00007f4826018419 00007f481f58fbd4
0709 12:25:04.314488 (+592075us) spinlock_profiling.cc:243] Waited 407 ms on lock 0x7b5400085aa0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fc9a1d 00007f4820fb01a4 00007f4821032447 00007f482104afe7 00007f482104c7de 00007f4821056b49 00007f4821057416 00007f4821053d8f 00007f482105383e 00007f4826018419
0709 12:25:04.478672 (+164184us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:04.478867 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1608447488}
W20260709 12:25:04.490054  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 86022.6us
I20260709 12:25:04.478791  8845 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:04.495374  8882 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:04.495559  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.507458  5959 raft_consensus.cc:2410] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:04.502712  8762 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20260709 12:25:04.504211  6009 leader_election.cc:336] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.946s (SENT)
I20260709 12:25:04.508232  6009 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:04.484755  8439 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:04.524272  5961 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:04.525696  5962 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:04.530427  8882 raft_consensus.cc:697] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:04.478645  8770 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.033s
I20260709 12:25:04.475389  8875 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.038s
I20260709 12:25:04.506934  8845 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.548390  5959 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 1. Current term is 2. Ops: []
I20260709 12:25:04.550060  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:04.555395  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:04.560878  6113 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.565930  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.565462  5967 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 2. Current term is 3. Ops: [2.2-2.2]
I20260709 12:25:04.486528  8873 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.051s
W20260709 12:25:04.616952  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.576284  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.565457  8744 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:25:04.585294  8882 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.538250  8868 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.586491  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:04.588023  6645 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEARNER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20260709 12:25:04.565935  8845 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:04.589452  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 85285.8us
W20260709 12:25:04.592751  8834 raft_consensus.cc:1068] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Unable to promote non-voter 24012af7747d4c4ea89c3da2ff950099: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }.
  Pending config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.610737  6113 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:04.614670  8865 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.128s
I20260709 12:25:04.623080  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:04.643122  6112 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:25:04.655210  6039 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:25:04.657514  6039 pending_rounds.cc:85] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 5
I20260709 12:25:04.657807  6039 pending_rounds.cc:107] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:25:04.658085  6039 raft_consensus.cc:2889] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:04.655893  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.662802  6110 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: []
W20260709 12:25:04.664059  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.667388  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.668660  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.668706  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.669915  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.670526  5968 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:04.670540  5964 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5. Ops: [3.5-4.6]
W20260709 12:25:04.671028  8888 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:25:04.671697  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.672644  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.672960  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:04.673486  5965 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:04.674774  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:04.675458  5959 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:04.675525  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.676353  5962 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:04.671419  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.677471  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.678162  5963 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:04.682173  5965 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:04.547124  8439 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:04.721439  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:04.719245  6009 leader_election.cc:336] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.997s (SENT)
I20260709 12:25:04.720593  5934 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:04.727029  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.565127  8746 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.118s
W20260709 12:25:04.732426  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 248448us
I20260709 12:25:04.722090  8452 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.735363  8452 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:04.737468  8452 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:04.742933  8734 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:04.743875  8616 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:04.744305  8616 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:04.744650  8616 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:04.744807  6009 leader_election.cc:336] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 2.028s (SENT)
I20260709 12:25:04.743588  8873 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:04.746335  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:04.759320  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.761271  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.762009  6038 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:25:04.777470  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:04.621100  8883 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:04.791632  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.792411  6038 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
W20260709 12:25:04.796142  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 49877.1us
I20260709 12:25:04.775493  8452 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:25:04.786239  8318 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:04.809145  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.809702  8892 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.087s
I20260709 12:25:04.810439  8858 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:04.810879  8858 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:04.812279  6115 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:04.794173  8868 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:04.835748  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.836488  6038 raft_consensus.cc:2376] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4. Re-sending same reply.
W20260709 12:25:04.837157  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.838665  6009 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:04.855512  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:04.857990  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:04.844609  8813 raft_consensus.cc:2764] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election decision vote started in defunct term 2: won
I20260709 12:25:04.859071  8813 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:04.859846  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.861378  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.861619  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.862022  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.862656  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.862928  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.863329  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.864033  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.864342  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.864687  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.865386  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.871290  8703 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.865790  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.871212  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.866310  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:04.873792  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.866689  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:04.866990  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:04.875193  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.875533  6037 raft_consensus.cc:2376] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4. Re-sending same reply.
I20260709 12:25:04.875916  5964 raft_consensus.cc:2410] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 7 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:04.874966  5959 raft_consensus.cc:2376] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6. Re-sending same reply.
I20260709 12:25:04.877429  5968 raft_consensus.cc:2393] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:25:04.876816  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.873623  8703 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:04.883780  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.884358  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.814680  8318 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.885249  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.814230  8858 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:04.889407  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:04.890431  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.890671  5967 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:04.891455  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.897087  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:04.896543  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.897826  6036 raft_consensus.cc:2376] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4. Re-sending same reply.
I20260709 12:25:04.885281  8868 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:04.902993  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:04.905627  6043 raft_consensus.cc:2376] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6. Re-sending same reply.
I20260709 12:25:04.906204  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.906843  6036 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:04.908664  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.903649  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.909309  6043 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:04.904166  5965 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:04.904692  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.910905  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:04.911300  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 53375.6us
I20260709 12:25:04.913609  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.912012  6038 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:04.915023  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.915899  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:04.899653  8858 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:04.919721  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:04.920136  6036 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:04.920707  6037 raft_consensus.cc:2376] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5. Re-sending same reply.
I20260709 12:25:04.924860  6649 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:04.925014  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.927264  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.930104  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.951156  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:04.951855  5959 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:04.952189  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.950289  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.952781  6038 raft_consensus.cc:2376] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6. Re-sending same reply.
I20260709 12:25:04.951617  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.953955  6037 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:25:04.954267  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:04.953974  5965 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:04.955011  6043 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:25:04.913817  5853 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ec584257f9db451c965f6b092aa9069c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0069e2ba1f02412e8e1d6c20a1fb510f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:04.958282  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.959281  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:04.958375  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 270118us
I20260709 12:25:04.959775  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:04.960747  6037 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:04.961715  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.948792  8439 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:04.963967  5853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52932.8us
I20260709 12:25:04.971560  8616 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:04.972893  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.960433  8900 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:25:04.979674  5960 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 5. Current term is 6. Ops: []
W20260709 12:25:04.984006  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:04.979947  5959 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:04.980402  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:04.980479  5961 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:04.982788  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:04.986259  6042 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:04.987497  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:04.987725  5968 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: [3.5-3.5]
I20260709 12:25:05.007602  8318 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:05.008924  8813 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:05.010123  6037 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:04.985378  8873 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:05.012912  8873 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:05.013484  8845 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:05.017575  6117 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: [3.3-3.3]
I20260709 12:25:05.015138  8873 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:05.015566  5963 raft_consensus.cc:2368] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5.
I20260709 12:25:04.981539  8756 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:05.024199  8756 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:04.972885  8883 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:05.033279  5968 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:05.034045  5963 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:05.035516  5968 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:25:05.036746  5967 raft_consensus.cc:2410] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:25:05.038450  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.046365  6036 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:25:05.052137  6115 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:05.056401  6112 pending_rounds.cc:85] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 4
I20260709 12:25:05.056813  6112 pending_rounds.cc:107] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 4.5
I20260709 12:25:05.057073  6112 raft_consensus.cc:2889] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:05.059764  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:05.026286  8756 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:05.033176  8598 raft_consensus.cc:1068] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Unable to promote non-voter 24012af7747d4c4ea89c3da2ff950099: Illegal state: RaftConfig change currently pending. Only one is allowed at a time.
  Committed config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }.
  Pending config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:05.119230  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.110201  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.081765  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.108042  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.094117  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.075047  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:05.092010  5964 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:05.091560  6111 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:05.079532  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.127092  6113 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 6: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:05.064528  6117 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
W20260709 12:25:05.082682  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.096701  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:05.080540  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.083909  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.131426  6110 raft_consensus.cc:2376] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6. Re-sending same reply.
I20260709 12:25:05.166328  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:05.164933  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.164680  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:05.159396  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.169915  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.075047  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.169109  6037 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.131894  5961 raft_consensus.cc:2393] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:25:05.133293  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 145866us
I20260709 12:25:05.150188  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.172328  6111 raft_consensus.cc:2393] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:05.166905  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.035782  8845 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:05.016876  8616 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:05.164012  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.167722  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.173004  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:05.178453  6117 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:05.179284  6117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:05.179904  6117 raft_consensus.cc:606] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:05.175647  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.177856  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.178591  6043 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:05.173842  6113 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:05.184305  6037 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:05.185464  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:05.179055  6115 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:05.189107  6037 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:25:05.189795  6611 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.191080  6117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:35576
I20260709 12:25:05.191723  6117 raft_consensus.cc:606] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Received request to transfer leadership
I20260709 12:25:05.192054  6117 raft_consensus.cc:614] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:05.186872  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:05.200169  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.203240  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.062134  8865 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.206126  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:05.116899  6644 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:05.207998  6115 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:25:05.210191  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:05.212656  6115 pending_rounds.cc:85] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 7
I20260709 12:25:05.212865  6036 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:05.213004  6115 pending_rounds.cc:107] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:25:05.213337  6115 raft_consensus.cc:2889] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:05.214617  6009 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.205415  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.210903  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.216413  5963 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:05.098105  8765 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.090s
I20260709 12:25:05.216785  6043 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:05.227838  6036 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:05.232969  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:05.236739  6609 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:05.239296  6043 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
W20260709 12:25:05.240809  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 71525.2us
I20260709 12:25:05.216729  8318 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:05.243860  5963 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:05.245085  6082 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.231565  8868 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:05.215854  8617 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:25:05.212507  8865 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:05.250774  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:05.255906  5963 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:05.240752  8538 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:05.248322  8845 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:05.270834  8845 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:05.271250  8845 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:05.273792  6115 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:05.275444  6111 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:05.255584  8914 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:05.260099  6081 leader_election.cc:336] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.758s (SENT)
I20260709 12:25:05.264524  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.280210  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.265389  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:05.285504  8538 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:05.286301  8865 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:05.267906  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.287088  8905 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:05.287891  6611 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.288468  6009 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:05.288890  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.270434  6118 raft_consensus.cc:2410] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 8 because replica has last-logged OpId of term: 6 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 5.
I20260709 12:25:05.289341  8914 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:05.289793  8868 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:05.288996  8905 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:05.290360  8538 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:05.290283  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.324191  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.330706  6115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1138b447c084c17ab4b465255e54118"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:05.331382  6115 raft_consensus.cc:606] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:05.331764  6115 raft_consensus.cc:614] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:05.333405  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.335566  8617 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:25:05.345309  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.350175  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.311138  8865 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:05.350371  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.357488  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 68641.5us
I20260709 12:25:05.358490  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.324082  8868 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:05.360500  6006 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:05.370246  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 131133us
I20260709 12:25:05.354725  8914 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:05.362720  8865 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:05.363850  8813 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:05.333808  8913 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:05.368249  8762 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:05.419811  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:05.424343  5960 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:05.420697  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.373754  8858 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.362602  8873 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.028s
I20260709 12:25:05.362414  8887 consensus_queue.cc:1059] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:25:05.364332  8900 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:25:05.366128  8111 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.031s
I20260709 12:25:05.363253  8756 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:25:05.372196  8744 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:25:05.375496  8868 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:05.427337  5964 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:05.425271  5968 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:05.432116  6118 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:05.426522  6115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adcfbfcb66fd4891959337c005335841"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:05.442951  6115 raft_consensus.cc:606] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:05.443338  6115 raft_consensus.cc:614] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:05.366353  8707 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:25:05.427917  8754 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:05.463541  8922 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
W20260709 12:25:05.464454  5865 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 190) took 12200 ms (client timeout 15000 ms). Trace:
I20260709 12:25:05.440317  8913 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.029s
W20260709 12:25:05.465649  5914 auto_rebalancer.cc:893] Removing replace marker failed: Replica 0069e2ba1f02412e8e1d6c20a1fb510f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 4 committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
W20260709 12:25:05.466089  5914 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
W20260709 12:25:05.466361  5914 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:25:05.469154  8865 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:05.470775  8754 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:05.462170  8845 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:05.471637  8449 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.429639  8312 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:25:05.476910  5962 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:05.480026  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:05.473309  8845 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:05.470242  8900 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:05.493148  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 130020us
I20260709 12:25:05.497996  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:05.501350  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:05.502008  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 141566us
I20260709 12:25:05.451429  8858 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:05.498147  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.473110  8754 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:05.520124  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 138556us
I20260709 12:25:05.524281  8887 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:05.530478  6118 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:05.534416  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.536491  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:05.545585  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.546057  6113 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:05.464864  5865 rpcz_store.cc:269] 0709 12:24:53.263719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.263862 (+   143us) service_pool.cc:224] Handling call
0709 12:24:53.483768 (+219906us) spinlock_profiling.cc:243] Waited 188 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:25:05.464391 (+11980623us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:03.879881 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:03.880593 (+   712us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:03.880647 (+    54us) write_op.cc:435] Acquired schema lock
0709 12:25:03.880667 (+    20us) tablet.cc:662] Decoding operations
0709 12:25:03.881559 (+   892us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:03.881635 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:03.881662 (+    27us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:25:03.882430 (+   768us) tablet.cc:701] Row locks acquired
0709 12:25:03.907599 (+ 25169us) write_op.cc:260] PREPARE: finished
0709 12:25:03.937079 (+ 29480us) write_op.cc:270] Start()
0709 12:25:03.942682 (+  5603us) write_op.cc:276] Timestamp: P: 1783599903929740 usec, L: 0
0709 12:25:03.942712 (+    30us) op_driver.cc:348] REPLICATION: starting
0709 12:25:03.943484 (+   772us) log.cc:844] Serialized 2876 byte log entry
0709 12:25:04.297654 (+354170us) op_driver.cc:464] REPLICATION: finished
0709 12:25:04.459357 (+161703us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b1800061960. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:25:04.459538 (+   181us) write_op.cc:301] APPLY: starting
0709 12:25:04.459650 (+   112us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:04.459874 (+   224us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:04.459905 (+    31us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:04.650534 (+190629us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:04.650834 (+   300us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:25:04.650882 (+    48us) write_op.cc:312] APPLY: finished
0709 12:25:04.651182 (+   300us) log.cc:844] Serialized 59 byte log entry
0709 12:25:04.651385 (+   203us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:04.651518 (+   133us) write_op.cc:454] Released schema lock
0709 12:25:04.651585 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:04.653654 (+  2069us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:04.653690 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":22,"spinlock_wait_cycles":433369856,"child_traces":[["op",{"apply.queue_time_us":99913,"apply.run_cpu_time_us":7108,"apply.run_wall_time_us":194044,"num_ops":7,"prepare.queue_time_us":182491,"prepare.run_cpu_time_us":8205,"prepare.run_wall_time_us":125100,"raft.queue_time_us":151730,"raft.run_cpu_time_us":41268,"raft.run_wall_time_us":85377,"replication_time_us":343626,"spinlock_wait_cycles":3596544,"thread_start_us":334624,"threads_started":4,"wal-append.queue_time_us":87546}]]}
I20260709 12:25:05.543337  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:05.547688  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 49607.3us
I20260709 12:25:05.548662  6081 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.543155  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:05.555142  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:05.557221  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.564740  6113 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:05.568964  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:05.566720  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 62189.5us
I20260709 12:25:05.554661  8756 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.005s
I20260709 12:25:05.502942  8892 consensus_queue.cc:1059] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.057s
I20260709 12:25:05.541525  8586 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:05.575132  6009 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:05.490911  8900 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:05.565011  8584 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.576778  8914 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:05.503373  8616 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.072s
I20260709 12:25:05.581094  8813 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:05.567332  8843 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.472131  8449 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:05.634305  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 45250.9us
W20260709 12:25:05.633414  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 61253.6us
W20260709 12:25:05.638438  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 63393.1us
I20260709 12:25:05.660974  6009 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:05.638782  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 69330.8us
W20260709 12:25:05.640506  8928 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:25:05.641710  8883 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:05.643373  8913 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:05.636395  8373 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:05.645308  8865 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:05.652771  8868 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:05.649904  6110 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 6. (term mismatch)
I20260709 12:25:05.673789  6110 pending_rounds.cc:85] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 5
I20260709 12:25:05.674058  6110 pending_rounds.cc:107] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 6.6
I20260709 12:25:05.674284  6110 raft_consensus.cc:2889] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:05.598135  8621 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.034s
I20260709 12:25:05.676388  8621 consensus_queue.cc:1243] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer f1bb8e63c2b448cdafd51f05d277c741 log is divergent from this leader: its last log entry 2.5 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 4
I20260709 12:25:05.633993  8943 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.678229  8943 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:05.680540  8943 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:05.681339  6118 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:25:05.681605  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:05.656868  8813 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:05.656772  8586 raft_consensus.cc:697] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:05.637332  8939 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.609954  8665 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.079s
W20260709 12:25:05.686924  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 144989us
I20260709 12:25:05.667367  8834 raft_consensus.cc:3055] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:05.670792  8373 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.697050  6110 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:05.671026  8865 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:05.657327  8584 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:05.698930  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:25:05.705833  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 148788us
I20260709 12:25:05.688241  8930 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:05.706801  8943 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:05.685081  8843 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:05.703613  8373 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:05.710985  8929 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:25:05.711323  8892 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:05.712978  8892 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.713246  8586 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:05.716732  6110 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:05.716851  8843 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:05.685976  8813 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:05.724290  8373 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:05.699393  8868 raft_consensus.cc:2764] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:25:05.726413  8373 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:05.730089  8900 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:05.696892  8834 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:05.735060  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:05.737063  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:05.714579  8883 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:05.713442  8892 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:05.743227  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:05.744855  8858 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:05.746138  8449 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:05.747002  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 48143us
I20260709 12:25:05.752368  8944 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:25:05.759375  8665 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.759595  8813 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:05.760757  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:05.761739  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.754609  8900 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.009s
I20260709 12:25:05.765350  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.739229  8868 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:05.765425  8865 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:05.774993  8598 raft_consensus.cc:3055] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:05.792810  8598 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:05.747838  8834 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:05.793946  8834 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:05.793679  8598 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:05.794854  8598 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:05.775053  5960 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:05.780251  6006 leader_election.cc:400] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5.
I20260709 12:25:05.797606  6006 leader_election.cc:403] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:05.693728  8939 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:05.790345  5964 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:05.800207  8584 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:05.800638  8905 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:05.801172  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.802205  8928 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:25:05.803675  8931 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:05.804260  8892 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:05.818907  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.805804  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 144900us
I20260709 12:25:05.819597  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.792040  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.791395  5961 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:05.813199  6037 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:05.807540  8665 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:05.814517  8939 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:05.815022  6644 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 6. (term mismatch)
I20260709 12:25:05.753780  8883 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:05.835119  6009 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.807991  8868 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:05.826942  6644 pending_rounds.cc:85] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 5
I20260709 12:25:05.888135  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:05.900429  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:05.905109  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 113125us
I20260709 12:25:05.905583  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:05.906219  5962 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:05.907182  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:05.909668  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:05.917493  8111 raft_consensus.cc:3055] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:05.917963  8111 raft_consensus.cc:740] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:05.918915  8111 consensus_queue.cc:260] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:05.920104  8111 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:05.924396  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.925812  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.927346  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.936148  5961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:25:05.936337  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.937103  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:05.936771  5961 raft_consensus.cc:606] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:05.901041  6644 pending_rounds.cc:107] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:25:05.876658  8932 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:05.887454  8893 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:05.944742  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:05.884239  8868 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:05.952668  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:05.949153  5964 pending_rounds.cc:85] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 4
I20260709 12:25:05.903971  8628 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:25:05.887303  5853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 58088.5us
I20260709 12:25:05.969599  5964 pending_rounds.cc:107] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 2.5
I20260709 12:25:05.933609  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:05.935803  8887 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:05.951685  6644 raft_consensus.cc:2889] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:05.974934  5964 raft_consensus.cc:2889] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:05.975370  6042 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
W20260709 12:25:05.951829  8941 log.cc:927] Time spent T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:25:05.964524  8946 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.949044  8900 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:05.951678  8947 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
W20260709 12:25:05.980490  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 44231.7us
I20260709 12:25:05.933374  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:05.988530  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:05.974010  8762 raft_consensus.cc:2764] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election decision vote started in defunct term 4: won
I20260709 12:25:05.977269  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:06.019446  6116 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:25:06.026036  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:05.828518  8882 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.114s
I20260709 12:25:06.006803  8932 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:06.042137  8887 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:06.061496  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:06.049688  8944 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:05.977072  8628 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:05.979429  8893 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:06.099146  8905 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:06.099781  8905 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:06.018683  8946 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:06.148638  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.095706  8813 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:06.097409  8944 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:06.174836  5959 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:06.177605  8900 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:06.178150  8900 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:06.189175  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.252153  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 417086us
W20260709 12:25:06.252822  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 245122us
W20260709 12:25:06.259449  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.262403  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.280254  8813 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.284765  5934 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:06.289809  8946 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:06.148023  5863 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 2 to 3, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:06.298202  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.299508  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:06.302153  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 303702us
I20260709 12:25:06.315936  6042 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:06.316527  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:06.257511  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.310251  6082 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:06.318964  8111 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:06.313807  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:06.320958  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:06.321492  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:06.322633  5863 catalog_manager.cc:5697] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 2, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.325842  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:06.326663  5967 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:06.328075  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:06.330799  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:06.334048  8111 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:06.334488  8111 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:06.334846  8111 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:06.335985  6006 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:06.330760  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:06.345700  8111 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:06.367702  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:06.394990  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 84549.5us
I20260709 12:25:06.317283  8665 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:06.317898  8584 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:06.397650  8111 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:06.332653  8914 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:06.412585  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 102423us
W20260709 12:25:06.423900  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.340365  8845 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.347121  8932 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:06.347848  8961 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:06.440373  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 103476us
I20260709 12:25:06.368297  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:06.424218  6082 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:06.441919  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:06.413659  8883 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:06.327422  8813 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:06.340870  8586 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 12:25:06.427332  8974 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:25:06.429061  5863 catalog_manager.cc:5697] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 2 to 3, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 3 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.430775  6644 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:06.431545  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:06.531572  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 163356us
I20260709 12:25:06.531922  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:06.533373  6041 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: [2.3-3.4]
I20260709 12:25:06.432572  8905 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:06.532634  6642 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:06.438227  8628 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:06.434620  8893 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:06.462949  8914 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:06.444936  8584 raft_consensus.cc:697] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:06.470719  8930 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:06.445374  8944 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:06.546075  8883 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:06.537465  8932 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:06.462829  8946 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.132s
I20260709 12:25:06.439000  8845 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
W20260709 12:25:06.599211  8913 consensus_meta.cc:287] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.928s	user 0.012s	sys 0.006s
I20260709 12:25:06.462545  8616 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.132s
I20260709 12:25:06.624293  6041 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
W20260709 12:25:06.596189  8834 consensus_meta.cc:287] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.802s	user 0.019s	sys 0.000s
I20260709 12:25:06.605969  8939 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:06.551723  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 85894.6us
W20260709 12:25:06.602021  8598 consensus_meta.cc:287] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.807s	user 0.010s	sys 0.007s
I20260709 12:25:06.618450  5863 catalog_manager.cc:5697] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 4 to 5, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 5 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.637128  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:06.638475  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 196603us
W20260709 12:25:06.639431  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 100171us
I20260709 12:25:06.644034  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:06.599918  8930 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:06.645102  6116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 451) took 1572 ms (client timeout 1879 ms). Trace:
W20260709 12:25:06.656757  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 184228us
I20260709 12:25:06.604274  8893 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
W20260709 12:25:06.664530  6116 rpcz_store.cc:269] 0709 12:25:05.059113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.059246 (+   133us) service_pool.cc:224] Handling call
0709 12:25:05.734918 (+675672us) spinlock_profiling.cc:243] Waited 1.6 ms on lock 0x7b5800167d98. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482601a0a0 00007f4826019984 00007f481f5946d4 00007f481f594662
0709 12:25:06.631400 (+896482us) spinlock_profiling.cc:243] Waited 69.8 ms on lock 0x7b54001b9254. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:06.631536 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":164163200}
W20260709 12:25:06.669423  5962 consensus_meta.cc:287] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.735s	user 0.012s	sys 0.006s
I20260709 12:25:06.667485  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:06.687299  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:06.687999  6115 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:06.689589  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:06.690706  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:06.691120  6112 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:06.690760  5962 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:06.692521  5961 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:06.628968  8913 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:06.690217  6109 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:25:06.655566  8930 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.701264  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:06.690529  8868 consensus_meta.cc:287] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.699s	user 0.012s	sys 0.011s
I20260709 12:25:06.619208  8932 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:06.707557  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:06.703250  5863 catalog_manager.cc:5697] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 2, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:06.702275  8967 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
W20260709 12:25:06.702122  8976 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.242s	user 0.001s	sys 0.000s
I20260709 12:25:06.689060  8616 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:06.719062  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.702231  8955 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
I20260709 12:25:06.698541  8887 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:25:06.727792  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:06.729705  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.702399  8963 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:06.646647  8939 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:06.730580  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 44104.1us
W20260709 12:25:06.720861  8931 consensus_meta.cc:287] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.901s	user 0.006s	sys 0.013s
I20260709 12:25:06.732705  5863 catalog_manager.cc:5697] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 3 to 4, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 4 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.733666  6041 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:25:06.734774  8963 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:06.739281  8845 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:06.740865  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:06.695281  8584 consensus_queue.cc:237] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:06.734716  8813 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:06.752139  5863 catalog_manager.cc:5697] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 1 to 2, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 2 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:06.730041  8887 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:06.745343  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:06.758975  5962 raft_consensus.cc:2410] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 5 because replica has last-logged OpId of term: 3 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 4.
I20260709 12:25:06.732112  6609 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:06.697225  8858 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:25:06.750902  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:06.752444  5934 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:06.759843  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:06.713980  8868 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:06.773000  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.773375  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:06.785346  6041 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: [4.3-4.3]
I20260709 12:25:06.754190  8931 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5.
I20260709 12:25:06.786952  8986 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:06.787539  8986 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.787914  8986 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.788981  6036 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
W20260709 12:25:06.766858  8900 consensus_meta.cc:287] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.588s	user 0.010s	sys 0.005s
I20260709 12:25:06.757593  8887 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:06.762759  8936 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:06.765368  8845 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:06.804821  6040 raft_consensus.cc:2368] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5.
I20260709 12:25:06.775905  8628 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:06.813665  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1644) took 1053 ms. Trace:
I20260709 12:25:06.814097  5965 rpcz_store.cc:276] 0709 12:25:05.760692 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.762239 (+  1547us) service_pool.cc:224] Handling call
0709 12:25:05.762592 (+   353us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:05.773505 (+ 10913us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:05.773533 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:05.774208 (+   675us) log.cc:844] Serialized 52 byte log entry
0709 12:25:06.023579 (+249371us) raft_consensus.cc:1645] Marking committed up to 1
0709 12:25:06.023625 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.023697 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:06.813436 (+789739us) raft_consensus.cc:1685] finished
0709 12:25:06.813455 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.813588 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10492,"raft.queue_time_us":10607,"raft.run_cpu_time_us":68,"raft.run_wall_time_us":68,"thread_start_us":248959,"threads_started":1,"wal-append.queue_time_us":510778}
I20260709 12:25:06.782636  8813 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:06.816087  8813 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:06.818039  8986 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:06.818733  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:06.820194  8986 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:06.790337  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:06.823850  6646 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:25:06.824692  8628 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.804064  8449 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.021s
I20260709 12:25:06.825206  8628 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.825766  6037 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 5. Ops: []
W20260709 12:25:06.827104  8978 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:25:06.835369  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:06.805645  8845 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:06.836810  8845 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.816215  8963 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:06.841946  8111 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:06.859062  8111 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:06.851004  6036 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
W20260709 12:25:06.865563  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 83842.1us
W20260709 12:25:06.867130  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.878726  8932 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:06.804152  8936 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.883448  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:06.898805  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:06.881649  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.903577  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:06.907610  6042 raft_consensus.cc:2393] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 4: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:06.818092  8813 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:06.915030  8312 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:06.804430  8900 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:06.926759  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:06.927218  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:06.918857  8986 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:06.928021  8986 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:06.928387  8868 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:06.928884  5968 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:06.928401  8986 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:06.930853  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:06.935631  8865 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:06.942612  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 135023us
I20260709 12:25:06.944222  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:06.945883  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:06.866283  8621 consensus_queue.cc:1059] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.080s
I20260709 12:25:06.947436  8882 raft_consensus.cc:3055] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:06.947814  8882 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:06.948824  8882 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:06.950040  8914 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:06.927378  6116 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.950220  8882 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:06.951520  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 549) took 1049 ms. Trace:
I20260709 12:25:06.879889  8522 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:06.922652  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:06.924016  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:06.970927  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:06.959556  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:06.981220  5962 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:06.978253  6082 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:06.981537  6041 raft_consensus.cc:2410] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:25:06.982722  8111 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:06.983153  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:06.983943  6041 raft_consensus.cc:2410] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 7 because replica has last-logged OpId of term: 6 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 4.
I20260709 12:25:06.984752  6039 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:06.903208  8936 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:06.987079  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:06.995577  6035 raft_consensus.cc:2410] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:25:06.973577  5964 rpcz_store.cc:276] 0709 12:25:05.901893 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.904400 (+  2507us) service_pool.cc:224] Handling call
0709 12:25:05.948958 (+ 44558us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:06.031092 (+ 82134us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:06.031122 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:06.269181 (+238059us) log.cc:844] Serialized 52 byte log entry
0709 12:25:06.617612 (+348431us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:06.647484 (+ 29872us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.647721 (+   237us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.647787 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:06.935812 (+288025us) spinlock_profiling.cc:243] Waited 21.4 ms on lock 0x7b4800080058. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4825f7daa1 00007f4825f74b37 00007f4825f749ca 00007f482606c26f 00007f482606bf37 00007f482608055c 00007f4826080508 00007f4826080488 00007f4826080443 00007f482607f6ec 00007f4824fa9a96
0709 12:25:06.951187 (+ 15375us) raft_consensus.cc:1685] finished
0709 12:25:06.951294 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:06.951460 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22838,"prepare.queue_time_us":29553,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":19270,"raft.run_cpu_time_us":2447,"raft.run_wall_time_us":293477,"spinlock_wait_cycles":49254144,"thread_start_us":276821,"threads_started":1,"wal-append.queue_time_us":421056}
I20260709 12:25:06.934000  8628 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:07.002991  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:07.004761  5962 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:07.007586  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:06.989727  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:07.048085  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:07.049222  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:07.049908  5959 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:25:06.996753  8312 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:07.080876  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:07.083305  6036 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:07.057291  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:07.087059  6044 raft_consensus.cc:2410] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 4 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:25:07.082327  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 74831.2us
I20260709 12:25:06.983927  8868 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:06.990398  8931 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:07.095882  6116 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
W20260709 12:25:07.110400  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 114323us
I20260709 12:25:07.003425  8949 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:07.128834  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:06.997650  8873 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:07.172832  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:07.095813  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:06.983685  8961 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.106s
I20260709 12:25:07.181311  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:07.165525  6111 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: []
W20260709 12:25:07.178376  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 46963.1us
I20260709 12:25:07.174926  6039 raft_consensus.cc:2376] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5. Re-sending same reply.
I20260709 12:25:07.183068  5934 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:07.184100  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:07.177809  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:07.090173  8980 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.362s	user 0.000s	sys 0.001s
I20260709 12:25:07.202392  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1643) took 1442 ms. Trace:
I20260709 12:25:07.202836  5963 rpcz_store.cc:276] 0709 12:25:05.760404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.761214 (+   810us) service_pool.cc:224] Handling call
0709 12:25:05.761538 (+   324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:05.817172 (+ 55634us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:05.817203 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:05.825512 (+  8309us) log.cc:844] Serialized 26 byte log entry
0709 12:25:06.277563 (+452051us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:06.278201 (+   638us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.194903 (+916702us) spinlock_profiling.cc:243] Waited 29.3 ms on lock 0x7b54002f1554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:07.194952 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:07.195005 (+    53us) raft_consensus.cc:1685] finished
0709 12:25:07.195019 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.202326 (+  7307us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":16320,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":3613,"spinlock_wait_cycles":67437312,"thread_start_us":344612,"threads_started":1,"wal-append.queue_time_us":407397}
I20260709 12:25:07.205364  8986 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:07.053581  8845 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:06.998169  8522 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:07.238755  6044 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:07.210583  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:07.240356  6036 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:07.089557  8813 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:07.213137  6039 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:07.088927  8914 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:07.088908  8913 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:07.164361  8932 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:07.215423  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 116708us
I20260709 12:25:07.135313  8883 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:25:07.199817  8967 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:25:07.200330  8893 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:25:07.249207  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 271013us
I20260709 12:25:07.126343  8618 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.111s
W20260709 12:25:07.257263  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.299537  6646 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:07.134498  8868 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:07.217324  8959 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:25:07.297298  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.302400  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 652) took 1008 ms. Trace:
I20260709 12:25:07.302474  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:07.239990  8961 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:07.336244  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.309731  6043 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:07.336890  6038 rpcz_store.cc:276] 0709 12:25:06.294122 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.294274 (+   152us) service_pool.cc:224] Handling call
0709 12:25:06.294600 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:06.296258 (+  1658us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:06.296287 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:06.296713 (+   426us) log.cc:844] Serialized 26 byte log entry
0709 12:25:06.465266 (+168553us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:06.465313 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.465385 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:07.302172 (+836787us) raft_consensus.cc:1685] finished
0709 12:25:07.302196 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:07.302333 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":805,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":10077,"thread_start_us":168265,"threads_started":1,"wal-append.queue_time_us":393736}
I20260709 12:25:07.252068  8946 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.098s
I20260709 12:25:07.301779  8756 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:07.347224  8756 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:07.349507  8756 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:07.351583  8986 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:07.351845  8883 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:07.323625  8932 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:07.298822  8312 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:07.353353  6037 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:07.355517  6041 raft_consensus.cc:2410] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 6 because replica has last-logged OpId of term: 5 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:25:07.361352  6036 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
W20260709 12:25:07.363567  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 190945us
W20260709 12:25:07.376377  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.339650  8959 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:07.338284  8893 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:25:07.368703  8930 consensus_meta.cc:287] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.635s	user 0.006s	sys 0.002s
W20260709 12:25:07.397790  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 100539us
I20260709 12:25:07.399443  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:07.401907  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:07.407464  6043 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:07.295411  8813 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:07.413455  8991 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.279s	user 0.001s	sys 0.000s
I20260709 12:25:07.412627  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:07.415278  6118 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:07.417272  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:07.408728  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 230969us
I20260709 12:25:07.164830  8931 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:07.199347  8887 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:07.419987  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 235973us
I20260709 12:25:07.420446  6082 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:07.419607  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 78946.6us
I20260709 12:25:07.323130  8913 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:07.200318  8949 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:07.412734  8961 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:07.397378  8930 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:07.409974  8944 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:07.441226  6043 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:07.393651  8939 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:07.444378  6111 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:07.418080  9002 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:07.455794  6118 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:07.419806  8628 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:07.479954  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.482357  6042 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:25:07.494704  6115 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
W20260709 12:25:07.503917  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 82808.8us
I20260709 12:25:07.506880  6609 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:25:07.532655  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.503008  8939 raft_consensus.cc:2764] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election decision vote started in defunct term 5: won
W20260709 12:25:07.542586  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 97655.6us
W20260709 12:25:07.544282  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 123914us
I20260709 12:25:07.550536  6082 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:07.495694  9013 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:07.530652  8845 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:07.457432  8893 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:07.458060  8961 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:07.596833  8522 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:07.542512  9011 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:07.437252  8959 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:07.604316  8762 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:07.608397  8762 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:07.608687  8887 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:07.609920  8887 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:07.610631  9016 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:07.611301  8900 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:07.611178  9016 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:07.486634  9002 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:07.590022  9006 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:07.593741  8932 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:07.608791  8762 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:07.633687  8882 consensus_meta.cc:287] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.649s	user 0.006s	sys 0.002s
I20260709 12:25:07.590950  9013 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:07.644327  9013 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:07.639555  8813 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:07.641312  8930 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:07.645146  8865 consensus_meta.cc:287] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.709s	user 0.011s	sys 0.000s
I20260709 12:25:07.645892  8883 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.646210  8913 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:07.646430  8883 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:07.648823  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 142020us
W20260709 12:25:07.650512  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 100093us
I20260709 12:25:07.651261  6082 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:07.625133  9006 raft_consensus.cc:697] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:07.677999  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:07.678755  6037 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:07.680624  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:07.681246  6649 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:25:07.684477  8762 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:07.688024  9028 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.081s
I20260709 12:25:07.691898  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:07.700572  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:07.702056  6040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1569) took 1807 ms (client timeout 1890 ms). Trace:
W20260709 12:25:07.702495  6040 rpcz_store.cc:269] 0709 12:25:05.887661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.887864 (+   203us) service_pool.cc:224] Handling call
0709 12:25:07.695206 (+1807342us) spinlock_profiling.cc:243] Waited 916 ms on lock 0x7b540030ded4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:07.695338 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2106380672}
W20260709 12:25:07.751358  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 48735.2us
I20260709 12:25:07.752477  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:07.670365  9016 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:07.767486  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:07.615366  9011 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:07.781689  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:07.783282  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:07.719856  8931 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:07.786285  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:07.792976  6043 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:07.793787  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:07.787833  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:07.749596  8865 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:07.784988  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:07.792117  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:07.795177  6040 raft_consensus.cc:2393] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 6: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:07.751780  9002 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:07.812373  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:07.765084  8949 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:07.790266  9016 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:07.829347  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.789767  8900 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:07.857656  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 61742us
I20260709 12:25:07.832015  8865 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:07.852291  9006 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:07.863555  8865 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:07.864246  9011 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:07.850818  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 60672.7us
W20260709 12:25:07.859994  9018 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.261s	user 0.000s	sys 0.002s
I20260709 12:25:07.893011  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:07.895212  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:07.897531  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:07.942245  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:07.952064  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:07.960654  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:07.981640  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 91963.2us
I20260709 12:25:07.872125  9012 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:07.983121  9003 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.271s	user 0.004s	sys 0.000s
I20260709 12:25:07.906694  8931 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:07.906975  9027 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:07.997959  8914 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.659s	user 0.061s	sys 0.070s
I20260709 12:25:08.007910  9031 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:07.995218  8813 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:08.008150  9025 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:07.994917  8961 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:08.012068  6649 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
W20260709 12:25:08.020190  9007 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.598s	user 0.001s	sys 0.007s
W20260709 12:25:08.024752  5932 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 1.611s (SENT) [suppressed 74 similar messages]
I20260709 12:25:08.030447  6646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 507) took 1073 ms. Trace:
W20260709 12:25:08.031960  8998 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.728s	user 0.000s	sys 0.007s
I20260709 12:25:07.998939  8887 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:08.036007  9000 log.cc:927] Time spent T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.658s	user 0.004s	sys 0.009s
I20260709 12:25:08.066762  6646 rpcz_store.cc:276] 0709 12:25:06.957343 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.958423 (+  1080us) service_pool.cc:224] Handling call
0709 12:25:06.958991 (+   568us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.299910 (+340919us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.030074 (+730164us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400468cd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:08.030319 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782393216}
I20260709 12:25:08.068032  8887 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.069581  8868 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:07.984382  8932 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:08.070849  8932 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:08.073256  8932 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:08.044456  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:08.074071  6118 raft_consensus.cc:2368] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6.
I20260709 12:25:08.075083  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.075978  6118 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:08.077339  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 1971) took 1172 ms. Trace:
I20260709 12:25:07.999765  9013 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:08.047770  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.034198  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:08.046921  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:08.000945  8936 consensus_meta.cc:287] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.993s	user 0.012s	sys 0.000s
I20260709 12:25:08.083079  8887 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:08.083459  8936 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.085780  8986 raft_consensus.cc:3055] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:08.086277  8986 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:08.087002  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 469) took 2290 ms. Trace:
I20260709 12:25:08.087323  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 555) took 2129 ms. Trace:
I20260709 12:25:08.087706  5966 rpcz_store.cc:276] 0709 12:25:05.933074 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.320093 (+387019us) service_pool.cc:224] Handling call
0709 12:25:06.320499 (+   406us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:06.332185 (+ 11686us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:06.332243 (+    58us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:06.347637 (+ 15394us) log.cc:844] Serialized 52 byte log entry
0709 12:25:06.729403 (+381766us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:06.755975 (+ 26572us) log.cc:844] Serialized 14 byte log entry
0709 12:25:06.765110 (+  9135us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:06.765177 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:08.038338 (+1273161us) spinlock_profiling.cc:243] Waited 6.77 ms on lock 0x7b1800292a80. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:25:08.040548 (+  2210us) raft_consensus.cc:1685] finished
0709 12:25:08.061827 (+ 21279us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.062052 (+   225us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43052,"prepare.queue_time_us":32810,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":18670,"raft.run_cpu_time_us":318,"raft.run_wall_time_us":41517,"spinlock_wait_cycles":15567744,"thread_start_us":176396,"threads_started":1,"wal-append.queue_time_us":239501}
I20260709 12:25:08.058914  6116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
W20260709 12:25:08.033383  8995 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.734s	user 0.007s	sys 0.005s
I20260709 12:25:07.851876  9016 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:08.065919  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 69462.4us
I20260709 12:25:08.007104  9012 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:08.003278  9019 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:25:08.096381  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.010449  9030 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:25:08.081041  6113 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:08.081697  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.112196  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.112850  6118 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
W20260709 12:25:08.112972  6009 leader_election.cc:336] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.766s (SENT)
I20260709 12:25:08.041479  8900 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:08.055783  8914 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.749s	user 0.062s	sys 0.071s
I20260709 12:25:08.089712  6116 raft_consensus.cc:606] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:08.136479  6116 raft_consensus.cc:614] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:08.090762  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:08.137213  6110 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:08.077886  6112 rpcz_store.cc:276] 0709 12:25:06.905326 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.905480 (+   154us) service_pool.cc:224] Handling call
0709 12:25:06.905785 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:06.914394 (+  8609us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:06.914424 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:07.301229 (+386805us) spinlock_profiling.cc:243] Waited 8.67 ms on lock 0x7b2c0003b2d8. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f94da11 00007f481f95d372 00007f482108fa01 00007f482105443a 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2
0709 12:25:07.336235 (+ 35006us) log.cc:844] Serialized 26 byte log entry
0709 12:25:07.401218 (+ 64983us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:25:07.401253 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.401613 (+   360us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:07.759521 (+357908us) spinlock_profiling.cc:243] Waited 9.3 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:08.077137 (+317616us) raft_consensus.cc:1685] finished
0709 12:25:08.077159 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.077287 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":601,"raft.run_cpu_time_us":44,"raft.run_wall_time_us":44,"spinlock_wait_cycles":41328384,"thread_start_us":46710,"threads_started":1,"wal-append.queue_time_us":148901}
I20260709 12:25:08.091449  6114 rpcz_store.cc:276] 0709 12:25:05.796689 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:05.803795 (+  7106us) service_pool.cc:224] Handling call
0709 12:25:06.631693 (+827898us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:06.646853 (+ 15160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:06.646885 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:06.656920 (+ 10035us) log.cc:844] Serialized 26 byte log entry
0709 12:25:07.205892 (+548972us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b1800140380. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:25:07.459364 (+253472us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:07.459412 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.459486 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:07.642954 (+183468us) raft_consensus.cc:1685] finished
0709 12:25:07.642972 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.086792 (+443820us) spinlock_profiling.cc:243] Waited 827 ms on lock 0x7b54001b9250. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:08.086898 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6725,"raft.queue_time_us":15362,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":4615,"spinlock_wait_cycles":1951008256,"thread_start_us":250294,"threads_started":1,"wal-append.queue_time_us":936214}
I20260709 12:25:08.077337  6109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 1970) took 1174 ms. Trace:
I20260709 12:25:08.057149  8931 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:08.064714  9032 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:25:08.113653  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:08.133496  9016 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:08.133910  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.198179  6113 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:08.134688  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.085834  8936 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:08.055971  9002 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:08.064307  8813 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:08.060887  9027 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:08.182981  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.210347  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:08.188334  6044 raft_consensus.cc:2410] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:25:08.191653  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:08.093252  9013 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:08.201718  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:08.135329  8900 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.065430  9025 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:08.135898  9019 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:08.087249  8986 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:08.211439  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:08.247956  9031 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:08.252207  9027 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:08.253620  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:08.255610  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:08.257309  9009 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.819s	user 0.003s	sys 0.011s
I20260709 12:25:08.258829  9012 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:08.259994  8944 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:08.261020  8944 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:08.218427  6110 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:08.224876  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:08.211845  6040 raft_consensus.cc:2393] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 6: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:08.223009  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:08.241662  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.221896  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:08.287930  6643 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:25:08.294052  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.218942  9041 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:08.232263  9025 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:08.234686  8889 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:08.233544  9019 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:08.302238  8889 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.248757  9031 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:08.424150  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1796) took 1717 ms. Trace:
I20260709 12:25:08.221460  6109 rpcz_store.cc:276] 0709 12:25:06.903083 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.903210 (+   127us) service_pool.cc:224] Handling call
0709 12:25:06.903537 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:06.919269 (+ 15732us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:06.919297 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:07.565053 (+645756us) spinlock_profiling.cc:243] Waited 3.87 ms on lock 0x7b2c0003b2d8. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f94da11 00007f481f95d372 00007f482108fa01 00007f482105443a 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2
0709 12:25:07.590726 (+ 25673us) log.cc:844] Serialized 26 byte log entry
0709 12:25:07.852351 (+261625us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:07.852391 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.852466 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:08.040215 (+187749us) raft_consensus.cc:1685] finished
0709 12:25:08.040236 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.077268 (+ 37032us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4318,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":8891136,"thread_start_us":231399,"threads_started":1,"wal-append.queue_time_us":403633}
I20260709 12:25:08.227128  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:08.223047  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:08.474314  6084 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:08.229913  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:08.394321  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.225399  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:08.240633  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:08.475601  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 450850us
W20260709 12:25:08.225653  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 112711us
W20260709 12:25:08.427659  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.403105  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1806) took 1447 ms. Trace:
W20260709 12:25:08.450348  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.453670  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 1979) took 1206 ms. Trace:
I20260709 12:25:08.475013  8900 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:08.403503  6143 heartbeater.cc:646] Failed to heartbeat to 127.4.181.126:41341 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.181.126:41341 timed out after 15.000s (SENT)
I20260709 12:25:08.244881  6114 raft_consensus.cc:2376] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4. Re-sending same reply.
I20260709 12:25:08.484993  6042 rpcz_store.cc:276] 0709 12:25:06.956134 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.083346 (+127212us) service_pool.cc:224] Handling call
0709 12:25:08.402833 (+1319487us) spinlock_profiling.cc:243] Waited 308 ms on lock 0x7b54001aa754. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:08.403036 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":709120768}
I20260709 12:25:08.486352  6111 rpcz_store.cc:276] 0709 12:25:07.247000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.247161 (+   161us) service_pool.cc:224] Handling call
0709 12:25:07.299106 (+ 51945us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.482719 (+183613us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.453394 (+970675us) spinlock_profiling.cc:243] Waited 145 ms on lock 0x7b54002cef54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:08.453596 (+   202us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":333664640}
I20260709 12:25:08.494266  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.494784  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:08.493572  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.495913  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.477304  6035 rpcz_store.cc:276] 0709 12:25:06.707216 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.707334 (+   118us) service_pool.cc:224] Handling call
0709 12:25:08.423881 (+1716547us) spinlock_profiling.cc:243] Waited 281 ms on lock 0x7b540030f2d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:08.424073 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":646970624}
I20260709 12:25:08.495342  6116 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:08.497072  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.497828  6109 raft_consensus.cc:2393] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:25:08.498076  6009 leader_election.cc:336] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.873s (SENT)
I20260709 12:25:08.498543  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:08.498766  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.499321  8868 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:08.500053  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:08.476194  8762 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:08.501700  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.431356  9027 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.260063  8986 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:08.494999  6112 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:25:08.514381  8993 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:08.515609  8889 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:08.502347  6009 leader_election.cc:336] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.934s (SENT)
I20260709 12:25:08.415674  9012 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.504248  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.493575  8949 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:08.221545  8914 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:08.506278  8950 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:08.503659  8616 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:08.436355  8813 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:08.302804  8931 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:08.221853  9016 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:08.447958  8970 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:08.421182  9011 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:08.404322  9041 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:08.518674  9027 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:08.520489  9010 log.cc:927] Time spent T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.984s	user 0.004s	sys 0.005s
I20260709 12:25:08.500778  8893 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.573668  8893 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:08.575762  9041 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.526589  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.577409  8893 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:08.534124  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.534929  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:08.403965  9004 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.038s	sys 0.026s
I20260709 12:25:08.493700  9025 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:08.421773  9008 raft_consensus.cc:993] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:08.503310  8449 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:08.503436  8979 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:08.502717  6109 raft_consensus.cc:2393] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:08.219388  9002 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:08.552188  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 409356us
I20260709 12:25:08.510874  8538 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:08.567651  8914 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:08.540566  8949 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:08.607920  6110 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
W20260709 12:25:08.589617  9004 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.176s	user 0.045s	sys 0.027s
I20260709 12:25:08.578426  6117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 1976) took 1485 ms. Trace:
I20260709 12:25:08.588428  6116 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:08.604017  6082 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:08.616910  6111 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:08.555263  8618 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:08.582593  9014 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:08.602813  8887 raft_consensus.cc:1081] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:08.533895  6009 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:08.630934  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 69140.8us
I20260709 12:25:08.589690  9013 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:08.590016  8944 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:08.554790  9016 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:08.610180  8949 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:08.611378  9027 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:08.610359  9051 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:25:08.612362  9041 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:08.617798  6082 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:08.540804  9012 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:08.615501  6117 rpcz_store.cc:276] 0709 12:25:07.092915 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.093230 (+   315us) service_pool.cc:224] Handling call
0709 12:25:07.093535 (+   305us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:07.093855 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.093882 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:07.135475 (+ 41593us) log.cc:844] Serialized 26 byte log entry
0709 12:25:07.364466 (+228991us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:07.364505 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:07.364571 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:08.518925 (+1154354us) spinlock_profiling.cc:243] Waited 2.52 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:08.578034 (+ 59109us) raft_consensus.cc:1685] finished
0709 12:25:08.578055 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.578350 (+   295us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":105724,"raft.run_cpu_time_us":54,"raft.run_wall_time_us":55,"spinlock_wait_cycles":5785344,"thread_start_us":127604,"threads_started":1,"wal-append.queue_time_us":239657}
I20260709 12:25:08.589342  8889 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:08.603122  8893 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:08.607003  8834 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:25:08.663751  9057 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
W20260709 12:25:08.666942  9044 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:25:08.562001  8970 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.604761  9025 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.665946  8893 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:08.670991  9054 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:25:08.671984  8893 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:08.651314  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:08.675762  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 58054.6us
I20260709 12:25:08.676543  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:08.677389  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:08.678655  8762 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:08.679505  8762 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:08.679692  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:08.633284  9014 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.680827  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:08.682103  8887 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:08.682983  9014 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:25:08.627864  8979 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.685838  8979 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:08.630995  8618 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.687144  8970 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:08.688177  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:08.689113  8111 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:08.551729  8950 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.589265  9011 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.663617  8834 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:08.670114  6644 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:25:08.619465  9048 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:08.582828  8616 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.631419  8449 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.686013  9002 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:08.607846  8538 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:08.697502  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.711342  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.699771  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.682296  8900 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:08.701601  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 193838us
I20260709 12:25:08.704059  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:08.705868  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.709539  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:08.712604  6113 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 4. Current term is 5. Ops: []
W20260709 12:25:08.700363  9001 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.169s	user 0.020s	sys 0.022s
I20260709 12:25:08.711691  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:08.718103  6042 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:08.726028  6611 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:08.703020  8318 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.732878  5932 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:08.690721  8889 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.726771  8325 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:08.734129  5932 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:08.713599  8586 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:08.738306  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:08.738762  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:08.798313  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 60080.3us
W20260709 12:25:08.798552  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.800814  5932 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:08.731621  8754 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.053s
I20260709 12:25:08.803810  8754 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:08.804214  8889 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:08.804524  8754 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:08.804955  8889 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:08.806293  8616 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:08.806370  8944 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:08.734413  5853 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ec584257f9db451c965f6b092aa9069c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0069e2ba1f02412e8e1d6c20a1fb510f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:08.806881  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.740914  8707 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:08.808454  8449 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:08.810361  8950 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:08.810940  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:08.812641  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:08.737426  8325 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:08.814970  8325 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:08.815801  8538 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:08.817194  9059 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:25:08.818948  9011 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:08.737351  8979 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:08.822784  6116 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:25:08.822018  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:08.722185  9001 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.231s	user 0.021s	sys 0.023s
I20260709 12:25:08.830850  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.737218  8618 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:08.834353  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 1967) took 2144 ms. Trace:
W20260709 12:25:08.826929  5853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 95512.8us
I20260709 12:25:08.838742  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.837355  6115 rpcz_store.cc:276] 0709 12:25:06.689743 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.691753 (+  2010us) service_pool.cc:224] Handling call
0709 12:25:06.692012 (+   259us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.495219 (+803207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.834126 (+1338907us) spinlock_profiling.cc:243] Waited 796 ms on lock 0x7b54001027d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:08.834295 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1830312832}
I20260709 12:25:08.841455  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:08.843411  6115 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:08.828192  9006 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:08.848641  8883 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:08.851116  9016 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:08.854619  8959 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:08.855189  5963 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:08.859073  8834 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:08.842429  9012 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:08.860946  8949 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.863036  6115 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:08.864365  6115 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:08.749663  9031 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:08.737927  8318 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:08.876444  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 75686.8us
I20260709 12:25:08.878512  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:08.881647  6042 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:08.883733  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:08.888441  8318 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:08.889257  6041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1815) took 1911 ms (client timeout 1624 ms). Trace:
I20260709 12:25:08.889844  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:08.888484  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 670) took 1488 ms. Trace:
W20260709 12:25:08.889669  6041 rpcz_store.cc:269] 0709 12:25:06.977447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.985038 (+  7591us) service_pool.cc:224] Handling call
0709 12:25:08.889033 (+1903995us) spinlock_profiling.cc:243] Waited 361 ms on lock 0x7b54003133d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:08.889189 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":830294400}
I20260709 12:25:08.829548  8586 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.895498  6041 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:08.896397  8586 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:08.897558  8318 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:08.892791  6036 rpcz_store.cc:276] 0709 12:25:07.399848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:07.399969 (+   121us) service_pool.cc:224] Handling call
0709 12:25:07.400256 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:07.444472 (+ 44216us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:07.444504 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:07.444548 (+    44us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:07.444578 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:08.888262 (+1443684us) spinlock_profiling.cc:243] Waited 44 ms on lock 0x7b54000d7354. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:08.888306 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:08.888427 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":101216640}
I20260709 12:25:08.893208  8707 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:08.899155  8949 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:08.902814  8834 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:08.909394  6042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36260
I20260709 12:25:08.904340  9064 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:08.905699  8318 consensus_queue.cc:1243] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer 0557a7246c8945b99e5215c99d4ddf9c log is divergent from this leader: its last log entry 3.6 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 5
W20260709 12:25:08.918341  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:08.925212  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.925493  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.925781  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.926049  5965 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:25:08.927496  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.928150  5965 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:25:08.928884  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.930393  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.933822  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.934508  5965 raft_consensus.cc:2410] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 5 because replica has last-logged OpId of term: 3 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 2.
I20260709 12:25:08.937309  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.937634  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.940665  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.941219  5967 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:08.942269  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.942762  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.942786  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.943027  5964 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:08.944892  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.945570  5960 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:08.946379  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.946957  5960 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:08.953711  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.954124  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.914067  8586 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:25:08.963179  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:08.912561  9061 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.038s
I20260709 12:25:08.962301  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:08.931991  8979 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.043s
I20260709 12:25:08.971771  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:08.935025  9064 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.991693  6081 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:08.961601  8834 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:08.994270  9001 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:08.994828  8834 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.996518  8325 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:08.996973  8834 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:09.000519  9064 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:09.003245  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.003919  6036 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:09.004839  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:09.007393  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:09.008041  6650 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:09.011668  6084 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:09.012120  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:09.012744  5968 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:09.012869  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:09.013937  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:09.014716  6084 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:09.017273  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:09.019665  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:09.020332  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:09.010324  6041 pending_rounds.cc:85] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 5
I20260709 12:25:09.024708  6041 pending_rounds.cc:107] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:25:09.025027  6041 raft_consensus.cc:2889] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:09.025902  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:09.014633  6651 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:09.030783  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:09.032428  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:09.034276  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:09.034597  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:09.035826  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:08.985689  8889 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:09.027949  8756 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:09.028105  8449 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
W20260709 12:25:08.995369  9066 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
W20260709 12:25:09.043238  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 50011.5us
I20260709 12:25:09.048779  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:09.050025  6044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 1823) took 1025 ms. Trace:
I20260709 12:25:09.053691  6044 rpcz_store.cc:276] 0709 12:25:08.024731 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.033897 (+  9166us) service_pool.cc:224] Handling call
0709 12:25:09.049806 (+1015909us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b54000d8754. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:09.049968 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246174976}
I20260709 12:25:09.043288  9008 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:09.045543  6609 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:25:09.054543  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.057637  6081 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:09.046838  8889 raft_consensus.cc:697] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:09.062595  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:09.063858  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:09.060421  6081 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:09.061167  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 558808us
I20260709 12:25:09.064816  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:09.065490  6009 leader_election.cc:336] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.982s (SENT)
I20260709 12:25:09.064839  6084 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:09.065927  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:09.027611  9001 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:09.060953  9062 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:09.066774  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:09.056705  9067 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:25:09.067811  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:09.069586  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:09.080358  5966 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:09.069955  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:09.082973  9031 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:09.083669  9031 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:09.085345  9013 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:09.069782  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:09.055830  9008 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:09.065497  8932 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:09.074931  6042 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:09.106575  6042 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:09.106861  8889 consensus_queue.cc:237] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:09.076211  8944 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:09.110877  8944 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:09.111294  8944 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:09.106108  6650 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:09.073477  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:09.112712  6038 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 9. (term mismatch)
I20260709 12:25:09.113170  6038 pending_rounds.cc:85] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 8
W20260709 12:25:09.074116  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 123364us
I20260709 12:25:09.113415  6038 pending_rounds.cc:107] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 12:25:09.113871  6038 raft_consensus.cc:2889] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:09.060741  8949 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:09.089629  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:09.115914  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:09.092175  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:09.063015  8325 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:09.080741  8586 consensus_queue.cc:1059] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:25:09.075709  9011 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:09.071163  8914 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.133819  8914 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.100473  9008 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:09.136138  8914 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:09.136881  8586 raft_consensus.cc:3055] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:09.137373  8586 raft_consensus.cc:740] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:09.130895  8932 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:09.065343  8964 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:09.117486  6081 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:09.115830  6006 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:09.132596  8961 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:09.123669  8756 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:09.164187  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 46766.3us
W20260709 12:25:09.164249  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 48507.8us
I20260709 12:25:09.191663  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:09.195057  6006 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:09.127523  6042 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.197817  6006 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:09.200340  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 2284) took 1143 ms. Trace:
I20260709 12:25:09.163900  8964 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.200855  6110 rpcz_store.cc:276] 0709 12:25:08.050555 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.390045 (+339490us) service_pool.cc:224] Handling call
0709 12:25:09.193642 (+803597us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b540020c954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:09.193784 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":296905984}
I20260709 12:25:09.201076  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:09.187175  8914 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:09.208247  6006 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:09.186208  8949 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:09.212633  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:09.214826  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 156363us
I20260709 12:25:09.217322  6006 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:09.221187  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:09.199384  8961 raft_consensus.cc:2764] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election decision vote started in defunct term 3: won
I20260709 12:25:09.201610  8959 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:09.138243  8586 consensus_queue.cc:260] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.206849  9041 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:09.210430  8964 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:09.211139  8914 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:09.218873  9027 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:09.215535  8949 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.225174  9012 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:09.231801  8813 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:09.241405  9027 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:09.241915  8914 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:09.245101  8949 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:09.246958  9012 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:09.248098  8813 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:09.254961  9027 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:09.266630  8813 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:09.256222  8754 consensus_queue.cc:1059] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.015s
I20260709 12:25:09.268038  8931 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.313294  6084 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:09.314512  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1583) took 1178 ms. Trace:
I20260709 12:25:09.319424  5962 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:25:09.320748  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 476) took 1268 ms. Trace:
I20260709 12:25:09.344899  5962 pending_rounds.cc:85] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 4
W20260709 12:25:09.344008  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.345216  5962 pending_rounds.cc:107] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 12:25:09.345578  5962 raft_consensus.cc:2917] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 12:25:09.346081  5962 raft_consensus.cc:2889] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:09.263293  9016 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:09.259356  9012 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:09.344638  6111 rpcz_store.cc:276] 0709 12:25:08.052197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.580156 (+527959us) service_pool.cc:224] Handling call
0709 12:25:08.616745 (+ 36589us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.617754 (+  1009us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.320582 (+702828us) spinlock_profiling.cc:243] Waited 36.2 ms on lock 0x7b540017edd0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:09.320694 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":83290496}
I20260709 12:25:09.352989  9001 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.006s
I20260709 12:25:09.298156  9008 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:09.261329  9078 consensus_queue.cc:1059] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.092s
W20260709 12:25:09.351649  9076 log.cc:927] Time spent T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.057s	user 0.002s	sys 0.002s
I20260709 12:25:09.343883  6039 rpcz_store.cc:276] 0709 12:25:08.136177 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.136670 (+   493us) service_pool.cc:224] Handling call
0709 12:25:08.890132 (+753462us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:08.891824 (+  1692us) raft_consensus.cc:1534] Early marking committed up to index 4
0709 12:25:08.940529 (+ 48705us) log.cc:844] Serialized 14 byte log entry
0709 12:25:09.075315 (+134786us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:09.075361 (+    46us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:09.075398 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.075457 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.314317 (+238860us) spinlock_profiling.cc:243] Waited 753 ms on lock 0x7b54003133d0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:09.314422 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":89589,"prepare.queue_time_us":93104,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":99116,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":106,"spinlock_wait_cycles":1732073216,"thread_start_us":93180,"threads_started":2,"wal-append.queue_time_us":141788}
I20260709 12:25:09.352806  9048 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:09.388038  8932 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:09.396369  9048 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:09.397374  9048 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:09.399256  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:09.400874  8949 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.350793  8931 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:09.403832  8931 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:09.404160  9081 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:09.404801  9081 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:09.406947  9081 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:09.409451  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:09.410085  5961 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:09.389791  8914 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.412910  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:09.392848  8964 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:09.392848  8944 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:09.395674  9077 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
W20260709 12:25:09.401422  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 269133us
I20260709 12:25:09.417675  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:09.393383  9082 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.133s	user 0.000s	sys 0.000s
I20260709 12:25:09.419180  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:09.426124  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:09.426785  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 193112us
I20260709 12:25:09.429076  6044 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:09.431658  8868 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:09.424935  9041 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:09.432782  9041 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:09.433228  9041 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:09.434116  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.438002  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:09.438300  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:09.438819  5961 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:09.389557  9027 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:09.450002  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.423616  8931 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:09.421810  9028 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:09.474829  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:09.476276  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.477993  6118 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:09.478770  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.480929  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.482982  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.484014  6110 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:09.486776  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:09.486145  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 60073.3us
I20260709 12:25:09.487335  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.487586  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:09.488109  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:09.488870  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.489742  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.490437  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:09.491833  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:09.492219  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:09.493861  6112 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:09.494760  6111 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:09.497150  5961 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:09.499181  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:09.492528  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:09.436689  8889 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:25:09.500480  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.467607  9028 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:09.500664  6644 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:09.498339  6081 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:09.499873  6111 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:09.500649  9088 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:09.510147  8964 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:09.505995  9028 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:09.504308  8949 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:09.493510  8944 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:09.522647  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1584) took 1382 ms. Trace:
I20260709 12:25:09.523830  9027 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:09.523095  6037 rpcz_store.cc:276] 0709 12:25:08.140156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.140368 (+   212us) service_pool.cc:224] Handling call
0709 12:25:09.051950 (+911582us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.052173 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:25:09.052402 (+   229us) log.cc:844] Serialized 14 byte log entry
0709 12:25:09.262589 (+210187us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:09.262653 (+    64us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:09.262697 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.263744 (+  1047us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.522376 (+258632us) spinlock_profiling.cc:243] Waited 909 ms on lock 0x7b54000d8750. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:09.522574 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":418,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":3448,"raft.queue_time_us":384,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":4543,"spinlock_wait_cycles":2090665728,"thread_start_us":209453,"threads_started":1,"wal-append.queue_time_us":306104}
I20260709 12:25:09.525173  8914 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:09.526747  9048 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:09.527412  9048 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:09.528398  9048 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.530898  8931 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.531489  8931 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.532580  8586 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:09.533659  8931 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:09.535146  9028 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:09.539016  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:09.540127  9028 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:09.541527  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 474) took 1489 ms. Trace:
I20260709 12:25:09.541908  6114 rpcz_store.cc:276] 0709 12:25:08.051735 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.549484 (+497749us) service_pool.cc:224] Handling call
0709 12:25:09.540886 (+991402us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b540023a928. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4825f7daa1 00007f4825ff8ebc 00007f482602e08c 00007f482601893b 00007f48260183d2 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c
0709 12:25:09.541028 (+   142us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.541222 (+   194us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:09.541247 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:09.541290 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:09.541320 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.541372 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.541475 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5053184}
I20260709 12:25:09.549304  9081 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:09.505192  9006 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:25:09.508598  9015 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:09.560333  9025 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:09.310875  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:09.568166  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:09.569671  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:09.570218  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:09.570837  5967 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:09.571900  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:09.572872  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 66006.9us
I20260709 12:25:09.578447  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:09.581127  6036 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:25:09.582810  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.584107  5968 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:09.581264  6114 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:09.586556  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:09.588696  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:09.588673  8813 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.590008  9012 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.530900  9091 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:09.591190  9091 raft_consensus.cc:697] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:09.583525  6111 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:25:09.592092  9091 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:09.596498  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:09.597081  5963 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:09.598652  6006 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:09.535239  9008 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:09.582106  9028 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:09.611353  5967 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:09.612646  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:09.613602  9013 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:09.614141  9013 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:09.615006  9013 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:09.619060  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 111204us
I20260709 12:25:09.602527  9027 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:09.603190  9031 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:09.636073  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:09.642009  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:09.644805  8914 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:09.645344  8914 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.644805  9061 consensus_queue.cc:1059] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 7.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:09.646395  9061 raft_consensus.cc:3055] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:09.646731  9061 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:09.647459  8914 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:09.647990  8914 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.648633  8665 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:09.649063  8665 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:09.649379  8834 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:09.647497  9061 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.650390  8616 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:09.650748  8616 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:09.651090  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:09.635929  8522 consensus_queue.cc:1059] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.016s
I20260709 12:25:09.651732  5967 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:09.651557  8616 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.652362  8522 raft_consensus.cc:3055] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:09.652765  8522 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:09.652911  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:09.653057  8616 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:09.653724  8868 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:09.650753  9061 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:09.649446  8665 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:09.607816  9005 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:25:09.664630  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.661669  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.665882  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.666206  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.664157  6117 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:09.666772  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.666913  6037 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:25:09.667960  6116 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:09.668817  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.669015  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.669490  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.664220  6114 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:09.669811  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.669931  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.670622  6117 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:09.675836  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:09.640690  9027 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:09.686208  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:09.688720  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.689688  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.690780  6117 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:09.691286  6116 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:09.678586  6036 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:09.639128  8586 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.040s
I20260709 12:25:09.636358  9041 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:09.676590  8813 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:09.641906  9031 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.663329  8868 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:09.735610  6109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 482) took 1634 ms. Trace:
I20260709 12:25:09.736089  6109 rpcz_store.cc:276] 0709 12:25:08.100720 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.620327 (+519607us) service_pool.cc:224] Handling call
0709 12:25:09.193801 (+573474us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:09.210144 (+ 16343us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:09.210177 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:09.210293 (+   116us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:09.210344 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.660029 (+449685us) spinlock_profiling.cc:243] Waited 16 ms on lock 0x7b540020c954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:09.660070 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:09.735378 (+ 75308us) spinlock_profiling.cc:243] Waited 573 ms on lock 0x7b540020c950. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:09.735537 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1354959488}
I20260709 12:25:09.738649  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:09.739317  5967 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:09.648680  8914 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.687199  9069 consensus_queue.cc:1059] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20260709 12:25:09.707337  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.707713  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.769116  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.772294  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.653752  8522 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:09.694243  8707 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:25:09.717028  9095 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:09.719978  8889 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:09.720826  6042 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:09.690052  8950 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:09.694681  9012 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:09.723819  9041 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:09.726923  9027 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:09.728358  9008 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.731431  9079 raft_consensus.cc:3055] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:09.699028  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.898926  6044 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:09.704610  9016 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:09.746126  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 110127us
I20260709 12:25:09.746699  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.773451  5967 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:09.789685  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.861691  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:09.903106  6643 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:25:09.862572  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:09.903921  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.904165  6110 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:09.863739  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:09.868741  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:09.870157  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:09.735632  8868 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:09.871467  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.873595  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:36260 (request call id 1592) took 1143 ms. Trace:
I20260709 12:25:09.863106  8813 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:09.865407  9095 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:09.907083  5965 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:09.910593  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:09.911717  6035 raft_consensus.cc:2410] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 8 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:25:09.908525  6036 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:25:09.915220  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.922077  6116 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:09.870903  8950 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:09.933827  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:09.934839  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.908411  6042 rpcz_store.cc:276] 0709 12:25:08.722788 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:08.905166 (+182378us) service_pool.cc:224] Handling call
0709 12:25:09.719619 (+814453us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54001ba154. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482104ba3d 00007f482601bcd0 00007f481f5a0254 00007f481f5a01e2 00007f481f5a0111 00007f481f5a008c 00007f481f59f342 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:09.862696 (+143077us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":346128128}
I20260709 12:25:09.934737  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:09.904924  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:09.923383  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:09.924436  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.925312  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.938342  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:09.927142  5932 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:09.916350  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.927848  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:09.880306  8522 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:09.928270  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:09.933943  6009 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:09.906571  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:09.939934  6036 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:09.941869  6036 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:09.929090  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.945230  6082 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:09.939635  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:09.947742  6109 raft_consensus.cc:2393] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:09.950153  6110 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:09.951331  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.892544  9079 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:25:09.953306  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 51048.1us
I20260709 12:25:09.954540  5932 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:09.909245  9016 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:09.955574  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 49147us
I20260709 12:25:09.960677  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:09.967803  6109 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:09.956804  6114 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:09.960096  6036 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 4 index: 5. (index mismatch)
I20260709 12:25:09.968859  5932 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:09.969167  6036 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:09.956285  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:09.977465  6009 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:09.949350  8950 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:09.980841  6044 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:09.991667  9088 raft_consensus.cc:3055] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:09.996115  8746 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:09.965153  9069 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:09.962234  8961 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:09.900838  9008 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:10.016324  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:09.997804  8889 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:09.959342  9011 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:10.007803  5863 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 295) took 16717 ms (client timeout 15000 ms). Trace:
I20260709 12:25:10.018211  9028 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:10.031064  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:10.019718  9088 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:10.012624  9064 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:09.935734  8813 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:09.970952  8944 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:10.048938  9031 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:10.059435  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 90650.8us
W20260709 12:25:10.079175  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.018666  8746 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:25:10.095158  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 64188.9us
W20260709 12:25:10.106765  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 145427us
I20260709 12:25:10.108958  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:10.118188  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:10.121934  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:10.122089  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:10.124009  6646 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:10.117328  5932 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:10.130661  5932 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:10.132587  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:10.148972  9088 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:10.150676  9088 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:10.162835  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 44726.7us
I20260709 12:25:10.164136  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:10.165848  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:10.060410  8931 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:10.173381  6642 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 5. (term mismatch)
I20260709 12:25:10.174140  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:10.174971  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:10.179636  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:10.181485  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:10.093806  9064 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:10.173838  6642 pending_rounds.cc:85] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 4
I20260709 12:25:10.192442  6642 pending_rounds.cc:107] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 3.5
I20260709 12:25:10.192891  6642 raft_consensus.cc:2917] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Aborting config change with OpId 3.5: Aborted: Op aborted by new leader
I20260709 12:25:10.193305  6642 raft_consensus.cc:2889] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:10.045852  5863 rpcz_store.cc:269] 0709 12:24:53.290225 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:24:53.290435 (+   210us) service_pool.cc:224] Handling call
0709 12:24:53.521194 (+230759us) spinlock_profiling.cc:243] Waited 169 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:25:10.007721 (+16486527us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:07.134843 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:07.392349 (+257506us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:07.393915 (+  1566us) write_op.cc:435] Acquired schema lock
0709 12:25:07.395439 (+  1524us) tablet.cc:662] Decoding operations
0709 12:25:07.604628 (+209189us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:07.613622 (+  8994us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:07.613657 (+    35us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:25:07.614233 (+   576us) tablet.cc:701] Row locks acquired
0709 12:25:07.614246 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:25:07.614387 (+   141us) write_op.cc:270] Start()
0709 12:25:07.614513 (+   126us) write_op.cc:276] Timestamp: P: 1783599907614343 usec, L: 0
0709 12:25:07.614537 (+    24us) op_driver.cc:348] REPLICATION: starting
0709 12:25:07.699912 (+ 85375us) log.cc:844] Serialized 2849 byte log entry
0709 12:25:08.730579 (+1030667us) op_driver.cc:464] REPLICATION: finished
0709 12:25:09.013036 (+282457us) write_op.cc:301] APPLY: starting
0709 12:25:09.013125 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:09.013296 (+   171us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:09.013410 (+   114us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:09.035796 (+ 22386us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:09.036007 (+   211us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=7
0709 12:25:09.036049 (+    42us) write_op.cc:312] APPLY: finished
0709 12:25:09.036307 (+   258us) log.cc:844] Serialized 59 byte log entry
0709 12:25:09.036477 (+   170us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:09.036585 (+   108us) write_op.cc:454] Released schema lock
0709 12:25:09.036626 (+    41us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:09.037022 (+   396us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:09.037050 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":600442,"reported_tablets":29,"spinlock_wait_cycles":388474624,"child_traces":[["op",{"apply.queue_time_us":255859,"apply.run_cpu_time_us":2796,"apply.run_wall_time_us":23960,"num_ops":7,"prepare.queue_time_us":177846,"prepare.run_cpu_time_us":9794,"prepare.run_wall_time_us":1126897,"raft.queue_time_us":239634,"raft.run_cpu_time_us":15577,"raft.run_wall_time_us":246434,"replication_time_us":1098226,"thread_start_us":848434,"threads_started":4,"wal-append.queue_time_us":741595,"wal-append.run_cpu_time_us":39656,"wal-append.run_wall_time_us":1594235}]]}
I20260709 12:25:10.189013  6650 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:10.093152  8961 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:10.104751  9078 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:10.167086  8889 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:10.207681  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 301142us
I20260709 12:25:10.167328  8754 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:10.173753  8931 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:10.219197  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 252002us
I20260709 12:25:10.197883  9064 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:10.183812  9031 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:10.168148  9069 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.049s
I20260709 12:25:10.204036  8449 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:10.247764  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 231485us
I20260709 12:25:10.249615  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:10.254731  8754 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:10.216212  8914 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:10.250587  9027 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:10.242620  8931 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:10.310693  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52769.8us
W20260709 12:25:10.261014  9098 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.341s	user 0.001s	sys 0.000s
W20260709 12:25:10.388321  9105 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.209s	user 0.000s	sys 0.000s
W20260709 12:25:10.390420  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 132015us
W20260709 12:25:10.390443  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 63327.2us
I20260709 12:25:10.242995  9118 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:10.262391  9084 raft_consensus.cc:3055] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:10.386528  8961 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:10.260231  8325 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.130s
I20260709 12:25:10.120556  9079 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:10.253562  8616 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:10.451804  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:10.256722  9031 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:10.492964  6651 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:10.481163  6084 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:10.487489  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 303266us
I20260709 12:25:10.493846  6611 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:10.470485  9115 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.259s	user 0.000s	sys 0.010s
W20260709 12:25:10.478077  9109 log.cc:927] Time spent T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.465s	user 0.000s	sys 0.006s
W20260709 12:25:10.528108  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 47049.8us
I20260709 12:25:10.529652  6084 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:10.530606  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:10.470672  9122 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.530292  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:10.465091  9084 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:10.482257  8621 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.480175  8944 raft_consensus.cc:697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:10.453241  8528 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.072s
W20260709 12:25:10.527892  8665 consensus_meta.cc:287] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.867s	user 0.011s	sys 0.000s
I20260709 12:25:10.539310  6084 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:10.549213  9117 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:25:10.549664  9129 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:25:10.525260  9006 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:10.550499  9108 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.299s	user 0.001s	sys 0.000s
W20260709 12:25:10.551976  9016 consensus_meta.cc:287] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.572s	user 0.004s	sys 0.004s
I20260709 12:25:10.478354  8914 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.067s
I20260709 12:25:10.528820  9028 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:10.532516  8862 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:10.555416  8621 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:10.538545  9131 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:10.544516  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:10.559464  6611 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:10.586644  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 47412.9us
I20260709 12:25:10.598439  8665 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:10.623006  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 78873.9us
I20260709 12:25:10.623808  8621 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:10.624254  9131 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:25:10.624444  9028 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:10.626377  9006 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:10.626801  9006 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:10.545673  9008 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:10.654390  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 488584us
I20260709 12:25:10.546083  9013 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:10.623859  6082 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:10.664507  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 105114us
I20260709 12:25:10.593168  9117 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:10.581507  9120 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:10.557895  8931 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:10.604454  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.676193  6116 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:10.546289  9116 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:10.590148  9106 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.485s	user 0.001s	sys 0.000s
I20260709 12:25:10.627656  8813 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:10.666517  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:10.595216  9134 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:10.613857  8914 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:10.669219  8528 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:10.543404  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 410791us
I20260709 12:25:10.709820  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:10.673869  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:10.673436  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:10.677625  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:10.678297  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:10.711059  6113 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:10.711387  6113 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:10.712039  6112 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:10.712158  6113 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:10.678901  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.713857  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:10.679486  6644 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:10.680114  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:10.537823  9122 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:10.684062  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:10.678886  6042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.014s	sys 0.012s
I20260709 12:25:10.682324  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:10.690526  6611 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:25:10.720062  6042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.672s	user 0.016s	sys 0.012s
I20260709 12:25:10.720562  8325 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:10.547828  8949 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.134s
W20260709 12:25:10.684434  6007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.639s	user 0.004s	sys 0.011s
W20260709 12:25:10.721648  6007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.679s	user 0.004s	sys 0.011s
I20260709 12:25:10.671272  9013 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:10.608724  8868 consensus_meta.cc:287] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.682s	user 0.007s	sys 0.003s
I20260709 12:25:10.723218  6109 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:10.724831  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:10.720248  6039 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:10.681140  8961 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:10.613703  8944 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:10.593242  9084 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:10.654270  9016 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:10.708491  8813 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:10.732574  5960 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:25:10.681617  9069 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:10.750986  5932 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:10.752131  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:10.735363  8868 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:10.735383  8834 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:10.753726  8586 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:10.749110  9113 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:10.696178  5853 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5a6d648272bf4bef9d5337acfc9d4a96 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0069e2ba1f02412e8e1d6c20a1fb510f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:10.695902  8616 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:25:10.620335  9095 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:10.737012  8961 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:10.627674  9006 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:10.721370  9125 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:10.770588  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:10.774859  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:10.722325  8914 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:10.824807  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:10.828486  6009 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:10.818662  9119 log.cc:927] Time spent T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.222s	user 0.003s	sys 0.000s
W20260709 12:25:10.769129  9064 consensus_meta.cc:287] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.513s	user 0.004s	sys 0.004s
W20260709 12:25:10.763778  9124 log.cc:927] Time spent T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
W20260709 12:25:10.768407  9114 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:25:10.761988  9084 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:10.731998  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:25:10.765061  9138 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.167s	user 0.001s	sys 0.000s
W20260709 12:25:10.769709  9111 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:25:10.763357  9121 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:25:10.758380  9013 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:10.849820  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:10.780319  8665 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
W20260709 12:25:10.830302  9088 consensus_meta.cc:287] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.676s	user 0.001s	sys 0.010s
I20260709 12:25:10.760977  9016 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:10.782346  9028 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:10.821426  9116 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.763136  9141 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:10.791390  9069 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:10.762897  9130 consensus_queue.cc:1059] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.167s
W20260709 12:25:10.817229  5853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 125857us
W20260709 12:25:10.774533  8889 consensus_queue.cc:1175] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "24012af7747d4c4ea89c3da2ff950099" responder_term: 4 status { last_received { term: 3 index: 5 } last_committed_idx: 5 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
W20260709 12:25:10.900321  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 168384us
I20260709 12:25:10.816119  8834 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:10.906111  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 225329us
I20260709 12:25:10.855674  8986 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:10.916620  6114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.026s	sys 0.051s
W20260709 12:25:10.993340  6114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.027s	sys 0.051s
I20260709 12:25:10.763015  9136 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.206s
I20260709 12:25:10.789124  8813 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:10.852401  9113 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:10.763259  9137 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 2, Time since last communication: 0.227s
I20260709 12:25:10.820190  9008 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:10.822124  9125 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:10.937065  6645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 525) took 1068 ms. Trace:
I20260709 12:25:10.894912  9064 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:10.918876  9013 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:10.922938  9121 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:10.975521  8986 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:10.996131  6041 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:10.996935  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1843) took 1122 ms. Trace:
W20260709 12:25:10.997660  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 246742us
I20260709 12:25:11.001147  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:11.001669  6037 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:10.970387  9148 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:10.898881  8961 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:10.923154  8746 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:10.998020  9144 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:11.010625  6645 rpcz_store.cc:276] 0709 12:25:09.868642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.868760 (+   118us) service_pool.cc:224] Handling call
0709 12:25:09.869121 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:09.891676 (+ 22555us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:09.891707 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:09.892164 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:25:10.210879 (+318715us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:10.210920 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.211024 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:10.761996 (+550972us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:10.923985 (+161989us) raft_consensus.cc:1685] finished
0709 12:25:10.924006 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.936983 (+ 12977us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22138,"raft.queue_time_us":22937,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":16518,"spinlock_wait_cycles":37284608,"thread_start_us":249347,"threads_started":1,"wal-append.queue_time_us":677027}
I20260709 12:25:11.031548  6117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 2306) took 1104 ms. Trace:
W20260709 12:25:10.994700  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 166286us
I20260709 12:25:10.943698  9016 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:11.045953  6041 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:11.016131  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:10.972071  8325 raft_consensus.cc:697] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:25:11.052683  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.017901  8950 consensus_meta.cc:287] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.988s	user 0.010s	sys 0.002s
I20260709 12:25:10.942238  8959 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:10.995507  8931 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.025054  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:11.025792  5932 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:11.039997  6117 rpcz_store.cc:276] 0709 12:25:09.926934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.954737 (+ 27803us) service_pool.cc:224] Handling call
0709 12:25:09.955030 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:10.044529 (+ 89499us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:10.044559 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:10.044602 (+    43us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:25:10.044630 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.031256 (+986626us) spinlock_profiling.cc:243] Waited 89.3 ms on lock 0x7b5400162e54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:11.031313 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.031481 (+   168us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":205291904}
I20260709 12:25:11.021672  6035 rpcz_store.cc:276] 0709 12:25:09.874228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.936072 (+ 61844us) service_pool.cc:224] Handling call
0709 12:25:09.936515 (+   443us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:09.946916 (+ 10401us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:09.946948 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:09.961731 (+ 14783us) log.cc:844] Serialized 26 byte log entry
0709 12:25:10.268520 (+306789us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:10.268662 (+   142us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.268918 (+   256us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:10.763015 (+494097us) spinlock_profiling.cc:243] Waited 19.3 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:10.975279 (+212264us) raft_consensus.cc:1685] finished
0709 12:25:10.975302 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:10.996863 (+ 21561us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9996,"raft.queue_time_us":16342,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":11281,"spinlock_wait_cycles":44315520,"thread_start_us":255951,"threads_started":1,"wal-append.queue_time_us":581883}
I20260709 12:25:11.041774  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:10.939356  9116 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:11.045025  9132 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.260s	user 0.001s	sys 0.000s
I20260709 12:25:10.942204  9141 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.028618  8986 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:11.080498  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 57216.6us
I20260709 12:25:11.085393  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:11.075253  8746 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:11.096030  8834 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.096540  9134 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:11.025980  9121 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.099488  9116 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:11.099676  9134 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:11.100430  9134 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:11.102721  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:11.050701  9148 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.107633  8944 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.108453  8944 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.109747  9148 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.102757  9121 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:11.115808  5932 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:11.117238  6009 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:11.074215  8868 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.017530  9008 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.025596  9013 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.140305  6009 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:11.105736  8961 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:11.123900  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:11.048683  9130 consensus_queue.cc:1059] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:25:11.123091  8834 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:11.071451  8950 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:11.131683  9139 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.229s	user 0.000s	sys 0.001s
W20260709 12:25:11.133952  9061 consensus_meta.cc:287] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 1.479s	user 0.005s	sys 0.009s
W20260709 12:25:11.135138  9145 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.241s	user 0.001s	sys 0.001s
I20260709 12:25:11.104995  9091 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:11.138711  9088 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:25:11.147948  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 363367us
I20260709 12:25:11.151317  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 1683) took 1788 ms. Trace:
I20260709 12:25:11.138952  8914 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.122982  9016 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:11.163138  6037 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:11.140251  9121 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:11.143335  9137 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.009138  9113 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.066079  9144 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.154431  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:11.147111  8868 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:11.166554  5962 rpcz_store.cc:276] 0709 12:25:09.363278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.363555 (+   277us) service_pool.cc:224] Handling call
0709 12:25:09.363846 (+   291us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:09.364467 (+   621us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:09.364495 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:09.364927 (+   432us) log.cc:844] Serialized 26 byte log entry
0709 12:25:10.178435 (+813508us) spinlock_profiling.cc:243] Waited 2.09 ms on lock 0x7b1800430d80. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:25:10.260824 (+ 82389us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:10.261365 (+   541us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.266781 (+  5416us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:11.144638 (+877857us) raft_consensus.cc:1685] finished
0709 12:25:11.144662 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.151240 (+  6578us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3592,"raft.queue_time_us":155,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":6693,"spinlock_wait_cycles":4801920,"thread_start_us":81136,"threads_started":1,"wal-append.queue_time_us":1331153}
I20260709 12:25:11.161664  6041 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
W20260709 12:25:11.227689  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.234278  6035 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:25:11.150585  9122 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.150717  9118 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:11.213940  9013 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.239426  8834 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:11.287005  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 132728us
I20260709 12:25:11.295680  6009 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:11.201238  9130 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:11.165479  9041 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:11.201184  9148 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:11.287935  9156 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
W20260709 12:25:11.289250  9147 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:25:11.164673  8325 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.165040  8931 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:11.316478  8931 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.319278  9064 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.291085  8914 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
W20260709 12:25:11.325090  6040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60122 (request call id 724) took 1750 ms (client timeout 2177 ms). Trace:
W20260709 12:25:11.279445  9078 consensus_meta.cc:287] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 1.070s	user 0.004s	sys 0.012s
W20260709 12:25:11.325554  6040 rpcz_store.cc:269] 0709 12:25:09.574748 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.575272 (+   524us) service_pool.cc:224] Handling call
0709 12:25:11.324859 (+1749587us) spinlock_profiling.cc:243] Waited 366 ms on lock 0x7b540025ab54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:11.325022 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":841874176}
I20260709 12:25:11.232859  8950 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.201328  9061 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.092s
I20260709 12:25:11.193231  5967 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:11.214975  9125 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.228029  9160 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:11.335636  8949 raft_consensus.cc:3055] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:11.233300  9081 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.070s
I20260709 12:25:11.228654  9159 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:11.302325  9041 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.304068  9141 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.350819  9160 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:11.278278  9137 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:11.304766  8528 consensus_meta.cc:287] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.582s	user 0.008s	sys 0.008s
I20260709 12:25:11.215404  9153 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:11.345882  8986 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.306559  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:11.296223  9121 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.295048  8834 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.315127  9008 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:11.291760  8522 consensus_meta.cc:287] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 1.335s	user 0.012s	sys 0.002s
I20260709 12:25:11.317987  9144 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.330657  9146 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:11.331764  9149 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:11.327135  9148 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.285626  9028 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:11.302134  9130 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.301724  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1847) took 1383 ms. Trace:
I20260709 12:25:11.336813  9159 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.344836  8931 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.346266  9079 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:11.333215  9078 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:11.338577  8993 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.379848  9153 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:11.343282  8949 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:25:11.355163  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.165145  8586 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.168169  9088 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:11.301179  9013 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:11.328744  8944 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.353977  9160 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.302019  9069 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:11.370760  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 64332.4us
I20260709 12:25:11.415311  6009 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:11.279016  8813 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.362011  8528 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:11.383468  9127 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.360773  9158 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:11.387271  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.383919  9149 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.387398  8834 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.392699  8986 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.393388  9130 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.387938  6042 rpcz_store.cc:276] 0709 12:25:09.918811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.964536 (+ 45725us) service_pool.cc:224] Handling call
0709 12:25:09.964868 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:09.980100 (+ 15232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:09.980132 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:09.980608 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:25:10.720505 (+739897us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:10.940846 (+220341us) log.cc:844] Serialized 14 byte log entry
0709 12:25:10.941042 (+   196us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:10.941125 (+    83us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:11.301496 (+360371us) raft_consensus.cc:1685] finished
0709 12:25:11.301518 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.301666 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":15210,"prepare.queue_time_us":301087,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":52,"raft.queue_time_us":56581,"raft.run_cpu_time_us":349,"raft.run_wall_time_us":10548,"thread_start_us":892617,"threads_started":2,"wal-append.queue_time_us":797635}
I20260709 12:25:11.374552  9041 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:11.402112  9027 consensus_meta.cc:287] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 1.095s	user 0.005s	sys 0.007s
I20260709 12:25:11.419744  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:11.412992  9088 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:11.394140  9028 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.442693  9113 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:11.537405  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.435016  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 268894us
I20260709 12:25:11.437889  8813 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:11.425722  9153 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:11.428460  9121 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:11.417371  8586 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:11.432546  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 282194us
I20260709 12:25:11.431531  9160 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:11.422475  8993 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.438659  9137 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:11.438771  9027 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:11.421860  9013 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.432291  9127 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.438952  8949 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.527493  6044 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:11.455062  9041 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.038s
I20260709 12:25:11.564299  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:11.564900  6109 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:25:11.565272  8949 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:11.419199  8931 consensus_queue.cc:1059] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:25:11.438015  6009 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:11.532131  9088 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:11.442613  8665 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:11.438602  8970 consensus_queue.cc:1059] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.002s
W20260709 12:25:11.538581  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.545226  8744 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.536931  8961 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.558938  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:11.535176  9130 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:11.574980  8961 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.575704  9130 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.577108  8961 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.577978  9130 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:11.578622  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 140671us
I20260709 12:25:11.575258  8931 raft_consensus.cc:3055] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:11.579324  8931 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:11.579545  9079 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:11.580060  9079 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.580302  8931 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.581506  8931 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:11.582054  9079 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.582528  9166 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:11.583071  9166 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.562060  9028 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.566030  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:11.585969  6109 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:11.568845  6110 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:11.548115  9016 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:11.547555  8944 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:25:11.567531  9101 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.973s	user 0.003s	sys 0.001s
I20260709 12:25:11.567930  9121 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.006s
I20260709 12:25:11.574397  9088 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.561079  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:11.549705  9134 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.595340  6115 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:11.596711  9134 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:11.598610  6042 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:11.592957  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:11.584448  6608 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:11.586696  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.589970  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:11.570578  9148 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.594590  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:11.600085  5962 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:11.593546  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:11.602849  6117 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:11.578951  9041 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:11.583881  8993 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.604984  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:11.580353  9013 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.630297  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:11.630808  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 46441.5us
I20260709 12:25:11.607600  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:11.632045  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:11.577912  8744 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:11.732501  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 138621us
W20260709 12:25:11.732904  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 91227us
I20260709 12:25:11.597702  9027 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:11.742518  5962 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:11.745193  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2006) took 2125 ms. Trace:
W20260709 12:25:11.745229  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.630394  8964 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:11.745736  6111 rpcz_store.cc:276] 0709 12:25:09.620290 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.620436 (+   146us) service_pool.cc:224] Handling call
0709 12:25:09.620778 (+   342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:09.621114 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:09.621140 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:09.634211 (+ 13071us) log.cc:844] Serialized 26 byte log entry
0709 12:25:09.952362 (+318151us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:09.952405 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:09.952473 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:11.566928 (+1614455us) spinlock_profiling.cc:243] Waited 15.2 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:11.744765 (+177837us) raft_consensus.cc:1685] finished
0709 12:25:11.744790 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.745115 (+   325us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1823,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":3635,"spinlock_wait_cycles":34976000,"thread_start_us":276284,"threads_started":1,"wal-append.queue_time_us":951543}
I20260709 12:25:11.750779  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:11.756196  9110 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 1.566s	user 0.002s	sys 0.006s
I20260709 12:25:11.759672  5934 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:11.598453  8944 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.732744  8893 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.775202  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.777132  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.778874  5961 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:11.779942  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.629685  9159 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.767771  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:11.793395  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:11.794121  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.795199  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.799876  5964 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:11.790869  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:11.750197  8993 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.769146  6115 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:11.786124  5962 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:11.790081  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.804457  8979 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:11.791386  9088 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:11.751734  9027 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.799351  8893 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.814733  5934 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:11.828920  5968 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:25:11.811894  9149 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.831087  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:11.813339  8986 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:11.832338  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 77993.3us
I20260709 12:25:11.820804  8979 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.838570  6041 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:25:11.845733  5965 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:11.810609  8993 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.818629  9069 consensus_queue.cc:1059] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:25:11.834321  9164 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:11.853261  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:11.833598  8986 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:11.843377  8979 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:11.827646  9088 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.871804  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:11.871888  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:11.873438  9155 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:11.873986  9155 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:11.874372  8744 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.874830  9155 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.878137  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.879113  5966 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:25:11.880223  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:11.881009  8707 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:11.881505  8707 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.881875  8707 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:11.885288  9095 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:11.886626  9157 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:11.887179  9157 raft_consensus.cc:697] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:11.888048  9157 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.889792  8707 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.893445  8707 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.894215  6118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 508) took 1170 ms. Trace:
I20260709 12:25:11.894637  6118 rpcz_store.cc:276] 0709 12:25:10.723945 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.754736 (+ 30791us) service_pool.cc:224] Handling call
0709 12:25:10.754969 (+   233us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.029304 (+274335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.029334 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.029369 (+    35us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:11.029406 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.894001 (+864595us) spinlock_profiling.cc:243] Waited 274 ms on lock 0x7b54000915d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:11.894052 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.894164 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":630477184}
I20260709 12:25:11.897783  9027 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:11.900472  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.901283  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:11.901597  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.858721  9163 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.906347  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:11.863521  9164 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:11.907054  5963 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:11.907786  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 144774us
I20260709 12:25:11.867933  8986 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:11.911219  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:11.913993  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.916791  9031 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:11.918530  8893 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.922809  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.923655  8528 raft_consensus.cc:3055] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:11.924085  8528 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:11.924721  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.924049  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.925645  5962 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:11.925841  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.926440  5959 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:11.927245  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.928334  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.929411  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.924937  8528 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:11.932184  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:11.932750  6037 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:11.937376  5967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 606) took 1153 ms. Trace:
I20260709 12:25:11.937781  5967 rpcz_store.cc:276] 0709 12:25:10.783625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.784929 (+  1304us) service_pool.cc:224] Handling call
0709 12:25:10.785227 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.334717 (+549490us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.937162 (+602445us) spinlock_profiling.cc:243] Waited 408 ms on lock 0x7b54001df454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:11.937320 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":937895296}
I20260709 12:25:11.939090  6042 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:11.941596  9127 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.941927  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:11.942890  6112 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:11.943493  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2014) took 1259 ms. Trace:
I20260709 12:25:11.943773  6112 rpcz_store.cc:276] 0709 12:25:10.683620 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.712876 (+ 29256us) service_pool.cc:224] Handling call
0709 12:25:10.713120 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.942755 (+1229635us) spinlock_profiling.cc:243] Waited 296 ms on lock 0x7b5400080fa0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fcbdc0 00007f48210561c0 00007f4821057231 00007f4821053d8f 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c
0709 12:25:11.943254 (+   499us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.943426 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":679811968}
W20260709 12:25:11.951965  6038 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.118s	user 0.017s	sys 0.024s
I20260709 12:25:11.960213  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:11.963198  6112 raft_consensus.cc:2410] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 6 because replica has last-logged OpId of term: 3 index: 2, which is greater than that of the candidate, which has last-logged OpId of term: 1 index: 1.
W20260709 12:25:11.908352  9173 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:25:11.961952  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:11.974198  6006 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:11.905326  9078 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:11.905172  8889 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:11.952339  6038 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.123s	user 0.017s	sys 0.024s
I20260709 12:25:11.979544  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1846) took 2072 ms. Trace:
I20260709 12:25:11.910301  9164 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:11.981504  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:11.983799  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:11.985817  5932 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:11.986886  6041 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 6: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:11.983008  9078 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.979701  8813 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:11.990780  9041 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:11.991868  9041 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:11.992381  8868 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:11.992905  8868 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.995209  8868 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.995659  8993 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.991083  9078 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:11.996790  8754 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:11.999068  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:12.018261  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:12.018891  6112 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:11.998746  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:12.020558  6041 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:12.021366  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:12.022341  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:11.987414  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:12.022886  6041 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:12.027669  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:12.029518  6609 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:25:11.980521  9169 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.326s	user 0.001s	sys 0.000s
I20260709 12:25:11.996665  9162 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:12.017478  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:12.031746  5932 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:11.910439  9163 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:11.979939  6038 rpcz_store.cc:276] 0709 12:25:09.907466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:09.959472 (+ 52006us) service_pool.cc:224] Handling call
0709 12:25:09.959810 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:09.976794 (+ 16984us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:09.976823 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:10.014340 (+ 37517us) log.cc:844] Serialized 26 byte log entry
0709 12:25:10.537370 (+523030us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:10.764354 (+226984us) spinlock_profiling.cc:243] Waited 12 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:10.829031 (+ 64677us) log.cc:844] Serialized 14 byte log entry
0709 12:25:11.234366 (+405335us) spinlock_profiling.cc:243] Waited 21.8 ms on lock 0x7b18003a00c0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df352a6 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4825f7daa1 00007f4825f74b37 00007f4825f749ca 00007f482606c26f
0709 12:25:11.235130 (+   764us) spinlock_profiling.cc:243] Waited 5.15 ms on lock 0x7b480024c258. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4825f7daa1 00007f4825f74b37 00007f4825f749ca 00007f482606c26f 00007f482606bf37 00007f482608055c 00007f4826080508 00007f4826080488 00007f4826080443 00007f482607f6ec 00007f4824fa9a96
0709 12:25:11.979220 (+744090us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:11.979297 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:11.979337 (+    40us) raft_consensus.cc:1685] finished
0709 12:25:11.979349 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:11.979483 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":32223,"prepare.queue_time_us":436313,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":4456,"raft.queue_time_us":129782,"raft.run_cpu_time_us":3315,"raft.run_wall_time_us":297622,"spinlock_wait_cycles":89521280,"thread_start_us":1925320,"threads_started":3,"wal-append.queue_time_us":565714}
I20260709 12:25:12.049059  5968 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:11.980746  9166 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:12.052245  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:12.042526  6118 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:12.054232  8944 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:12.040838  9001 consensus_queue.cc:1059] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.015s
I20260709 12:25:12.055757  9001 consensus_queue.cc:1243] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer f1bb8e63c2b448cdafd51f05d277c741 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:25:12.056268  9001 raft_consensus.cc:3055] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:12.056579  9001 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:12.057330  9001 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:12.037672  9116 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:12.058482  9001 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:11.984311  8889 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:12.060853  8889 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:12.019464  9031 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:25:11.990949  8813 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:12.050609  9069 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.064652  9163 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:12.066596  9022 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:12.067227  9022 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.067589  9022 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.053275  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:11.976264  9123 consensus_queue.cc:1059] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.063s
I20260709 12:25:12.071595  6006 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:12.072139  6042 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 7. (term mismatch)
I20260709 12:25:12.072582  6042 pending_rounds.cc:85] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 6
I20260709 12:25:12.072858  6042 pending_rounds.cc:107] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 5.7
I20260709 12:25:12.073110  6042 raft_consensus.cc:2889] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:12.075384  6006 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:12.039492  8993 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:12.079087  9027 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:12.079547  9027 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:12.080111  9027 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:12.080349  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:12.080951  6038 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:12.081780  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:12.086836  9162 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:25:12.091286  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:12.092253  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:12.078416  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:12.013751  5963 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:12.092880  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:12.106032  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:12.106840  5968 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:12.107576  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:12.107823  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:12.109259  5967 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:12.010763  6037 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:12.115432  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:12.116748  6037 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:25:12.113510  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 96386.9us
I20260709 12:25:12.122087  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:12.123154  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:12.123814  6112 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
W20260709 12:25:12.241581  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.123651  5934 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:12.055769  9088 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:12.267134  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:12.071147  8944 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.275738  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 739) took 1055 ms. Trace:
I20260709 12:25:12.277163  6036 rpcz_store.cc:276] 0709 12:25:11.219951 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.220089 (+   138us) service_pool.cc:224] Handling call
0709 12:25:11.220395 (+   306us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.368872 (+148477us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.368906 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.368951 (+    45us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:11.368982 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.275496 (+906514us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b5400270954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:12.275542 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.275680 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":340965632}
I20260709 12:25:12.039234  9127 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.065s
I20260709 12:25:12.284024  6081 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:12.078013  8931 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:12.293244  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:12.077658  8993 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:12.295830  6038 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:12.272382  8618 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:12.273520  9162 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:12.262830  8665 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:12.311738  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.277405  9031 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:12.293239  8931 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.257543  9001 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.206s
I20260709 12:25:12.304232  8754 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:12.300428  8993 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:12.298242  9117 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:12.356257  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 738) took 1147 ms. Trace:
I20260709 12:25:12.360466  6043 rpcz_store.cc:276] 0709 12:25:11.209181 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.209408 (+   227us) service_pool.cc:224] Handling call
0709 12:25:11.219222 (+  9814us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.301983 (+ 82761us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.302023 (+    40us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:11.302065 (+    42us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:11.302097 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.355992 (+1053895us) spinlock_profiling.cc:243] Waited 82.6 ms on lock 0x7b5400171454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:12.356049 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.356197 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":189888384}
I20260709 12:25:12.288349  8944 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.301426  8756 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 4.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.051s
I20260709 12:25:12.348966  8931 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:12.344976  9160 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:12.349694  8754 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:12.371862  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 248177us
I20260709 12:25:12.374976  5934 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:12.377648  5934 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:12.362332  9117 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:12.343418  8618 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.346774  9162 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:12.407554  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.345152  8665 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.348356  9031 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.376425  8754 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.353636  9027 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:12.409366  9095 consensus_meta.cc:287] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.000s
I20260709 12:25:12.397423  9117 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.389397  9081 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:12.397059  9069 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:12.379575  9160 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.420524  9113 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.421631  9081 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.433810  9001 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:12.437836  8979 consensus_meta.cc:287] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.532s	user 0.008s	sys 0.001s
W20260709 12:25:12.557617  9181 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.136s	user 0.000s	sys 0.000s
I20260709 12:25:12.557827  8618 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:12.558499  9179 log.cc:927] Time spent T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.138s	user 0.000s	sys 0.000s
I20260709 12:25:12.480883  8949 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.485472  9081 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.522341  9116 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:12.488220  9113 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.556263  8979 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:12.586294  9180 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.172s	user 0.001s	sys 0.000s
I20260709 12:25:12.486913  9001 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.568497  8949 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:12.596364  9160 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:12.591977  8944 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:12.602272  9162 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:12.603356  8665 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:12.574920  9116 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.608355  9116 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:12.592593  9164 consensus_meta.cc:287] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.000s
I20260709 12:25:12.609210  9164 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:12.611361  9164 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:12.614755  9031 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:12.625655  8949 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:12.629662  9117 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:12.634382  9022 consensus_meta.cc:287] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.566s	user 0.006s	sys 0.000s
I20260709 12:25:12.634725  9027 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:12.691422  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 313700us
I20260709 12:25:12.675361  5965 raft_consensus.cc:2368] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6.
I20260709 12:25:12.699185  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:12.688577  5967 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:25:12.644125  9081 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:12.729655  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:12.642813  9117 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:12.730739  5967 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:12.732108  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:12.674535  5963 raft_consensus.cc:2368] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5.
I20260709 12:25:12.741245  8979 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:12.742352  9141 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:12.743367  9141 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.742810  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 1607) took 1742 ms. Trace:
I20260709 12:25:12.750310  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:12.639609  9001 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:12.752410  9186 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:12.753296  9186 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:12.753592  8993 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.757190  9164 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:12.757894  9164 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:12.758492  9164 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:12.752605  6044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1606) took 1753 ms (client timeout 2044 ms). Trace:
I20260709 12:25:12.766573  6038 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.767141  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2012) took 2711 ms. Trace:
I20260709 12:25:12.769590  8993 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:12.767642  6114 rpcz_store.cc:276] 0709 12:25:10.055895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.056007 (+   112us) service_pool.cc:224] Handling call
0709 12:25:10.056492 (+   485us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:10.106082 (+ 49590us) raft_consensus.cc:1534] Early marking committed up to index 3
0709 12:25:10.172593 (+ 66511us) log.cc:844] Serialized 14 byte log entry
0709 12:25:11.082795 (+910202us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:11.083265 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:25:11.083397 (+   132us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:11.083430 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.766334 (+1682904us) spinlock_profiling.cc:243] Waited 44.9 ms on lock 0x7b5400207954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:12.766419 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:12.766524 (+   105us) raft_consensus.cc:1685] finished
0709 12:25:12.766631 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.766893 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83948,"prepare.queue_time_us":76179,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":163326,"raft.run_cpu_time_us":359,"raft.run_wall_time_us":32569,"spinlock_wait_cycles":103292160,"thread_start_us":899065,"threads_started":2,"wal-append.queue_time_us":839988,"wal-append.run_cpu_time_us":5750,"wal-append.run_wall_time_us":1308579}
W20260709 12:25:12.759697  6044 rpcz_store.cc:269] 0709 12:25:10.999506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.999636 (+   130us) service_pool.cc:224] Handling call
0709 12:25:12.752235 (+1752599us) spinlock_profiling.cc:243] Waited 481 ms on lock 0x7b5400172354. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:12.752441 (+   206us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1105234816}
I20260709 12:25:12.772459  9186 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:12.773046  9081 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:12.773394  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 46910.1us
I20260709 12:25:12.766597  9022 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.777449  9022 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:12.782548  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:12.783509  6110 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.783756  6116 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:12.784438  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:12.784801  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.785302  6112 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:12.794723  9031 consensus_queue.cc:1059] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:12.796006  9117 raft_consensus.cc:3055] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:12.796404  9117 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:12.758829  8665 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:12.797497  8665 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.744483  6039 rpcz_store.cc:276] 0709 12:25:10.999815 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.000501 (+   686us) service_pool.cc:224] Handling call
0709 12:25:11.000758 (+   257us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:11.126381 (+125623us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.126402 (+    21us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:11.147581 (+ 21179us) log.cc:844] Serialized 26 byte log entry
0709 12:25:11.493165 (+345584us) raft_consensus.cc:1645] Marking committed up to 2
0709 12:25:11.493210 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.742050 (+1248840us) spinlock_profiling.cc:243] Waited 112 ms on lock 0x7b54001f2f54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:12.742135 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:12.742215 (+    80us) raft_consensus.cc:1685] finished
0709 12:25:12.742227 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:12.742602 (+   375us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19536,"raft.queue_time_us":13147,"raft.run_cpu_time_us":214,"raft.run_wall_time_us":9434,"spinlock_wait_cycles":258029952,"thread_start_us":292243,"threads_started":1,"wal-append.queue_time_us":420977,"wal-append.run_cpu_time_us":9600,"wal-append.run_wall_time_us":1149831}
I20260709 12:25:12.797739  9117 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.800614  8665 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:12.801146  9117 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:12.803925  5967 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:12.814849  6110 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:12.816187  6112 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:12.817562  6038 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:12.825842  6118 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:12.827225  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:12.828078  6110 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.830128  9006 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:12.832043  8986 consensus_meta.cc:287] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.859s	user 0.009s	sys 0.005s
I20260709 12:25:12.832634  8986 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.834233  5962 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:12.835644  9194 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:12.836510  9194 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.845125  9141 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:12.861238  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:12.862469  5968 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:12.865258  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:12.861133  8528 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:12.865464  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.859272  8986 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:12.872224  6110 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:12.875260  8325 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.876250  5964 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:12.876107  8325 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.877633  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:12.878275  9031 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:12.908712  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:12.909600  6114 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:12.910759  9031 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:12.911194  9031 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:12.912437  9031 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:12.913933  9031 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:12.879240  5959 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:12.915938  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:12.919330  8862 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.920039  8862 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.922921  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:12.923426  9113 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:12.923656  6114 raft_consensus.cc:2368] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6.
I20260709 12:25:12.880367  8325 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:12.883584  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.882867  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:12.926329  5964 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:12.926870  6114 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:25:12.886616  9001 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:12.887995  8949 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:12.887888  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:12.928017  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:12.895598  8813 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:12.929327  5966 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:12.929819  8325 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.897467  8986 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.930514  9001 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.930696  8325 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.928792  8949 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.934836  8970 raft_consensus.cc:3055] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:12.935264  8970 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:12.936154  6038 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:12.937186  6645 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 9. (term mismatch)
I20260709 12:25:12.937597  6645 pending_rounds.cc:85] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 8
I20260709 12:25:12.937861  6645 pending_rounds.cc:107] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 7.9
I20260709 12:25:12.938155  6645 raft_consensus.cc:2889] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:12.938933  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 99173.1us
W20260709 12:25:12.939786  9170 log.cc:927] Time spent T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 1.189s	user 0.021s	sys 0.028s
I20260709 12:25:12.940172  8868 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:12.899480  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:12.941666  6039 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:12.941272  8986 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:12.942778  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:12.943724  8986 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:12.944139  6081 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:12.944397  8813 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:12.945076  8813 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.945832  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:12.901798  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:12.894412  9194 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:12.904150  6113 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:12.906980  9130 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:12.941259  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:12.928133  5964 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:12.944216  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:12.900600  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:12.903731  5968 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:12.907650  8586 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:12.934645  8862 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:12.927852  9178 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.566s	user 0.000s	sys 0.003s
I20260709 12:25:12.959103  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:12.940804  9121 raft_consensus.cc:3055] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:12.949221  8325 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:12.940912  9050 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:12.965548  8964 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:12.967486  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:12.968350  6039 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:12.967479  9050 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:12.971230  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:12.940822  8868 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.972010  9050 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.965549  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:12.972926  9130 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.974707  6044 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:12.975540  9130 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:12.975831  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:12.978142  6110 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:12.981045  9188 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:12.981561  9188 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:12.981954  9188 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:12.983749  8834 raft_consensus.cc:3055] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:12.984154  8834 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:12.985363  8834 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:12.971920  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:12.988010  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:12.988662  6039 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:12.919209  9164 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:12.990490  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 66084.5us
I20260709 12:25:12.991068  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:12.993017  5967 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:12.961678  8813 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:12.962184  9121 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:12.875330  8754 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:12.974309  8868 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:13.004384  5960 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 6: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:13.001111  6112 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:13.006754  5964 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:13.002969  6035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.513s	user 0.008s	sys 0.012s
I20260709 12:25:13.007746  6038 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 5
I20260709 12:25:13.007884  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:12.986264  8964 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:13.009007  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.012473  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.012643  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.015057  5961 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 7: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:25:13.015501  6035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.718s	user 0.009s	sys 0.013s
I20260709 12:25:13.014428  8834 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:13.014318  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.028976  6118 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:13.033417  6039 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
W20260709 12:25:13.036652  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 72219us
I20260709 12:25:13.042876  9125 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:13.044399  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.044881  6110 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:13.045650  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:13.043129  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.047647  6116 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:13.043465  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.049110  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:13.043263  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.053684  6117 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:13.053963  6114 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:13.079253  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.044133  9125 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.083019  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.083338  9125 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.083626  8964 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.030577  8970 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.082692  6644 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:13.041949  8949 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:13.086236  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.080227  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 753) took 1057 ms. Trace:
I20260709 12:25:13.088593  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.091969  9102 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.043s
I20260709 12:25:13.093211  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.094225  6036 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 7: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:13.094609  9160 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:13.088156  6112 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:13.096289  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1860) took 1171 ms. Trace:
I20260709 12:25:13.088935  6042 rpcz_store.cc:276] 0709 12:25:11.936231 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.939823 (+  3592us) service_pool.cc:224] Handling call
0709 12:25:11.947291 (+  7468us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:12.073608 (+126317us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:12.955326 (+881718us) spinlock_profiling.cc:243] Waited 121 ms on lock 0x7b540025ab54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:12.993720 (+ 38394us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":278155648}
I20260709 12:25:13.099191  9001 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:13.095438  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.101073  9196 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:13.121814  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.122017  9196 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.123186  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.123932  9113 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.124346  9196 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:13.100286  6609 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:13.124680  6111 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: [5.4-5.4]
W20260709 12:25:13.125353  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 80995.4us
I20260709 12:25:13.126118  6609 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:13.126812  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.127631  6043 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:13.128683  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.129891  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:13.130088  8325 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:13.130578  8325 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.126993  9006 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:13.124615  9113 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:13.131573  9006 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:25:13.133121  8931 consensus_meta.cc:287] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.753s	user 0.007s	sys 0.012s
I20260709 12:25:13.132887  9006 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.103006  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.135722  6118 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:13.107445  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.133618  8931 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.107709  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.108067  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:13.119433  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.119920  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.100795  6081 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.130925  8325 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.145471  6116 raft_consensus.cc:2368] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5.
I20260709 12:25:13.098881  8970 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:13.107882  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.120585  8754 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:13.153405  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.154846  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.156085  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.156865  6036 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 6: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:13.157688  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.157990  6036 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 5. Current term is 6. Ops: []
W20260709 12:25:13.158826  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 58159.6us
I20260709 12:25:13.163187  6112 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
W20260709 12:25:13.164614  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.119997  9117 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.165141  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:13.165514  9117 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.166131  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.164644  9130 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:13.166726  6036 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:13.167177  9130 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:13.167322  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.167761  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.130949  8373 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:25:13.168299  9130 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:13.151283  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 45079.9us
I20260709 12:25:13.170189  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.171847  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.173597  9117 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:13.141146  9121 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.5, Last appended by leader: 5, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:13.175273  9121 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:13.171273  5934 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.176800  8986 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:13.176965  5934 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.180145  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:13.180510  8889 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:13.181090  8889 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:13.095299  9160 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.119834  8868 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.182063  8754 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:13.182490  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.120097  9102 raft_consensus.cc:3055] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:13.183215  9102 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:13.182797  8889 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.183862  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.184158  9102 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.185330  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:13.155973  8931 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:13.186159  6118 raft_consensus.cc:2410] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 5 because replica has last-logged OpId of term: 4 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 5.
I20260709 12:25:13.187016  8868 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.187506  6111 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:13.177510  8986 raft_consensus.cc:697] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:13.121197  8586 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:13.187431  5934 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.189628  8586 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.190212  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.190565  6114 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:13.191824  6114 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:13.192682  6110 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.193153  8449 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:13.189579  8986 consensus_queue.cc:237] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.195518  8449 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:13.185787  9102 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:13.196583  9050 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:13.203711  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.168141  6036 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:13.185694  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.194926  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.231871  6651 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:13.196748  8449 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.233628  6113 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:13.235140  6109 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:13.235327  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.236025  9001 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:13.236420  9117 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:13.136368  8949 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.237270  9001 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:13.133666  9113 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:13.237903  8616 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:13.237279  8949 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.241631  9120 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:13.237659  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.243108  8949 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:13.237200  6006 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.243808  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.244639  9116 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:13.245069  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.245690  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.242448  9120 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.247205  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.246219  6006 leader_election.cc:400] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5.
W20260709 12:25:13.234323  6113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 2310) took 2561 ms (client timeout 1810 ms). Trace:
I20260709 12:25:13.237759  9001 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:13.247802  6006 leader_election.cc:403] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:13.231240  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.245146  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:13.252153  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.105283  6035 rpcz_store.cc:276] 0709 12:25:11.924819 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.924966 (+   147us) service_pool.cc:224] Handling call
0709 12:25:11.925246 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:11.925450 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:12.297290 (+371840us) log.cc:844] Serialized 14 byte log entry
0709 12:25:13.036347 (+739057us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:13.048644 (+ 12297us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:13.079254 (+ 30610us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.089041 (+  9787us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:13.096229 (+  7188us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":488184,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":42,"raft.queue_time_us":5468,"raft.run_cpu_time_us":178,"raft.run_wall_time_us":17534,"thread_start_us":1089843,"threads_started":2,"wal-append.queue_time_us":441653}
I20260709 12:25:13.258734  6111 raft_consensus.cc:2393] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 3: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:25:13.247972  6113 rpcz_store.cc:269] 0709 12:25:10.673291 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:10.673414 (+   123us) service_pool.cc:224] Handling call
0709 12:25:11.308974 (+635560us) spinlock_profiling.cc:243] Waited 595 ms on lock 0x7b1800053940. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482108f646 00007f4820fc958e 00007f482104af9e 00007f482104c7de 00007f482105827c 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c
0709 12:25:12.903386 (+1594412us) spinlock_profiling.cc:243] Waited 273 ms on lock 0x7b5800721ad0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fb00aa 00007f4821032447 00007f482104afe7 00007f482104c7de 00007f482105827c 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c
0709 12:25:13.234221 (+330835us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1996835072}
I20260709 12:25:13.244745  9196 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:13.238382  8616 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.263167  6039 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: [2.3-4.5]
I20260709 12:25:13.266497  6043 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
W20260709 12:25:13.268756  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.275161  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.281498  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.263728  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.267011  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.288195  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.289760  6044 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
W20260709 12:25:13.290448  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 44548us
I20260709 12:25:13.293413  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.300125  6041 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:13.305047  6111 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:13.306442  6036 raft_consensus.cc:2410] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 10 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:25:13.265009  9196 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:13.282563  8616 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.310679  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:13.312680  6112 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:13.314150  6044 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:13.315137  6038 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
W20260709 12:25:13.315193  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51540.9us
I20260709 12:25:13.308650  6117 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
W20260709 12:25:13.321987  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.316588  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.245185  9116 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.323482  6035 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:13.318904  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:13.317202  8586 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:13.302165  8868 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:13.332674  6042 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:13.337000  8944 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:13.337512  8944 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:13.337867  8944 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:13.319311  9196 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:13.334882  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 71550.9us
I20260709 12:25:13.323383  9113 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:25:13.359238  9202 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.079s	user 0.001s	sys 0.000s
I20260709 12:25:13.317399  9123 consensus_queue.cc:1059] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.107s
I20260709 12:25:13.372390  6110 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:13.375963  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:13.378975  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.384737  9148 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 4. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5.
I20260709 12:25:13.356684  9113 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:25:13.363941  5934 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.68:45477 timed out after 1.544s (SENT) [suppressed 9 similar messages]
I20260709 12:25:13.390736  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:13.389325  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 1705) took 1336 ms. Trace:
I20260709 12:25:13.393055  5961 rpcz_store.cc:276] 0709 12:25:12.045197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.045304 (+   107us) service_pool.cc:224] Handling call
0709 12:25:12.942449 (+897145us) spinlock_profiling.cc:243] Waited 4.04 ms on lock 0x7b5800010598. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482601a0a0 00007f4826019984 00007f481f5946d4 00007f481f594662
0709 12:25:13.381014 (+438565us) spinlock_profiling.cc:243] Waited 68.4 ms on lock 0x7b540008be54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:13.381167 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":166501632}
I20260709 12:25:13.395902  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:13.347558  9188 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.400650  6644 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
W20260709 12:25:13.395452  5965 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2310) took 1528 ms (client timeout 1955 ms). Trace:
W20260709 12:25:13.409231  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.404835  5965 rpcz_store.cc:269] 0709 12:25:11.871432 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.871632 (+   200us) service_pool.cc:224] Handling call
0709 12:25:13.373581 (+1501949us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54000f8a54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:13.395385 (+ 21804us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1843902208}
I20260709 12:25:13.374151  9160 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:13.414862  6110 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.405077  9125 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.422925  6118 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:13.423583  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.425026  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.427305  5932 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:13.423046  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.428814  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.429033  9079 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:13.408450  8528 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.430519  8528 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.432826  8528 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:13.435849  6647 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:13.436370  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:13.437685  8754 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:13.438107  6645 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:13.381855  9001 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.441195  6113 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:13.423419  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.426203  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.422997  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:13.437789  5932 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:13.447506  6642 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:13.454398  6115 raft_consensus.cc:2393] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:13.405016  8931 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:13.428932  9164 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:13.474836  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:13.460531  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.476905  6650 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:13.456571  8754 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:13.495652  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.493901  6643 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:13.481449  8931 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.441165  8616 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.480026  9120 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:13.503430  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.507550  6651 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: [4.6-4.6]
I20260709 12:25:13.505791  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.504047  9148 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.515443  9148 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.497571  8754 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:13.519536  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1859) took 1584 ms. Trace:
I20260709 12:25:13.519392  8754 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:13.519961  6040 rpcz_store.cc:276] 0709 12:25:11.924500 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.934546 (+ 10046us) service_pool.cc:224] Handling call
0709 12:25:11.934866 (+   320us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:11.977542 (+ 42676us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:11.977574 (+    32us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:11.978182 (+   608us) log.cc:844] Serialized 52 byte log entry
0709 12:25:13.101845 (+1123663us) spinlock_profiling.cc:243] Waited 6.87 ms on lock 0x7b18003dc900. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:25:13.343313 (+241468us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:13.459671 (+116358us) log.cc:844] Serialized 14 byte log entry
0709 12:25:13.479663 (+ 19992us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:13.494030 (+ 14367us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:13.494081 (+    51us) raft_consensus.cc:1685] finished
0709 12:25:13.501138 (+  7057us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:13.506935 (+  5797us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":33297,"raft.queue_time_us":47868,"raft.run_cpu_time_us":254,"raft.run_wall_time_us":15894,"spinlock_wait_cycles":15799168,"thread_start_us":301773,"threads_started":2,"wal-append.queue_time_us":1405823}
I20260709 12:25:13.510377  9013 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:13.523531  8931 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:13.524562  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 86892.7us
I20260709 12:25:13.530274  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.518251  9148 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:13.527817  9200 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.068s	user 0.001s	sys 0.000s
I20260709 12:25:13.519383  9188 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:13.504875  8986 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:13.542812  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 157140us
W20260709 12:25:13.557021  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.557968  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:13.560094  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 201778us
I20260709 12:25:13.561865  6110 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:13.564780  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:13.566980  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.509305  9113 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:13.561522  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 146421us
I20260709 12:25:13.570300  6650 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:13.561051  9148 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:13.591835  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 47166.3us
I20260709 12:25:13.592845  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:13.594539  5961 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:13.594749  9210 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:13.595517  9164 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:13.596493  5864 catalog_manager.cc:5697] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 4 to 5, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:13.591861  9027 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.599166  9027 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.601210  9027 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:13.598850  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.607287  5965 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 7: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:13.608335  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.608892  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:13.609201  9201 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.205s	user 0.001s	sys 0.000s
I20260709 12:25:13.609567  5967 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:13.608906  9001 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:13.609930  5864 catalog_manager.cc:5697] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 5, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:13.612349  9116 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:13.612115  5864 catalog_manager.cc:5697] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 2 to 3, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 3 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:13.613397  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.614001  5864 catalog_manager.cc:5697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 4, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 4 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:13.614813  8616 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:13.615494  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.616057  5967 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:13.618626  6114 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:13.621552  9006 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:13.621961  9006 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:13.554044  8986 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.622804  9006 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.624049  9006 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:13.624312  8986 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:13.625957  9148 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.627482  9125 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:13.610531  9207 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 12:25:13.632406  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.633955  6081 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:13.634879  5864 catalog_manager.cc:5697] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 2 to 4, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 4 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:13.641358  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.652045  5864 catalog_manager.cc:5697] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 4, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 4 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:13.654991  9027 consensus_queue.cc:1059] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:25:13.655287  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 97033.6us
I20260709 12:25:13.656368  9013 raft_consensus.cc:3055] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:13.634831  9116 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:25:13.656808  9013 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:25:13.657895  9031 consensus_meta.cc:287] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.743s	user 0.009s	sys 0.009s
I20260709 12:25:13.664338  5864 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 5 to 6, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 6 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:13.657799  9013 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.666414  5864 catalog_manager.cc:5697] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 2 to 4, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 4 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:13.668934  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.669981  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.670279  9116 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:13.670843  5967 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:25:13.671867  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.675168  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.673028  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.676448  5964 raft_consensus.cc:2393] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 5: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:13.671454  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.675186  5962 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:13.677412  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.678220  5965 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:13.669269  5864 catalog_manager.cc:5697] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 2 to 4, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 4 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:13.688345  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 107407us
I20260709 12:25:13.692915  9148 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:13.693699  9013 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:13.696945  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.693054  5864 catalog_manager.cc:5697] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 3, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 3 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:13.700943  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.677486  9121 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:13.706286  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.716311  8813 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:13.717581  8813 consensus_queue.cc:1243] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer f1bb8e63c2b448cdafd51f05d277c741 log is divergent from this leader: its last log entry 6.4 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 3
I20260709 12:25:13.718158  8931 raft_consensus.cc:3055] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:13.718607  8931 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:13.719512  8931 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:13.720152  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.720609  8931 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:13.722060  9148 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:13.722754  9148 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.725864  9148 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:13.726842  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.727583  6649 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:13.728561  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:13.729064  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.729233  5963 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:13.734793  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:13.737056  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 172333us
I20260709 12:25:13.736541  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.743621  5963 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:13.744706  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.744920  5960 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:13.746532  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.705044  9113 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:13.751076  9113 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.753659  9113 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:13.755261  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.755578  5932 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:13.756477  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.757395  8616 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:13.758908  5963 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:13.759222  8616 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:13.759678  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.759050  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.693766  8986 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:13.735234  9121 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:13.767732  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:13.650440  8944 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.774176  5962 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.760290  5960 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
W20260709 12:25:13.776834  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 63210.2us
I20260709 12:25:13.777765  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:13.778786  6650 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:13.749495  8325 consensus_meta.cc:287] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.562s	user 0.010s	sys 0.009s
I20260709 12:25:13.781208  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.769225  6082 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:13.759708  8616 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.788295  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.785542  8325 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.791872  8325 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:13.794868  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.795744  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:13.796315  5960 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.796808  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:13.781834  9050 consensus_meta.cc:287] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.585s	user 0.012s	sys 0.001s
I20260709 12:25:13.799893  5963 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:13.797447  6038 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.776317  9121 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.798408  6650 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
W20260709 12:25:13.806574  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.807268  9196 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.798949  9116 raft_consensus.cc:2764] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:25:13.785326  9164 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:13.815515  6646 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:25:13.816033  6643 raft_consensus.cc:2368] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7.
I20260709 12:25:13.815315  5961 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: [4.3-4.3]
W20260709 12:25:13.827221  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.835206  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.786343  8986 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:13.829746  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 83995.6us
I20260709 12:25:13.833060  6038 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:13.838821  5962 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:13.841637  6609 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:13.845711  5962 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:13.847361  5959 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:13.847384  6043 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:13.850546  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.851717  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.847834  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.859157  6006 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.863889  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.866173  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:13.867053  9100 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:13.867837  6084 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:13.848054  8813 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.017s
I20260709 12:25:13.870260  9196 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:13.862949  9148 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:13.871243  9148 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:13.871704  9148 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:13.850512  9050 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:13.873958  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.878074  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.878698  5963 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 7: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:13.879565  9136 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:13.870317  8813 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:13.874800  8944 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:13.875919  9210 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:13.880839  9027 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:13.881009  9050 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:13.884524  9125 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:13.894692  9160 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:13.892508  9210 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:13.900199  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.875849  9116 consensus_queue.cc:1059] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.019s
W20260709 12:25:13.894883  9223 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.143s	user 0.002s	sys 0.002s
I20260709 12:25:13.901497  9027 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.934206  9027 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:13.902761  9050 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:13.906719  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:13.937736  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.937932  9148 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:13.914678  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 46886.1us
I20260709 12:25:13.918906  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.886708  8813 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:13.923130  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:13.923346  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.926191  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.928694  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.931239  5960 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:13.931533  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.931945  9116 raft_consensus.cc:3055] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:13.929838  9210 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:13.940929  6648 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:25:13.914322  8986 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:13.947765  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.947937  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:13.949493  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.941989  5968 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:13.909981  8616 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:13.946709  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 105131us
I20260709 12:25:13.953081  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:13.955724  6040 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.956832  8616 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:13.957569  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 98468.4us
I20260709 12:25:13.958678  6006 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.959897  9196 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:13.960520  9196 raft_consensus.cc:697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:13.961429  9196 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:13.953370  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:13.962796  5965 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:25:13.952963  5961 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:13.968294  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:13.969084  6038 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:13.969911  6040 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:13.950939  5932 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:13.930585  9125 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:13.971861  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.977759  6037 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:13.972949  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:13.942541  9116 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:13.942407  8813 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:25:13.973609  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.978441  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.978441  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:13.981726  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:13.982734  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:13.983968  9148 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:13.985402  6650 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:13.982625  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:13.989755  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:13.992717  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:13.994443  6648 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:13.996428  6084 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.000155  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:13.984412  9125 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:13.992826  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:14.002214  6109 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:14.006193  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:14.002562  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.009629  8616 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:13.995633  9079 raft_consensus.cc:2764] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
W20260709 12:25:14.010207  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.017289  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.017397  5934 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.018266  6118 raft_consensus.cc:2410] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:25:14.018433  9141 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:14.019960  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.024762  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:14.025893  6037 raft_consensus.cc:2410] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 6 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:25:14.027706  6115 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:25:13.996184  8944 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:14.028064  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 59299.6us
I20260709 12:25:14.020766  9141 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.033138  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.034412  9031 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:13.992970  9123 consensus_queue.cc:1059] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:25:14.042793  6114 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:14.044888  9121 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:14.047484  9031 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:14.048735  9031 raft_consensus.cc:3055] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:14.048930  5934 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.049238  9031 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:14.049830  9164 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:14.050868  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 48434.3us
I20260709 12:25:14.003494  8986 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.007241  9160 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:14.073730  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.077467  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:14.078513  6081 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:14.080363  6006 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:14.081296  9196 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:14.081823  9196 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.081362  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:14.083189  8931 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:14.083359  8986 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:14.084272  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:14.083217  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.085659  8986 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:14.086002  9079 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:14.086730  9001 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:14.088819  8931 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.089273  8931 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:14.082211  9196 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:14.083329  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.095592  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:14.082151  6084 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.087592  5934 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.101274  6118 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:14.102702  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.104162  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:14.081252  9211 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.418s	user 0.000s	sys 0.003s
I20260709 12:25:14.107376  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:14.063150  8528 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:14.109062  6084 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.050272  9031 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:14.115427  5932 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:14.117906  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.116165  6109 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:14.010161  9116 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:14.119896  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:14.117620  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.122570  6084 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.123710  6608 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:14.123742  5932 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:14.066905  9164 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.049s
I20260709 12:25:14.127405  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:14.127658  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 44434.1us
I20260709 12:25:14.109558  9160 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:14.174314  6648 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:14.127271  9001 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:14.121307  8970 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
I20260709 12:25:14.122514  8944 raft_consensus.cc:2764] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
W20260709 12:25:14.190035  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 56864.7us
I20260709 12:25:14.192811  9148 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.133306  9136 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:14.127029  9079 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:14.132176  8325 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:14.131234  9113 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:25:14.196076  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.196669  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.134936  8373 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:14.192852  9116 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:14.193539  9148 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:14.246378  9050 raft_consensus.cc:3055] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:14.246902  9050 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:14.247702  9148 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:14.247965  9050 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:14.199175  8325 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:14.250803  8325 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:14.251263  9050 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:14.197116  9117 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:14.181450  9121 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:14.244478  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 156970us
W20260709 12:25:14.244694  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 122211us
W20260709 12:25:14.258037  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 61478.9us
I20260709 12:25:14.289426  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.288975  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.257709  9136 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:14.307088  9234 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:25:14.309118  9031 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:14.311808  6009 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.316031  9233 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:14.319509  6009 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.320420  9233 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:14.321746  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:14.322016  6084 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:14.347595  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 216513us
I20260709 12:25:14.351300  6082 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.303720  9238 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:14.314090  9121 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:14.350742  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:14.372218  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 59149.7us
I20260709 12:25:14.373129  6084 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:25:14.372426  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 248753us
I20260709 12:25:14.344982  9229 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:14.375015  5932 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.320961  9148 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.048s
I20260709 12:25:14.378916  6084 leader_election.cc:400] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7.
I20260709 12:25:14.381378  6009 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.377517  9117 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:14.382851  9117 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:14.383212  9117 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:14.387681  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:14.391340  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:14.392140  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:14.365628  9160 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:14.369699  9121 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:14.394884  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 93769.6us
I20260709 12:25:14.395723  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:14.397065  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:14.399319  6650 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:14.399847  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:14.358527  8616 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.026s
I20260709 12:25:14.371707  9031 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:14.352478  8944 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:14.377230  9233 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:14.377031  9229 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.422214  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:14.413552  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:14.414953  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:14.418056  5934 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:14.420863  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:14.416646  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.422834  6043 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:14.423657  6646 raft_consensus.cc:2376] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5. Re-sending same reply.
I20260709 12:25:14.410357  9121 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:14.430299  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:14.431905  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:14.432574  6041 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:14.408242  9013 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:14.435541  5932 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:14.436151  6111 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:14.437541  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:14.437870  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.442898  9123 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:25:14.443902  5853 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ec584257f9db451c965f6b092aa9069c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0069e2ba1f02412e8e1d6c20a1fb510f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:14.445981  6035 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:14.450590  9031 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:14.451131  9031 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:14.453168  9031 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:14.453819  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:14.456754  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.457924  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.459022  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.459707  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.459955  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.460870  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.461011  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.461476  6115 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:25:14.461593  9242 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:14.464567  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:14.462365  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:14.462901  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.464570  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.474575  6110 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:14.475112  6109 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:14.464087  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.468114  6084 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.463195  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.477218  6117 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:14.463795  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:14.412951  9113 raft_consensus.cc:697] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:14.491228  6042 raft_consensus.cc:2368] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7.
I20260709 12:25:14.462296  9242 raft_consensus.cc:697] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:14.422967  9164 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:14.463470  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:14.492152  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.492396  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.493777  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:14.499193  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.464157  9230 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:25:14.426649  9229 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:14.529556  6115 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:14.529583  6114 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 7: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:14.532325  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:14.532491  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 102548us
W20260709 12:25:14.533417  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 74011.1us
I20260709 12:25:14.534842  5934 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.535717  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:14.461201  9244 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:14.539772  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.540212  6109 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:25:14.543037  6109 pending_rounds.cc:85] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 5
I20260709 12:25:14.543291  6109 pending_rounds.cc:107] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:25:14.543516  6109 raft_consensus.cc:2889] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:14.543883  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.541085  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:14.544523  6116 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
W20260709 12:25:14.541901  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 106459us
I20260709 12:25:14.547106  6112 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:14.549098  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:14.554971  6082 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.526309  9125 raft_consensus.cc:2764] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
W20260709 12:25:14.557631  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 145883us
I20260709 12:25:14.558043  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:14.563917  6110 raft_consensus.cc:2376] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7. Re-sending same reply.
I20260709 12:25:14.564276  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:14.564857  6042 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:14.463871  8931 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:14.569306  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.552278  9141 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:14.583935  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 115913us
I20260709 12:25:14.582559  6109 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
W20260709 12:25:14.589248  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 55457.8us
I20260709 12:25:14.561647  9233 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:14.545019  9148 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.032s
I20260709 12:25:14.571017  8754 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:14.551783  8449 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:25:14.571376  9243 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:14.598515  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.554091  8325 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:14.577070  9001 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:14.571494  9248 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:14.592434  9238 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:14.611536  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 75098.3us
W20260709 12:25:14.634831  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 65609.2us
I20260709 12:25:14.624864  6112 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:14.556494  9160 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:14.616022  9233 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:14.644491  6112 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:25:14.652071  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 81429.7us
I20260709 12:25:14.641376  9238 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:14.608371  9013 raft_consensus.cc:2764] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:25:14.609098  8754 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:14.662966  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:14.665467  6650 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:14.668156  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:14.668398  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.668901  6649 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
W20260709 12:25:14.670176  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.672417  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 79145.5us
I20260709 12:25:14.674962  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:14.680444  6114 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:14.683467  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:14.669842  8813 consensus_meta.cc:287] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.666s	user 0.005s	sys 0.005s
I20260709 12:25:14.684136  6114 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:14.625576  9239 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.123s
I20260709 12:25:14.691154  6009 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.666353  9238 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:14.695827  6035 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:14.607682  9113 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:14.696135  6082 leader_election.cc:400] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7.
I20260709 12:25:14.699368  6082 leader_election.cc:403] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:25:14.670318  9079 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:14.702658  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:14.703475  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:14.704355  9255 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.055s
I20260709 12:25:14.704744  6646 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:25:14.695837  9250 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:25:14.616755  9243 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:14.691242  9148 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:14.714670  6110 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:14.703641  9079 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:14.720708  9079 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:14.721907  9079 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:14.732977  8931 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:14.733736  8754 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:14.702503  9027 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:14.744977  6041 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:14.694042  8813 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:14.718123  9125 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:14.759756  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 76640.2us
W20260709 12:25:14.763063  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 71988.3us
I20260709 12:25:14.763968  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.709582  9136 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7.
I20260709 12:25:14.645939  9242 consensus_queue.cc:237] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:14.774286  6111 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
W20260709 12:25:14.768836  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 49642.2us
I20260709 12:25:14.701922  9260 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:25:14.779378  9117 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:14.730073  9001 consensus_queue.cc:1059] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.031s
I20260709 12:25:14.795557  6009 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.759919  9125 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:14.770080  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.814544  5968 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 5 index: 3. (index mismatch)
I20260709 12:25:14.815508  6009 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.816658  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:14.823400  8931 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:14.823872  8931 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:14.824268  8931 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:14.824671  9117 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:14.827798  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.829003  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.821393  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:14.830394  5964 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:14.831969  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:14.832443  6009 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.829071  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:14.834985  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:14.835498  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:14.814563  9027 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:14.847318  6036 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:14.818776  9125 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:14.833947  9116 consensus_meta.cc:287] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.543s	user 0.002s	sys 0.008s
I20260709 12:25:14.822717  9148 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:14.854717  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 84726.1us
I20260709 12:25:14.859534  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:14.860267  5966 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
W20260709 12:25:14.864454  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 86288.1us
I20260709 12:25:14.834542  9255 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:14.865433  6113 raft_consensus.cc:2410] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 5 because replica has last-logged OpId of term: 4 index: 3, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 2.
I20260709 12:25:14.865824  5967 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:14.869839  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.843502  9246 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:14.835908  9254 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:14.887477  8449 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:14.862841  9210 consensus_meta.cc:287] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.895s	user 0.012s	sys 0.000s
I20260709 12:25:14.933060  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:14.934949  6651 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEARNER]: Advancing to term 5
I20260709 12:25:14.868328  9255 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:14.943598  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 65080.2us
I20260709 12:25:14.871891  9027 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:14.865211  9243 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:14.872066  8325 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:14.948706  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 116333us
I20260709 12:25:14.960793  6112 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
W20260709 12:25:14.944280  9211 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:25:14.971282  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.942600  9248 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:14.950985  9255 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:14.988677  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 149906us
I20260709 12:25:14.981163  6009 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:14.992331  5964 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:14.940527  8616 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:25:14.993801  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:14.941365  9239 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.037s
I20260709 12:25:14.973016  9260 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:14.938618  9210 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:15.000492  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:14.980670  9248 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:15.001163  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:14.997923  9121 consensus_meta.cc:287] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.543s	user 0.005s	sys 0.005s
I20260709 12:25:15.007102  9121 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.009366  9121 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:14.990191  9001 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:15.000173  8986 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.016s
W20260709 12:25:15.016191  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 59916.3us
W20260709 12:25:15.018159  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.018862  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:15.020423  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:15.021204  6039 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 7: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:25:15.021680  9264 log.cc:927] Time spent T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.165s	user 0.000s	sys 0.000s
I20260709 12:25:14.998297  8813 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:15.032810  6118 raft_consensus.cc:2368] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5.
I20260709 12:25:15.065757  6644 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:15.029196  9027 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:15.038800  9278 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:15.046335  6040 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:15.048281  9210 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:15.056130  9229 consensus_meta.cc:287] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.503s	user 0.007s	sys 0.002s
I20260709 12:25:15.084210  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:15.084658  8449 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:15.084995  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:15.079061  9006 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:25:15.087637  6036 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:15.068614  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:15.092813  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 54396us
I20260709 12:25:15.093868  6646 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:25:15.096561  6084 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:15.039199  9100 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.042s
I20260709 12:25:15.087560  9006 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:15.073058  6042 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:15.079021  6035 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:25:15.129242  6035 pending_rounds.cc:85] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 3
I20260709 12:25:15.080621  6039 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:15.011997  9248 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:15.030897  9260 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:15.104516  9050 consensus_meta.cc:287] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.853s	user 0.008s	sys 0.004s
W20260709 12:25:15.103339  9196 consensus_meta.cc:287] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 1.012s	user 0.012s	sys 0.000s
I20260709 12:25:15.129518  6035 pending_rounds.cc:107] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:25:15.094254  6611 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:15.150275  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 56163.1us
W20260709 12:25:15.119875  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 85966.8us
I20260709 12:25:15.152626  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:15.154537  6009 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:15.148981  6035 raft_consensus.cc:2889] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:15.157163  6611 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:15.147377  9196 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:15.164786  8813 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:15.167624  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:15.099967  9229 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.098111  8528 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.168897  6038 raft_consensus.cc:2368] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4.
I20260709 12:25:15.104802  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:15.102692  8325 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:25:15.170986  9229 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:15.141585  8931 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:15.172394  9100 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:15.174597  8931 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:15.130295  9269 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.103856  9027 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:15.071354  6651 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEARNER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:15.177789  9269 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.185001  9269 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:15.178560  9263 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:15.155748  9279 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:15.177063  9251 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:15.191818  9276 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
I20260709 12:25:15.119228  9210 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:15.128208  9006 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:25:15.198634  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 137548us
W20260709 12:25:15.207557  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 210662us
I20260709 12:25:15.078934  9001 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.117s
I20260709 12:25:15.108560  9126 consensus_queue.cc:1059] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.087s
I20260709 12:25:15.225040  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:15.225625  8931 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:15.207165  9210 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:25:15.247764  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 80245.3us
I20260709 12:25:15.230594  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:15.259440  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:15.261911  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:15.265151  9006 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.249502  9229 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:15.267562  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:15.270601  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:15.271476  6112 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:15.274806  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:15.277596  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:15.278242  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:15.275506  6115 raft_consensus.cc:2376] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4. Re-sending same reply.
I20260709 12:25:15.248842  9243 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:25:15.283488  5967 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:25:15.285501  9079 consensus_meta.cc:287] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.563s	user 0.005s	sys 0.006s
I20260709 12:25:15.262399  9125 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:15.288233  9125 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:15.290743  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:15.291384  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:15.291961  5967 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:15.291390  6651 raft_consensus.cc:2376] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4. Re-sending same reply.
I20260709 12:25:15.278335  6035 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:25:15.295123  9196 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:15.294941  9125 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:15.297336  9255 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:15.298345  9027 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:15.261716  8970 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:15.304620  9210 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.316807  9006 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:15.302609  8970 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:15.319334  8970 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:15.314146  9238 consensus_meta.cc:287] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.612s	user 0.009s	sys 0.002s
I20260709 12:25:15.320771  9248 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:15.324754  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 94302.7us
I20260709 12:25:15.326081  6082 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:15.327212  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:15.329381  6112 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:15.331763  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:15.333652  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:15.334316  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:15.336115  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 89088.9us
I20260709 12:25:15.338301  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:15.340075  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:15.342962  6039 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:15.347415  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 190337us
I20260709 12:25:15.324517  9254 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:15.351686  6110 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:15.355271  5932 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:15.336990  9125 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:15.344784  8970 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:15.367069  6609 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:15.359995  9239 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:15.395450  5967 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:15.360294  9255 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:15.398049  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:15.359686  9079 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
W20260709 12:25:15.398851  9273 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.342s	user 0.001s	sys 0.004s
I20260709 12:25:15.362926  9254 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:15.335170  9238 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:15.400048  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 49630.3us
I20260709 12:25:15.400924  9251 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:15.419751  6109 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:15.421475  9295 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:15.396878  6648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0468d70863214876bf59fb3ea9474307"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:15.422405  9238 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:15.427502  9239 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:25:15.404309  9125 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:15.405979  9248 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:15.440413  6009 leader_election.cc:336] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.810s (SENT)
I20260709 12:25:15.406220  9251 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.460630  9251 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:15.461169  9239 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:15.407691  9255 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:25:15.443275  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 89233.8us
I20260709 12:25:15.444765  6648 raft_consensus.cc:606] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:15.467378  6648 raft_consensus.cc:614] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:15.446645  9295 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:15.447515  9285 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.469496  9285 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:15.419714  9254 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:15.466648  9255 raft_consensus.cc:697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:25:15.477694  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.487716  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:15.509714  6116 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:15.510231  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 64266us
W20260709 12:25:15.509143  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 169157us
I20260709 12:25:15.457162  9126 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.026s
I20260709 12:25:15.513273  6115 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:15.514269  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:15.515004  6115 raft_consensus.cc:2393] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 3: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:15.518245  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:15.518939  6115 raft_consensus.cc:2368] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6.
I20260709 12:25:15.519639  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:15.520138  6115 raft_consensus.cc:2376] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7. Re-sending same reply.
I20260709 12:25:15.520785  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:15.524695  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 84555.5us
I20260709 12:25:15.525440  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:15.527207  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:15.529119  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:15.530390  6115 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:25:15.532102  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:15.533106  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:15.533711  6115 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:15.534691  9312 consensus_queue.cc:1059] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:15.534741  5964 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:15.481917  9303 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:25:15.524403  9123 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.545166  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:15.546298  6115 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:15.547079  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:15.547688  6115 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:15.545760  9123 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:15.550688  9301 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:25:15.550976  9123 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:15.552037  9306 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:15.554790  9255 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.560076  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:15.560659  6041 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:15.560737  6037 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:15.562125  6609 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:15.569000  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:15.572753  5967 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:25:15.585175  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:15.585994  5967 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:15.590351  6115 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:15.596791  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:15.602087  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:15.598934  8373 consensus_queue.cc:1059] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:15.619333  6608 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:15.600203  6115 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:15.633456  6110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:15.634209  6110 raft_consensus.cc:606] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:15.634579  6110 raft_consensus.cc:614] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:15.625353  9050 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:15.642630  9050 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:15.631944  8325 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:15.643126  8970 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:15.643700  8325 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:15.644603  8325 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.646817  9123 raft_consensus.cc:3055] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:15.647240  9123 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:15.648056  9123 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.643121  9050 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:15.650862  9123 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:15.672201  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:15.659674  9247 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:15.674598  6110 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:15.678020  6115 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:15.673422  9247 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:15.701097  9136 raft_consensus.cc:3055] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:15.711992  9136 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:15.703785  9251 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.723711  6116 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:15.724275  6110 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: [5.6-5.6]
I20260709 12:25:15.725306  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:15.733505  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:15.734721  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:15.726783  9317 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:15.734725  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:15.739816  6041 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:15.740216  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:15.742587  9027 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:15.743851  6009 leader_election.cc:400] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6.
I20260709 12:25:15.744159  6009 leader_election.cc:403] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:25:15.745253  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:15.745975  8813 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:15.746333  8813 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:15.746709  8813 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:15.752076  6042 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:15.726425  9136 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:15.761123  6041 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:15.772119  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:15.779464  6116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:15.779978  6116 raft_consensus.cc:606] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:15.780231  6116 raft_consensus.cc:614] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:15.784185  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:15.769958  9233 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6.
I20260709 12:25:15.770417  9317 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:15.819265  6115 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 3. (term mismatch)
I20260709 12:25:15.819720  6115 pending_rounds.cc:85] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 2
I20260709 12:25:15.819962  6115 pending_rounds.cc:107] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 4.3
I20260709 12:25:15.820195  6115 raft_consensus.cc:2889] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:15.822608  6113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 2340) took 1379 ms. Trace:
I20260709 12:25:15.782924  9255 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:15.823055  6113 rpcz_store.cc:276] 0709 12:25:14.439768 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.439874 (+   106us) service_pool.cc:224] Handling call
0709 12:25:15.818684 (+1378810us) spinlock_profiling.cc:243] Waited 387 ms on lock 0x7b54000e29d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:15.818861 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":889202560}
I20260709 12:25:15.824705  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:25:15.830179  9297 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.306s	user 0.000s	sys 0.001s
I20260709 12:25:15.829137  9294 raft_consensus.cc:3055] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:15.839082  9294 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:15.839984  9294 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.841132  9294 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:15.844416  8813 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.853452  6043 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:15.846414  8449 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.785583  9325 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:15.790998  9027 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:25:15.834182  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:15.859339  6117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:15.859970  6117 raft_consensus.cc:606] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:15.818672  9247 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:15.860360  6117 raft_consensus.cc:614] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:15.863207  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:15.865473  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:15.870066  9321 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:25:15.871868  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:15.873548  6647 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:15.874739  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:15.878984  9317 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.878876  6643 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
W20260709 12:25:15.884610  9320 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.173s	user 0.001s	sys 0.000s
I20260709 12:25:15.885160  6644 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:25:15.865778  9322 log.cc:927] Time spent T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.154s	user 0.001s	sys 0.000s
W20260709 12:25:15.882570  9327 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:25:15.860018  9261 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.891556  9117 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.891989  9261 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.892802  9031 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.893308  9031 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:15.894955  9251 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:15.896395  8813 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:15.897022  8813 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:15.897428  8813 raft_consensus.cc:697] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:15.899870  5967 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:15.900522  9325 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:15.901181  6118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 2334) took 1465 ms (client timeout 1810 ms). Trace:
W20260709 12:25:15.901559  6118 rpcz_store.cc:269] 0709 12:25:14.435838 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.436908 (+  1070us) service_pool.cc:224] Handling call
0709 12:25:15.900979 (+1464071us) spinlock_profiling.cc:243] Waited 578 ms on lock 0x7b5400385254. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:15.901124 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1329866112}
I20260709 12:25:15.902697  9260 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:15.902933  8754 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:15.903844  6112 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5. Ops: [4.4-4.4]
I20260709 12:25:15.850267  9255 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:15.904479  9255 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:15.892072  9117 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.920141  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:15.894218  9261 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:15.921779  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:15.926959  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:15.923739  9116 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.930069  9116 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:15.932193  9116 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:15.934194  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:15.934928  5960 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:15.938692  9117 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:15.940150  9100 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.946775  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:15.948927  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:15.969347  6117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:15.970021  6117 raft_consensus.cc:606] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:15.970394  6117 raft_consensus.cc:614] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:15.971704  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:15.940670  9100 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.860275  8449 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:15.950436  9261 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:15.986819  9117 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:15.986933  8449 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:15.987495  9117 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:15.988086  9300 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.647s	user 0.000s	sys 0.005s
I20260709 12:25:15.903072  8813 consensus_queue.cc:237] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:15.988834  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 164208us
I20260709 12:25:15.991110  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:15.984092  9027 raft_consensus.cc:697] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:15.980393  9261 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:16.025383  6117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adcfbfcb66fd4891959337c005335841"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:16.027132  6117 raft_consensus.cc:606] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:16.027532  6117 raft_consensus.cc:614] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:16.027288  9331 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:16.033547  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.035596  9100 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:16.038062  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:16.038760  5961 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:15.992381  9050 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.047566  6035 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:16.056828  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:16.070745  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:16.072585  9325 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:16.073604  9027 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:16.074615  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
W20260709 12:25:16.115082  6038 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 1633) took 1727 ms (client timeout 2197 ms). Trace:
I20260709 12:25:16.074770  9050 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:16.075785  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.076327  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:16.076161  9126 consensus_queue.cc:1059] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:16.062744  9260 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:16.124362  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:16.081714  8449 raft_consensus.cc:1064] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:25:16.090166  6114 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:16.091188  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:16.127504  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:16.091946  9285 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:16.095013  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:16.132594  6642 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:16.097268  5960 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:16.097046  9278 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:16.098479  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:16.104527  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:16.137732  6643 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:16.107620  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:16.110198  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.110356  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:16.115190  6042 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:16.139061  6036 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:25:16.123538  5967 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:16.140439  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:16.125434  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 99643.1us
I20260709 12:25:16.127907  6116 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:16.090063  9136 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:16.149307  8754 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:16.149884  8754 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.150246  8754 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:16.118883  6038 rpcz_store.cc:269] 0709 12:25:14.387557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:14.395496 (+  7939us) service_pool.cc:224] Handling call
0709 12:25:16.114868 (+1719372us) spinlock_profiling.cc:243] Waited 770 ms on lock 0x7b54001f2a54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:16.115022 (+   154us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1770262272}
I20260709 12:25:16.146085  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:16.146474  9332 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:25:16.146293  9126 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:16.147226  9240 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:16.124591  9260 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.159190  9117 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:16.160830  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 53309.2us
I20260709 12:25:16.161897  9050 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:16.162662  8449 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.163934  9259 consensus_queue.cc:1059] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:16.164551  6116 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:16.165270  9255 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.165843  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:16.167327  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:16.213208  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:16.213761  6114 raft_consensus.cc:2368] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7.
I20260709 12:25:16.210407  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:16.175732  6036 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:16.209625  6009 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:16.199926  9136 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.218844  9136 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.220995  9136 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:16.222021  9261 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:16.222507  6609 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:16.225558  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:16.226037  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:16.178721  9240 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:16.232571  9240 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.234134  9240 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:16.227314  9315 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:16.236014  9255 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:16.236172  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:16.236565  6037 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:16.138532  9333 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 3.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.073s
I20260709 12:25:16.243265  9261 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:16.244436  5965 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
I20260709 12:25:16.213052  9117 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:16.246385  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:16.249956  6642 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:16.216080  9050 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.253058  6109 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:16.255609  5967 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:16.260048  5934 leader_election.cc:400] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7.
I20260709 12:25:16.246702  9302 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:16.260428  5934 leader_election.cc:403] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:16.249910  9315 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.248852  9006 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:16.256603  9285 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:16.274137  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 91464.4us
I20260709 12:25:16.252442  9125 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:16.277369  6009 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:16.275043  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:16.288214  9333 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:16.289512  9260 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:16.289850  9333 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:16.272529  9302 raft_consensus.cc:697] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:16.291327  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:16.280267  9125 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:16.292543  9302 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.291821  9031 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:16.272739  9006 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.267719  9261 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.272718  9325 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 7
W20260709 12:25:16.305193  9335 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.289s	user 0.001s	sys 0.001s
I20260709 12:25:16.310001  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:16.317466  9325 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 6. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7.
I20260709 12:25:16.318527  8986 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:16.319409  9331 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:16.320154  6043 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:16.319106  5934 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:16.322563  9244 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:16.322968  9244 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.323323  9244 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:16.328740  6650 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
W20260709 12:25:16.298760  9282 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 1.152s	user 0.003s	sys 0.004s
I20260709 12:25:16.299355  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:16.331882  6009 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:16.334134  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:16.296540  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:16.262792  9050 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:16.351539  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:16.354108  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:16.354821  6651 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:16.357295  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:16.328657  9261 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:16.294432  9315 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:16.335860  6642 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEARNER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:16.338104  6644 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:16.298621  9345 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:16.339781  9331 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:16.298405  9006 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:16.338030  9233 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:16.265266  9117 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.294662  9125 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:16.335088  6650 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:16.339257  8754 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.363384  9345 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:16.388832  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:16.370126  9331 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:25:16.394248  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.395491  9245 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:16.398018  6039 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:16.399807  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:16.401422  6081 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:16.403811  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:16.406997  9345 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:16.412156  5932 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:16.407588  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:16.413698  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:16.412444  6081 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:16.417234  6043 raft_consensus.cc:2393] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:16.418277  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:16.419059  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:16.382479  9233 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:16.390066  9278 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:16.415663  9031 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:16.418399  9315 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:16.435411  9345 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:16.426791  9317 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.009s
I20260709 12:25:16.437022  9255 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:16.411439  9245 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:16.506595  9245 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:16.427042  9260 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:16.500753  9233 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.523432  9244 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:16.524605  5959 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:16.525012  9269 raft_consensus.cc:3055] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:16.525467  9269 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:16.526355  9269 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.527814  9269 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:16.528287  9244 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:16.529963  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:16.532858  9031 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:16.534022  9031 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:16.539036  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:16.540139  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:16.541453  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.544597  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:16.554325  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:16.445382  9263 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.115s
I20260709 12:25:16.519595  9260 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:16.433537  9278 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:16.577929  5965 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
W20260709 12:25:16.582587  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.472386  9027 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.098s
I20260709 12:25:16.558777  9345 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:16.565019  9116 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:16.572696  9260 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:16.624215  5864 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 311) took 14149 ms (client timeout 15000 ms). Trace:
W20260709 12:25:16.626237  9328 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:16.648811  6648 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:16.623052  9345 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:16.652418  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 227716us
I20260709 12:25:16.655310  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:16.658510  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:16.566929  9331 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.626058  9116 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.641503  9367 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:16.667300  6038 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []
W20260709 12:25:16.667711  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 243830us
W20260709 12:25:16.668052  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 102113us
I20260709 12:25:16.674047  5961 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:16.684319  8754 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:16.697487  6648 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:16.701270  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:16.702188  9248 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:16.702663  9248 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:16.703050  9248 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:16.703895  9164 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:16.702943  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:16.746505  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 64989.1us
I20260709 12:25:16.710911  6082 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:16.754887  6082 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:16.753729  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 95313.2us
W20260709 12:25:16.792863  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 91921.5us
W20260709 12:25:16.624667  5864 rpcz_store.cc:269] 0709 12:25:02.462909 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:02.463200 (+   291us) service_pool.cc:224] Handling call
0709 12:25:03.027440 (+564240us) spinlock_profiling.cc:243] Waited 3.49 ms on lock 0x7b5400002490. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df300b2 00007f4826ea9759 00007f4826e41a76 00007f4826e12d58 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc
0709 12:25:03.093470 (+ 66030us) spinlock_profiling.cc:243] Waited 29 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:25:16.612341 (+13518871us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:14.199531 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:14.308873 (+109342us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:14.308934 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:25:14.308970 (+    36us) tablet.cc:662] Decoding operations
0709 12:25:14.310105 (+  1135us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:14.310181 (+    76us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:14.310207 (+    26us) tablet.cc:685] Acquiring locks for 10 operations
0709 12:25:14.311174 (+   967us) tablet.cc:701] Row locks acquired
0709 12:25:14.311223 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:25:14.311393 (+   170us) write_op.cc:270] Start()
0709 12:25:14.350673 (+ 39280us) write_op.cc:276] Timestamp: P: 1783599914311321 usec, L: 0
0709 12:25:14.352850 (+  2177us) op_driver.cc:348] REPLICATION: starting
0709 12:25:14.464363 (+111513us) log.cc:844] Serialized 4042 byte log entry
0709 12:25:14.878004 (+413641us) op_driver.cc:464] REPLICATION: finished
0709 12:25:15.022425 (+144421us) write_op.cc:301] APPLY: starting
0709 12:25:15.022584 (+   159us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:15.022868 (+   284us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:15.023100 (+   232us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:15.031156 (+  8056us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:15.175918 (+144762us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=10
0709 12:25:15.195178 (+ 19260us) write_op.cc:312] APPLY: finished
0709 12:25:15.280820 (+ 85642us) log.cc:844] Serialized 77 byte log entry
0709 12:25:15.281011 (+   191us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:15.281151 (+   140us) write_op.cc:454] Released schema lock
0709 12:25:15.281215 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:15.281667 (+   452us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:15.281694 (+    27us) write_op.cc:454] Released schema lock
0709 12:25:15.684408 (+402714us) spinlock_profiling.cc:243] Waited 24 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482105132a 00007f4820fd6f14 00007f4820fd6ec3 00007f4820fd6e38 00007f4820fd6df3 00007f4820fd60dc 00007f4820fffe16 00007f4820fe7cbb 00007f4820fd239d 00007f4820fd5d75
Metrics: {"mutex_wait_us":1780,"reported_tablets":23,"spinlock_wait_cycles":74800768,"child_traces":[["op",{"apply.queue_time_us":135001,"apply.run_cpu_time_us":5162,"apply.run_wall_time_us":259223,"num_ops":10,"prepare.queue_time_us":225165,"prepare.run_cpu_time_us":13289,"prepare.run_wall_time_us":398211,"raft.queue_time_us":139058,"raft.run_cpu_time_us":20168,"raft.run_wall_time_us":907411,"replication_time_us":501221,"spinlock_wait_cycles":55239552,"thread_start_us":325835,"threads_started":4,"wal-append.queue_time_us":120439,"wal-append.run_cpu_time_us":9575,"wal-append.run_wall_time_us":1691124}]]}
I20260709 12:25:16.756949  9117 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:16.854605  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:16.752378  9136 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:16.756026  8754 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:16.760672  9367 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:16.859074  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 104268us
I20260709 12:25:16.871362  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:16.877059  6082 leader_election.cc:400] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 3. Current term is 4.
I20260709 12:25:16.897440  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:16.792716  9285 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.093s
I20260709 12:25:16.855350  9079 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:16.879206  9125 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:16.813486  9343 consensus_queue.cc:1059] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:25:16.850363  9160 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:16.855150  9117 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.058s
I20260709 12:25:16.946231  9116 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:16.936170  9079 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:16.902968  9246 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:16.958122  9136 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.007s
I20260709 12:25:16.965914  8325 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:16.966653  8325 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.972664  9245 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:16.975919  9050 consensus_meta.cc:287] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.619s	user 0.000s	sys 0.009s
I20260709 12:25:16.976394  9050 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.977706  6649 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:16.900430  9241 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
I20260709 12:25:16.936839  9278 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:16.984309  9246 raft_consensus.cc:697] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:16.987504  9246 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.992376  9116 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:16.993216  9358 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
W20260709 12:25:16.993726  9362 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:25:16.994287  9353 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.319s	user 0.000s	sys 0.001s
W20260709 12:25:16.993311  9349 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.331s	user 0.001s	sys 0.000s
I20260709 12:25:16.993094  9116 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.998082  9136 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:16.998543  9136 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:16.999320  9136 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:16.999845  9116 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:17.000617  9136 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:17.005232  9370 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:17.005820  9370 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:16.992466  9361 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.009004  9361 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.010722  9252 raft_consensus.cc:3055] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:17.012044  9113 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.012588  9113 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.011278  9252 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:16.993016  9369 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:16.992497  9355 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.292s	user 0.000s	sys 0.001s
I20260709 12:25:17.011252  9361 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:17.019344  6116 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:16.995332  9345 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:17.021142  9371 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
W20260709 12:25:17.022398  9366 log.cc:927] Time spent T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
W20260709 12:25:17.024464  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.030519  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:17.029596  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:17.029381  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:17.048249  6113 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:17.049103  9027 raft_consensus.cc:3055] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:17.049525  9027 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:17.050319  9027 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.051541  9027 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:17.052150  9079 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:17.052348  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:17.053110  6114 raft_consensus.cc:2393] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 7: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:17.058616  9254 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.059176  9254 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.060495  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.061344  9254 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:17.063609  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.067139  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.068559  9113 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:17.069195  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.048009  9006 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:17.058696  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.070700  9006 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:17.071115  9006 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:17.072224  6116 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:17.071970  9006 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.073225  9006 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:17.073550  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:17.074146  6118 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:17.074889  9370 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:17.075399  9370 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:17.075822  9269 consensus_meta.cc:287] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.000s
I20260709 12:25:17.077108  6109 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:25:17.051301  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:17.079025  6111 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:17.079314  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:17.080467  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:17.082650  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:17.086349  6118 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:17.084586  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:17.082883  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:17.090874  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:17.087790  6114 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:17.092736  6115 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:17.069785  9295 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:17.069859  6043 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:17.097896  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:17.098636  6009 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:17.100359  6114 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 7 index: 4. (index mismatch)
W20260709 12:25:17.101058  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.104472  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:17.104944  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.066072  9260 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.106223  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.112408  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.112450  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:17.087255  9360 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:17.113730  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:17.117467  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.069978  8813 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:25:17.120381  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.120805  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.127319  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:17.122499  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.123647  5967 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:17.076304  9248 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.075842  9370 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.129082  6082 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:17.135651  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:17.133091  6043 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:17.139303  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.140112  5964 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:17.114800  9278 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:17.100142  9113 consensus_queue.cc:1059] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.036s
I20260709 12:25:17.125373  9360 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.104337  9295 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.114606  9345 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.033s
I20260709 12:25:17.136855  9367 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:17.146127  5853 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 5a6d648272bf4bef9d5337acfc9d4a96 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0069e2ba1f02412e8e1d6c20a1fb510f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:17.136718  9378 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:17.191056  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 55472.6us
I20260709 12:25:17.192366  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:17.147217  9379 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:17.233254  9367 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:17.236716  9361 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.236841  9378 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:17.237294  9361 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.237465  9378 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.239661  9361 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:17.236227  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 122563us
I20260709 12:25:17.171748  9343 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:17.173790  9113 consensus_queue.cc:1243] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer 0557a7246c8945b99e5215c99d4ddf9c log is divergent from this leader: its last log entry 4.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:25:17.243858  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:17.244030  6112 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:17.241952  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:17.197784  5853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 56318us
I20260709 12:25:17.246937  9113 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:17.247418  9113 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:17.247836  9113 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:17.248003  9370 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:17.248135  9360 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:17.212960  9031 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:17.218135  9160 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.246168  9343 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:17.261534  9356 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.608s	user 0.001s	sys 0.006s
I20260709 12:25:17.263154  9378 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:17.265019  9379 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.265604  9379 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.268054  9379 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:17.264918  9360 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:17.270517  9079 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:17.271082  9079 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.273196  9079 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:17.273524  9387 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:17.274403  9387 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:17.276008  6084 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:17.276290  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:17.277031  6112 raft_consensus.cc:2368] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8.
I20260709 12:25:17.280175  6009 leader_election.cc:400] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8.
I20260709 12:25:17.280507  6009 leader_election.cc:403] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:17.281112  9345 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:17.270330  9233 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:17.249450  9263 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:25:17.293427  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:17.258610  9384 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:17.294387  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:17.295476  6113 raft_consensus.cc:2393] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 7: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:17.303200  6116 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:17.259560  9343 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:17.307556  6109 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:17.309188  6112 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:25:17.309636  6112 pending_rounds.cc:85] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 5
I20260709 12:25:17.309861  6112 pending_rounds.cc:107] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:25:17.310113  6112 raft_consensus.cc:2889] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:17.313911  9295 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:17.314711  9248 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:17.255707  9031 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.255488  9160 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.302414  9384 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:17.304332  9361 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:17.328154  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:17.329155  6118 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:17.333109  9248 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:25:17.338670  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:17.339349  6650 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:17.315289  9260 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:17.316033  9315 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:17.351152  9384 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.352608  9384 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:17.358865  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 224697us
I20260709 12:25:17.363447  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.364172  5960 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:17.364970  6043 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:17.365568  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:17.365233  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.320840  8813 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 12:25:17.369804  9363 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.395s	user 0.000s	sys 0.005s
I20260709 12:25:17.371181  9160 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:17.371690  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 144240us
I20260709 12:25:17.367017  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.367246  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:17.364115  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.366107  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.366677  9386 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:25:17.369194  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:17.359548  9389 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:25:17.372516  6039 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:17.375975  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:17.373348  5966 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
W20260709 12:25:17.385320  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 69299.2us
I20260709 12:25:17.390165  9376 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:17.371945  9126 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:25:17.387331  9233 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:17.404763  6035 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:17.381844  9248 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.361549  9315 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:17.413025  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.388221  9345 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8.
I20260709 12:25:17.387027  9380 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:17.416674  9241 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:17.425974  9376 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.427620  9376 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.429834  9376 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:17.431540  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.435340  9031 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:17.435518  9397 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:25:17.441515  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.442337  6035 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 6: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:17.402311  9160 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.017s
I20260709 12:25:17.444820  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:17.445550  6644 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:17.446772  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:17.448292  9031 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:17.419891  9361 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.470356  6044 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
W20260709 12:25:17.472157  9365 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.524s	user 0.003s	sys 0.000s
I20260709 12:25:17.475452  9113 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.476229  5965 raft_consensus.cc:3055] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:17.476577  5965 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:17.477310  5965 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.413321  9248 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.451879  9315 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:17.490986  6114 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:17.483731  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:17.493784  9248 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:17.494520  9333 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:17.477641  9113 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:17.494994  9333 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:17.495384  9333 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:17.496071  8325 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:17.491659  9343 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.480217  9361 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.478369  5965 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:17.502868  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.498842  9343 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:17.521755  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:17.524142  5959 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:17.528941  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:17.529590  6117 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:17.448724  9031 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:17.532302  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 122880us
I20260709 12:25:17.524471  9345 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.024s
I20260709 12:25:17.535434  9031 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:17.553500  9374 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.574s	user 0.005s	sys 0.000s
I20260709 12:25:17.550494  9397 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.004s
I20260709 12:25:17.558395  5959 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
W20260709 12:25:17.631980  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:17.627566  8813 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:17.580385  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.637598  6037 raft_consensus.cc:2410] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:25:17.557731  9333 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.570572  9361 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:17.602747  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:17.639432  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:17.605829  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1917) took 1199 ms. Trace:
I20260709 12:25:17.640013  6039 rpcz_store.cc:276] 0709 12:25:16.406606 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.424178 (+ 17572us) service_pool.cc:224] Handling call
0709 12:25:17.372219 (+948041us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:17.381629 (+  9410us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.605581 (+223952us) spinlock_profiling.cc:243] Waited 938 ms on lock 0x7b540025ba50. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:17.605761 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2156450688}
I20260709 12:25:17.641029  9333 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:17.594035  5865 catalog_manager.cc:5697] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 4 to 5, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 5 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:17.644095  8970 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.644861  8970 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.644461  5865 catalog_manager.cc:5697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 2 to 5, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 5 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:17.584807  5934 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:17.646965  9123 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:17.647625  8970 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:17.647820  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 63106.6us
I20260709 12:25:17.610069  9245 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:17.648761  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:17.649348  6648 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:17.650061  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.650274  9397 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:25:17.626515  9372 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.640s	user 0.004s	sys 0.000s
I20260709 12:25:17.601931  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.560457  6117 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
W20260709 12:25:17.591566  9357 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.616s	user 0.001s	sys 0.002s
I20260709 12:25:17.656023  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1905) took 1258 ms. Trace:
I20260709 12:25:17.585777  5965 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 3. (term mismatch)
I20260709 12:25:17.657963  5965 pending_rounds.cc:85] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 2
I20260709 12:25:17.658223  5965 pending_rounds.cc:107] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:25:17.658452  5965 raft_consensus.cc:2889] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:17.659055  9164 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 4 current term: 4 is higher.
I20260709 12:25:17.634992  8813 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.621763  9252 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.661126  9252 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:17.661501  8813 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:17.578228  5963 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:17.647190  8754 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:17.662492  8754 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:17.549865  9395 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:17.652935  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 1919) took 1136 ms. Trace:
I20260709 12:25:17.656383  6036 rpcz_store.cc:276] 0709 12:25:16.397804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.398735 (+   931us) service_pool.cc:224] Handling call
0709 12:25:16.399056 (+   321us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.399374 (+   318us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.399400 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.399823 (+   423us) log.cc:844] Serialized 26 byte log entry
0709 12:25:16.661790 (+261967us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:16.983365 (+321575us) log.cc:844] Serialized 14 byte log entry
0709 12:25:17.056179 (+ 72814us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:17.056254 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.591034 (+534780us) spinlock_profiling.cc:243] Waited 78.3 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:17.655755 (+ 64721us) raft_consensus.cc:1685] finished
0709 12:25:17.655845 (+    90us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.655968 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120303,"prepare.queue_time_us":601547,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":77318,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":170,"spinlock_wait_cycles":180025600,"thread_start_us":441945,"threads_started":2,"wal-append.queue_time_us":561208}
I20260709 12:25:17.663080  6042 rpcz_store.cc:276] 0709 12:25:16.516912 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:16.517306 (+   394us) service_pool.cc:224] Handling call
0709 12:25:16.517678 (+   372us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:16.552253 (+ 34575us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:16.552287 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:16.572457 (+ 20170us) log.cc:844] Serialized 26 byte log entry
0709 12:25:16.797045 (+224588us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:16.797085 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:16.797158 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:17.625869 (+828711us) spinlock_profiling.cc:243] Waited 73.8 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:17.652644 (+ 26775us) raft_consensus.cc:1685] finished
0709 12:25:17.652665 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:17.652870 (+   205us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26651,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":6865,"spinlock_wait_cycles":169788288,"thread_start_us":176129,"threads_started":1,"wal-append.queue_time_us":361671}
I20260709 12:25:17.615623  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.665531  9395 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.604063  9339 raft_consensus.cc:3055] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:17.666728  9339 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:17.667893  9395 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:17.667629  9339 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.604413  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.663470  8754 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.669636  9339 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:17.639997  6043 raft_consensus.cc:2368] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
W20260709 12:25:17.589255  9331 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.002s	sys 0.002s
I20260709 12:25:17.639565  6650 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:17.623492  9050 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:17.671777  9331 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.621s	user 0.002s	sys 0.006s
I20260709 12:25:17.646391  5865 catalog_manager.cc:5697] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 2 to 4, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 4 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:17.679445  9373 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:17.679839  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 55320.4us
I20260709 12:25:17.679584  5865 catalog_manager.cc:5697] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:17.683140  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:17.683986  6112 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:17.680384  9373 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.687712  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.687914  9373 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:17.689261  9375 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:17.689796  9375 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:17.690673  9375 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.689188  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.671500  5934 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:17.691869  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:17.692651  6650 raft_consensus.cc:2410] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 8 because replica has last-logged OpId of term: 6 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 7.
I20260709 12:25:17.695071  6648 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:17.695309  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:17.707360  6118 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:17.695749  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:17.709401  5966 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:17.709934  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:17.697369  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.713256  5959 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:25:17.697834  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:17.714144  6109 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 3.
I20260709 12:25:17.698387  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.698758  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.715224  5967 raft_consensus.cc:2410] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 6 because replica has last-logged OpId of term: 4 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 3 index: 3.
I20260709 12:25:17.700333  5964 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:17.698663  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:17.701628  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:17.702490  6035 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:17.680948  5865 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 7 to 9, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 9 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.719305  5865 catalog_manager.cc:5697] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 1 to 2, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 2 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:17.700747  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.723433  6611 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:17.724674  9258 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:17.725749  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 82579.9us
I20260709 12:25:17.727461  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:17.721369  6006 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:17.735071  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:17.734444  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:17.744426  5932 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:17.751461  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.752646  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:17.753485  5962 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 6: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:17.755468  5968 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:17.756014  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:17.769168  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:17.763473  5865 catalog_manager.cc:5697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 3 to 5, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 5 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:17.764133  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:17.775969  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:17.776554  5964 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:17.779240  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:17.780359  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:17.783020  6112 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 7: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:17.760407  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:17.786008  5932 leader_election.cc:400] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:25:17.786334  5932 leader_election.cc:403] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:25:17.789321  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:17.758783  9395 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:17.798451  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:17.774863  9260 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:17.804667  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:17.806859  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:17.777990  9384 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:17.809454  6648 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:17.810899  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:17.580222  9160 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.811582  6644 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:17.817788  9343 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:17.818153  9331 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:17.833138  5964 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:17.778825  9379 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.035s
I20260709 12:25:17.799582  9395 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:17.776325  9031 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.814446  8449 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:17.814270  9123 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:17.846632  5865 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:25:17.848233  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 58080.9us
W20260709 12:25:17.849086  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 44488.3us
I20260709 12:25:17.849834  5934 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:17.841301  9246 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.844s	user 0.007s	sys 0.035s
I20260709 12:25:17.840493  9375 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:17.835346  9315 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:25:17.853505  5865 catalog_manager.cc:5697] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 1 to 2, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 2 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:17.857949  9307 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:17.862731  9324 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:17.823714  9404 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 4, Time since last communication: 0.045s
I20260709 12:25:17.827221  9384 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:17.845561  9395 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:17.828361  9258 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:25:17.845706  9331 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:25:17.852286  9246 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.857s	user 0.007s	sys 0.035s
I20260709 12:25:17.871783  5966 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:17.849859  9376 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:17.879215  9376 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.873805  5865 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 3 to 6, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 6 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:17.834794  9160 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:17.883579  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 48750.3us
W20260709 12:25:17.884639  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 92039.2us
I20260709 12:25:17.887387  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:17.889521  6081 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:17.890342  9412 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:17.891654  9141 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:17.892277  9141 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:17.893177  9141 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.868511  9375 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:17.895009  9260 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:17.896544  9375 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:17.894569  8449 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:17.901567  5865 catalog_manager.cc:5697] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:17.899708  6081 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:17.905790  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:17.902513  5932 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:17.909807  9260 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:17.910753  9079 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:17.894356  9031 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:17.891788  9406 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:25:17.919798  6081 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:17.897907  9384 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:17.934425  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:17.999434  5865 catalog_manager.cc:5697] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 5 to 6, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 6 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:18.019256  5865 catalog_manager.cc:5697] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 2 to 5, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 5 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:18.020928  5865 catalog_manager.cc:5697] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:25:18.015789  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 83726.8us
I20260709 12:25:18.033303  9376 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:18.034997  9415 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.131s	user 0.001s	sys 0.000s
I20260709 12:25:18.036780  9378 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:18.039644  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:18.040815  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:18.041623  6642 raft_consensus.cc:2410] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:17.933522  9398 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.055680  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:18.044812  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 110653us
W20260709 12:25:18.046697  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 158167us
I20260709 12:25:18.000692  9361 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.068794  6081 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:18.079945  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:18.057336  9031 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:18.071838  9398 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:18.103627  9409 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.187s	user 0.003s	sys 0.014s
I20260709 12:25:18.105224  9398 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:18.091496  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:18.106858  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:18.073431  9331 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:18.094504  6042 raft_consensus.cc:2410] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 6 because replica has last-logged OpId of term: 5 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:18.075941  9378 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:18.120314  6611 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:18.059669  9027 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:18.091593  9404 raft_consensus.cc:2955] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 2 to 7, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:18.097680  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:18.070106  9126 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:18.095719  9160 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:18.124454  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:18.123799  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:18.146111  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:18.146782  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 3 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:18.125834  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:18.132154  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 63954us
I20260709 12:25:18.151687  6035 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 6: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:18.135967  6643 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:18.074927  9376 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 2, Time since last communication: 0.025s
I20260709 12:25:18.156906  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:18.123907  6038 raft_consensus.cc:2955] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 2 to 7, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:18.156430  9376 consensus_queue.cc:1243] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer f1bb8e63c2b448cdafd51f05d277c741 log is divergent from this leader: its last log entry 3.3 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 2
I20260709 12:25:18.167416  5934 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:18.155154  9126 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:18.141570  9027 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:18.122289  8449 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:18.170615  6081 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:18.184018  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:18.194944  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:18.212281  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:18.168190  9375 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.170528  9263 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:18.174584  9079 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:18.179186  9027 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:18.219959  9378 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:18.220902  9418 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:18.221668  9160 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:18.245178  9031 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:18.269212  9031 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:18.280035  9126 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:18.300612  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:18.262212  9418 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:18.286074  9395 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:18.324946  5965 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:18.341199  9419 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:25:18.383526  6038 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 6. (term mismatch)
I20260709 12:25:18.383987  6038 pending_rounds.cc:85] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 5
I20260709 12:25:18.384223  6038 pending_rounds.cc:107] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 4.6
I20260709 12:25:18.384462  6038 raft_consensus.cc:2889] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:18.393702  9425 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:25:18.380853  9418 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:18.402761  9395 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:18.418990  6609 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:18.426141  9263 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:25:18.426900  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 203883us
I20260709 12:25:18.430860  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:18.441673  9247 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:18.426770  9240 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.008s
I20260709 12:25:18.453756  9379 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:18.454355  9379 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:18.455950  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:18.456600  9379 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:18.461375  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:18.462069  6644 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:18.470811  5963 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:18.440752  9254 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 7.4, Next index: 5, Last known committed idx: 3, Time since last communication: 0.034s
I20260709 12:25:18.474419  5962 pending_rounds.cc:85] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 2
I20260709 12:25:18.475319  5962 pending_rounds.cc:107] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 3.3
I20260709 12:25:18.474711  6039 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 4. (term mismatch)
I20260709 12:25:18.475989  6039 pending_rounds.cc:85] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 3
I20260709 12:25:18.476187  6039 pending_rounds.cc:107] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 5.4
I20260709 12:25:18.476492  6112 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:18.477675  9247 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:18.478173  9247 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:18.481864  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:18.482537  6113 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:18.484951  9302 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:18.485615  9302 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:18.485137  6116 raft_consensus.cc:2955] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 2 to 7, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:18.487895  9027 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:18.489531  6040 raft_consensus.cc:2410] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 8 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:25:18.475564  5962 raft_consensus.cc:2889] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:18.494349  6038 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:18.494797  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:18.495841  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:18.494928  6039 raft_consensus.cc:2889] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:18.499322  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:18.500726  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:18.510289  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:18.475489  9254 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:18.510846  9373 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:25:18.523600  9306 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:18.517342  9254 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:18.526075  9384 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:18.526593  9384 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.526963  9384 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:18.529485  9027 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:18.526155  9254 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:18.532449  9247 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:18.532271  9254 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.538683  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:18.494146  9031 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:18.502990  9302 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:18.535260  6611 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:18.510046  9260 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.557446  6643 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:18.558770  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:18.561708  6109 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:18.564615  5959 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:18.586437  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51262.4us
I20260709 12:25:18.588866  6643 raft_consensus.cc:2955] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 2 to 7, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:18.591511  9325 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:18.593294  5934 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:18.601707  5965 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:18.607551  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:18.612941  6116 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 7: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:18.616595  8970 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.616987  9031 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:18.623456  9141 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:18.625347  5934 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:18.626758  9398 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:18.600771  9136 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:18.628294  9136 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:18.631237  9247 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:18.633005  6110 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:18.632879  9247 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:18.640097  9345 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:18.642153  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:18.655431  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:18.658178  9384 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:18.663184  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:18.665261  5963 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:18.665266  6650 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:18.667603  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:18.668771  9343 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:18.672298  9384 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:18.673182  6084 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:18.679332  5853 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet ec584257f9db451c965f6b092aa9069c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 0069e2ba1f02412e8e1d6c20a1fb510f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:18.607887  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:25:18.769996  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 85353.8us
I20260709 12:25:18.745537  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:18.782783  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 96740.5us
I20260709 12:25:18.782450  6039 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 7: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:18.787297  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:18.797116  5965 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 3. Current term is 4. Ops: []
W20260709 12:25:18.800784  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 192979us
I20260709 12:25:18.781632  9260 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:25:18.787042  9390 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:18.770033  5853 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.ChangeConfig -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 90753.5us
I20260709 12:25:18.686976  9302 consensus_queue.cc:1059] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.112s
I20260709 12:25:18.815446  6642 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:18.815689  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:18.816022  6109 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:18.821955  6117 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:18.817037  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:18.822877  6644 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:18.806026  9384 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:18.842845  6117 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:18.830752  9268 consensus_queue.cc:1059] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 3.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:25:18.846989  9240 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:18.808604  9390 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:18.861543  9384 raft_consensus.cc:697] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:18.912206  9390 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:18.913902  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:18.914649  6109 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:18.916386  6611 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:18.926419  9258 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:18.949697  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:18.951081  9380 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:18.952817  9136 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:18.961654  6039 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:25:18.945595  9258 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:18.971930  9258 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:18.970667  9333 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election won for term 7
W20260709 12:25:18.982793  9445 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.102s	user 0.001s	sys 0.000s
I20260709 12:25:18.978082  9453 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
W20260709 12:25:18.984256  9446 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
W20260709 12:25:18.986238  9450 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
W20260709 12:25:18.986742  9440 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.106s	user 0.000s	sys 0.001s
W20260709 12:25:18.987316  9437 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
I20260709 12:25:18.987581  9258 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:18.989045  9333 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:25:18.989725  9438 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.268s	user 0.001s	sys 0.000s
W20260709 12:25:18.978514  9441 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:25:18.964927  9345 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:25:18.944621  9384 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:19.015460  6648 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:25:19.015727  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:19.030689  6649 raft_consensus.cc:2368] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8.
I20260709 12:25:19.031601  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:19.032348  6037 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:19.048746  6084 leader_election.cc:400] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8.
I20260709 12:25:19.049139  6084 leader_election.cc:403] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:19.057650  6644 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:19.060377  9160 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:25:19.080925  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 246362us
I20260709 12:25:19.043254  9453 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:25:18.990559  9333 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:19.082546  9295 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:19.062191  9404 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:25:19.106235  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:19.136807  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:19.137848  6037 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:19.135283  9463 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.152174  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:19.158349  9461 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.070s	user 0.000s	sys 0.001s
W20260709 12:25:19.159062  9457 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.072s	user 0.001s	sys 0.000s
I20260709 12:25:19.151597  9258 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:19.157204  9463 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:19.189730  9463 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:19.259851  9246 raft_consensus.cc:3055] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:19.260511  9246 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:19.261624  9246 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:19.275945  9246 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:19.305179  6037 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:19.306691  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:19.307750  9246 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:19.308342  9246 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:19.309568  9246 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:19.314184  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 145550us
I20260709 12:25:19.316685  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:19.317478  6649 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
W20260709 12:25:19.324295  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 240541us
I20260709 12:25:19.327011  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:19.331180  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:19.331947  5959 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:19.334507  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:19.347977  6037 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:19.350024  9463 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:19.361533  9463 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.361913  9463 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:19.380635  9253 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.381237  9253 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:19.350656  9113 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:25:19.411106  6113 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:25:19.426410  5965 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:19.492878  9160 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8.
I20260709 12:25:19.463367  9467 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.507486  9467 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:19.511943  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:19.512596  6109 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:19.513964  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:19.528244  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:19.544952  6118 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:19.552024  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:19.554186  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:19.472894  9164 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.048s
W20260709 12:25:19.565418  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 219363us
I20260709 12:25:19.527890  9467 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:19.555114  9379 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:19.593413  9379 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.589869  9253 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
W20260709 12:25:19.626796  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 58735us
W20260709 12:25:19.630717  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 62114.8us
I20260709 12:25:19.649264  9261 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:25:19.667961  9470 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.194s	user 0.001s	sys 0.000s
W20260709 12:25:19.683447  9475 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:25:19.685351  9479 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.065s	user 0.001s	sys 0.000s
I20260709 12:25:19.688396  9160 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:19.689121  9160 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:19.695263  9160 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:19.625731  9379 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:19.642743  9463 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:19.708930  9463 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:19.757907  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:19.758391  9379 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:19.761211  9379 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:19.776258  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:19.782757  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:19.790382  9241 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:19.794843  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:19.795469  5961 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:19.807171  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:19.818900  5961 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:19.827035  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:19.843981  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 251721us
I20260709 12:25:19.848279  9331 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:19.848837  9331 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:19.852483  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:19.853118  6649 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:19.861073  6649 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:19.877686  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:19.890390  9331 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:19.883936  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 100798us
I20260709 12:25:19.911559  6081 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:19.912582  9453 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:19.925760  6116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:19.926393  6116 raft_consensus.cc:606] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:19.926760  6116 raft_consensus.cc:614] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:19.930142  6116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:19.930707  6116 raft_consensus.cc:606] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:19.931440  6006 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:19.933064  9463 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:19.933584  9463 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:19.934417  9463 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:19.937212  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 44627.5us
I20260709 12:25:19.938221  6116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:19.938966  6116 raft_consensus.cc:606] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:19.939268  6116 raft_consensus.cc:614] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:19.948719  5961 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:25:19.949337  5961 raft_consensus.cc:606] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:19.952386  6650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:19.953022  6650 raft_consensus.cc:606] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:19.962644  6116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:19.963229  6116 raft_consensus.cc:606] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:19.963526  6116 raft_consensus.cc:614] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:19.967993  6042 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:19.969079  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:19.969770  5968 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
W20260709 12:25:19.970896  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 124527us
I20260709 12:25:19.973407  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:19.975176  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:19.976045  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:19.976194  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:19.979363  9339 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:19.979780  9339 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:19.980237  9339 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:19.982975  5864 catalog_manager.cc:5697] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.985402  5864 catalog_manager.cc:5697] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 2 to 7, term changed from 3 to 5, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:19.984035  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:19.990187  5865 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 305) took 13700 ms (client timeout 15000 ms). Trace:
I20260709 12:25:19.992411  6117 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:19.993194  6116 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:19.992411  6649 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:19.994130  6650 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:19.995540  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:19.996848  5864 catalog_manager.cc:5697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 5 to 9, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 9 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:19.998198  5864 catalog_manager.cc:5697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 4 to 8, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:19.999457  5864 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 4 to 6, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 6 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:19.977670  9466 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:25:19.993024  9473 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:20.013689  6040 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: [5.5-5.5]
W20260709 12:25:19.990609  5865 rpcz_store.cc:269] 0709 12:25:06.289779 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:06.290000 (+   221us) service_pool.cc:224] Handling call
0709 12:25:19.990129 (+13700129us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:18.312019 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:18.403770 (+ 91751us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:18.403816 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:25:18.403843 (+    27us) tablet.cc:662] Decoding operations
0709 12:25:18.405217 (+  1374us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:18.405281 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:18.405309 (+    28us) tablet.cc:685] Acquiring locks for 14 operations
0709 12:25:18.406416 (+  1107us) tablet.cc:701] Row locks acquired
0709 12:25:18.406439 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:25:18.414250 (+  7811us) write_op.cc:270] Start()
0709 12:25:18.427275 (+ 13025us) write_op.cc:276] Timestamp: P: 1783599918409287 usec, L: 0
0709 12:25:18.428283 (+  1008us) op_driver.cc:348] REPLICATION: starting
0709 12:25:18.497612 (+ 69329us) log.cc:844] Serialized 5670 byte log entry
0709 12:25:19.155266 (+657654us) op_driver.cc:464] REPLICATION: finished
0709 12:25:19.477200 (+321934us) write_op.cc:301] APPLY: starting
0709 12:25:19.481760 (+  4560us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:19.482033 (+   273us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:19.489726 (+  7693us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:19.692582 (+202856us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:19.692836 (+   254us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:25:19.692884 (+    48us) write_op.cc:312] APPLY: finished
0709 12:25:19.693219 (+   335us) log.cc:844] Serialized 101 byte log entry
0709 12:25:19.693397 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:19.693551 (+   154us) write_op.cc:454] Released schema lock
0709 12:25:19.693605 (+    54us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:19.694024 (+   419us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:19.694056 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":34,"spinlock_wait_cycles":21248,"child_traces":[["op",{"apply.queue_time_us":267704,"apply.run_cpu_time_us":4928,"apply.run_wall_time_us":228203,"num_ops":14,"prepare.queue_time_us":195005,"prepare.run_cpu_time_us":38386,"prepare.run_wall_time_us":485889,"raft.queue_time_us":153494,"raft.run_cpu_time_us":7278,"raft.run_wall_time_us":213616,"replication_time_us":716131,"thread_start_us":710490,"threads_started":4,"wal-append.queue_time_us":346992}]]}
I20260709 12:25:20.026049  5864 catalog_manager.cc:5697] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 2 to 5, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.027783  5864 catalog_manager.cc:5697] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.033303  9136 raft_consensus.cc:993] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:20.041746  5864 catalog_manager.cc:5697] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.043746  5864 catalog_manager.cc:5697] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 4 to 8, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 8 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:20.047669  5864 catalog_manager.cc:5697] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 2 to 6. New cstate: current_term: 6 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:20.057574  5864 catalog_manager.cc:5697] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 5, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 5 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:20.060670  5864 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 6 to 10, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 10 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:20.063511  9456 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:20.064147  5864 catalog_manager.cc:5697] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 5, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.066433  9468 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:20.067780  5864 catalog_manager.cc:5697] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 5 to 9, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 9 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:20.070375  9397 raft_consensus.cc:993] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:20.070987  9397 raft_consensus.cc:1081] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:20.071587  5864 catalog_manager.cc:5697] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:20.074427  5864 catalog_manager.cc:5697] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 5 to 6, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 6 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.049417  9260 raft_consensus.cc:1081] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:20.045048  8813 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:25:20.080441  6040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36260
I20260709 12:25:20.080772  9384 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:20.081158  6040 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:20.078433  5864 catalog_manager.cc:5697] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 5, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.081523  6040 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:20.099366  5864 catalog_manager.cc:5697] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:20.101095  5864 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 7, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 7 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:20.103865  5864 catalog_manager.cc:5697] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 6. New cstate: current_term: 6 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.105893  6038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36266
I20260709 12:25:20.106747  6038 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:20.107173  6038 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.090571  6040 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:20.114148  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:20.115183  5962 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:20.105641  5864 catalog_manager.cc:5697] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 4 to 6. New cstate: current_term: 6 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.128778  9260 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:20.129426  9260 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:20.135931  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:20.137259  5864 catalog_manager.cc:5697] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 4. New cstate: current_term: 4 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:20.139787  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:20.138988  5864 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 9 to 10, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 10 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:20.141582  5864 catalog_manager.cc:5697] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 5, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 5 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:20.143826  5967 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:20.078341  9339 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:20.150564  6040 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:20.151151  5962 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:20.142949  5864 catalog_manager.cc:5697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 6, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 6 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.156895  5864 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 7, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 7 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:20.157090  6006 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:20.110832  9483 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 4.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.041s
I20260709 12:25:20.158653  5864 catalog_manager.cc:5697] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 7, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 7 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.159848  6118 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:20.138779  9260 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:20.163761  6035 raft_consensus.cc:2368] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9.
I20260709 12:25:20.162321  5864 catalog_manager.cc:5697] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 6, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 6 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.165652  9339 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:20.165346  5864 catalog_manager.cc:5697] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 4 to 7. New cstate: current_term: 7 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.167776  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:20.168761  5962 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.167141  5864 catalog_manager.cc:5697] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:20.170771  6038 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:20.171273  5864 catalog_manager.cc:5697] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 2 to 6, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 6 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:20.174120  9113 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:20.174670  9113 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:20.177101  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:20.177774  5967 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:20.178108  5967 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:20.178972  5967 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:20.162583  9027 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:20.184249  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:20.184840  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:20.185451  6118 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:20.184898  6117 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.173488  5864 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 2 to 3, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 3 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:20.182753  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:20.204833  6112 raft_consensus.cc:3055] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:20.205168  6112 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:20.208207  6118 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:20.182619  6038 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:20.210711  6009 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:20.204521  5864 catalog_manager.cc:5697] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 4 to 5, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 5 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:20.205873  6112 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:20.217752  5864 catalog_manager.cc:5697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 1 to 5, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:20.219236  6112 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:20.219847  5864 catalog_manager.cc:5697] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 4 to 5, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:20.222147  5864 catalog_manager.cc:5697] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 5 to 9. New cstate: current_term: 9 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:20.226897  5962 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:20.172160  9123 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:25:20.241565  6117 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:20.224310  9331 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:20.246444  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:20.228605  9027 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:20.250452  6112 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:20.259256  9331 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:20.260298  9331 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.4, Last appended by leader: 4, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:20.264611  9456 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:20.287199  9456 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:20.288182  9456 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:20.285037  9027 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:20.330976  9113 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:20.332250  9113 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:20.347457  6082 leader_election.cc:400] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9.
I20260709 12:25:20.347880  6082 leader_election.cc:403] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:20.348483  9306 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9.
I20260709 12:25:20.350878  5967 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:20.361207  5967 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:20.361759  9258 raft_consensus.cc:993] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:20.362347  9258 raft_consensus.cc:1081] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:20.381347  6037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:25:20.381999  6037 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:20.382388  6037 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:20.405212  6037 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:20.411304  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:20.411826  6112 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:20.421629  6112 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:20.422982  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:20.433573  6037 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:20.436293  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:20.436990  6649 raft_consensus.cc:3055] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:20.437348  6649 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:20.438346  6649 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:20.453279  6035 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:20.442205  9384 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:20.457589  6649 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:20.463701  9384 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:20.495244  9384 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:20.498082  9466 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:20.498711  9466 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:20.501777  9466 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:20.507341  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:20.508033  6110 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:25:20.509442  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:20.521660  9241 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:20.522083  9241 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:20.522439  9241 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:20.524979  6650 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:20.531859  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:20.532616  5967 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:25:20.540457  6649 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:20.543848  9456 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:25:20.661572  9241 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:20.663892  9241 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:20.666234  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:20.666958  6111 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:20.676717  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:20.677479  5962 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:20.692370  6111 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:20.697911  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:20.698746  5962 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:20.703603  9258 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:20.704185  9258 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:20.705078  9258 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:20.712469  6118 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:20.716495  5962 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:20.718974  9473 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:25:20.714697  9331 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.006s
I20260709 12:25:20.754479  6118 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:20.755867  9331 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:20.811597  5967 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:20.811822  5961 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:20.843550  9384 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.017s
I20260709 12:25:20.843436  9468 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.014s
I20260709 12:25:20.863590  5961 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:20.865689  9333 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:20.917004  6111 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 4. Preceding OpId from leader: term: 9 index: 5. (index mismatch)
I20260709 12:25:20.923559  9456 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20260709 12:25:20.924175  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 64941.6us
W20260709 12:25:20.927774  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 54779.6us
I20260709 12:25:20.997910  6649 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:25:21.000162  5864 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 312) took 1642 ms. Trace:
I20260709 12:25:21.000597  5864 rpcz_store.cc:276] 0709 12:25:19.357408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:19.357575 (+   167us) service_pool.cc:224] Handling call
0709 12:25:21.000074 (+1642499us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:20.495275 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:20.495795 (+   520us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:20.495831 (+    36us) write_op.cc:435] Acquired schema lock
0709 12:25:20.495848 (+    17us) tablet.cc:662] Decoding operations
0709 12:25:20.498180 (+  2332us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:20.498238 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:20.498267 (+    29us) tablet.cc:685] Acquiring locks for 36 operations
0709 12:25:20.526140 (+ 27873us) tablet.cc:701] Row locks acquired
0709 12:25:20.526187 (+    47us) write_op.cc:260] PREPARE: finished
0709 12:25:20.526431 (+   244us) write_op.cc:270] Start()
0709 12:25:20.526640 (+   209us) write_op.cc:276] Timestamp: P: 1783599920526327 usec, L: 0
0709 12:25:20.526691 (+    51us) op_driver.cc:348] REPLICATION: starting
0709 12:25:20.527886 (+  1195us) log.cc:844] Serialized 14045 byte log entry
0709 12:25:20.623822 (+ 95936us) op_driver.cc:464] REPLICATION: finished
0709 12:25:20.782864 (+159042us) write_op.cc:301] APPLY: starting
0709 12:25:20.782949 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:20.783537 (+   588us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:20.783656 (+   119us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:20.786751 (+  3095us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:20.787142 (+   391us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=36
0709 12:25:20.787188 (+    46us) write_op.cc:312] APPLY: finished
0709 12:25:20.787696 (+   508us) log.cc:844] Serialized 236 byte log entry
0709 12:25:20.788506 (+   810us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:20.790042 (+  1536us) write_op.cc:454] Released schema lock
0709 12:25:20.790996 (+   954us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:20.807860 (+ 16864us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:20.808719 (+   859us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1391,"reported_tablets":44,"child_traces":[["op",{"apply.queue_time_us":158098,"apply.run_cpu_time_us":5807,"apply.run_wall_time_us":20234,"num_ops":36,"prepare.queue_time_us":179878,"prepare.run_cpu_time_us":7464,"prepare.run_wall_time_us":39151,"replication_time_us":96972,"thread_start_us":228895,"threads_started":2}]]}
I20260709 12:25:21.000716  5863 catalog_manager.cc:5697] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 2 to 5. New cstate: current_term: 5 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:21.009008  9384 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:21.012918  6111 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:25:21.020639  9384 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
W20260709 12:25:21.033672  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 58224.3us
I20260709 12:25:21.039085  5967 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:21.066517  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:21.096275  5863 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 296) took 9213 ms. Trace:
I20260709 12:25:21.114782  5862 catalog_manager.cc:5697] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 2 to 6, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 6 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:21.123198  5862 catalog_manager.cc:5697] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 4 to 5, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 5 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:21.096688  5863 rpcz_store.cc:276] 0709 12:25:11.883197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:11.891252 (+  8055us) service_pool.cc:224] Handling call
0709 12:25:21.096212 (+9204960us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:21.038049 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:21.038638 (+   589us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:21.038670 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:25:21.038681 (+    11us) tablet.cc:662] Decoding operations
0709 12:25:21.038992 (+   311us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:21.039047 (+    55us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:21.039074 (+    27us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:25:21.039239 (+   165us) tablet.cc:701] Row locks acquired
0709 12:25:21.039255 (+    16us) write_op.cc:260] PREPARE: finished
0709 12:25:21.039378 (+   123us) write_op.cc:270] Start()
0709 12:25:21.039951 (+   573us) write_op.cc:276] Timestamp: P: 1783599921039335 usec, L: 0
0709 12:25:21.039972 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:25:21.040540 (+   568us) log.cc:844] Serialized 538 byte log entry
0709 12:25:21.042353 (+  1813us) op_driver.cc:464] REPLICATION: finished
0709 12:25:21.043921 (+  1568us) write_op.cc:301] APPLY: starting
0709 12:25:21.044008 (+    87us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:21.044108 (+   100us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:21.044188 (+    80us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:21.044386 (+   198us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:21.044538 (+   152us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:25:21.044580 (+    42us) write_op.cc:312] APPLY: finished
0709 12:25:21.044726 (+   146us) log.cc:844] Serialized 23 byte log entry
0709 12:25:21.044865 (+   139us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:21.044956 (+    91us) write_op.cc:454] Released schema lock
0709 12:25:21.044993 (+    37us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:21.045323 (+   330us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:21.045347 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":191314,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":1364,"apply.run_cpu_time_us":1351,"apply.run_wall_time_us":1351,"num_ops":1,"prepare.queue_time_us":2914,"prepare.run_cpu_time_us":2329,"prepare.run_wall_time_us":2757,"replication_time_us":2252}]]}
I20260709 12:25:21.155097  6040 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:25:21.163493  9247 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:21.181294  6649 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:25:21.183727  9517 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:21.196431  5967 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:21.203181  9241 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:21.230722  6648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:21.231389  6648 raft_consensus.cc:606] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:21.231739  6648 raft_consensus.cc:614] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:21.241726  5967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0468d70863214876bf59fb3ea9474307"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:25:21.242411  5967 raft_consensus.cc:606] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:21.249974  6649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:21.250576  6649 raft_consensus.cc:606] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:21.254068  9517 raft_consensus.cc:2955] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:21.261427  5865 catalog_manager.cc:5697] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 6 to 7, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 7 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:21.262499  6111 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:21.263175  5865 catalog_manager.cc:5697] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 5 to 9, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 9 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:21.264169  9126 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:21.264940  5865 catalog_manager.cc:5697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 5 to 6, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 6 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:21.266645  5865 catalog_manager.cc:5697] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 4 to 7, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 7 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:21.268639  5865 catalog_manager.cc:5697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 5 to 7, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 7 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:21.272750  5865 catalog_manager.cc:5697] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 5 to 7, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 7 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:21.276043  6648 raft_consensus.cc:2955] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:21.278091  6649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:21.278677  6649 raft_consensus.cc:606] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:21.287135  6040 raft_consensus.cc:2955] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Committing config change with OpId 5.8: config changed from index 7 to 8, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:21.296589  6649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:21.297250  6649 raft_consensus.cc:606] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:21.307540  6649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:21.308175  6649 raft_consensus.cc:606] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:21.313087  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:21.328222  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:21.329022  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:21.328645  5865 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:21.330390  5865 catalog_manager.cc:5697] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 4 to 7, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 7 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:21.336547  5865 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 2 to 4, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 4 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:21.338297  5865 catalog_manager.cc:5697] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:21.353740  5850 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 3fd6047b66ab4b4abc3fe659e8cff000 with cas_config_opid_index 7: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:25:21.355623  5862 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 191) took 8389 ms. Trace:
I20260709 12:25:21.356122  5862 rpcz_store.cc:276] 0709 12:25:12.966434 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:12.966863 (+   429us) service_pool.cc:224] Handling call
0709 12:25:21.355535 (+8388672us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:21.128495 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:21.128861 (+   366us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:21.128884 (+    23us) write_op.cc:435] Acquired schema lock
0709 12:25:21.128894 (+    10us) tablet.cc:662] Decoding operations
0709 12:25:21.129199 (+   305us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:21.129235 (+    36us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:21.129254 (+    19us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:25:21.129486 (+   232us) tablet.cc:701] Row locks acquired
0709 12:25:21.129494 (+     8us) write_op.cc:260] PREPARE: finished
0709 12:25:21.129607 (+   113us) write_op.cc:270] Start()
0709 12:25:21.129685 (+    78us) write_op.cc:276] Timestamp: P: 1783599921129573 usec, L: 0
0709 12:25:21.129697 (+    12us) op_driver.cc:348] REPLICATION: starting
0709 12:25:21.130626 (+   929us) log.cc:844] Serialized 913 byte log entry
0709 12:25:21.132643 (+  2017us) op_driver.cc:464] REPLICATION: finished
0709 12:25:21.133158 (+   515us) write_op.cc:301] APPLY: starting
0709 12:25:21.133240 (+    82us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:21.133361 (+   121us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:21.133449 (+    88us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:21.133757 (+   308us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:21.133923 (+   166us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:25:21.133966 (+    43us) write_op.cc:312] APPLY: finished
0709 12:25:21.134193 (+   227us) log.cc:844] Serialized 29 byte log entry
0709 12:25:21.134356 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:21.134444 (+    88us) write_op.cc:454] Released schema lock
0709 12:25:21.134502 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:21.134819 (+   317us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:21.134845 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"dns_us":3078,"mutex_wait_us":15353,"reported_tablets":31,"spinlock_wait_cycles":23808,"child_traces":[["op",{"apply.queue_time_us":278,"apply.run_cpu_time_us":1625,"apply.run_wall_time_us":1625,"num_ops":2,"prepare.queue_time_us":131,"prepare.run_cpu_time_us":2147,"prepare.run_wall_time_us":2401,"replication_time_us":2826}]]}
I20260709 12:25:21.359822  5865 catalog_manager.cc:5697] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 7 to 8, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 8 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:21.361578  5865 catalog_manager.cc:5697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:25:21.427805  5853 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leader transfer in progress [suppressed 35 similar messages]
I20260709 12:25:21.428781  6649 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:21.441020  5853 catalog_manager.cc:4755] TS 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): ChangeConfig:REMOVE_PEER RPC failed for tablet 81efabae1bb448e3a8483e6231673c10: Remote error: Service unavailable: leader transfer in progress
I20260709 12:25:21.454939  6111 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:21.456607  9466 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:21.462904  5967 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 5 index: 6. (index mismatch)
I20260709 12:25:21.468936  9126 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:21.477720  9466 raft_consensus.cc:993] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:21.478197  9466 raft_consensus.cc:1081] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:21.481684  6040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:25:21.482580  6040 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:21.482960  6040 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.494165  6040 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:21.504734  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:21.505522  5967 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.504827  5864 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 4 to 5, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 5 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:21.517277  5967 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:21.519769  6040 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:21.518716  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:21.521130  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:21.522311  6649 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:21.522646  6649 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:21.523362  6649 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:21.524402  6649 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.536824  9027 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:21.537487  9027 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:21.538522  9027 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:21.547323  6649 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:21.579470  9518 raft_consensus.cc:993] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:21.579952  9518 raft_consensus.cc:1081] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:21.583434  6111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0468d70863214876bf59fb3ea9474307"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:25:21.583985  6111 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:21.584349  6111 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.608748  5863 catalog_manager.cc:5697] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 7 to 8, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:21.611377  9466 raft_consensus.cc:993] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:21.612039  9466 raft_consensus.cc:2955] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:21.613492  6112 raft_consensus.cc:2955] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:21.606415  6111 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:21.617287  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:21.617677  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:21.617796  5962 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:21.618220  5962 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:21.618626  9126 raft_consensus.cc:1081] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:21.619109  5962 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:21.610877  5863 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 5. New cstate: current_term: 5 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:21.620193  5962 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.619788  6111 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:21.618259  6649 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:21.624061  6112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:42484
I20260709 12:25:21.624543  6112 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:21.624816  6112 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:21.628636  6649 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:21.629552  6084 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:21.631484  9306 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:21.641901  6112 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:21.652953  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:21.653594  5967 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:21.651067  5962 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:21.672304  5963 raft_consensus.cc:2955] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Committing config change with OpId 5.6: config changed from index 4 to 6, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:21.686991  5967 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:21.691375  6112 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:21.732851  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 78438.2us
I20260709 12:25:21.739338  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:21.739956  6040 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:21.752789  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50370.8us
I20260709 12:25:21.761483  6040 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:21.766477  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:21.767164  6649 raft_consensus.cc:3055] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:21.767446  6649 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:21.768193  6649 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:21.770247  6649 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:21.772477  6103 tablet_service.cc:1558] Processing DeleteTablet for tablet 3fd6047b66ab4b4abc3fe659e8cff000 with delete_type TABLET_DATA_TOMBSTONED (TS 0069e2ba1f02412e8e1d6c20a1fb510f not found in new config with opid_index 8) from {username='slave'} at 127.0.0.1:35576
I20260709 12:25:21.776851  6649 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:21.779018  6084 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:21.790050  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 86037.3us
I20260709 12:25:21.777479  9306 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:25:21.812592  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 67887.7us
I20260709 12:25:21.823796  9260 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:21.830540  9268 raft_consensus.cc:993] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:21.834568  9536 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:21.839162  9306 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:21.847198  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 106501us
I20260709 12:25:21.860072  5864 catalog_manager.cc:5697] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 4 to 6, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New cstate: current_term: 5 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:21.855139  9534 raft_consensus.cc:1081] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:21.885290  5865 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 6 to 7, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 7 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:21.894553  5853 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 5a6d648272bf4bef9d5337acfc9d4a96 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 10)
W20260709 12:25:21.895690  5853 catalog_manager.cc:5227] ChangeConfig:REMOVE_PEER RPC for tablet 81efabae1bb448e3a8483e6231673c10 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER failed with leader 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) due to error UNKNOWN_ERROR; will retry: Illegal state: Replica 24012af7747d4c4ea89c3da2ff950099 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 6 committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:21.899569  9260 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:21.900780  9260 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:21.851357  9536 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:21.904683  9536 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:21.906797  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:21.907698  6040 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 6: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:21.916452  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:21.917120  5962 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:21.920989  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:21.924021  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 108868us
I20260709 12:25:21.932601  9547 tablet_replica.cc:333] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:25:21.932996  6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 5a6d648272bf4bef9d5337acfc9d4a96 with delete_type TABLET_DATA_TOMBSTONED (TS 0557a7246c8945b99e5215c99d4ddf9c not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:36246
I20260709 12:25:21.933593  9548 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:21.934060  9548 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:21.923913  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 144787us
I20260709 12:25:21.934442  9548 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:21.964745  6040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:25:21.972720  6040 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:21.973842  6040 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:21.972353  9548 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:21.982867  6040 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:21.985659  6040 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:21.986070  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:21.986723  5961 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:22.000387  5961 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:25:22.001084  5963 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:22.008791  9554 tablet_replica.cc:333] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:25:22.009893  9554 raft_consensus.cc:2243] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.010761  9554 raft_consensus.cc:2272] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Raft consensus is shut down!
W20260709 12:25:22.012341  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 91519.9us
W20260709 12:25:22.012609  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 69714.1us
I20260709 12:25:22.003260  6006 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:22.015565  9539 consensus_queue.cc:1059] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:22.016247  9547 raft_consensus.cc:2243] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:22.017032  9539 raft_consensus.cc:3055] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:22.017216  9547 raft_consensus.cc:2272] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:22.017531  9539 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:22.018392  9539 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:22.019717  9539 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:22.020884  9548 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:22.025527  9550 raft_consensus.cc:993] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:22.026022  9550 raft_consensus.cc:1081] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:22.027029  5864 catalog_manager.cc:5697] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 6 to 7, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 7 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.031177  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:22.031380  9331 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:22.029273  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:22.029310  9027 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:22.031833  9331 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:22.032539  9027 raft_consensus.cc:697] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:22.032956  6037 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 6: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:22.033438  9027 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:22.033910  9331 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:22.041018  6110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:42484
I20260709 12:25:22.041582  6110 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:22.041903  6110 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:22.046536  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:22.047334  5963 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:22.052362  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:22.052523  5961 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:22.053938  6650 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:22.055920  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:22.063855  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:22.068262  6649 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:25:22.080490  9547 ts_tablet_manager.cc:1916] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:22.088032  9554 ts_tablet_manager.cc:1916] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:22.063988  9384 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:25:22.067749  9553 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:22.077843  6110 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:22.110373  6110 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:22.120311  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:22.121016  6040 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:22.122092  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:22.122867  6649 raft_consensus.cc:3055] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:22.123195  6649 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:22.124342  6649 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:22.125646  6649 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:22.107277  9553 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:25:22.140396  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 77372us
I20260709 12:25:22.149075  6649 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:22.150308  6084 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:22.153569  6040 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:22.157792  9555 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:22.158430  9555 raft_consensus.cc:697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:22.159411  9555 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:22.172034  9553 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 5.5, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:22.190811  5865 catalog_manager.cc:5697] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 2 to 3, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 3 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.220225  9544 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
W20260709 12:25:22.270429  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 65913.9us
I20260709 12:25:22.362234  5963 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:25:22.375475  9547 ts_tablet_manager.cc:1929] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.7
I20260709 12:25:22.377547  9547 log.cc:1199] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/wals/3fd6047b66ab4b4abc3fe659e8cff000
I20260709 12:25:22.425554  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:22.370290  9553 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.050s
I20260709 12:25:22.448606  9331 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:22.476425  6650 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:22.478374  9306 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:22.441671  5853 catalog_manager.cc:5028] TS 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): tablet 3fd6047b66ab4b4abc3fe659e8cff000 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
W20260709 12:25:22.502614  5853 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 61387.9us
I20260709 12:25:22.520942  6649 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:25:22.528254  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:22.528312  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 102893us
I20260709 12:25:22.527793  9554 ts_tablet_manager.cc:1929] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.5
I20260709 12:25:22.557044  9554 log.cc:1199] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/wals/5a6d648272bf4bef9d5337acfc9d4a96
I20260709 12:25:22.572072  6035 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:22.576426  9566 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:22.576675  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 245858us
I20260709 12:25:22.568642  5851 catalog_manager.cc:5028] TS 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): tablet 5a6d648272bf4bef9d5337acfc9d4a96 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:25:22.585912  5865 catalog_manager.cc:5697] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 5 to 6, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 6 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.596407  5865 catalog_manager.cc:5697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 5 to 6, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 6 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:22.598248  5865 catalog_manager.cc:5697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 5 to 6, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 6 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:22.544013  9260 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:25:22.611291  6035 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:25:22.613803  9566 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:22.616254  6649 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:22.617728  9548 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:22.630190  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 54522.6us
I20260709 12:25:22.685757  5967 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:25:22.700131  5965 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:22.715428  9555 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:22.766307  6649 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:25:22.769373  9544 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:22.787060  9532 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:22.795011  5961 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 5. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:25:22.798116  6040 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 6 index: 6. (index mismatch)
I20260709 12:25:22.808132  9555 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:22.821034  9553 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
I20260709 12:25:22.884581  6035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:25:22.885461  6035 raft_consensus.cc:606] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:25:22.975531  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 163252us
I20260709 12:25:23.024253  5965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:25:23.025439  5965 raft_consensus.cc:606] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:23.063793  6112 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 5, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:23.096778  6040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:25:23.097971  6040 raft_consensus.cc:606] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:23.135968  6040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:25:23.136977  6040 raft_consensus.cc:606] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:23.145537  6038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:25:23.146598  6038 raft_consensus.cc:606] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Received request to transfer leadership to TS 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:23.148247  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:25:23.156448  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:23.158049  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:23.165586  6649 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
W20260709 12:25:23.166054  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 57196.7us
I20260709 12:25:23.169152  6038 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:23.170506  9553 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:23.185379  9541 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:25:23.216130  9542 raft_consensus.cc:993] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:23.216856  9572 raft_consensus.cc:1081] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:23.228873  9573 raft_consensus.cc:993] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:25:23.229404  9542 raft_consensus.cc:1081] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:25:23.231086  9553 raft_consensus.cc:2955] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:23.231775  6110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35596
I20260709 12:25:23.234406  6110 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.234797  6110 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:23.236267  6648 raft_consensus.cc:2955] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:23.268373  5853 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 81efabae1bb448e3a8483e6231673c10 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 7)
I20260709 12:25:23.258214  6038 raft_consensus.cc:2955] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Committing config change with OpId 6.7: config changed from index 4 to 7, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:23.302757  5968 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:34558
I20260709 12:25:23.303352  5968 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.303725  5968 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:23.315086  9568 raft_consensus.cc:993] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:23.315672  9568 raft_consensus.cc:1081] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:23.321383  6116 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:25:23.321990  6116 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.322335  6116 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:23.341921  6116 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:23.350206  6110 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:23.352239  6116 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:23.351711  5968 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:23.358315  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:23.359170  6650 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:23.365031  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:23.365696  5965 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:23.366017  5965 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:23.366869  5965 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:23.368374  5965 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:23.372503  6650 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:23.374025  5968 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:23.375893  6110 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:23.390021  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:23.392740  6649 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:23.393466  6084 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:23.394399  9553 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:23.395093  9553 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:23.396282  9553 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:23.393635  5862 catalog_manager.cc:5697] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 4 to 7, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New cstate: current_term: 6 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:23.416544  9542 raft_consensus.cc:993] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:23.417196  9572 raft_consensus.cc:1081] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:23.418334  5965 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:23.419467  6112 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35596
I20260709 12:25:23.420060  6112 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.421511  6112 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.427162  6649 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:23.434635  5934 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:23.436949  9563 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:23.437585  9563 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:23.438553  9563 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:23.442128  6112 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:23.462224  6112 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:23.517192  9573 raft_consensus.cc:993] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:25:23.517745  9572 raft_consensus.cc:1081] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Signalling peer 24012af7747d4c4ea89c3da2ff950099 to start an election
I20260709 12:25:23.523633  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:23.524330  5968 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:23.524673  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:23.525321  6038 raft_consensus.cc:3055] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:23.525645  6038 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:23.526413  6038 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:23.587570  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:23.591001  6649 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:50454
I20260709 12:25:23.591514  6649 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:23.591771  6649 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:23.593313  5968 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:23.595853  5965 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:23.659891  5965 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:24.485018  9595 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:24.512516  9595 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.515997  9595 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:24.516647  9595 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.517186  9595 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:24.521755  9518 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.522413  9518 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.524732  9518 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:24.537801  9591 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.538561  9591 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:24.544595  9595 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:24.545411  9595 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.545967  9595 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.547721  6038 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:24.550752  9595 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:24.555238  6038 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:24.557813  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 2059) took 1036 ms. Trace:
I20260709 12:25:24.558203  6038 rpcz_store.cc:276] 0709 12:25:23.521657 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.524408 (+  2751us) service_pool.cc:224] Handling call
0709 12:25:24.557703 (+1033295us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:25:24.565277  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 142429us
I20260709 12:25:24.572857  9599 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:24.573534  9599 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:24.578516  9597 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:24.579183  9597 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:24.581169  9597 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:24.582295  9600 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.582855  9600 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.585165  9600 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:24.586417  9591 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:24.736409  9591 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.736984  9591 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:24.718772  5989 debug-util.cc:398] Leaking SignalData structure 0x7b08000e2800 after lost signal to thread 4824
W20260709 12:25:24.791630  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 224662us
I20260709 12:25:24.804220  9605 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.804900  9605 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.834632  9609 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:24.835413  9609 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.838829  9607 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.840906  9607 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:24.842090  9606 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:24.731709  9583 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.614193  9600 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.876499  9603 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:24.877184  9603 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.857672  9609 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:24.882395  9614 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.882546  9599 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:24.883092  9614 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.884240  9605 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:24.884766  9605 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.884927  9604 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.883376  9591 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:24.882670  9603 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:24.885423  9604 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.885968  9603 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:24.886444  9603 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.886569  9600 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:24.869722  9611 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:24.885342  9614 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:24.887339  9591 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:24.889845  9607 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:24.909312  9607 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.916886  9607 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:24.917789  9624 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:24.918119  9616 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:24.870079  9583 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.918658  9616 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:24.920537  9583 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:24.921089  9583 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.918627  9624 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:24.921629  9583 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.868551  9606 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.923243  9617 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:24.923847  9617 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.924746  9606 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:24.925345  9606 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.924896  9607 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:24.928020  9607 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:24.925815  9606 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:24.920960  9616 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:24.927141  9260 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:24.935889  9260 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.937109  9606 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:24.937762  9606 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.938093  9260 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:24.894953  9609 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:24.942198  9609 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:24.944823  9609 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:24.945508  9609 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.948148  9600 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:24.950757  9591 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.946101  9609 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:24.952970  9591 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:24.953795  9621 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:24.954670  5989 debug-util.cc:398] Leaking SignalData structure 0x7b08000bbe40 after lost signal to thread 5900
I20260709 12:25:24.954494  9621 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.934890  9607 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.894855  9599 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:24.959777  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:24.960024  9599 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.958906  9601 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:24.962836  9601 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.964116  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:24.885293  9605 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.964759  6117 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:24.925973  9617 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:24.978546  9617 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:24.978731  9541 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:24.979336  9260 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:24.979203  9617 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:24.980680  9541 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:24.986387  9617 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:24.979902  9260 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:24.986517  9541 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:24.989023  9260 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:24.982113  9624 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:24.939129  9614 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:24.962674  9604 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:24.952854  9602 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:24.962392  9599 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:24.975533  9597 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:24.938321  9606 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.009115  9544 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:25.011068  5989 debug-util.cc:398] Leaking SignalData structure 0x7b08001d92c0 after lost signal to thread 5992
I20260709 12:25:25.014948  9541 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.015471  9608 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:25.014909  9619 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.016062  9608 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.016115  9541 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.018929  9608 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.019448  9608 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.019863  5965 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:25:25.020433  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.021093  9619 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.021999  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.022740  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.023881  9619 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.024657  9619 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.022809  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.025439  6081 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:25.025835  5968 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:25.026821  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.026121  9619 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.028693  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.029707  5964 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:25.028669  9608 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.030027  9617 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.025660  9260 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:25.026300  6081 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:25.031673  9617 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.029436  9541 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.035766  9541 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.007819  9614 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.033320  9260 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.041499  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.047005  6116 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:25:24.949851  9611 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.035764  9608 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.002835  9602 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.112063  9606 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.041025  9609 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.048449  9599 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:25.013906  9597 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.138669  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.100616  9518 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.112875  9601 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.046415  9541 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.195182  9541 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.148744  9617 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.195564  9568 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:25.196028  9565 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:25.196712  9565 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.150127  9614 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.150368  9619 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.150952  9596 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.207206  9605 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.207098  9596 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.209560  9596 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.151624  9610 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.124594  9621 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.112848  9602 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.210444  9610 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.214852  9598 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.134100  9608 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:25.215463  9598 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.154973  9611 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.155470  9559 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.155979  9615 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:25.167248  5963 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:25.217615  9559 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.219143  9625 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.219537  9615 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.219866  9617 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.220878  9617 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.221844  9615 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.167413  9572 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.222729  9572 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.215946  9608 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:25.221869  9260 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.224196  9608 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.224853  9572 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.170516  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.175630  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.176497  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.219772  9625 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.176846  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.177687  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.178239  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.178570  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.178854  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:25.181485  6649 consensus_meta.cc:287] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 1.586s	user 0.019s	sys 0.013s
I20260709 12:25:25.186980  9583 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.133493  9604 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.042317  9544 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:25.189642  5989 debug-util.cc:398] Leaking SignalData structure 0x7b0800326da0 after lost signal to thread 6068
I20260709 12:25:25.190240  9620 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.191253  9607 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.191999  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.192735  9630 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:25.193005  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.142855  9603 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.198565  9631 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.196213  9568 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.199127  9565 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.199177  9518 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.144024  9599 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.206017  9626 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:25:25.464532  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 431080us
I20260709 12:25:25.331951  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.349023  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.465819  6118 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
W20260709 12:25:25.465075  5989 debug-util.cc:398] Leaking SignalData structure 0x7b080037d240 after lost signal to thread 6069
I20260709 12:25:25.217559  9541 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.525110  9541 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.525363  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.525904  9559 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:25.524665  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 96540.5us
I20260709 12:25:25.526535  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.485280  9631 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.526101  6116 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:25.367890  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.464818  6649 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:25.508661  5989 debug-util.cc:398] Leaking SignalData structure 0x7b08003bae40 after lost signal to thread 6142
W20260709 12:25:25.535732  5989 debug-util.cc:398] Leaking SignalData structure 0x7b08003add80 after lost signal to thread 6675
W20260709 12:25:25.536074  5989 debug-util.cc:398] Leaking SignalData structure 0x7b0800274c00 after lost signal to thread 6676
I20260709 12:25:25.536908  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.509366  9627 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.509924  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.494479  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:25.510579  6610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.008s	sys 0.016s
W20260709 12:25:25.543408  6610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.579s	user 0.008s	sys 0.016s
I20260709 12:25:25.366971  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.533190  6043 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:25.512132  9544 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.512310  9625 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.512970  9602 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.513531  9539 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.507548  9630 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.513971  9549 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.514743  9599 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.517302  9617 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.518002  9636 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.521277  9620 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.523389  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.522841  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.504236  9597 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.537364  6113 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
W20260709 12:25:25.537602  5989 debug-util.cc:398] Leaking SignalData structure 0x7b08003d05c0 after lost signal to thread 9456
W20260709 12:25:25.566751  5989 debug-util.cc:398] Leaking SignalData structure 0x7b08003957c0 after lost signal to thread 9567
I20260709 12:25:25.538156  6116 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:25.488096  9604 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.506035  6112 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 2.
I20260709 12:25:25.506568  6111 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:25:25.332435  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.366179  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.239887  9595 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:25.573383  9598 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.573264  9595 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.575568  9595 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.576642  9636 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.579054  9636 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.581522  9541 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.561472  9549 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.583452  9604 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.584529  9549 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.550416  9627 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.585098  5864 catalog_manager.cc:5697] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 5 to 6, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 6 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:25.586642  9627 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.587745  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.588361  9639 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.588941  9639 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.564438  9559 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.590230  9559 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.590629  9640 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:25.591270  9640 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.592264  9559 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.592830  9559 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.593272  9559 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.555907  6649 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.333410  9622 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.551102  6081 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:25.595512  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 47935.8us
I20260709 12:25:25.561939  9602 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.596465  6081 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:25.597443  9602 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.598093  9621 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:25.599512  9631 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.599715  9621 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.594144  6649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:50454 (request call id 960) took 2073 ms. Trace:
I20260709 12:25:25.331331  9596 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.338495  9615 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:25.489998  9603 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.557672  5934 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:25.500161  9626 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:25.562147  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.611953  9620 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.612784  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.612501  9626 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.613237  9544 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.484107  9572 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.345541  9616 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.613761  9544 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.614050  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.613914  9572 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.564162  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.615752  9544 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.565835  9539 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.616852  9572 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.618119  9539 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.572693  9534 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.593499  9640 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.593979  9632 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.619324  9632 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.619868  9568 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.619680  9603 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:25.619333  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 61738.1us
I20260709 12:25:25.620455  9568 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:25.620843  9568 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.621241  5934 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:25.621733  9603 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.622614  9598 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:25.622378  9615 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.622990  9598 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.618608  6036 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:25.330422  9618 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.618805  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.604605  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.624423  9615 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.488970  9606 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.069s
I20260709 12:25:25.594514  9622 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.626959  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.627319  9622 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.622637  9534 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.621206  9568 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:25.606154  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.605600  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.631198  9630 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.606094  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.631769  9630 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.630226  9632 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.600582  6649 rpcz_store.cc:276] 0709 12:25:23.521268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.590883 (+ 69615us) service_pool.cc:224] Handling call
0709 12:25:25.594029 (+2003146us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:25.624032  9618 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.634618  9618 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.635143  9618 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.635645  9618 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.614507  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.614362  9616 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.523384  9518 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.614728  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.276221  9610 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.618692  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.647949  5968 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 2.
I20260709 12:25:25.623404  9598 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:25.608206  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.572172  5961 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:25.646066  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.650063  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.652318  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.607375  9621 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:25.658037  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.659782  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.660447  5965 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:25.638135  9541 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:25.661653  9613 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.662528  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.687527  5968 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:25.663218  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:25.663877  9616 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.664181  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.667869  6081 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:25.619472  9638 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.673074  9534 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.675730  9618 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.661712  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.676676  9568 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.677964  9559 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.632282  9630 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.642810  9597 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:25.658648  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:25.715256  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 56704.1us
I20260709 12:25:25.715886  5934 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:25.676591  9639 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.639479  9596 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.719448  9597 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.721032  9596 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.694952  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:25.721539  9597 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:25.721781  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 77828.4us
I20260709 12:25:25.681542  9541 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.722285  9565 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:25.722739  9565 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.723131  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:25.723680  6040 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:25.723956  6040 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:25.724654  6040 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.725517  6040 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:25.726032  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.726601  6042 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:25.722399  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:25.695981  9613 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.757478  9621 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.769316  6110 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:25.770272  9621 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.710245  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:25.713249  9568 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.706331  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:25.706540  9638 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.722656  9541 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:25.749361  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.775308  9600 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:25.775758  9600 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.776124  9600 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:25.775228  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 68959.9us
W20260709 12:25:25.778798  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 62983.7us
I20260709 12:25:25.766283  9596 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:25.781144  9596 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.750972  9630 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.779116  6081 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:25.754390  9610 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:25.782661  9610 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.783092  9610 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:25.783634  9606 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:25.784111  9606 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.784487  9606 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:25.783113  9619 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:25.786924  9619 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.787272  9619 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.723160  9565 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:25.705930  9572 consensus_queue.cc:1059] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:25:25.764482  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.796769  6035 raft_consensus.cc:3055] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:25.797104  6035 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:25.766389  9598 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.799985  9598 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.768484  9613 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.704607  9608 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:25.806670  9608 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.807150  9608 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:25.781394  9638 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.815984  9541 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.818679  9541 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.819212  5934 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:25.820291  5934 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:25.820823  9606 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.833662  9518 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:25.834052  9518 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.834394  9518 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.835525  9606 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.825388  9610 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.798012  6035 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.836596  6035 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:25.839649  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:25.840688  9613 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:25.841907  9518 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.827513  9645 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.843986  9645 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.781525  9596 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:25.846530  9518 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.856856  9600 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.858558  9645 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:25:25.859740  9608 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.847873  9610 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.862509  9608 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:25.830088  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 168685us
I20260709 12:25:25.864555  6609 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:25.868749  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:25.869314  6044 raft_consensus.cc:3055] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:25.869586  6044 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:25.870610  6044 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.851430  6035 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
W20260709 12:25:25.872236  9572 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:25:25.875474  9645 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:25.826222  9598 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:25.876495  9598 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.832574  9619 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.854252  9596 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.877036  9598 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:25.878997  9619 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.879978  9596 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.871824  6044 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:25.889500  9598 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.890610  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.892620  9613 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:25.892797  9534 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.893656  9602 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.894120  9648 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.894279  9602 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.893409  9534 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.900419  9518 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.876377  9645 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:25.901191  9518 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.900828  9534 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.903031  9602 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.902971  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:25.894161  9596 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:25.903499  9518 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.893357  9613 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.903770  9596 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.906091  9602 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:25.896037  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.894122  6044 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:25:25.904721  9648 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.876812  9565 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:25.909039  6649 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:25:25.910063  9565 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.905624  9613 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.950024  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:25.950574  5965 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:25.895491  9598 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.954713  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:25.955636  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.955811  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:25.956565  5959 raft_consensus.cc:2393] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:25.956794  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.957269  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:25.957980  5963 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 3: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:25.911053  9572 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.912093  9596 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:25.912643  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.913347  6608 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:25.914049  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.915096  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.962788  9572 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:25.965101  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.966261  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:25.966912  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 53636.8us
I20260709 12:25:25.915838  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.967872  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:25.915854  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.967779  6009 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:25.916808  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.917363  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.969244  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:25.969664  6650 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:25.970172  9596 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:25.970697  9638 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:25.915146  9648 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.916239  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.972010  6643 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:25.972687  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.973016  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.973323  6642 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:25.973971  6038 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:25.901196  9645 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:25.922993  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.975349  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.975907  6035 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:25:25.976660  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.977136  6035 raft_consensus.cc:1813] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Handling vote request from an unknown peer f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:25.977676  6035 raft_consensus.cc:2410] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:25:25.923298  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.978740  6041 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:25.979542  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.980206  6041 raft_consensus.cc:2393] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 4: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:25.980087  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.981009  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.981370  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.982064  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.923980  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.927731  9600 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:25.930928  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.989995  6036 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:25.937192  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.990958  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.991350  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.992074  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.992524  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.993130  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.993665  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.937812  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.938941  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.995316  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.995659  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.996337  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.996735  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.997371  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.997747  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.939364  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.940104  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.941232  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:25.945116  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:25.949887  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:25.958875  6609 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:25.960974  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:25.998453  6651 raft_consensus.cc:2393] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 4: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:26.000851  6111 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:25.994186  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.962282  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.962909  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:25.970599  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.917618  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.971081  9596 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:25.971942  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.916054  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:25.920138  6040 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:25.923621  9649 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:25.964092  6649 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 8: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:25.986523  9572 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:25.972584  9613 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:25.987237  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.969167  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.968294  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.988301  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.974483  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:25.967214  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:25.974438  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:25.978363  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:25.989498  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.000252  6647 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
W20260709 12:25:26.074775  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.028311  5967 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 9: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:26.002142  6609 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:26.018539  5965 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:25.994306  6043 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:26.109592  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:26.110296  6110 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:26.074872  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.109338  6117 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:26.125065  6113 raft_consensus.cc:2393] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:26.055197  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.112932  6084 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:26.130193  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.130962  6084 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.002367  6650 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:26.076658  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.002836  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.077239  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.125697  6642 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:26.132723  6037 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
W20260709 12:25:26.132804  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 130712us
I20260709 12:25:26.102228  6111 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:26.002288  6118 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:26.133847  6609 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:26.134392  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.135092  6035 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:26.133898  6644 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:26.140898  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.141470  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.142243  6112 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:26.135815  6609 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:26.153957  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.155122  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.155143  6117 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:26.155709  9619 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:26.156133  9619 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:26.156458  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.157013  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:26.159346  6116 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:26.156424  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.161190  6081 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:26.160900  6609 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:26.049907  9648 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:25:26.164372  6115 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:26.168468  6111 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:26.129384  9613 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:26.175833  6037 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:26.147536  9610 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:26.177059  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.180054  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.156634  9619 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:26.178776  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.111783  9621 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:25:26.181411  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.182745  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.137012  9634 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:26.170143  9534 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:26.185699  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.186678  6645 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:26.187704  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.188200  9597 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:26.188755  9597 raft_consensus.cc:697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:26.188874  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.189309  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.189550  6645 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:26.189735  9597 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:26.190786  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:26.179522  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.191975  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.192171  6115 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:26.193500  5959 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:26.165328  9596 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:26.194195  9634 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:26.196848  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 5 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.198140  9634 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:26.181121  9610 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:26.198935  9610 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:26.197075  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.203764  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.171016  9600 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:26.204537  6645 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:26.177021  9613 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:26.211210  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.218938  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.221172  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.221671  5862 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 200) took 2917 ms. Trace:
I20260709 12:25:26.221807  6645 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:26.224864  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.225574  6118 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:26.226127  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.227458  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.228615  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.229619  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.229545  5956 tablet_service.cc:1558] Processing DeleteTablet for tablet 81efabae1bb448e3a8483e6231673c10 with delete_type TABLET_DATA_TOMBSTONED (TS f1bb8e63c2b448cdafd51f05d277c741 not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:34548
I20260709 12:25:26.230505  6650 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:26.222033  5862 rpcz_store.cc:276] 0709 12:25:23.304636 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:23.304805 (+   169us) service_pool.cc:224] Handling call
0709 12:25:26.221587 (+2916782us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:24.456155 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:24.456841 (+   686us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:24.456890 (+    49us) write_op.cc:435] Acquired schema lock
0709 12:25:24.456927 (+    37us) tablet.cc:662] Decoding operations
0709 12:25:24.457353 (+   426us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:24.488448 (+ 31095us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:24.491483 (+  3035us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:25:24.571171 (+ 79688us) tablet.cc:701] Row locks acquired
0709 12:25:24.571224 (+    53us) write_op.cc:260] PREPARE: finished
0709 12:25:24.571410 (+   186us) write_op.cc:270] Start()
0709 12:25:24.571579 (+   169us) write_op.cc:276] Timestamp: P: 1783599924571344 usec, L: 0
0709 12:25:24.571618 (+    39us) op_driver.cc:348] REPLICATION: starting
0709 12:25:25.112405 (+540787us) log.cc:844] Serialized 533 byte log entry
0709 12:25:25.708166 (+595761us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482104fe28 00007f4824a8a581 00007f4824a89d58 00007f4824a8e9f1 00007f4824a8e9a9 00007f4824a8e939 00007f4824a8e901 00007f4824a8db2d 0000000000388634 0000000000388479
0709 12:25:25.893031 (+184865us) op_driver.cc:464] REPLICATION: finished
0709 12:25:26.185393 (+292362us) write_op.cc:301] APPLY: starting
0709 12:25:26.185497 (+   104us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:26.185613 (+   116us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:26.185649 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:26.185994 (+   345us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:26.186268 (+   274us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:25:26.186324 (+    56us) write_op.cc:312] APPLY: finished
0709 12:25:26.186836 (+   512us) log.cc:844] Serialized 23 byte log entry
0709 12:25:26.187152 (+   316us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:26.187247 (+    95us) write_op.cc:454] Released schema lock
0709 12:25:26.187307 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:26.187786 (+   479us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:26.187815 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":289338,"apply.run_cpu_time_us":2369,"apply.run_wall_time_us":2377,"mutex_wait_us":4645,"num_ops":1,"prepare.queue_time_us":151958,"prepare.run_cpu_time_us":24505,"prepare.run_wall_time_us":1252254,"raft.queue_time_us":508639,"raft.run_cpu_time_us":56367,"raft.run_wall_time_us":239552,"replication_time_us":1321235,"spinlock_wait_cycles":1009236736,"thread_start_us":1031431,"threads_started":4,"wal-append.queue_time_us":487456}]]}
I20260709 12:25:26.235378  6645 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:26.238699  6645 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:26.226306  9634 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:26.226346  6111 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:26.216635  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.217181  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.217890  6649 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:25:26.247589  6649 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:26.238842  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.148350  9649 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:26.265033  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.276111  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.277215  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.283648  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.261274  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.285739  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.290512  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.215780  9600 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:26.294627  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.296604  6116 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:26.178124  9648 raft_consensus.cc:697] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:26.301249  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.303510  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.304374  6039 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:26.310058  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:26.313508  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 157606us
I20260709 12:25:26.314975  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.321254  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.327310  6118 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:26.329694  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.332083  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.333609  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.335283  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.341696  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.343001  9634 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:26.357899  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.362702  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:26.377815  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.391088  5863 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 317) took 1237 ms. Trace:
I20260709 12:25:26.391595  5863 rpcz_store.cc:276] 0709 12:25:25.154032 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:25.154209 (+   177us) service_pool.cc:224] Handling call
0709 12:25:25.522902 (+368693us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:25:26.390814 (+867912us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":812516224}
I20260709 12:25:26.393323  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.394819  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.396322  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.396611  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.397017  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.397594  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.398221  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.398808  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.398893  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.398591  9648 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:26.399974  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.400571  9649 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:26.400993  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.394836  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.398593  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.402354  9600 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:26.402875  5864 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 322) took 1838 ms. Trace:
I20260709 12:25:26.403781  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.404639  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.405773  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.407382  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.407506  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.404201  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.414760  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:26.314265  9645 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:26.395377  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.408483  6035 raft_consensus.cc:2376] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10. Re-sending same reply.
I20260709 12:25:26.419507  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:26.423864  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:26.425738  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.419245  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:26.426853  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 295956us
I20260709 12:25:26.427017  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:26.425078  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.433144  5967 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:26.434059  6608 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.434221  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.434906  6040 raft_consensus.cc:2376] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9. Re-sending same reply.
I20260709 12:25:26.432257  5959 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:25:26.439720  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:26.439731  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.440521  6111 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:26.441556  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.442041  5962 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:26.442713  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.427630  6084 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.444191  5934 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.437469  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:26.446290  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.447320  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.448055  6118 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:26.450031  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.451957  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.453181  5934 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.455190  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.455490  6643 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:26.421239  9600 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.474926  6648 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:26.477324  6082 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.432619  9632 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:26.485388  9621 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:26.485541  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.485831  9621 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:26.486225  9621 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:26.486476  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.486920  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.485984  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.487424  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.489305  5963 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:26.445465  9596 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:26.492295  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 64765.3us
I20260709 12:25:26.445156  9629 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.445075  9605 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:26.403230  5864 rpcz_store.cc:276] 0709 12:25:24.564583 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:24.564733 (+   150us) service_pool.cc:224] Handling call
0709 12:25:25.224501 (+659768us) spinlock_profiling.cc:243] Waited 439 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:25:26.402817 (+1178316us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:25.708593 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:25.709200 (+   607us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:25.709235 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:25:25.709252 (+    17us) tablet.cc:662] Decoding operations
0709 12:25:25.709573 (+   321us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:25.709616 (+    43us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:25.709646 (+    30us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:25:25.709837 (+   191us) tablet.cc:701] Row locks acquired
0709 12:25:25.709854 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:25:25.710041 (+   187us) write_op.cc:270] Start()
0709 12:25:25.710145 (+   104us) write_op.cc:276] Timestamp: P: 1783599925709987 usec, L: 0
0709 12:25:25.710164 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:25:25.710772 (+   608us) log.cc:844] Serialized 533 byte log entry
0709 12:25:26.179909 (+469137us) op_driver.cc:464] REPLICATION: finished
0709 12:25:26.248384 (+ 68475us) write_op.cc:301] APPLY: starting
0709 12:25:26.257536 (+  9152us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:26.266517 (+  8981us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:26.274576 (+  8059us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:26.302854 (+ 28278us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:26.318389 (+ 15535us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0709 12:25:26.328511 (+ 10122us) write_op.cc:312] APPLY: finished
0709 12:25:26.350086 (+ 21575us) log.cc:844] Serialized 23 byte log entry
0709 12:25:26.361944 (+ 11858us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:26.365913 (+  3969us) write_op.cc:454] Released schema lock
0709 12:25:26.365960 (+    47us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":1010034560,"child_traces":[["op",{"apply.queue_time_us":11580,"apply.run_cpu_time_us":2575,"apply.run_wall_time_us":117991,"num_ops":1,"prepare.queue_time_us":120468,"prepare.run_cpu_time_us":2427,"prepare.run_wall_time_us":2427,"replication_time_us":452204,"threads_started":1}]]}
I20260709 12:25:26.455798  9598 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.466866  9518 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:26.501636  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.467468  9565 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:26.505323  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.466895  9627 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:26.506922  5960 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:26.470379  9628 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:26.510838  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.427357  9610 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:26.515468  5967 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:26.509480  6084 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:26.518718  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 63595.1us
I20260709 12:25:26.523258  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.445752  9619 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:26.526314  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.533393  6609 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:26.516885  9600 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:26.538331  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 100938us
I20260709 12:25:26.540531  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:26.540354  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.542668  6650 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:26.501959  9639 consensus_queue.cc:1059] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.038s
I20260709 12:25:26.543632  6609 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:26.519932  9655 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:26.544950  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.520325  9518 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:26.506007  9630 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.036s
I20260709 12:25:26.536046  9602 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.645113  9572 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:26.646502  9572 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:26.585633  9613 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:26.546106  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:26.550302  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.567242  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.538515  9667 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:26.546412  9655 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:26.595024  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:26.649412  9655 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:26.593576  9610 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:26.567898  9608 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:26.594333  9639 raft_consensus.cc:3055] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:26.606217  5967 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:26.582979  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.564976  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:26.569557  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.651923  9614 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:26.629179  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 129993us
W20260709 12:25:26.652930  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 88032.4us
I20260709 12:25:26.590344  9645 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:26.583765  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:26.650729  9639 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:26.654728  9630 consensus_queue.cc:1059] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:26.603752  5864 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 7 to 8, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:26.655759  9638 raft_consensus.cc:3055] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:26.554062  9621 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:26.656533  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 110512us
I20260709 12:25:26.606263  5964 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:26.656805  6117 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:26.610909  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:26.596189  9619 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:26.552212  9629 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.592844  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.658707  9602 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.650302  9608 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:26.659377  9608 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:26.607159  5932 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:26.593348  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.649202  9667 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:26.567842  5966 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:26.660825  9600 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:26.565565  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:26.660604  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 53466us
I20260709 12:25:26.562556  9605 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:26.662353  9605 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:26.663414  9605 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:26.567631  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 58245.9us
I20260709 12:25:26.656153  9638 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:26.664665  6084 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.654450  9673 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.011s
I20260709 12:25:26.648404  9572 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:26.665253  9638 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:26.653995  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.667819  9638 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:26.667910  9614 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:26.668329  9614 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:26.668690  9614 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:26.668951  9600 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:26.555718  9660 tablet_replica.cc:333] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:25:26.556825  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:26.672983  9260 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.556023  9627 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:25:26.675240  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 131692us
I20260709 12:25:26.676044  6609 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:26.676477  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.676621  9627 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:26.656766  9639 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:26.677070  9627 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.649645  9613 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:26.547205  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:26.678928  6642 raft_consensus.cc:2393] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:26.679333  9614 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:26.650134  6112 raft_consensus.cc:2393] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:26.678074  9639 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:26.677501  9627 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:26.680780  9669 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:26.677343  9572 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:26.658175  9621 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:26.666916  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.683147  9603 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.684757  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.649649  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:26.662256  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 209149us
I20260709 12:25:26.704007  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.704577  5932 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.660972  9667 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:26.705365  9565 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.674896  9673 raft_consensus.cc:3055] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:26.707221  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.707502  9673 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:26.708453  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.708546  9673 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:26.709874  9673 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:26.710632  9619 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:26.654021  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:26.712217  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 58260.2us
I20260709 12:25:26.712702  9655 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:26.694619  9613 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:26.713703  6111 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:26.695168  6084 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:26.715077  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:26.715467  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.715853  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.716604  9260 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:26.716948  9619 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.717048  9260 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:26.717495  9260 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:26.717657  9619 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:26.718081  9619 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:26.718425  9619 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:26.703936  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:26.720552  5863 catalog_manager.cc:5697] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 3 to 4, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 4 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:26.702970  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:26.724972  9260 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:26.645143  9518 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:26.681658  9614 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:26.728813  9565 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:26.729928  5932 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:26.730183  5934 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:26.716975  6082 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.731269  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.731506  5932 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.727011  9260 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:26.716569  6084 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.732517  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.734673  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:26.733657  9598 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:26.733840  9668 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:26.732703  9606 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:26.740252  9606 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:26.740648  9606 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:26.735908  9600 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:26.739285  9598 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:26.744563  9518 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:26.745193  9598 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:26.745636  5968 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:26.739588  9668 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:26.750936  9668 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:26.728191  9638 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.756749  6009 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:26.757596  9649 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:26.732517  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.737037  6084 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.738004  9671 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:26.733837  9565 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:26.732663  9628 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:26.739509  9614 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:26.739212  9630 consensus_queue.cc:1059] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:25:26.760715  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.763324  9260 consensus_queue.cc:1059] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:25:26.770573  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.762341  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:26.771654  6035 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:26.772372  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:26.773113  6642 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:26.762253  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.726696  9627 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:26.766753  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:26.771836  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:26.761257  9626 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:26.761407  9638 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:26.782984  9638 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:26.783416  9638 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:26.767432  9608 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:26.786756  9608 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:26.789134  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.759320  9632 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.762701  9600 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:26.779852  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:26.782051  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.774902  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:26.790992  6114 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:26.780126  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:26.766534  9628 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:26.762715  9670 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:26.761714  9606 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:26.777572  9658 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
W20260709 12:25:26.814779  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 44312.9us
I20260709 12:25:26.815639  6082 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.797605  9621 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:26.809393  9628 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:26.802225  9600 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:26.834324  6082 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.814023  9670 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:26.837018  6082 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.831117  9672 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:26.840421  9598 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:26.840301  9606 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:26.853283  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:26.855031  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:26.856004  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 66945.8us
I20260709 12:25:26.856720  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:26.857746  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.880635  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.833730  9600 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:26.906629  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:26.916034  9260 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:26.902267  6082 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.847771  9598 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:26.858708  9606 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:26.891274  9630 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:26.838829  9670 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:26.838488  9541 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:26.883206  9518 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:26.931564  6082 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.927448  9680 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:26.927673  9679 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:26.928408  9683 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:26.892151  9621 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.935007  9677 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:26.940131  9672 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:26.953301  9676 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.121s	user 0.004s	sys 0.000s
W20260709 12:25:26.955292  9675 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
I20260709 12:25:26.955857  6035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:25:26.956637  6035 raft_consensus.cc:606] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:26.959874  5968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:25:26.959967  9638 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:26.960520  5968 raft_consensus.cc:606] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:26.916188  9619 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:26.965790  9619 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:26.891261  9686 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:26.969106  9660 raft_consensus.cc:2243] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:26.970324  9660 raft_consensus.cc:2272] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:26.971392  9638 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:26.974597  9670 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:26.977344  9670 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:26.977854  9608 raft_consensus.cc:3055] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:25:26.937443  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 203942us
I20260709 12:25:26.935788  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.963639  5968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:25:26.982899  5968 raft_consensus.cc:606] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:26.984972  5932 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:26.986212  6035 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:38788
I20260709 12:25:26.986894  6035 raft_consensus.cc:606] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:26.988078  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:26.989606  9572 raft_consensus.cc:3055] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:26.989768  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:26.990046  9572 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:26.990797  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:26.990978  9638 consensus_queue.cc:1059] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:25:26.991343  9598 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:26.992190  9686 raft_consensus.cc:3055] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:26.992565  9686 raft_consensus.cc:740] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:26.993425  9686 consensus_queue.cc:260] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:26.994433  9686 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:25:26.997741  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 117049us
I20260709 12:25:27.000185  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.002769  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:26.974100  9660 ts_tablet_manager.cc:1916] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:25:26.930830  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 196219us
I20260709 12:25:26.935993  9655 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:26.936846  9680 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:27.017171  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:27.017902  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 82223.7us
I20260709 12:25:26.966248  9628 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.023653  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:27.024334  9628 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:26.978379  9608 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:27.027221  9678 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:27.028048  9655 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:27.027717  9626 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:27.028904  9655 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:27.029323  9655 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:27.015880  9680 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:27.003427  9668 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:27.035137  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:27.037086  9668 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:27.037576  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.042853  9572 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:27.044178  9572 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:27.045149  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:27.046434  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:27.027748  9608 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.048431  9627 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:27.044267  9639 raft_consensus.cc:3055] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:27.049434  9639 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:27.015529  9638 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:27.051138  9685 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:27.051677  6040 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:25:27.050354  9639 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.053673  9639 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:27.018175  9671 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:27.056744  9648 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:27.057348  9684 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
W20260709 12:25:27.050743  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.059625  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:27.059756  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:27.061146  6114 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:27.061333  6035 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:27.059756  5968 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:27.030138  9655 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:27.063074  6111 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:27.065279  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:27.063258  5934 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:27.079134  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:27.080677  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 78645.2us
I20260709 12:25:27.081928  9668 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:27.089243  9608 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:27.075011  9628 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:27.090772  9628 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:27.083496  9565 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.008s
I20260709 12:25:27.092417  9565 raft_consensus.cc:3055] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:27.092814  9565 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:27.094035  5934 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:27.095227  9684 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:27.093918  9565 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.082953  6009 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.104485  5934 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:27.106083  5934 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:27.098425  6035 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:27.107705  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:27.108937  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:27.110814  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:27.110729  5962 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 5, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.111611  5959 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:27.115962  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:27.091183  9628 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:27.116742  5968 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:27.117394  5934 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:27.138541  5961 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:27.118250  6609 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:27.112531  9565 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:27.143513  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:27.143759  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 141057us
W20260709 12:25:27.143148  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 60281.3us
I20260709 12:25:27.144675  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.140025  9534 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:27.147320  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.116384  9685 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20260709 12:25:27.114317  9632 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:27.150507  9572 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:27.145726  9668 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:27.163934  9687 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:27.152578  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.166841  9689 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:25:27.174739  9690 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:27.175926  9690 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:27.176280  9690 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:27.177152  9690 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.178488  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.179992  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.180951  9672 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:27.181494  9634 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:27.181639  9672 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:27.182199  9634 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:27.182971  9672 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:27.183346  9672 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:27.184330  9672 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:27.185527  9672 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:27.185730  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.186520  9619 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:27.146117  9686 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20260709 12:25:27.167119  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.188705  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:27.190821  6111 raft_consensus.cc:2393] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 7: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:27.190021  9632 raft_consensus.cc:697] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:27.195077  9632 consensus_queue.cc:237] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:27.196014  9680 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.187271  9673 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:27.197372  9673 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:27.160548  9534 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:27.198537  9534 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.198228  9673 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.204408  9673 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:27.208923  6035 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:27.100508  9600 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.178323  9690 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:27.223533  5932 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:27.213220  9660 ts_tablet_manager.cc:1929] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 6.6
W20260709 12:25:27.214105  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 47079.1us
I20260709 12:25:27.235066  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.215588  9600 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:27.216917  9608 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:27.198134  9680 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:27.225771  6112 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:27.214630  9639 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:27.236263  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:27.237357  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:27.238152  6037 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:27.240137  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:27.241246  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.240068  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:27.248019  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:27.248703  6041 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:27.250257  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.252123  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.253346  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.254792  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:27.254314  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:27.257754  6043 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
W20260709 12:25:27.258858  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 103080us
I20260709 12:25:27.259537  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:27.264539  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:27.270890  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:27.255841  9686 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:27.276331  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.258143  9660 log.cc:1199] T 81efabae1bb448e3a8483e6231673c10 P f1bb8e63c2b448cdafd51f05d277c741: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/wals/81efabae1bb448e3a8483e6231673c10
I20260709 12:25:27.266304  5863 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 4 to 5, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 5 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.246299  9572 consensus_queue.cc:1059] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:25:27.257864  9687 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:27.256719  9671 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:27.256454  9689 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:27.278087  5863 catalog_manager.cc:5697] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 7 to 8, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 8 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:27.284227  6611 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:27.287192  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.287532  9693 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:27.275805  9598 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:27.272332  9610 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.019s
I20260709 12:25:27.297078  6112 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:27.293087  6006 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.283391  9639 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:27.303714  9572 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:27.312392  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:27.313078  9660 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.DeleteTablet from 127.0.0.1:34548 (request call id 89) took 1085 ms. Trace:
I20260709 12:25:27.311982  6041 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:27.290804  9693 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:27.320489  6006 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.295737  9679 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:27.293898  9534 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:27.321419  9630 consensus_queue.cc:1059] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.002s
I20260709 12:25:27.323354  9689 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:27.322527  6006 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.313537  9660 rpcz_store.cc:276] 0709 12:25:26.227747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:26.229301 (+  1554us) service_pool.cc:224] Handling call
0709 12:25:26.555293 (+325992us) ts_tablet_manager.cc:1151] Deleting tablet 81efabae1bb448e3a8483e6231673c10
0709 12:25:26.555397 (+   104us) ts_tablet_manager.cc:1071] Acquired tablet manager lock
0709 12:25:27.166113 (+610716us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:27.213072 (+ 46959us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:27.312958 (+ 99886us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":92701,"tablet-delete.queue_time_us":324566,"thread_start_us":214784,"threads_started":1}
I20260709 12:25:27.286131  9628 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.350396  6006 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.351599  9639 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:27.301484  9600 consensus_queue.cc:1059] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.047s
I20260709 12:25:27.322296  9693 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:27.363860  9628 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:27.364861  6036 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:27.365561  5960 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:27.376739  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:27.377967  9630 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:27.378993  9655 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:27.380162  9685 raft_consensus.cc:3055] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:27.380589  9685 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:27.381457  9685 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:27.385725  6112 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:27.387555  9649 raft_consensus.cc:3055] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:27.388000  9649 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:27.388778  9649 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.389575  5850 catalog_manager.cc:5028] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): tablet 81efabae1bb448e3a8483e6231673c10 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:25:27.390172  9649 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:27.376787  9518 raft_consensus.cc:993] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:27.397473  9686 raft_consensus.cc:3055] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:27.348744  9534 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:25:27.394768  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 44410.6us
I20260709 12:25:27.399960  9630 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:27.407956  9628 raft_consensus.cc:1081] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:27.414876  9648 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
W20260709 12:25:27.409840  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 124590us
I20260709 12:25:27.411653  9685 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:27.409009  6608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.856s (SENT) [suppressed 6 similar messages]
I20260709 12:25:27.412781  9679 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:27.405285  9686 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:27.395992  9627 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:25:27.426065  6006 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.431134  9638 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:27.432009  9679 consensus_queue.cc:1059] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 5.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:27.433108  9679 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:27.433462  9679 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:27.423089  9686 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.429234  5932 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:27.441543  9679 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:27.491374  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:27.487112  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 49954us
I20260709 12:25:27.475169  6040 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:25:27.496330  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 87343.9us
I20260709 12:25:27.477173  6043 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:27.471573  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:27.444306  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:27.445914  6037 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:27.448181  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:27.516983  6111 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:27.516793  9670 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:27.495605  9534 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.468705  9638 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.058s
W20260709 12:25:27.509443  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 80284.2us
I20260709 12:25:27.513062  9701 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:27.529400  9701 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:27.445464  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:27.535595  6040 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:27.448396  9619 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:27.553118  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.434216  9600 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.113s
I20260709 12:25:27.546581  9621 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:27.541050  9669 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.019s
I20260709 12:25:27.561661  9655 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:27.542620  9670 consensus_queue.cc:1059] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 8.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.018s
I20260709 12:25:27.586889  9621 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:27.594347  9630 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:27.594767  9630 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:27.594985  9701 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:27.595566  9630 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.556181  9597 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:27.611716  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 323745us
I20260709 12:25:27.613633  9597 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:27.564437  9619 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.591653  9679 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:27.597043  9600 raft_consensus.cc:3055] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:27.602564  9670 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:27.623010  9670 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:27.625895  9670 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.627264  5934 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:27.628774  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:27.632187  5934 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:27.634760  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 81751.4us
I20260709 12:25:27.637179  6082 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.638206  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.639497  9628 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:27.640148  9678 consensus_queue.cc:1059] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:27.634653  9518 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:27.644400  9621 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:27.649950  6082 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:27.619396  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 61594.7us
I20260709 12:25:27.623116  9600 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:27.633370  9630 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:27.618918  9693 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:27.663894  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:27.631737  9699 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:27.634302  9670 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:27.680521  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:27.682785  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:27.658702  9655 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:27.674827  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:27.675184  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:27.675720  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:27.676709  5966 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20260709 12:25:27.677824  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:27.670147  6043 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:27.687701  6649 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:27.695514  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:27.689021  6118 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:27.696317  6114 raft_consensus.cc:2410] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 11 because replica has last-logged OpId of term: 10 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 5.
I20260709 12:25:27.689937  6116 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:27.698825  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:27.700906  5962 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:27.702281  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:27.703554  6645 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:27.705935  6109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:25:27.706519  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:27.706930  6109 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:27.638167  9709 consensus_queue.cc:1059] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:25:27.671849  9621 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:27.711377  5962 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:27.707399  6109 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:27.709725  6116 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:27.710265  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:27.718961  6110 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:27.682798  9672 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:27.723475  6112 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:27.700042  9686 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:27.731772  6043 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:27.735733  9600 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.677594  9608 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.045s
I20260709 12:25:27.685279  9565 consensus_queue.cc:1059] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:25:27.743297  9565 raft_consensus.cc:3055] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:27.743737  9565 raft_consensus.cc:740] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:27.744764  9684 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.003s
I20260709 12:25:27.744649  9565 consensus_queue.cc:260] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.756682  9565 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:27.752533  9613 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:27.770324  9613 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.771411  9693 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:27.774139  9626 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:27.774637  9626 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:27.775472  9626 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.776943  9626 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:27.778632  9610 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:27.779423  9610 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.781913  9610 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:27.754675  9597 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:27.756421  9645 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.030s
I20260709 12:25:27.786628  6039 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:27.756183  9628 raft_consensus.cc:3055] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:27.787415  9628 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:27.788338  9628 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.789456  9628 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:27.793303  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:27.800155  5961 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:27.804177  6109 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:27.815228  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 103618us
W20260709 12:25:27.817634  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 143966us
W20260709 12:25:27.833029  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 159895us
I20260709 12:25:27.835939  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:27.836764  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:27.810883  9613 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:27.842041  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:27.842583  5961 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:27.845306  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:27.845453  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:27.836375  6109 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:27.846089  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:27.847388  6112 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 7: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:27.847647  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.848819  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:27.849472  6117 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
W20260709 12:25:27.915007  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 60219.5us
I20260709 12:25:27.917344  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:27.916626  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:27.852579  9634 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:27.836048  9638 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.078s
I20260709 12:25:27.922914  6042 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:27.930708  9715 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:27.931299  9707 consensus_queue.cc:1059] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:27.921411  9680 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:27.959993  9719 raft_consensus.cc:3055] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:27.960556  9719 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:27.961532  9719 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:27.920522  9689 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:25:27.957234  9634 raft_consensus.cc:697] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:27.967713  9680 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:27.968127  9634 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:27.975009  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:27.975736  5965 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:27.979249  6006 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:27.957731  9717 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.025s
I20260709 12:25:27.981966  6117 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:27.985419  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:27.987159  6112 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:27.988106  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:27.989317  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:27.977494  9630 raft_consensus.cc:3055] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:27.993254  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:27.993875  5960 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:27.990746  9669 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:25:27.997035  9705 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:27.997526  9705 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:27.998697  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:27.998387  9705 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:28.002945  9649 consensus_meta.cc:287] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
I20260709 12:25:27.991940  9629 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:27.984186  9638 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:28.004660  9638 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.005033  9638 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:27.992785  9630 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:28.015036  9630 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.016309  9630 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:28.018384  9638 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.020633  6113 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:28.021159  9701 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:28.098093  9619 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:28.102396  9600 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:28.087513  9680 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:28.094189  9679 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:28.128568  6039 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:28.122582  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 279846us
I20260709 12:25:28.127177  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:28.129604  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 107102us
I20260709 12:25:28.129743  5965 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:28.138717  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 291127us
I20260709 12:25:28.142385  5964 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:28.144356  5934 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:28.131644  9638 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:28.171350  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:28.132524  9679 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:25:28.181102  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 47639.7us
I20260709 12:25:28.174088  5965 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:28.180162  6112 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:28.180647  6039 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:28.195381  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:28.197953  6112 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:28.135421  9701 consensus_queue.cc:1059] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.046s
I20260709 12:25:28.160972  9680 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.201922  6006 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:28.179744  9626 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:28.163668  9684 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:25:28.219524  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:28.186911  9703 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:28.220345  6081 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:28.218760  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:28.225780  6081 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:28.226689  9626 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.198768  9597 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:28.235620  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 66806us
I20260709 12:25:28.224702  6645 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:28.229565  9614 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:28.241086  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:28.230818  9626 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:28.231374  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:28.231766  9719 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:28.243541  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:28.248764  5965 raft_consensus.cc:3055] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:28.249125  5965 raft_consensus.cc:740] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:28.249812  5965 consensus_queue.cc:260] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.245244  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:28.246021  5934 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:28.247076  6650 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:28.197613  9673 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:25:28.220506  9638 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:28.254709  5965 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:28.264892  5965 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:28.266146  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:28.271965  6650 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:28.221242  9632 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.037s
I20260709 12:25:28.266081  9638 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:28.274632  9638 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:28.273777  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:28.221411  9680 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.282781  9684 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:28.283284  9680 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:28.258375  9703 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:28.287011  9632 raft_consensus.cc:3055] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:28.287540  9632 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:28.227903  9518 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.032s
I20260709 12:25:28.260360  9565 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.028s
I20260709 12:25:28.255057  9701 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:28.248265  9597 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.246394  9715 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:28.293248  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:28.301553  5965 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:28.312692  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:28.260947  9717 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:28.261246  9626 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:28.313413  6113 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:28.302253  9680 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.307631  9699 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:28.331549  9598 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:28.327452  9626 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.337564  9626 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:28.325740  9715 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:28.341624  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 75164.4us
I20260709 12:25:28.289453  9709 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:28.285809  9703 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:28.343958  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 77905.3us
I20260709 12:25:28.345103  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:28.302865  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:28.346382  9717 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:28.349758  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 46955.5us
I20260709 12:25:28.335337  9699 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:28.354972  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:28.344853  9709 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:28.364583  9709 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.365783  9709 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:28.367707  6084 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:28.370677  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 108992us
I20260709 12:25:28.373275  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:28.371548  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:28.332638  9680 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.378624  9572 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:28.380838  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 81307.4us
I20260709 12:25:28.354208  9634 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:28.384127  6041 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:25:28.380510  9572 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.386140  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:28.376354  9608 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:28.345674  9715 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.386175  9572 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:28.397694  9597 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:28.345268  9632 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.398988  9632 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:28.386579  9613 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:28.401029  9699 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.403093  9699 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:28.404718  5961 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:25:28.405148  5961 pending_rounds.cc:85] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 7
I20260709 12:25:28.405373  5961 pending_rounds.cc:107] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:25:28.405639  5961 raft_consensus.cc:2889] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:28.400015  9721 consensus_queue.cc:1175] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0557a7246c8945b99e5215c99d4ddf9c" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 12:25:28.391477  9738 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:28.408492  9738 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.411335  9628 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:28.411808  9628 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:28.412730  9628 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.414032  9628 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:28.417711  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:28.419234  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:28.427158  6111 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 6. (term mismatch)
I20260709 12:25:28.427697  6111 pending_rounds.cc:85] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 5
I20260709 12:25:28.427919  6111 pending_rounds.cc:107] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 10.6
I20260709 12:25:28.428148  6111 raft_consensus.cc:2889] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:28.411521  9694 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 8 is higher.
I20260709 12:25:28.426728  9717 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.003s
I20260709 12:25:28.437487  9738 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:25:28.426412  9737 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.018s
I20260709 12:25:28.442241  6081 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:28.462628  9679 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.464033  9621 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:28.464166  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 121315us
I20260709 12:25:28.469907  6113 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:25:28.476020  9725 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
I20260709 12:25:28.487507  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:28.520017  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 99079.6us
I20260709 12:25:28.523768  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:28.524501  5961 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
W20260709 12:25:28.515257  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 73099.4us
I20260709 12:25:28.532797  6117 raft_consensus.cc:2393] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 9: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:28.532903  6118 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:28.536384  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:28.539434  6081 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:28.532089  9689 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.391477  9701 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:28.560184  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:28.564388  9701 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.554819  9679 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:28.573176  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:28.573714  6006 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:28.574527  9673 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:28.574915  9673 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:28.545985  9614 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:28.610036  5863 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 202) took 1449 ms. Trace:
I20260709 12:25:28.552585  9705 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:28.575264  9673 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:28.537853  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:28.641649  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 81194.9us
I20260709 12:25:28.676563  6110 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:28.558995  9658 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.611495  5864 catalog_manager.cc:5697] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 8 to 9, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 9 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:28.562723  9680 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:28.679646  5864 catalog_manager.cc:5697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 5 to 6, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 6 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:28.713073  6042 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:28.714285  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:28.576249  9689 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.666656  9634 raft_consensus.cc:697] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:28.577975  9738 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.122s
I20260709 12:25:28.678684  9705 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:28.610482  5863 rpcz_store.cc:276] 0709 12:25:27.161019 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.161175 (+   156us) service_pool.cc:224] Handling call
0709 12:25:28.609969 (+1448794us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:27.559266 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:27.636842 (+ 77576us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:27.648670 (+ 11828us) write_op.cc:435] Acquired schema lock
0709 12:25:27.655906 (+  7236us) tablet.cc:662] Decoding operations
0709 12:25:27.719705 (+ 63799us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:27.719785 (+    80us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:27.719813 (+    28us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:25:27.720235 (+   422us) tablet.cc:701] Row locks acquired
0709 12:25:27.720254 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:25:27.720398 (+   144us) write_op.cc:270] Start()
0709 12:25:27.720534 (+   136us) write_op.cc:276] Timestamp: P: 1783599927720354 usec, L: 0
0709 12:25:27.720560 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:25:27.721225 (+   665us) log.cc:844] Serialized 913 byte log entry
0709 12:25:27.977755 (+256530us) op_driver.cc:464] REPLICATION: finished
0709 12:25:28.345413 (+367658us) write_op.cc:301] APPLY: starting
0709 12:25:28.348596 (+  3183us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:28.375906 (+ 27310us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:28.386703 (+ 10797us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:28.397533 (+ 10830us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:28.397747 (+   214us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:25:28.397792 (+    45us) write_op.cc:312] APPLY: finished
0709 12:25:28.397974 (+   182us) log.cc:844] Serialized 29 byte log entry
0709 12:25:28.398137 (+   163us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:28.398238 (+   101us) write_op.cc:454] Released schema lock
0709 12:25:28.398276 (+    38us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:28.398665 (+   389us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:28.398696 (+    31us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":4,"spinlock_wait_cycles":109952,"child_traces":[["op",{"apply.queue_time_us":358459,"apply.run_cpu_time_us":2111,"apply.run_wall_time_us":57150,"num_ops":2,"prepare.queue_time_us":246282,"prepare.run_cpu_time_us":3798,"prepare.run_wall_time_us":167928,"replication_time_us":227220,"thread_start_us":498929,"threads_started":2}]]}
I20260709 12:25:28.723086  6082 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:28.686589  9630 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.606618  9605 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.104s
I20260709 12:25:28.695091  9649 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:28.695883  9658 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.721812  9600 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:25:28.753177  6116 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
W20260709 12:25:28.822446  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 106907us
I20260709 12:25:28.727334  9705 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:28.843580  6118 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:25:28.843708  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:28.747792  9728 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:28.844342  5934 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:28.765182  9733 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:28.777567  9638 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.767406  9678 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:28.724642  9565 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.106s
I20260709 12:25:28.729892  9672 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.116s
I20260709 12:25:28.858932  6645 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:28.842300  9701 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:28.826031  9626 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.828465  9741 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.772841  9572 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.846031  9608 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.866312  6039 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:25:28.778762  9630 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.814765  9649 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.828426  9680 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.036s
I20260709 12:25:28.738003  9634 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.869757  9626 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.858246  9678 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.872985  9741 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:28.857424  9733 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.874189  9756 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:28.885160  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:28.864362  9694 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:28.936213  6650 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:28.939509  5965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:25:28.941071  5965 raft_consensus.cc:606] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:25:28.942070  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45994us
I20260709 12:25:28.860618  9638 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.877139  9630 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:28.950130  6036 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:28.951944  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 91928.2us
I20260709 12:25:28.959719  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:28.867491  9701 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.873974  9608 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.938369  9719 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.898538  9534 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
I20260709 12:25:28.950881  9730 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:28.951445  9694 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:28.968415  9630 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:28.991623  9628 consensus_meta.cc:287] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.577s	user 0.014s	sys 0.012s
I20260709 12:25:28.945631  9756 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.031603  9734 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:29.034929  9619 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.035486  9619 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:28.999554  9719 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.059758  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.079171  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:29.080036  6111 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:29.022545  9630 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.058519  9658 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:28.883215  9685 raft_consensus.cc:2955] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Committing config change with OpId 5.7: config changed from index 4 to 7, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:29.065811  9703 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.097966  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.099102  6039 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:29.099151  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:29.013411  9730 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.100073  6113 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:29.072005  9733 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.096194  9572 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:29.105775  9750 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:25:29.105891  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:29.106630  6114 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:29.099202  9649 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.107630  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:29.112950  9705 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:29.115042  9744 log.cc:927] Time spent T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:25:29.115424  9619 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:29.115801  9626 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:29.115986  9755 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.156s	user 0.000s	sys 0.001s
I20260709 12:25:29.119462  9701 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:29.121490  9745 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.401s	user 0.001s	sys 0.001s
I20260709 12:25:29.095393  9694 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.131992  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:29.118162  9730 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:29.100941  9703 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.119490  9747 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:29.163726  9766 log.cc:927] Time spent T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:25:29.150090  9719 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:29.162146  5965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:25:29.140592  9608 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:29.141371  6116 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:29.142774  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.162804  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.161290  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.185779  6036 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:29.174572  6009 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:29.196652  6041 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:29.138820  6114 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:29.198180  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:29.207527  6645 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
W20260709 12:25:29.149107  9768 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:29.215533  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.216219  6036 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:29.218868  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:29.220448  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:29.145654  9610 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:29.221809  5968 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 6 index: 9. (index mismatch)
I20260709 12:25:29.223569  9775 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:29.224251  9775 raft_consensus.cc:697] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:29.225093  9775 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.162585  9767 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.230039  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.151122  9638 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:29.233565  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.166622  9630 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:29.174293  9689 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.235513  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.211515  9649 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:29.237459  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.238307  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.239156  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.237365  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.250614  5961 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 6: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:29.242777  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:29.206554  9680 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:29.243289  5960 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 3.
I20260709 12:25:29.152849  9715 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:29.246531  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:29.148195  9678 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:29.247272  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:29.246448  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:29.236810  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.241807  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:29.251849  5964 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:29.251227  5966 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:29.250677  5959 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:29.248672  9684 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:25:29.263974  5962 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:29.233071  9719 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:29.263098  6645 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:29.213451  9534 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.233676  9610 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.250658  5963 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:29.259831  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:29.260248  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.276403  6043 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:29.260747  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.229190  9703 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.263135  6112 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:29.263578  6650 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:29.254163  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.270503  6006 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:29.280826  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:29.280974  6609 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:29.278745  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:29.281423  5968 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:29.282423  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.279812  6081 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:29.283249  5963 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:29.285166  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:29.285811  6650 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:29.286775  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:29.253787  9626 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.254890  9680 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.288317  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:29.288507  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:29.255524  9649 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.289603  6651 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:29.291198  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:29.253314  9741 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.279907  5962 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:29.301080  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:29.274799  9719 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.273548  9693 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:29.199069  9747 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.301947  6109 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:29.291673  6645 raft_consensus.cc:2955] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:29.304263  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:29.318015  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:29.322085  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:29.288962  9689 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:29.293725  9678 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.322839  6647 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:29.265452  9621 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.045s
W20260709 12:25:29.304243  9673 consensus_meta.cc:287] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.629s	user 0.007s	sys 0.004s
I20260709 12:25:29.303937  9680 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:29.299726  9634 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Leader pre-election won for term 4
W20260709 12:25:29.331048  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50162.5us
I20260709 12:25:29.329757  6109 raft_consensus.cc:2955] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Committing config change with OpId 5.7: config changed from index 4 to 7, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:29.310743  9630 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:29.364144  6116 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:25:29.322484  9730 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:29.339278  6113 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:29.311196  9670 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:29.365016  9730 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.365228  9670 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.365667  9670 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.281769  9534 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.370357  9701 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:29.341042  5968 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:29.341607  9738 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:29.314165  9565 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:25:29.333040  9689 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.344666  9740 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:29.345109  9770 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.067s
W20260709 12:25:29.345680  9759 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
I20260709 12:25:29.243678  9767 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.312093  9693 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:29.422816  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 124850us
I20260709 12:25:29.314533  9719 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:29.354614  9634 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.359381  9628 raft_consensus.cc:993] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:29.475062  9628 raft_consensus.cc:1081] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:29.303696  9649 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:29.474706  9634 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:29.374246  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 73223.8us
I20260709 12:25:29.376392  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.477584  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:29.343813  9705 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.374311  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.478415  9614 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:29.331179  9638 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:29.478832  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:29.479321  9638 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.479779  9638 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.304477  9626 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.483572  9728 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.484066  9626 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:29.349112  9756 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:29.484102  9728 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.486831  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.487450  6040 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:29.488137  9728 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:29.489286  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:29.424778  9767 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.425230  6035 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
W20260709 12:25:29.426051  9776 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:25:29.407650  9721 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.334970  9679 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.074s
I20260709 12:25:29.491580  9721 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.373747  9534 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.340543  9673 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.493468  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.494350  9673 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.478906  9614 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.495103  6082 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:29.375124  9730 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:29.379607  9738 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:29.496068  9738 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:29.491230  9649 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.497787  9649 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:29.339847  9678 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.439276  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.438148  9747 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:29.406244  9689 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:29.498965  9747 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:29.499326  9747 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.347452  9610 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.415402  9734 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:29.407063  9740 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.500298  9740 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:29.501121  6646 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:25:29.446782  9773 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.455701  9775 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.495179  6038 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:25:29.462729  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48958.3us
I20260709 12:25:29.506294  6114 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
W20260709 12:25:29.464325  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 43694.2us
I20260709 12:25:29.506974  6114 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:29.507349  6114 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:29.508286  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:29.422708  9693 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.380690  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.509020  6118 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:29.442591  9670 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.497498  9719 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.502668  9614 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:29.502789  9634 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.495421  9721 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.517104  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.513955  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.452123  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:29.549952  6043 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:29.518657  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:29.519223  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.520066  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.520934  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.551921  5961 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:29.522166  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.522883  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:29.552923  5959 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:29.536144  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:29.515586  6114 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.540114  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:29.540957  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:29.544763  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:29.547451  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:29.555781  5966 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:29.499648  9747 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.542963  9775 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.563720  9775 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:29.557101  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.564870  5963 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:29.564972  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:29.559031  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:29.555070  6116 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:29.567652  6117 raft_consensus.cc:2368] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8.
I20260709 12:25:29.568678  6110 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 7: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:29.559974  6081 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:29.499624  9678 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:29.566649  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:29.525548  9679 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:29.572994  6118 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 4: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:29.575078  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.575871  5966 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:25:29.582229  5959 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:29.502846  9773 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.546438  9630 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:29.546608  9728 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:29.589560  6081 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:29.600883  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:29.601517  5960 raft_consensus.cc:3055] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:29.586319  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:29.546435  9619 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:29.601810  5960 raft_consensus.cc:740] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:29.608531  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:29.609210  6035 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:29.604264  5960 consensus_queue.cc:260] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.577901  9767 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:29.578852  9685 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.ChangeConfig from 127.0.0.1:34548 (request call id 90) took 2470 ms. Trace:
I20260709 12:25:29.618423  6042 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:29.577129  9721 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:29.601155  9678 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:29.612172  9626 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:29.603112  9728 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:29.652971  6611 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:29.655303  6611 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:29.657021  9629 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:29.657424  9629 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:29.657583  6651 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:29.658584  9762 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:25:29.653574  9669 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:29.660691  9669 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.612429  9619 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.663190  9619 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:29.649871  6035 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:29.664223  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.664851  5967 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:29.666006  9669 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.665256  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:29.664893  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:29.668457  9719 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:29.668946  9629 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:29.669152  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:29.670004  6043 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 7: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:29.674008  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.675146  9634 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:29.675966  9673 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:29.676415  5967 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:29.677520  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:29.678272  5967 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:29.620963  9767 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.653178  9626 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.678083  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:29.681412  5962 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:29.685295  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:29.682734  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 4 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:29.643435  9756 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:29.695144  6043 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 4: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:29.641469  9721 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.588871  9679 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.649340  9678 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:29.710796  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:29.610800  9630 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.714578  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:29.683873  9715 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:29.606973  9680 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.712181  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:29.713166  5967 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.701421  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:29.684031  9728 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:29.669911  9719 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:29.696141  9626 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.733574  6038 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:29.693627  9767 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:29.719066  6650 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.724004  9757 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:29.750744  9680 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:29.724690  9789 log.cc:927] Time spent T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:25:29.728720  9773 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:29.676489  9673 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.751921  9614 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.753263  9673 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.651651  9638 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.754921  9738 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.755682  9614 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:29.756031  6646 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:29.757233  9738 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.758339  9747 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.757115  6116 raft_consensus.cc:2368] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:29.760290  9719 raft_consensus.cc:697] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:29.760519  9747 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:29.761392  9719 consensus_queue.cc:237] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.711071  9737 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:29.714025  9678 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.715021  9756 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.749791  6044 raft_consensus.cc:2368] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:25:29.713491  9670 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:29.713811  9721 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:29.765829  6112 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: [7.7-7.7]
I20260709 12:25:29.740787  5962 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:29.801407  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:29.755805  6041 raft_consensus.cc:2368] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8.
I20260709 12:25:29.799688  6650 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:29.777979  5967 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:29.706647  9634 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.078s
I20260709 12:25:29.807415  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:29.809042  5967 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:29.783380  9775 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:29.782615  9737 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:29.752493  9730 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.804293  9645 raft_consensus.cc:2764] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election decision vote started in defunct term 7: won
I20260709 12:25:29.806114  9638 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:29.811174  9630 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:29.793699  9689 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.848537  6109 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:29.853046  6084 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:29.832728  9737 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.827251  9773 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:29.860520  6646 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:29.854887  5967 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:29.896133  6084 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:25:29.898699  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 187256us
I20260709 12:25:29.902333  6037 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:25:29.878872  9795 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:25:29.831586  9693 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.911764  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:29.900239  9766 log.cc:927] Time spent T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:25:29.832331  9775 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.886444  9565 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:25:29.919269  9629 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.898988  9597 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:29.921336  9629 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.922618  9775 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.624011  9685 rpcz_store.cc:276] 0709 12:25:27.082029 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.082198 (+   169us) service_pool.cc:224] Handling call
0709 12:25:27.097153 (+ 14955us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b54003cc1a0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fd1520 00007f482105ab42 00007f4821059800 00007f48210529fa 00007f482601a4c9 00007f481f596c54 00007f481f596be2 00007f481f596b11 00007f481f596a8c 00007f481f595d42
0709 12:25:27.143720 (+ 46567us) log.cc:844] Serialized 494 byte log entry
0709 12:25:29.547339 (+2403619us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3442,"raft.queue_time_us":13789,"raft.run_cpu_time_us":1533,"raft.run_wall_time_us":90831,"spinlock_wait_cycles":24358272,"thread_start_us":160773,"threads_started":2,"wal-append.queue_time_us":191355,"wal-append.run_cpu_time_us":1739,"wal-append.run_wall_time_us":1027975}
I20260709 12:25:29.924882  5965 raft_consensus.cc:606] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:29.902179  9619 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:29.925643  9619 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:29.926411  5850 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet ec584257f9db451c965f6b092aa9069c with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 11)
I20260709 12:25:29.926604  9619 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.928484  9756 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:29.930017  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:29.930017  9740 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.930958  5964 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:29.931317  5968 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:29.942210  9626 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.943022  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:29.945960  5960 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:29.950066  9739 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:29.950699  9739 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.956991  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:29.966440  6111 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:29.967557  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:29.968945  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:29.971903  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 59290.1us
I20260709 12:25:29.947711  9678 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.984535  6115 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:29.899715  9773 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:29.971166  9565 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:30.000975  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 62299.2us
I20260709 12:25:30.003976  9771 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.004559  9771 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:30.005163  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:30.005954  6112 raft_consensus.cc:2393] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:29.992995  9798 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:30.009240  9773 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:30.009701  9798 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:29.990482  9721 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:30.012142  9721 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.998447  9565 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:30.015409  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:30.016315  9565 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:30.016644  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:30.017326  6037 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:30.018814  9626 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:30.020222  9739 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:29.994048  9679 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:30.021888  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:30.022449  5964 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.022778  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:30.023351  9678 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:30.023376  5968 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:30.024642  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:30.025017  9693 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:30.025663  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:30.026192  5968 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:30.026849  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:30.036191  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:30.036962  9730 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:30.037147  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:30.037817  5962 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:30.012073  9798 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:30.014179  9737 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:30.028182  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:29.980962  9669 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:30.028810  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:30.020768  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:30.028724  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:30.028940  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:30.029417  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:30.030786  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:30.032709  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:30.033143  6111 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:30.033721  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:30.035130  9771 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:30.048159  5961 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:30.047777  5959 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:30.093837  5961 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:30.051158  5962 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:30.043226  6081 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:30.040910  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:30.048713  5864 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 306) took 2424 ms. Trace:
I20260709 12:25:30.044900  6650 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:30.046865  6035 raft_consensus.cc:2368] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7.
W20260709 12:25:30.054809  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 56651.4us
I20260709 12:25:30.047509  6647 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.047274  6651 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:30.045202  6644 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:30.038422  5960 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:30.042990  6114 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:30.095546  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 52414.5us
I20260709 12:25:30.047228  6118 raft_consensus.cc:2368] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7.
I20260709 12:25:30.100023  6037 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.100613  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:30.100785  6081 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 4 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:30.045879  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:30.095702  5968 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:30.101397  6118 raft_consensus.cc:2368] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8.
I20260709 12:25:30.102543  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:30.103178  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:30.103313  6044 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:25:30.106390  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 60596.4us
I20260709 12:25:30.146812  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:30.131141  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:30.119439  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:30.118400  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:30.109262  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:30.054840  5964 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:30.147157  9730 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:30.153498  9730 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.153599  6038 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:25:30.153934  9730 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:30.154765  5932 leader_election.cc:400] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:25:30.155090  5932 leader_election.cc:403] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:30.155750  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 51192.3us
I20260709 12:25:30.157295  9693 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:25:30.158128  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:30.158783  6651 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:30.146940  9669 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:30.161343  9669 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:30.162206  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:30.163131  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:30.163703  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:30.164086  5962 raft_consensus.cc:2368] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:30.164319  5963 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:30.164734  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:30.165858  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:30.166491  6649 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:30.104960  9572 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.062s
I20260709 12:25:30.167047  9739 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:30.167689  9739 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.168043  9739 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:30.170450  9722 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader election lost for term 4. Reason: could not achieve majority
I20260709 12:25:30.173678  6608 leader_election.cc:400] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:30.174160  6608 leader_election.cc:403] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:30.174568  9730 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:30.175488  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:30.106654  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:30.151922  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:30.105479  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:30.147449  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:30.177106  6111 raft_consensus.cc:2368] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8.
I20260709 12:25:30.112270  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:30.178066  6611 leader_election.cc:400] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7.
I20260709 12:25:30.151319  6036 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:30.178336  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:30.179334  5962 raft_consensus.cc:2393] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:30.178344  6006 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:30.178442  6611 leader_election.cc:403] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:25:30.151353  6114 raft_consensus.cc:2368] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8.
I20260709 12:25:30.095866  5864 rpcz_store.cc:276] 0709 12:25:27.624593 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:27.624741 (+   148us) service_pool.cc:224] Handling call
0709 12:25:30.048668 (+2423927us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:29.097423 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:29.120026 (+ 22603us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:29.120063 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:25:29.120093 (+    30us) tablet.cc:662] Decoding operations
0709 12:25:29.120522 (+   429us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:29.120581 (+    59us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:29.120613 (+    32us) tablet.cc:685] Acquiring locks for 2 operations
0709 12:25:29.120924 (+   311us) tablet.cc:701] Row locks acquired
0709 12:25:29.120942 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:25:29.121103 (+   161us) write_op.cc:270] Start()
0709 12:25:29.121218 (+   115us) write_op.cc:276] Timestamp: P: 1783599929121045 usec, L: 0
0709 12:25:29.121238 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:25:29.124634 (+  3396us) log.cc:844] Serialized 923 byte log entry
0709 12:25:29.350042 (+225408us) op_driver.cc:464] REPLICATION: finished
0709 12:25:29.701561 (+351519us) write_op.cc:301] APPLY: starting
0709 12:25:29.704563 (+  3002us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:29.717714 (+ 13151us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:29.748063 (+ 30349us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:29.809311 (+ 61248us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:29.842059 (+ 32748us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=2
0709 12:25:29.846801 (+  4742us) write_op.cc:312] APPLY: finished
0709 12:25:29.901038 (+ 54237us) log.cc:844] Serialized 29 byte log entry
0709 12:25:29.911018 (+  9980us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:29.914684 (+  3666us) write_op.cc:454] Released schema lock
0709 12:25:29.956400 (+ 41716us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:29.992979 (+ 36579us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:29.994994 (+  2015us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":167551,"reported_tablets":4,"child_traces":[["op",{"apply.queue_time_us":277771,"apply.run_cpu_time_us":5942,"apply.run_wall_time_us":294532,"num_ops":2,"prepare.queue_time_us":352236,"prepare.run_cpu_time_us":3016,"prepare.run_wall_time_us":51715,"replication_time_us":207457,"thread_start_us":307910,"threads_started":2}]]}
W20260709 12:25:30.182550  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 76004.6us
W20260709 12:25:30.183770  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 80662.9us
I20260709 12:25:30.186228  5968 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:30.048342  5862 catalog_manager.cc:5697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 5 to 6, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 6 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:30.187886  5862 catalog_manager.cc:5697] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 6 to 7, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 7 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:30.188740  6650 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:30.189507  5862 catalog_manager.cc:5697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 6 to 7, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 7 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:30.089694  9795 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
I20260709 12:25:30.193064  6609 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:30.199338  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:30.194054  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:30.192028  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 44642.9us
I20260709 12:25:30.195642  6647 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:30.044694  9737 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:30.177665  9798 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:30.020840  9767 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:30.205178  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 104104us
I20260709 12:25:30.217519  6036 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:25:30.204243  6006 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:30.206051  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:30.206223  6009 leader_election.cc:400] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8.
I20260709 12:25:30.039386  9728 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:30.181638  9735 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:30.213470  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:30.089542  9684 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:30.191239  9771 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:30.202011  9572 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:30.199832  9610 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:30.200919  9715 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:30.254359  9730 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:30.254268  9610 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:30.218722  6037 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:30.205273  9597 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:30.250095  6009 leader_election.cc:403] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:30.250226  6649 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:25:30.204679  9773 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:25:30.251039  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 45071.7us
I20260709 12:25:30.250590  6609 leader_election.cc:400] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8.
I20260709 12:25:30.205742  9613 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:30.262356  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 60730.6us
I20260709 12:25:30.262717  6041 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 7: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:30.211556  9775 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:30.266897  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 49062.7us
I20260709 12:25:30.177902  9678 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:25:30.267405  6081 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:30.275517  6113 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:30.255098  9610 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:30.216528  9798 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.216123  9737 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7.
I20260709 12:25:30.281337  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:30.257071  9722 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:30.285339  6609 leader_election.cc:400] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7.
W20260709 12:25:30.269210  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 65304.5us
I20260709 12:25:30.289770  6009 leader_election.cc:400] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8.
I20260709 12:25:30.299399  6006 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:30.272274  9630 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:30.261910  9689 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:30.270407  9805 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:30.299876  6009 leader_election.cc:403] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:30.271356  9572 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:30.273959  9597 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:30.314532  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:30.315135  5967 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:30.271706  9613 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:30.251065  9684 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:30.289462  9775 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.290138  6649 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:30.308260  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:30.321897  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:30.301059  9747 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:30.326963  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:30.291931  9798 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:30.275125  9773 raft_consensus.cc:697] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:30.294368  9715 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:30.337957  9613 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:30.342795  9572 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:30.363798  5967 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:30.313644  9673 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.373620  6644 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:30.472393  9597 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:30.522675  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 162407us
I20260709 12:25:30.340539  9775 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:30.523383  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 156252us
I20260709 12:25:30.337857  9638 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 8
I20260709 12:25:30.322690  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:25:30.548887  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 226249us
I20260709 12:25:30.549576  6009 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:30.550398  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:30.357447  9765 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:30.372479  9717 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.160s
W20260709 12:25:30.532639  9810 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.328s	user 0.005s	sys 0.000s
I20260709 12:25:30.531917  9747 raft_consensus.cc:697] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:30.538503  9715 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:30.560213  9630 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:30.563297  9649 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:30.565089  9689 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:30.566558  9765 raft_consensus.cc:697] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:30.591902  9728 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:30.592839  9715 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:30.586668  9773 consensus_queue.cc:237] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:30.580631  9807 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.289s	user 0.001s	sys 0.000s
I20260709 12:25:30.582805  9630 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:30.602042  9610 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:30.608784  9689 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:25:30.621140  9808 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.351s	user 0.006s	sys 0.000s
W20260709 12:25:30.675817  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 260602us
I20260709 12:25:30.624838  9630 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:30.616992  9767 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:30.682246  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:30.638825  9565 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 6.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.054s
W20260709 12:25:30.707690  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 91560us
I20260709 12:25:30.715005  6611 leader_election.cc:400] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8.
I20260709 12:25:30.715353  6611 leader_election.cc:403] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:25:30.718184  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 72815.5us
I20260709 12:25:30.728269  6611 leader_election.cc:400] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:30.734594  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2154) took 1212 ms. Trace:
W20260709 12:25:30.735373  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 112949us
I20260709 12:25:30.735085  6040 rpcz_store.cc:276] 0709 12:25:29.515839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.517846 (+  2007us) service_pool.cc:224] Handling call
0709 12:25:29.526620 (+  8774us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:29.526936 (+   316us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:29.526962 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:29.541898 (+ 14936us) log.cc:844] Serialized 26 byte log entry
0709 12:25:29.924121 (+382223us) spinlock_profiling.cc:243] Waited 1.18 ms on lock 0x7b1800052300. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:25:29.992777 (+ 68656us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:29.992804 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:29.992857 (+    53us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:30.527743 (+534886us) spinlock_profiling.cc:243] Waited 2.63 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:30.727686 (+199943us) raft_consensus.cc:1685] finished
0709 12:25:30.727711 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:30.727870 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":454,"raft.queue_time_us":85,"raft.run_cpu_time_us":167,"raft.run_wall_time_us":17351,"spinlock_wait_cycles":8748672,"thread_start_us":68508,"threads_started":1,"wal-append.queue_time_us":678132}
I20260709 12:25:30.653836  9747 consensus_queue.cc:237] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:30.748364  6611 leader_election.cc:400] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8.
I20260709 12:25:30.723543  9770 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8.
I20260709 12:25:30.747732  9649 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:30.774658  9649 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:30.729844  9565 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:30.776834  9565 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:30.783136  9572 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:30.785912  9572 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:30.786672  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:30.787458  5963 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:30.698637  9765 consensus_queue.cc:237] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 6.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:30.785054  9610 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:30.869520  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:30.734575  9689 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:30.888525  9739 consensus_meta.cc:287] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.720s	user 0.012s	sys 0.000s
I20260709 12:25:30.889016  9739 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:30.893368  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:30.794646  9735 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:30.912262  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 148006us
W20260709 12:25:30.907188  9722 consensus_meta.cc:287] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.604s	user 0.009s	sys 0.001s
I20260709 12:25:30.896592  9678 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:30.907022  9735 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:30.924605  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:30.925421  5967 raft_consensus.cc:2368] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7.
W20260709 12:25:30.926815  9814 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:25:30.927093  5968 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:30.932614  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:30.935940  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 135091us
I20260709 12:25:30.938050  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:30.923959  9815 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:30.942736  9815 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:30.944001  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:30.922585  9722 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:30.952508  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:30.953131  6115 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:30.928304  9678 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:30.952526  9739 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:30.954860  9689 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:30.978318  5934 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:30.968307  9638 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8.
I20260709 12:25:30.981998  9739 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:31.004354  9818 log.cc:927] Time spent T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:25:31.007212  9630 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.008497  9775 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.009440  9630 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.010601  6040 raft_consensus.cc:2368] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:31.013935  6115 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:25:30.977277  9689 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.010612  6035 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:31.019080  6117 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:31.022619  9815 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:31.029089  9805 consensus_meta.cc:287] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.688s	user 0.010s	sys 0.000s
I20260709 12:25:31.029676  9805 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8.
W20260709 12:25:31.034936  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48127.9us
I20260709 12:25:31.041945  6650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 934) took 1124 ms. Trace:
I20260709 12:25:31.044054  6650 rpcz_store.cc:276] 0709 12:25:29.910642 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.911547 (+   905us) service_pool.cc:224] Handling call
0709 12:25:31.034913 (+1123366us) spinlock_profiling.cc:243] Waited 132 ms on lock 0x7b540053edd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:31.035051 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":304665856}
W20260709 12:25:31.057714  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 749947us
I20260709 12:25:31.043260  9833 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:31.061024  9833 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.062991  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:31.066531  9689 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.067116  9638 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:31.067706  9638 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.041850  9613 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.068575  9735 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.064045  9833 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.070746  9649 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:31.071420  9649 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:31.074011  9649 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:31.066705  9630 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:31.074752  9630 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:31.075150  9630 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:31.077494  9741 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:31.078102  9741 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.079339  9678 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.080457  9741 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:31.084563  9798 consensus_meta.cc:287] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.658s	user 0.006s	sys 0.004s
I20260709 12:25:31.085052  9798 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.086187  6037 raft_consensus.cc:2368] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12.
I20260709 12:25:31.070137  9638 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.067150  9689 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:31.087400  9689 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:31.088478  6081 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:31.089671  9689 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:31.089891  9833 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:31.091094  9833 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:31.086730  9565 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:31.091948  9833 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:31.094007  9825 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:31.090261  9649 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:31.096107  9775 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.090018  6081 leader_election.cc:400] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7.
I20260709 12:25:31.096809  6081 leader_election.cc:403] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:25:31.101240  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:31.102686  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:31.105664  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:31.108291  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:31.118746  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:31.119390  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:31.119903  6038 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:31.120261  5959 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:25:31.121202  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 143902us
I20260709 12:25:31.125288  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:31.128558  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:31.129372  5967 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 7: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:31.129235  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:31.130115  5960 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 9: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:31.131759  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:31.133175  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:31.114950  6113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 2577) took 1647 ms (client timeout 1569 ms). Trace:
W20260709 12:25:31.135239  6113 rpcz_store.cc:269] 0709 12:25:29.449942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.451858 (+  1916us) service_pool.cc:224] Handling call
0709 12:25:31.096183 (+1644325us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b5400163854. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:31.096737 (+   554us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1667992320}
I20260709 12:25:31.131026  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:31.096784  9649 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:31.126156  6043 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:31.152869  6044 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:31.155407  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:31.121197  9626 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:31.160240  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:31.166359  5960 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:31.140131  9565 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:31.173450  5961 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 5 index: 4. (index mismatch)
I20260709 12:25:31.174244  5960 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:31.122390  9608 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
W20260709 12:25:31.295635  9821 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.347s	user 0.000s	sys 0.003s
W20260709 12:25:31.301198  9820 log.cc:927] Time spent T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.328s	user 0.000s	sys 0.003s
I20260709 12:25:31.306412  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:56036 (request call id 18) took 2144 ms. Trace:
I20260709 12:25:31.307044  5965 rpcz_store.cc:276] 0709 12:25:29.161844 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.161997 (+   153us) service_pool.cc:224] Handling call
0709 12:25:31.177322 (+2015325us) spinlock_profiling.cc:243] Waited 68.3 ms on lock 0x7b54003cc1a0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fd1520 00007f482104e652 00007f482601c60a 00007f481f5a27d4 00007f481f5a2762 00007f481f5a2691 00007f481f5a260c 00007f481f5a18c2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:31.306190 (+128868us) spinlock_profiling.cc:243] Waited 739 ms on lock 0x7b54001cb6d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482104e853 00007f482601c60a 00007f481f5a27d4 00007f481f5a2762 00007f481f5a2691 00007f481f5a260c 00007f481f5a18c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:31.306297 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1857844352}
I20260709 12:25:31.286449  9839 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:31.328560  9839 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:31.258586  9798 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.362329  6036 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:31.376573  9722 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:25:31.386445  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:25:31.388455  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:31.389344  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:31.410989  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 391180us
I20260709 12:25:31.439818  6647 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:31.440141  9572 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:31.441133  9819 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.507s	user 0.004s	sys 0.000s
I20260709 12:25:31.442649  9613 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:31.444765  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:31.445019  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:31.445523  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:31.448346  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:31.439874  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:31.450584  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:31.451793  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:31.452405  6647 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:31.456545  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:31.457150  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:31.457557  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:31.458067  6646 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:31.459512  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:31.460106  6644 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:31.460357  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:31.469434  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:31.470239  5962 raft_consensus.cc:2368] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:31.495708  6644 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:25:31.496074  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:31.497985  5964 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:31.499307  6647 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:25:31.501434  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:31.502096  6650 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:31.511287  6646 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:31.512126  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:31.513494  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:31.516275  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:31.524154  6650 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
W20260709 12:25:31.538937  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 47894us
I20260709 12:25:31.505419  9834 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:31.505980  9839 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:31.608201  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 68350.4us
W20260709 12:25:31.608563  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 66744.7us
I20260709 12:25:31.437491  9630 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:31.613464  6084 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:31.529361  9775 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:31.538942  9784 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:31.633064  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 118724us
I20260709 12:25:31.539319  9689 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:31.540966  9805 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:31.545071  9679 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:31.663460  6042 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:31.633913  6009 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:31.660701  9837 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:31.676573  6041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 2161) took 1556 ms (client timeout 1687 ms). Trace:
I20260709 12:25:31.677637  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60122 (request call id 1176) took 1360 ms. Trace:
I20260709 12:25:31.627041  9739 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:31.678047  6037 rpcz_store.cc:276] 0709 12:25:30.307751 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.308012 (+   261us) service_pool.cc:224] Handling call
0709 12:25:31.667810 (+1359798us) spinlock_profiling.cc:243] Waited 745 ms on lock 0x7b540024ccd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:31.667938 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1712413056}
W20260709 12:25:31.677013  6041 rpcz_store.cc:269] 0709 12:25:30.111875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.112005 (+   130us) service_pool.cc:224] Handling call
0709 12:25:31.668089 (+1556084us) spinlock_profiling.cc:243] Waited 84 ms on lock 0x7b540030ded4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:31.668209 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":193102720}
I20260709 12:25:31.551734  9773 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.116s
I20260709 12:25:31.632463  9740 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:31.665746  9722 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:31.620496  9834 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.619774  9747 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.063s
I20260709 12:25:31.681620  9833 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:31.685451  9679 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:25:31.730530  9814 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
W20260709 12:25:31.754376  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 120548us
I20260709 12:25:31.689824  9701 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:31.669571  9835 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:25:31.668987  9689 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.757941  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:31.724505  9758 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:31.669162  9805 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:31.663829  9784 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.737624  9775 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:31.733107  9831 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:31.737349  9864 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:31.707882  9739 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.689148  9837 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.766217  9830 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:31.786191  9572 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:31.759641  9833 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:31.801383  9856 log.cc:927] Time spent T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:25:31.802017  9784 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.799767  9863 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:31.802538  9869 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:31.802862  9859 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:25:31.803177  6114 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:25:31.803984  9739 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:31.805191  9626 consensus_meta.cc:287] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.637s	user 0.008s	sys 0.000s
I20260709 12:25:31.805580  9626 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7.
I20260709 12:25:31.805938  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:31.784128  9758 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.800338  9679 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.791939  9864 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.808840  9758 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:31.809226  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:31.810384  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:31.809836  6113 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:31.813024  9572 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:31.813838  9630 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:31.814013  9572 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.814621  9869 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.815438  9834 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.796897  9775 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:31.817632  6042 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:31.818286  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:31.818797  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:31.814231  9837 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:25:31.794809  9868 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:31.803946  9860 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.258s	user 0.000s	sys 0.001s
I20260709 12:25:31.816872  9869 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.881999  6113 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
W20260709 12:25:31.887284  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 96573.9us
I20260709 12:25:31.771112  9701 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.817849  9825 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:31.808840  9864 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:31.886734  9565 consensus_meta.cc:287] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.000s
I20260709 12:25:31.790023  9831 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.800449  9830 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:31.928669  9701 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.930543  9689 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.932065  9833 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.933516  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:31.936966  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:31.937525  5964 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:31.938339  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:31.939008  5959 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:25:31.939612  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:31.940346  5961 raft_consensus.cc:2368] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 6. Current term is 7.
I20260709 12:25:31.930812  9649 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:31.941202  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:31.941804  5968 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:31.912348  9693 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.931993  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:31.944159  5962 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:31.945538  6649 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:31.884677  9868 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.951177  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:31.951527  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:31.951911  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:31.953230  6006 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:31.948257  9689 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:31.819257  9863 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.963533  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:31.965553  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 98453us
I20260709 12:25:31.967868  6006 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:31.968333  9866 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.170s	user 0.001s	sys 0.000s
I20260709 12:25:31.904148  9825 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.972824  6044 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:31.957082  9864 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:31.977617  9825 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.956207  9693 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.963374  9670 consensus_queue.cc:1059] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.016s
I20260709 12:25:31.978451  9877 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:31.979458  5962 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:25:31.966434  9572 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:31.983747  6006 leader_election.cc:400] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 6. Current term is 7.
I20260709 12:25:31.984648  6006 leader_election.cc:403] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Cancelling election due to peer responding with higher term
I20260709 12:25:31.977325  9679 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:31.987058  6006 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:31.988359  9830 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:31.988727  9693 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.990911  9670 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:31.991892  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:31.926005  9775 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:31.994971  9868 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:31.983039  9858 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.212s	user 0.000s	sys 0.000s
I20260709 12:25:32.026284  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:31.984368  9825 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.043s
I20260709 12:25:32.027452  9693 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:31.996703  9863 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:32.000438  9829 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 1.032s	user 0.003s	sys 0.005s
I20260709 12:25:32.008656  9871 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.023s
I20260709 12:25:32.009440  9864 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election lost for term 6. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 6. Current term is 7.
I20260709 12:25:31.997784  9831 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:32.011880  9684 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:31.962879  9689 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.019528  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:32.050000  9689 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:32.050081  9830 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:32.034597  9868 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.052763  9868 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.053313  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:32.053931  6039 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
W20260709 12:25:32.023247  6117 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 2589) took 1701 ms (client timeout 1755 ms). Trace:
I20260709 12:25:32.054883  9868 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:32.054625  6117 rpcz_store.cc:269] 0709 12:25:30.321535 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.321659 (+   124us) service_pool.cc:224] Handling call
0709 12:25:32.023041 (+1701382us) spinlock_profiling.cc:243] Waited 615 ms on lock 0x7b54002391d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:32.023176 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1415412992}
I20260709 12:25:32.027997  9693 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.057145  9693 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:32.057530  9805 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:32.058095  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:32.058832  6644 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:32.059551  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.060808  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.061089  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60122 (request call id 1181) took 1260 ms. Trace:
I20260709 12:25:32.061470  6040 rpcz_store.cc:276] 0709 12:25:30.800858 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:30.801018 (+   160us) service_pool.cc:224] Handling call
0709 12:25:32.060925 (+1259907us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b5400172d54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:32.061037 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":320207616}
I20260709 12:25:32.067386  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.068216  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.069726  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.061961  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.029139  9572 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:32.073036  9572 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:32.073704  9572 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:32.075502  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:32.076673  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:32.077320  6043 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:32.079495  6037 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:32.054994  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:32.081988  6036 raft_consensus.cc:2376] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8. Re-sending same reply.
I20260709 12:25:32.045298  9826 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:32.047560  9802 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:32.083191  9802 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.059607  5862 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 203) took 2471 ms. Trace:
I20260709 12:25:32.088202  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:32.090052  9802 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:32.082839  9826 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:32.091815  9826 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:32.095839  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:32.097246  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.098779  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:32.088649  6609 leader_election.cc:400] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12.
I20260709 12:25:32.100648  6609 leader_election.cc:403] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:32.101305  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:32.105703  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:32.105607  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.106654  6115 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:32.087222  5862 rpcz_store.cc:276] 0709 12:25:29.588397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.588545 (+   148us) service_pool.cc:224] Handling call
0709 12:25:32.059544 (+2470999us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:30.716796 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:30.921468 (+204672us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:30.923389 (+  1921us) write_op.cc:435] Acquired schema lock
0709 12:25:30.923414 (+    25us) tablet.cc:662] Decoding operations
0709 12:25:30.945945 (+ 22531us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:30.946007 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:30.946034 (+    27us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:25:30.946356 (+   322us) tablet.cc:701] Row locks acquired
0709 12:25:30.946369 (+    13us) write_op.cc:260] PREPARE: finished
0709 12:25:30.946638 (+   269us) write_op.cc:270] Start()
0709 12:25:30.946775 (+   137us) write_op.cc:276] Timestamp: P: 1783599930946568 usec, L: 0
0709 12:25:30.946794 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:25:30.986614 (+ 39820us) log.cc:844] Serialized 1293 byte log entry
0709 12:25:31.691733 (+705119us) op_driver.cc:464] REPLICATION: finished
0709 12:25:31.940169 (+248436us) write_op.cc:301] APPLY: starting
0709 12:25:31.940248 (+    79us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:31.940370 (+   122us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:31.940470 (+   100us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:31.940873 (+   403us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:31.941059 (+   186us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=3
0709 12:25:31.941102 (+    43us) write_op.cc:312] APPLY: finished
0709 12:25:31.941288 (+   186us) log.cc:844] Serialized 35 byte log entry
0709 12:25:31.941447 (+   159us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:31.941537 (+    90us) write_op.cc:454] Released schema lock
0709 12:25:31.941573 (+    36us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:31.941896 (+   323us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:31.941920 (+    24us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":44084,"reported_tablets":6,"child_traces":[["op",{"apply.queue_time_us":213326,"apply.run_cpu_time_us":1730,"apply.run_wall_time_us":1730,"num_ops":3,"prepare.queue_time_us":491687,"prepare.run_cpu_time_us":9017,"prepare.run_wall_time_us":449869,"raft.queue_time_us":230992,"raft.run_cpu_time_us":15970,"raft.run_wall_time_us":245105,"replication_time_us":714517,"thread_start_us":689070,"threads_started":4,"wal-append.queue_time_us":387035}]]}
I20260709 12:25:32.108538  6608 leader_election.cc:400] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:32.108844  6608 leader_election.cc:403] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:32.109653  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:32.110445  5934 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:32.110869  6609 leader_election.cc:400] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:32.111251  6609 leader_election.cc:403] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:32.103694  9670 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.115649  9699 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.127501  9684 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:32.129276  9730 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:32.133431  9728 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.021s
I20260709 12:25:32.116175  9762 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:32.157881  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.153069  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.139592  9619 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:32.124436  9758 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12.
I20260709 12:25:32.133553  9830 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:32.138731  9823 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:32.173839  9792 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:32.162705  9699 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.179374  9734 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.181012  9734 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.178925  6609 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:32.158552  9670 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.162837  9730 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:32.201994  9730 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:32.206502  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:32.207306  6009 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:32.184556  9734 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:32.179176  9830 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:32.212627  9825 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:32.221488  9830 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:32.187167  9735 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:32.189031  9658 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.179525  9619 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:32.245864  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:32.191430  9802 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:32.193045  9699 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:32.197635  9885 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.002s
I20260709 12:25:32.200335  5863 catalog_manager.cc:5697] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 9 to 10, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 10 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.212301  6041 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:32.212708  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:32.236778  9572 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.247722  6646 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:32.248102  5962 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:25:32.251708  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:32.249718  9658 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.252199  9619 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.253373  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:32.257236  9802 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:32.259680  9608 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:32.278716  9608 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.279454  9597 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.008s
I20260709 12:25:32.280864  9608 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:32.283869  9887 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.157s	user 0.002s	sys 0.000s
I20260709 12:25:32.260131  9839 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.260789  9816 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:32.286585  9802 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:32.258353  6081 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:32.262095  5863 catalog_manager.cc:5697] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 4 to 5, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.288465  5863 catalog_manager.cc:5697] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 9 to 11, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 11 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:32.265494  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52857.7us
I20260709 12:25:32.274253  9658 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:32.291496  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.290053  5863 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 8 to 9, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 9 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.275593  9826 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.276430  9876 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:25:32.277778  9730 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.267307  9869 raft_consensus.cc:3055] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:32.269865  9775 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:32.300364  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.319559  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.317924  9869 raft_consensus.cc:740] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:32.296131  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:32.295661  5863 catalog_manager.cc:5697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 6 to 7, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 7 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:32.298311  9572 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:32.353681  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.355291  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:32.356021  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 59976.4us
I20260709 12:25:32.360054  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.361299  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.363796  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.366988  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.370887  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.370887  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.292727  9824 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:32.286759  9816 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.376138  6113 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:32.320004  9762 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:32.286281  9839 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.296682  9871 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 12:25:32.294183  9747 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.092s
I20260709 12:25:32.392936  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:32.394207  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:32.292769  9833 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:32.382622  9773 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:32.443971  6041 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
W20260709 12:25:32.467269  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 173175us
I20260709 12:25:32.466861  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:32.469201  6036 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 7: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:32.350512  9868 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.095s
I20260709 12:25:32.472903  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:32.379037  9824 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.440565  9863 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:32.389317  9762 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.477409  9773 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:32.467691  9608 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:32.502852  9608 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.503285  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:32.504269  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:32.504976  9608 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:32.505470  9608 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:32.503197  9773 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.517742  6009 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:32.519129  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.480724  6040 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:32.443918  9565 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:32.483109  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:32.447618  9812 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:32.564914  6041 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:25:32.564153  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 46490us
I20260709 12:25:32.566885  6009 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:32.481319  9833 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:32.510316  9626 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:32.693110  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.701946  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:32.659704  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:32.714340  5960 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:32.720347  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:32.525724  9877 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:32.600771  9825 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:32.440007  9869 consensus_queue.cc:260] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 7, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.746827  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.747545  6112 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
W20260709 12:25:32.740384  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 47653.4us
I20260709 12:25:32.751327  5960 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:32.522955  9863 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.756285  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:32.600364  9565 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.781633  9817 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:32.789064  9893 log.cc:927] Time spent T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.345s	user 0.001s	sys 0.000s
I20260709 12:25:32.789304  9817 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.789724  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:32.790966  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.791414  9817 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:32.781706  9608 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:32.791967  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:32.792449  9826 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:32.793593  9798 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:32.793486  9608 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.795176  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.796319  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.796904  6111 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:32.797982  6111 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
W20260709 12:25:32.799247  6650 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.070s	sys 0.100s
I20260709 12:25:32.793138  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:32.800868  6650 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.636s	user 0.070s	sys 0.100s
W20260709 12:25:32.805841  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 103997us
I20260709 12:25:32.766741  9679 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:32.811385  5932 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:32.781847  9846 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:32.793871  9890 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.269s	user 0.000s	sys 0.000s
I20260709 12:25:32.814109  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.815979  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.794124  9798 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.842960  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.818549  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:32.819895  6109 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:32.655165  9812 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.782451  9730 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:32.811566  9835 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.034s	sys 0.083s
I20260709 12:25:32.841452  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:32.811088  9628 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:32.845247  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 278447us
I20260709 12:25:32.738857  9877 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.782686  9825 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:32.802093  9869 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:32.837460  9699 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:32.856763  6645 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:32.857226  9824 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:32.848692  9839 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:32.859381  6651 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:25:32.883155  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:32.901425  9762 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:32.852665  9835 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.596s	user 0.034s	sys 0.084s
W20260709 12:25:32.905486  9901 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:25:32.817785  9816 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:32.851274  9804 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:32.915617  9830 consensus_meta.cc:287] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.694s	user 0.010s	sys 0.000s
I20260709 12:25:32.928472  6114 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:32.842700  9846 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.915565  9826 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:32.926797  9896 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.454s	user 0.003s	sys 0.014s
I20260709 12:25:32.915480  9649 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:32.935642  6116 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.586s	user 0.008s	sys 0.004s
W20260709 12:25:32.939989  6116 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.605s	user 0.009s	sys 0.004s
I20260709 12:25:32.940455  6645 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:32.915686  9864 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:32.951385  9864 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.953464  9864 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:32.942267  6651 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:32.942900  9846 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:32.943892  9798 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:32.944559  9649 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.944586  9634 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:32.945406  9565 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:32.935863  9830 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.945564  9826 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.917150  9699 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.946784  9608 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:32.948513  9877 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:32.949450  9863 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:32.913975  9825 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.960314  9689 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:25:32.970080  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:32.972904  9565 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:32.973479  9565 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:32.977461  6041 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:32.983222  9670 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:32.965513  9634 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:32.986116  9825 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:32.987044  9812 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:32.989611  6117 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:32.990490  5863 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.604s	user 0.009s	sys 0.004s
W20260709 12:25:32.990813  5863 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.010s	sys 0.004s
I20260709 12:25:32.991688  6611 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:32.991976  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:32.992717  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:32.996762  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:33.000856  9837 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:33.001976  9699 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:33.002230  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:33.002974  9738 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:33.001883  9912 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.002s
W20260709 12:25:33.004781  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 47289.2us
I20260709 12:25:33.006171  6611 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:33.007194  9825 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:33.008736  9738 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:33.009117  9738 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.009444  9738 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:33.011392  6651 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
I20260709 12:25:33.012020  9826 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:33.013816  9830 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:32.995306  9863 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:33.014767  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:33.014935  9863 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:33.014180  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:33.017616  9863 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:32.961233  9638 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:25:33.018435  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:33.019203  9863 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:33.020383  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:33.021044  9863 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:33.022274  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:33.024291  6009 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:33.031654  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:33.029326  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:33.039110  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:33.039997  6116 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:33.041044  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:33.042428  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 231109us
I20260709 12:25:33.043360  5932 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:33.044665  5932 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:33.045655  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:33.048306  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:33.026803  9846 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:33.028407  9863 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:33.054415  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:33.056408  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 246267us
I20260709 12:25:33.021011  9738 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:33.028911  9699 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:33.032013  9638 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:33.114969  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 45495.8us
I20260709 12:25:33.035135  9565 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:33.189715  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:33.031633  9572 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.149s
I20260709 12:25:33.116369  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:33.181339  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 152055us
I20260709 12:25:33.184036  6040 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:33.055693  9804 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:33.055864  9762 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:25:33.174849  9802 consensus_meta.cc:287] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.888s	user 0.010s	sys 0.002s
I20260709 12:25:33.201287  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:33.176467  9830 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:33.179621  9638 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.210796  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:33.178426  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:33.188377  9877 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:33.220124  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:33.224598  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:33.048839  9895 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.172s
I20260709 12:25:33.239600  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:33.241603  6039 raft_consensus.cc:2410] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:25:33.175913  9846 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:33.204239  9908 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:33.203846  9804 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:33.239892  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:33.245879  9762 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.010s
I20260709 12:25:33.188707  9699 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:33.246536  9703 raft_consensus.cc:993] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:33.256994  9703 raft_consensus.cc:1081] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:33.257838  9699 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:33.257997  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:33.260149  9846 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:33.219902  9638 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:33.215610  9863 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:33.272958  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:33.284451  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:33.285406  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:33.216699  9802 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:33.263993  9804 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:33.219722  9830 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:33.303655  9619 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:33.249889  9907 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.073s
I20260709 12:25:33.260800  9908 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:33.318964  6646 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:33.300668  9649 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:33.366443  9738 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:33.443333  9894 raft_consensus.cc:3055] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:33.444023  9894 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:33.445086  9894 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:33.473042  9894 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:33.404320  9802 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:33.458630  9920 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.090s	user 0.004s	sys 0.000s
W20260709 12:25:33.465317  9869 consensus_meta.cc:287] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.551s	user 0.009s	sys 0.002s
I20260709 12:25:33.437337  9830 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:33.454200  9917 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.087s	user 0.001s	sys 0.001s
W20260709 12:25:33.514599  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 397807us
W20260709 12:25:33.514604  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 334458us
I20260709 12:25:33.516710  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:33.519667  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.523964  5960 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:33.524092  5967 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:33.529940  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.519747  5934 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:33.534178  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:33.537186  5934 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:33.545728  5934 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:33.553154  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:33.558674  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.559031  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:33.559906  5962 raft_consensus.cc:2410] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 9 because replica has last-logged OpId of term: 7 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:25:33.567515  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:33.601677  6649 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.575s	user 0.009s	sys 0.021s
W20260709 12:25:33.621475  6649 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.010s	sys 0.021s
I20260709 12:25:33.647116  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.649375  5962 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:33.651192  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.656917  5960 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:33.658075  9634 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:33.658783  9824 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:33.688141  9824 consensus_queue.cc:1059] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:33.689213  9869 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:33.690093  9869 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:33.665036  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 120160us
I20260709 12:25:33.666728  5964 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:33.668573  9908 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:33.670425  9834 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:33.678684  9872 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:33.678957  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.646101  9802 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:33.685540  9658 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:33.686232  9913 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:33.690559  9626 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:33.685160  5960 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:33.704515  6646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 961) took 1369 ms. Trace:
I20260709 12:25:33.702601  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.708694  9912 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:33.709712  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.710538  5968 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:33.711529  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.718160  9872 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:33.721016  9872 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:33.722288  9923 raft_consensus.cc:3055] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:33.722859  9925 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:33.705092  6646 rpcz_store.cc:276] 0709 12:25:32.290707 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.291369 (+   662us) service_pool.cc:224] Handling call
0709 12:25:32.291635 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:33.323942 (+1032307us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:33.654158 (+330216us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b54005339d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:33.659862 (+  5704us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2362127616}
I20260709 12:25:33.729183  9892 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:33.711550  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.734498  5968 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 8. (index mismatch)
W20260709 12:25:33.704840  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 314705us
I20260709 12:25:33.735037  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:33.735271  9626 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:33.726183  9658 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:33.736796  9802 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:33.737454  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:33.740253  9817 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:33.741277  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.742149  9869 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:33.742645  9913 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:33.747565  9928 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:25:33.722787  9923 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:33.758955  5966 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:33.750909  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.757968  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:33.758100  9626 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:33.758656  9869 consensus_queue.cc:1059] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:33.768646  6113 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:33.768646  9802 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:33.779582  9869 raft_consensus.cc:3055] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:33.780294  9869 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:33.779369  9638 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:33.789634  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:33.729995  9892 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:33.776700  9916 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:33.795557  9699 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:33.794412  9658 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:33.781714  9869 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:33.777242  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:33.808034  5961 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:33.798246  9824 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:33.813721  9908 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:25:33.815012  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 57160.7us
I20260709 12:25:33.819392  6646 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:25:33.820879  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:33.821735  9817 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:33.821936  9913 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:33.822790  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:33.824667  9638 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:33.825035  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:33.825856  9733 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:33.826575  9824 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:33.832157  6113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 780) took 1105 ms. Trace:
I20260709 12:25:33.832563  6113 rpcz_store.cc:276] 0709 12:25:32.726962 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.730315 (+  3353us) service_pool.cc:224] Handling call
0709 12:25:33.831897 (+1101582us) spinlock_profiling.cc:243] Waited 781 ms on lock 0x7b54001ead54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:33.832060 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1797285760}
I20260709 12:25:33.814070  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:33.835628  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:33.793984  9804 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:33.817255  6082 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:33.835706  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.838781  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.844255  9731 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:33.847164  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:33.851055  9923 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:33.869716  9923 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:33.870590  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:33.871313  6117 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
W20260709 12:25:33.855774  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 150380us
I20260709 12:25:33.874148  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:33.874972  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:33.875694  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:33.876148  6036 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:33.876412  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:33.858577  9872 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:33.859856  6006 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:33.860363  9670 consensus_queue.cc:1059] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:33.877048  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:33.879005  9731 raft_consensus.cc:697] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:33.879324  9911 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:33.880383  9731 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.7, Last appended by leader: 7, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:33.864988  5963 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:33.881564  9804 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:33.882742  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 72887.1us
W20260709 12:25:33.885140  9872 consensus_queue.cc:1175] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "f1bb8e63c2b448cdafd51f05d277c741" responder_term: 6 status { last_received { term: 6 index: 4 } last_committed_idx: 4 last_received_current_leader { term: 6 index: 4 } }
I20260709 12:25:33.885995  9658 raft_consensus.cc:3055] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:33.865329  9638 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:33.886490  9658 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:33.887574  9634 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:33.888342  9634 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:33.884840  9869 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:33.880731  9911 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:33.867449  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:33.868322  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:33.894165  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:33.877277  9908 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:33.882776  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:33.895404  9908 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:33.895884  9908 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:33.864378  9892 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:33.879010  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:33.887403  9872 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:33.897596  9824 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:33.898021  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:33.900005  9911 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:33.891577  9658 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:33.900863  6113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:25:33.902166  6113 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:33.902616  6113 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:33.903374  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:33.898939  9638 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:33.904706  9658 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:33.901211  9913 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:33.904754  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:33.912003  9634 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:33.912412  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:33.914625  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:33.914299  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:33.916199  9638 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:33.917301  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:33.931182  9911 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:33.932761  9911 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:33.934935  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 117844us
I20260709 12:25:33.947209  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:33.953899  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:33.953960  6082 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:33.954227  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:33.949476  9911 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:33.964083  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:33.965091  9911 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:33.966202  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:33.969141  9670 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:33.967235  9911 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:33.969982  9670 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:25:33.970592  9911 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:33.969584  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:33.966055  9872 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:34.004226  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.005817  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.009187  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.010954  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.023188  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:34.022333  9907 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:34.038781  9915 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:34.039017  9912 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:34.039634  9912 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.041769  9912 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:34.039659  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 61464.6us
I20260709 12:25:34.042541  9913 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:34.043962  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.046682  9679 consensus_queue.cc:1059] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:34.047461  9868 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:34.050173  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.050315  9923 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:34.050894  5962 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:34.051064  9923 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.051837  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.052954  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.053674  9907 raft_consensus.cc:3055] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:34.053198  9923 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:34.063445  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 94086.6us
I20260709 12:25:34.063746  9703 consensus_queue.cc:1059] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 6.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:34.064893  9699 raft_consensus.cc:3055] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:34.065320  9699 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:34.066108  9689 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:34.066511  9699 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.067677  9912 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:34.068150  9699 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:34.053992  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.069941  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.066840  9689 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.072072  9907 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:34.073232  9907 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.074748  9907 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:34.002818  9638 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:34.075572  9638 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.076922  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.078114  9638 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:34.068552  9912 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.064333  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.029240  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:34.096053  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:34.092698  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:34.103559  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.110495  9913 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:34.111187  9913 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.111824  9908 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.113519  9689 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:34.114226  9908 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:34.114176  9658 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:34.111756  9913 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.115756  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.117020  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:34.108424  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 100419us
W20260709 12:25:34.123121  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 58876.1us
I20260709 12:25:34.124099  6651 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: [7.9-7.9]
I20260709 12:25:34.126287  6113 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.164723  6113 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:34.166520  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:34.175849  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:34.177598  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 85005.3us
I20260709 12:25:34.178388  5934 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.176059  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.187057  6649 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:34.159757  9824 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:34.214601  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:34.217562  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.179030  9916 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:34.177374  9638 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.218139  9670 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:34.226795  6081 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:34.235303  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 59472.8us
I20260709 12:25:34.236447  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.238229  9658 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:34.239210  9658 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.241696  9658 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:34.243935  5959 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:34.225960  9703 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:34.251598  9703 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:34.234905  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 56621.9us
I20260709 12:25:34.253485  6112 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:34.235005  9827 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:34.234884  9916 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.260926  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:34.264490  5934 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.268859  9869 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:34.269362  9912 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:34.272269  9634 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:34.273079  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.273761  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:34.272408  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.277366  5964 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
W20260709 12:25:34.275328  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 82864.3us
I20260709 12:25:34.283730  9915 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:34.285990  9670 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:34.272468  9638 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.280220  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.306728  6649 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:34.309506  6006 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:34.310305  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 139972us
I20260709 12:25:34.324209  5968 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:34.325655  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:34.328550  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.329756  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.332777  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.334915  9689 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:34.335516  9689 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:34.336611  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.336519  9689 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.338450  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.344305  9891 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:34.334942  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.321298  9869 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:34.345768  9869 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:34.334185  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:34.328533  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 64137.4us
I20260709 12:25:34.346129  9869 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:34.345364  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.351822  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.352847  5934 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.320858  9679 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:34.351651  9872 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:34.358696  9634 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:34.345402  9891 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:34.315428  9913 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.362195  9634 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.372500  9634 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:34.367486  9872 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.374536  9872 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:34.365499  9891 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:34.376322  9891 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.377923  9891 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:34.380311  9916 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:34.382819  6608 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.383111  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:34.372377  9846 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:34.385766  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:34.386554  6646 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:34.386375  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:34.356925  9679 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:34.389585  9703 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:34.390997  6084 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:34.389494  9730 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:34.396317  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:34.397737  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:34.397990  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.398322  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:34.405332  5960 raft_consensus.cc:3055] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:34.405755  5960 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:34.406441  5960 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.406949  9911 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.407207  9730 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.409165  9911 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:34.409596  9730 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:34.410391  6035 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: [8.5-8.5]
I20260709 12:25:34.403107  9802 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:34.412364  9802 consensus_queue.cc:1059] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:34.413848  9737 raft_consensus.cc:3055] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:34.414057  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:34.415675  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:34.414224  9737 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:34.421564  6116 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:34.367441  9728 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:34.428272  9658 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:34.428787  9670 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:34.428850  9658 raft_consensus.cc:697] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:34.429440  9670 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.430888  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:34.401432  9679 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:34.431978  5960 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:34.440833  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:34.438871  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.445863  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.444154  5963 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:34.455579  9827 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:34.456122  9670 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:34.463013  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:34.466528  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.483929  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:34.495639  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:34.449296  9658 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.507503  6114 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:34.509413  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:34.510601  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.512800  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:34.515870  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:34.516510  6114 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:34.517304  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.523520  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:34.524052  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:34.524154  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 63094.6us
I20260709 12:25:34.487457  9869 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.466176  9728 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.534169  9913 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:34.504009  9737 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.538851  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:34.538899  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.542405  6082 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.553834  5960 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
W20260709 12:25:34.549624  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 158833us
I20260709 12:25:34.495615  9699 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:34.565138  5934 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:34.559597  6114 raft_consensus.cc:2410] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 8 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:25:34.560485  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.560716  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:34.569414  6109 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:34.569927  6643 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 8: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:34.572291  6082 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.580268  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:34.582026  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.584120  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:34.585819  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:34.586850  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.555094  9913 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:34.589736  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:34.564360  9699 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.593918  9638 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:34.564220  9915 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:34.581475  9703 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:34.565212  9892 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:34.584018  9670 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:34.597867  6082 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.587126  9730 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:34.595475  9699 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:34.598412  9638 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:34.609537  9626 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:34.619598  6111 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:34.649514  5934 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:34.654294  9827 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:34.646037  9737 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:34.659482  9961 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:25:34.662832  9679 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.665395  9679 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:34.666246  9638 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.675848  6115 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
W20260709 12:25:34.680179  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 82406us
I20260709 12:25:34.613194  9892 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.703709  9869 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:34.704764  9892 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:34.682613  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 86260.8us
I20260709 12:25:34.676339  9670 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:34.683132  9948 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:25:34.706872  6082 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:34.707203  9960 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:25:34.683902  9951 log.cc:927] Time spent T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
W20260709 12:25:34.716238  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 62356.5us
W20260709 12:25:34.720602  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:34.709477  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:34.725850  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:34.729180  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 148250us
I20260709 12:25:34.731025  6009 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:34.726727  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 114730us
I20260709 12:25:34.731393  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:34.733203  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.734164  5934 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.736348  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:34.683378  9699 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.742010  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.743376  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.744345  6009 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.728117  9869 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:34.742619  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.748790  5934 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.749270  9638 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:34.749848  9638 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:34.750438  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.751526  6009 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.752074  9908 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:34.756652  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.759025  5934 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.759294  5960 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:34.757296  6044 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:34.738183  9953 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:34.736865  9679 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:34.740106  9804 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:34.755208  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.740520  9634 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:34.766958  9973 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:34.767706  9974 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:34.768466  9846 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:34.758747  9916 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:34.764503  9907 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:34.776604  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:34.778854  9969 log.cc:927] Time spent T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:25:34.782895  9826 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:34.788846  9679 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.791109  9679 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:34.764416  9953 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:34.806552  9953 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:34.811836  9699 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:34.792840  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:34.794999  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.801415  9731 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:34.818986  9731 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:34.823362  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 64413.8us
I20260709 12:25:34.765934  9912 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:34.825306  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:34.825430  5934 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:34.827333  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:34.821302  9731 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
W20260709 12:25:34.828318  9970 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.162s	user 0.000s	sys 0.004s
I20260709 12:25:34.838229  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.836457  9699 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:34.837008  9728 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:34.834734  9670 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.011s
I20260709 12:25:34.842144  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.841805  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.853516  5961 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:34.855532  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:34.859630  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 101605us
I20260709 12:25:34.861397  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.867604  5962 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:34.869623  9923 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:34.874919  9670 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:34.875394  9670 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:34.876312  9912 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:34.876940  9912 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:34.879045  9912 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:34.881524  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:34.882099  9826 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:34.881577  9728 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:34.882712  9826 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.883774  9953 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.884871  9826 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:34.885039  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 46906.8us
I20260709 12:25:34.885424  9728 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:34.885730  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:34.887068  9826 raft_consensus.cc:2764] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:34.888576  6611 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.892023  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:34.893554  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.882932  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.897447  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:34.902218  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:34.903914  5963 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:34.904570  6611 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.905516  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:34.905825  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:34.902657  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:34.903856  6643 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:34.910400  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:34.912400  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:34.913136  6042 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 8: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:34.906401  6115 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:34.910671  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:34.910419  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:34.913544  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:34.914853  5961 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:34.915648  6112 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:34.915875  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:34.916452  6116 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:34.906045  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:34.917074  6646 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:34.912118  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:34.917465  6109 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:34.911778  9975 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:34.920819  6118 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:34.921028  6006 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:34.898859  9953 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:34.905489  9731 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:34.928370  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:34.876351  9670 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.932982  9670 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:34.942075  9981 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:34.948971  9981 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:34.950053  9981 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.902025  9868 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:25:34.955572  9953 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:34.955972  9953 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:34.956864  9953 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:34.958065  9953 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:34.921403  9728 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:34.973058  6109 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:34.986578  9964 raft_consensus.cc:2764] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election decision vote started in defunct term 7: won
I20260709 12:25:34.947007  9986 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:25:35.019785  6609 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:35.021798  9831 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:35.032151  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 116423us
I20260709 12:25:35.033018  6611 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:35.035481  9990 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:35.037266  6611 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:35.039552  9731 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:35.040092  9731 raft_consensus.cc:697] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:35.040970  9731 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:35.985139  5960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 895) took 1260 ms. Trace:
I20260709 12:25:35.985707  5960 rpcz_store.cc:276] 0709 12:25:34.724493 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.724622 (+   129us) service_pool.cc:224] Handling call
0709 12:25:34.724937 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:34.759726 (+ 34789us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:35.984736 (+1225010us) spinlock_profiling.cc:243] Waited 34.2 ms on lock 0x7b54002783d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:35.985012 (+   276us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":78612352}
I20260709 12:25:36.444872  9986 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:36.445622  9986 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:36.484709  9986 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:36.560127  9986 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:36.560868  9986 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:36.563200  9986 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:36.923405  9986 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:36.923969  9986 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:36.926180  9986 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:36.935998  9986 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:36.936712  9986 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:36.914503  9995 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:36.884548  5961 consensus_meta.cc:287] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 1.960s	user 0.020s	sys 0.011s
I20260709 12:25:36.927045  9975 consensus_queue.cc:1059] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:36.938851  5961 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
W20260709 12:25:36.928923  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 1.89029e+06us
W20260709 12:25:36.939734  5961 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2649) took 2047 ms (client timeout 2478 ms). Trace:
W20260709 12:25:36.940506  5961 rpcz_store.cc:269] 0709 12:25:34.892477 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.897401 (+  4924us) service_pool.cc:224] Handling call
0709 12:25:36.939442 (+2042041us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:25:36.940968  9986 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:36.941512  9986 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:36.942049  9986 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:36.944128  9975 raft_consensus.cc:3055] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:36.944548  9975 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:36.945458  9975 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:36.960217  9975 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:36.969076  9894 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.969674  9894 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:36.971011  9908 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:36.971592  9908 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:36.972092  9894 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:36.940460  9995 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:36.975245  9995 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:36.975730  9995 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:36.976176  9995 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:36.977906  9983 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:36.980170  9983 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:36.983450  9908 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:36.983770  9986 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:36.984548  9986 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.985076  9986 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:36.985807  9981 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:36.986392  9981 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:36.987028  9983 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:36.987180  9986 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:36.987600  9983 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:36.988091  9983 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:36.988979  9981 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:36.990000  9983 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:36.990527  9983 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:36.990957  9983 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:36.992802  9983 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:36.993220  9983 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:36.993619  9983 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:36.978148  9995 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:36.995496  9983 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:37.000756  5897 debug-util.cc:398] Leaking SignalData structure 0x7b08000837c0 after lost signal to thread 4824
I20260709 12:25:37.001166  9894 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.001802  9894 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.004011  9894 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.007953  9975 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.032414  9802 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.034104  9802 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.038726  9894 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.030668  9996 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.031997  9975 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.048180  9996 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.049618  9975 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.053476  9915 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.054097  9915 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.046834  9894 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.058323  9894 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:37.065950  5962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.051s	user 0.013s	sys 0.041s
I20260709 12:25:37.055945  9975 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.067021  9975 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.069391  9975 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:37.070485  5962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.055s	user 0.016s	sys 0.041s
I20260709 12:25:37.079100  9915 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.079737  9915 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.082018  9996 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:37.084180  9731 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.015s	user 0.016s	sys 0.030s
I20260709 12:25:37.086628  9915 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:37.089687  9731 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.021s	user 0.017s	sys 0.031s
I20260709 12:25:37.113519  9999 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.113894  9998 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.114187  9999 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.114670  9998 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.116662  9999 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.117216  9999 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.117825 10003 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.117743  9999 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.118484 10003 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.120198  9999 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.122079 10002 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.122664 10002 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.125159 10002 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.125835 10002 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.120870  9999 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.139931 10003 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.140820 10003 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.141505 10003 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.144462 10003 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.145228 10003 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.134884  9915 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.151692  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 2651) took 2138 ms. Trace:
I20260709 12:25:37.152143  5962 rpcz_store.cc:276] 0709 12:25:35.012948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:35.013774 (+   826us) service_pool.cc:224] Handling call
0709 12:25:35.014100 (+   326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:35.014515 (+   415us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:35.014780 (+   265us) log.cc:844] Serialized 14 byte log entry
0709 12:25:37.071224 (+2056444us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:37.071790 (+   566us) log.cc:844] Serialized 26 byte log entry
0709 12:25:37.088770 (+ 16980us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:37.088802 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.088867 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:37.151428 (+ 62561us) raft_consensus.cc:1685] finished
0709 12:25:37.151449 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.151606 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":883,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":1676,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"thread_start_us":2072490,"threads_started":2,"wal-append.queue_time_us":105628,"wal-append.run_cpu_time_us":1259,"wal-append.run_wall_time_us":1001370}
I20260709 12:25:37.154691 10001 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.157948 10001 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.156158  9915 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.159024  9916 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.159090  9915 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.159679  9916 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.161384  9915 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.161685  9916 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.161932  9915 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.126299 10002 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.120860  9998 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.162451  9915 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.167222  9999 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.232174  9999 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.232702  9999 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.233264  9999 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.165618 10003 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.235405 10007 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.236171 10003 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.236752 10003 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.237258 10003 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.239429  9999 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.239622 10002 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.240013  9999 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.240350 10002 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.241025 10002 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.243033  9915 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.243618  9915 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.229257  9998 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.246848  9998 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.229755 10005 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.235947 10007 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.246757  9915 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.249490 10005 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.251328 10007 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.241325 10003 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.165270  9916 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.252446  9916 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.240474  9999 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.228310 10004 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.244050  9824 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.255048 10004 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.226838 10001 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.255134  9824 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.243065 10002 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.261826  9998 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.273440  6611 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:37.274893  9979 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:37.278350  9965 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.278976  9965 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.290889  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:37.292097  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.298794  9830 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:37.299155  9977 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.299419  9830 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.299656  9977 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.287559  9658 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.282497  9634 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.292038  9983 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.301919  9634 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.292038  9913 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:37.302341  9983 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.302992  9913 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.304013  9634 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:37.304394  9983 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.304522  9634 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.304855  9913 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:37.305395  9913 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:37.286952  9626 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.305830  6082 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:37.306097  9965 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:37.301582  9977 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.306823  9634 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.307955  9977 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:37.302261  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.309607  6113 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:37.318400 10008 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.318331  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.319381  6114 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:37.319074 10008 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.321501 10008 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.306238  9626 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.301653  9658 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.326951  9658 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:37.327832  6112 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:37.330595  9626 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.301621  9830 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.332501  6611 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:37.334286  9979 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:37.334749  9979 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.335109  9979 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:37.335904  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.336184  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.336817  6113 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:25:37.336966  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.338982  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.339731  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.339277  9916 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.341099  9824 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.340039  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.338371  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.343394  6112 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:37.339701  6118 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:37.346053  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.347853  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.351889  9965 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.354048  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.354408  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.353796  9913 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.355367  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.357834  5962 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:37.355854  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.354725  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.358340  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.359139  5964 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:37.358486  9658 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.358665  9983 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.360846  9658 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.361588  9983 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.357561  9977 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.362929  9977 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.365633  5966 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:37.366328  9626 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.366930  9626 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.368300  9830 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.368810  9830 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.370829  9830 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.372191  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.373050  5959 raft_consensus.cc:2410] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 9 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 6 index: 6.
I20260709 12:25:37.374056  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.374739  5966 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:37.360756  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.377534  5967 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:37.382054  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.382668  5967 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:37.344467  9634 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.398128  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.398892  5966 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:37.390749  9975 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.400130  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.350438  9979 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.396024  9997 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.386034  9731 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.387777  9977 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:37.412006  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.427716  6111 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:37.412609  9997 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.429199  9953 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.429790  9953 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.430642  9997 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.413450  9731 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.431923  9953 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.416356  9981 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.432554  9981 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.433931  9731 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.414299  9975 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.434509  9981 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.435061  9981 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.435554  9981 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.417613  9980 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.418052  9868 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.418490  9995 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.437424  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.437250  9980 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.437898  9995 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.439651  9980 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.440111  9995 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.440488  9980 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:37.440748  9995 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:37.441269  9995 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.420032  9973 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.444245  9973 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.420550  9863 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.446821  9863 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.420938  9983 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.386747  9965 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.449023  9863 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.449510  9965 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.449862  9973 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.424819  9869 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.425993  9824 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.426234 10008 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.426446  9916 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.420951  9986 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.431795  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.451010 10008 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.451463  9986 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.453214 10008 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.453619  9986 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.454042  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.450932  9824 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.454741  5966 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:37.456471  9824 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.457254  9916 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.459447  9916 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.460045  9869 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.441606  9975 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.418901  9912 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:37.462522  9912 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.464584  9912 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.442616  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.417045  9572 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.465970  9572 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.468112  9572 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.437330  9868 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.470275  9868 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.382877  9913 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.472401  9913 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:37.462095  9869 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.475800  9981 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:37.488869  5897 debug-util.cc:398] Leaking SignalData structure 0x7b080035aee0 after lost signal to thread 5900
I20260709 12:25:37.503640  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.504329  6118 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:37.494269  9802 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.484134  9638 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.527326  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.528066  6110 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:37.529152  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2211) took 2610 ms. Trace:
I20260709 12:25:37.527396  9638 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.529518  6042 rpcz_store.cc:276] 0709 12:25:34.918357 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:34.918524 (+   167us) service_pool.cc:224] Handling call
0709 12:25:34.928524 (+ 10000us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:37.486653 (+2558129us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:37.486685 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:37.486726 (+    41us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:37.486758 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:37.528903 (+ 42145us) spinlock_profiling.cc:243] Waited 2.56 s on lock 0x7b5400270e54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:37.528946 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:37.529061 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5882728832}
I20260709 12:25:37.531188  9638 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.483851  9894 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.532039  5934 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.493517 10004 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.492620  9999 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.506193  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.507984  9658 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.508636  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.533695  6037 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:37.508841  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.534731  6040 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:37.534826  5934 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.510638  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.535251  9827 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:37.535668  9827 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.536017  9827 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:37.538048  5863 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 324) took 8176 ms. Trace:
I20260709 12:25:37.532099  9894 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.541003  9894 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:37.481726  9966 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.511914  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.514650  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.542670  6038 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:37.543071  9999 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:37.482544  9891 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.515543  6041 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:37.543525  9966 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.544544  5934 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.515784  9626 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.545861  9966 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:37.518951  5897 debug-util.cc:398] Leaking SignalData structure 0x7b080031f9c0 after lost signal to thread 5992
W20260709 12:25:37.546396  5897 debug-util.cc:398] Leaking SignalData structure 0x7b080025a020 after lost signal to thread 5993
I20260709 12:25:37.487018  9908 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:37.547098  9908 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:37.547644  5897 debug-util.cc:398] Leaking SignalData structure 0x7b0800393de0 after lost signal to thread 6068
W20260709 12:25:37.547926  5897 debug-util.cc:398] Leaking SignalData structure 0x7b080038c680 after lost signal to thread 6069
W20260709 12:25:37.548908  5897 debug-util.cc:398] Leaking SignalData structure 0x7b08003b9ac0 after lost signal to thread 6142
W20260709 12:25:37.549170  5897 debug-util.cc:398] Leaking SignalData structure 0x7b08003da4c0 after lost signal to thread 6143
I20260709 12:25:37.516503  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.518172  6111 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:37.441232  9980 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:37.550233  5897 debug-util.cc:398] Leaking SignalData structure 0x7b080032e740 after lost signal to thread 6675
W20260709 12:25:37.551370  5897 debug-util.cc:398] Leaking SignalData structure 0x7b08000c3a80 after lost signal to thread 6676
I20260709 12:25:37.541437  9995 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.545578  9891 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:37.477367  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:37.552404  9980 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.514761  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.522017  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.509900  9915 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.553874  5967 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:37.490901 10005 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.555363  9981 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.555965  9981 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.558028  9981 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.558575  9981 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.558722  9638 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.559090  9981 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.543500  9999 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.560637  9999 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:37.561589  9638 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.562763  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:37.560662  9737 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.563829  9737 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.564965  9981 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.565780  9737 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.565877  9733 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:37.567132  6611 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:37.564994  9892 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:37.569897  9892 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.570292  9892 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.541505  5862 catalog_manager.cc:5697] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 4 to 5, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 5 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:37.575385  5862 catalog_manager.cc:5697] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 7 to 8, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.538439  5863 rpcz_store.cc:276] 0709 12:25:29.361812 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.362722 (+   910us) service_pool.cc:224] Handling call
0709 12:25:29.883367 (+520645us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:25:37.537828 (+7654461us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:33.294127 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:33.294718 (+   591us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:33.294758 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:25:33.294777 (+    19us) tablet.cc:662] Decoding operations
0709 12:25:33.295491 (+   714us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:33.295558 (+    67us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:33.295595 (+    37us) tablet.cc:685] Acquiring locks for 5 operations
0709 12:25:33.296121 (+   526us) tablet.cc:701] Row locks acquired
0709 12:25:33.296138 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:25:33.296294 (+   156us) write_op.cc:270] Start()
0709 12:25:33.296414 (+   120us) write_op.cc:276] Timestamp: P: 1783599933296241 usec, L: 0
0709 12:25:33.296439 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:25:33.297144 (+   705us) log.cc:844] Serialized 2070 byte log entry
0709 12:25:34.214115 (+916971us) op_driver.cc:464] REPLICATION: finished
0709 12:25:34.549581 (+335466us) spinlock_profiling.cc:243] Waited 25.4 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f481df4a0ac 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4824a8aef0
0709 12:25:34.728669 (+179088us) write_op.cc:301] APPLY: starting
0709 12:25:34.747879 (+ 19210us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:34.768601 (+ 20722us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:34.768642 (+    41us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:34.771201 (+  2559us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:34.771479 (+   278us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=5
0709 12:25:34.771537 (+    58us) write_op.cc:312] APPLY: finished
0709 12:25:34.771907 (+   370us) log.cc:844] Serialized 47 byte log entry
0709 12:25:34.772100 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:34.772242 (+   142us) write_op.cc:454] Released schema lock
0709 12:25:34.772304 (+    62us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:34.772750 (+   446us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:34.772782 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":90747,"reported_tablets":8,"spinlock_wait_cycles":507563392,"child_traces":[["op",{"apply.queue_time_us":451885,"apply.run_cpu_time_us":3358,"apply.run_wall_time_us":72181,"num_ops":5,"prepare.queue_time_us":917919,"prepare.run_cpu_time_us":80755,"prepare.run_wall_time_us":410658,"raft.queue_time_us":317154,"raft.run_cpu_time_us":22016,"raft.run_wall_time_us":419026,"replication_time_us":893736,"spinlock_wait_cycles":58494208,"thread_start_us":1366118,"threads_started":4,"wal-append.queue_time_us":392741,"wal-append.run_cpu_time_us":41594,"wal-append.run_wall_time_us":3337191}]]}
I20260709 12:25:37.577054  5862 catalog_manager.cc:5697] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 6 to 8, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.581151  9987 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:37.581578  9987 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.581902  9987 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.587177  9827 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.589462  9827 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.591833  9987 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.593952  9987 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.595932  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.596553  6044 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:37.597962  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.598788  6044 raft_consensus.cc:2393] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:37.599752  9891 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.601173  6041 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:37.602432  6081 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.603403  9634 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:37.603794  9634 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:37.603825  9626 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:37.604293  9634 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:37.605199  9638 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.611342  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.606519  6081 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.617048  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.617745  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.618136  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.631198  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.615676  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.633541  6038 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:37.618124  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.637387  6041 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:37.632753  6081 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.639694  6081 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.608057  6609 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:37.640898  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.643260  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.645439  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.645750  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.646374  6114 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:37.649158  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.650882  5964 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 6 index: 5. (index mismatch)
I20260709 12:25:37.651422  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.652130  5960 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 2.
I20260709 12:25:37.652128  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.652905  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.653663  5961 raft_consensus.cc:1813] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Handling vote request from an unknown peer 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:37.654121  5961 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:37.654570  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:37.654819  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.655099  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.641562  6035 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:37.655339  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:37.617609  5862 catalog_manager.cc:5697] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:37.655121  6113 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.656201  5961 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:37.657186  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.657305  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.657712  5961 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:37.654768  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.657892  5959 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:37.658919  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.659056  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.659540  5959 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:37.659651  5961 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:37.661016  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.652915  5964 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:37.661623  5966 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:37.667155  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.667235  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.668121  5967 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:37.668960  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.608892  9737 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:37.670267  5960 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:37.670061  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.703092  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.703080  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.702028  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.674767  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.675148  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.709769  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.712437  6035 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:37.706141  6609 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:37.713550  6041 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:37.641444  9908 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.618475  9999 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.720345  6081 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.719229  5862 catalog_manager.cc:5697] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 7 to 9, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 9 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.722093  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 6 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.712141  9737 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.645385  9872 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:37.671402 10013 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.730115  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.707887  9626 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:37.647010  9728 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:37.727456  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.612453  9892 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.669973  9891 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:37.730865  5966 raft_consensus.cc:2393] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:37.725375  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.738517  6647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38df61ba407240499023581d9f885037"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:37.732681  9597 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:37.742779  9597 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.743183  9597 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:37.747279  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.731042  5862 catalog_manager.cc:5697] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 6 to 8, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:37.726985  9737 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.727087  9872 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.722783  9913 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:37.714951  9802 consensus_queue.cc:1059] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.015s
I20260709 12:25:37.753643  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.733741  9626 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.735587  9966 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:37.755592  6113 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
W20260709 12:25:37.733393  6009 connection.cc:256] RPC call timeout handler was delayed by -1.0453111000001627s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1796s for a response
I20260709 12:25:37.645242  9987 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:37.737090  9891 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.770573  6035 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:37.780014  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.734231  9908 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.754369  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.774072  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.773617  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.781217  6113 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:37.734083  9728 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.783880  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.782652  5966 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:25:37.785580  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.785599  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.770493  9872 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:37.788240  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.790213  6041 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:37.751546  5862 catalog_manager.cc:5697] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 4 to 7, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New cstate: current_term: 5 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:37.770212  9913 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.796625  5934 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.715207  9996 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:25:37.786216  9728 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.792843  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:37.802017  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:37.784332  9891 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:37.776659  9626 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:37.798776  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.799590  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.799846  5934 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.794111  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.795039  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.803821  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.789253  9908 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.805004  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.793388 10014 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:37.813057  9731 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:37.818507  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.813716  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.807298  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:37.802848 10005 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:37.799366  9913 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:37.820533  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:37.810281  5966 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:37.821112  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.822490  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.827307  6041 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:37.819347  6110 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:37.787528  9987 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.815449  9915 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:37.843242  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.817917  9975 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:37.844475  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.843475  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.734536 10013 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.850243  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.850402  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.818897  9731 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:37.825069 10005 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.840339  9987 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:37.856298  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.855366  9731 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.865469  9597 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:37.875294 10015 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:25:37.877538  9979 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.884824  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:37.886018  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:37.886673  6044 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.889046  9987 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.849107  9975 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:25:37.890758 10009 log.cc:927] Time spent T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.001s
I20260709 12:25:37.891654  9731 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.890750  9975 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.893838  9731 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.879614  9966 raft_consensus.cc:3055] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:37.890993  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.902146  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:37.912914  6044 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:25:37.913254  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:37.851985  9733 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:37.914397  6609 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:37.914965  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.915647  5964 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:37.916988  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:37.917109  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.917770  6651 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:37.852377  9915 raft_consensus.cc:697] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:37.920367  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:37.921187  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.922220  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.924199  6115 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:37.925184  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.922865  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.925886  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.926389  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:37.927016  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.925093  9894 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:37.897049  9987 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:37.856791  9997 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:37.930768  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.858068 10005 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:37.941265  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:37.952349  6111 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:37.928975  6643 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:37.947139  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.950421  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:37.950649  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:37.934494  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.908545  9966 raft_consensus.cc:740] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:37.956985  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:37.951972  6009 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.717s (SENT) [suppressed 3 similar messages]
I20260709 12:25:37.962986  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.963064  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:37.963789  5963 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:37.918200  9733 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:37.966171  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.966272  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:37.951829  9997 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:37.968376  9997 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:37.968660  9912 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:25:37.969069  9912 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:37.969419  9912 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:37.955452  9892 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.837667 10014 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:37.931908  9999 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:37.951457  9980 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:37.982218  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:37.865355  9634 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:37.998813  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:37.999434  6643 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:37.966634  9658 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:37.996932  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:37.998173  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.002027  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:37.977203  9733 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.005340  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:37.999782  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:37.978080  9894 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:37.983364  9572 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:38.006582  6651 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
W20260709 12:25:38.007086  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 47722us
I20260709 12:25:37.976775  9973 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:25:38.015627  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.011179  9572 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:38.022917  9572 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:38.022996  9894 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.028672  9891 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.030974  9597 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:38.039193  9908 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:38.045310  9912 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:38.046792  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 50262.1us
I20260709 12:25:38.038821  9966 consensus_queue.cc:260] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.047719  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:38.049217  6111 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:38.041980  9737 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.007843  9980 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:38.077148  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.079313  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.081409  6651 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
W20260709 12:25:38.080446  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 253168us
I20260709 12:25:38.083196  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.087332  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.053208 10012 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:38.091233  6647 raft_consensus.cc:606] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:38.091940  6647 raft_consensus.cc:614] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:38.071187  9973 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:38.112414  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 160451us
I20260709 12:25:38.086033  9981 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.090499  9731 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:38.086910  9966 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.038699  9915 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:38.148404  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 189137us
I20260709 12:25:38.149468  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.151885  6651 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:25:38.144515  6006 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:38.160478  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:38.164151  6006 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:38.164480  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 77219.7us
I20260709 12:25:38.123322  9973 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:38.168068  6608 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.096661 10012 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:38.144050  9979 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:38.161213  5964 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:38.169526  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.091264  9908 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.064s
I20260709 12:25:38.171290  6608 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:38.174230  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:38.175191  5963 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:38.104620  9872 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:38.170428 10017 log.cc:927] Time spent T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.088s	user 0.000s	sys 0.001s
I20260709 12:25:38.103924 10013 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:38.194020  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.178987 10012 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:38.173527  9973 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.143950  9981 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.187060  9894 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:38.209154  6112 raft_consensus.cc:2368] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8.
I20260709 12:25:38.163337  9572 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.211980  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:38.213210  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 73109.3us
W20260709 12:25:38.220618  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 56535.3us
I20260709 12:25:38.224347  5934 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:38.224399  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:38.232954  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:38.225281  5964 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:38.210494  9912 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:38.241871  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.214555  9974 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:25:38.242710  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 58086.7us
W20260709 12:25:38.240969  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 68766.5us
I20260709 12:25:38.249629  6651 raft_consensus.cc:2393] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:38.250546  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:38.251849  6082 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.234664  9634 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:38.211431  9728 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:38.250233  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 67343.4us
I20260709 12:25:38.259936  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:38.256567  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:38.242269 10004 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:38.234479 10014 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:38.198046  9980 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.266647  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:38.261641  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:38.247280  9974 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.260627  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:38.274319 10023 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:38.255067  9912 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:38.275849  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:38.281005  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 61466.2us
I20260709 12:25:38.283349  5961 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.286206  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.275941 10030 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:38.281217  9974 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.291543 10030 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:38.291951 10030 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.294505 10029 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:38.295100  9891 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:38.277582 10004 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:38.290005  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:38.282127 10023 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:38.290525  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.277808  9737 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:38.284919  9634 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:38.301918  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:38.282534  9912 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:38.285264 10035 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:38.306005  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.305241  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.306197  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:38.311735  5959 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.298316 10022 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:38.295174 10029 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:38.315282  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.303843 10013 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:38.303539 10023 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.321257  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:38.321655 10026 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:25:38.322008  9728 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:38.326138 10034 log.cc:927] Time spent T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.052s	user 0.000s	sys 0.000s
I20260709 12:25:38.337700  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:38.339150  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:38.339828  5966 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.341717  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.327316  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.304636  9634 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.330037 10040 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:25:38.347338  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:38.348272  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.349285  5967 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:25:38.340483  9872 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:38.327668 10029 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:38.331107 10032 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:25:38.355170  9981 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:38.349402  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.344216  9634 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.356467  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.357583  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.316550 10022 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:38.358884 10022 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:38.360003  5959 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:38.330943 10028 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:38.310847 10035 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:38.330014  5964 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:38.289767  9975 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.310143  9912 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.320809  5961 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:38.310285  9826 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:38.329576  6642 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:38.329000 10013 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.319623  9913 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.342240  6648 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:38.381520  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.391584  6006 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:38.399005  6644 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:38.307036 10004 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.366729 10035 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.400332  6081 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:38.408428  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 121189us
I20260709 12:25:38.408509  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.407914  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.409032  6081 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:38.391268  9826 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.407193  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.413443  6114 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:38.395076 10013 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.393038  9658 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:38.393381 10010 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:38.409291  6009 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.414364  6646 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:38.401069 10037 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:38.424844 10037 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.426131  6643 raft_consensus.cc:2410] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 11 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:25:38.426354  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.427045  6039 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.427426  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:38.426982  6044 raft_consensus.cc:1240] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:38.431656  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.432288  6035 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.432602  6041 raft_consensus.cc:2410] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 9 because replica has last-logged OpId of term: 7 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 8.
I20260709 12:25:38.414876  9826 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.415894  9983 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:38.434286  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.393618 10005 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.437206  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.437245  6042 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 2. Current term is 3. Ops: []
I20260709 12:25:38.441664  5963 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:38.442862  9974 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.423125  9658 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:38.435225  9728 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:38.446270  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.425182 10037 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:38.433360 10044 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:38.460099  5967 raft_consensus.cc:606] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:38.445564  5934 leader_election.cc:400] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8.
I20260709 12:25:38.482060  5967 raft_consensus.cc:614] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:25:38.446979  9626 consensus_meta.cc:287] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.628s	user 0.011s	sys 0.000s
I20260709 12:25:38.448331  6009 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.467247  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.468024  9974 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:38.473261  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:38.489032  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.477198  9658 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.482227  5934 leader_election.cc:403] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:25:38.479524  9913 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:38.489722  9626 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.495599  9626 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:38.497823  9658 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:38.445081  9997 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.498831  9974 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:38.499306  6645 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 7: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:25:38.499745  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51501.1us
I20260709 12:25:38.500330  9997 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:38.501816  6084 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.500589  6009 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:38.502872 10039 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:25:38.503109  9974 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:38.504926  9975 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:38.506894 10005 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:38.508841  9973 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.509723 10031 raft_consensus.cc:3055] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:38.510150 10031 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:38.487715  5960 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 6. Current term is 7. Ops: [6.5-6.5]
I20260709 12:25:38.489332  5963 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:25:38.490197  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 72592.8us
I20260709 12:25:38.460590 10040 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:38.463188  6081 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:38.511020  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:38.513511  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:38.521931  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:38.491456  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 186262us
I20260709 12:25:38.516487  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:38.462433  9983 raft_consensus.cc:697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:38.514533  6608 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:38.439118  9733 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.526180  6118 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.526538  6647 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:38.527624  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.433625 10010 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.546216  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:38.547258  6035 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
W20260709 12:25:38.540035  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 76938.9us
I20260709 12:25:38.548728  9973 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:38.549769 10048 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:38.550307 10048 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:38.551283 10048 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.553033  9830 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:38.555953  9974 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:38.542801  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:38.502040 10030 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.559757  6650 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:38.539805  6084 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.560359  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:38.537848  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.519254  9987 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8.
I20260709 12:25:38.566160  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.562625  6649 raft_consensus.cc:2368] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9.
I20260709 12:25:38.563868  6039 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:38.559880  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:38.565384  6009 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.566167  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:38.569011  6009 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.573612  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:38.523561  9728 raft_consensus.cc:697] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:38.536242  9908 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:38.531672 10032 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:38.541584 10005 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.680723  6648 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:38.681432  5855 maintenance_manager.cc:419] P 5def43035e3245068dbad43bca95206c: Scheduling FlushMRSOp(00000000000000000000000000000000): perf score=0.033388
I20260709 12:25:38.679560  9892 consensus_queue.cc:1059] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.083s
I20260709 12:25:38.682291 10019 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:38.573485 10040 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:38.723628  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.573635  9802 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:38.690971  9983 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.696151 10031 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.726624  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:38.727712  9892 raft_consensus.cc:3055] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:38.728132  9892 raft_consensus.cc:740] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:38.691463  9733 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:38.570891  9916 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:38.567263  9830 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:38.526587  9634 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.696264  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:38.701318  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.733618  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:38.733960  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:38.705338  6118 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:38.702265  5966 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:38.570741 10044 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:38.715080  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.720427  9913 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:38.572242  9974 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:38.567317  9827 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:38.718477  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.759245  6039 raft_consensus.cc:2393] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:38.718945  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.719310  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.720259  6040 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:38.720898  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.760068  6041 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.688776 10014 consensus_queue.cc:1059] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 2.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:38.724524  5965 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:38.690101  9826 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.727543 10016 consensus_queue.cc:1059] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:38.692878 10013 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.699276 10032 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:38.732869  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:38.573550 10023 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.734923  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:38.757038  9913 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:38.753798  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 184800us
I20260709 12:25:38.737083  9830 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:38.737075  9802 raft_consensus.cc:697] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:38.791910  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.793211  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.735280 10019 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.756054  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:38.784979  9634 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:38.794971  9830 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.803527 10023 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:38.803756  9572 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:38.795209  9995 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:38.794486  9728 consensus_queue.cc:237] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.796967  9974 consensus_queue.cc:1059] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.012s
I20260709 12:25:38.809551 10005 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:38.809894  9974 raft_consensus.cc:3055] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:38.810288  9974 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:38.766289 10037 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.811053  9974 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.5, Last appended by leader: 5, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.812194  9974 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:38.817628 10022 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:38.714545  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 174791us
I20260709 12:25:38.760397  6044 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 8: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:38.761955  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.730281  9915 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:38.766680  9826 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:38.761698  9827 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:38.769752  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.736559  9916 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:38.754261  9975 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:38.826725  9916 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:38.775831  6109 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 10: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:38.775704  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.776453  6114 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.775104 10032 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.777714 10030 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:38.778200 10013 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:38.778807  6113 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:25:38.779389 10051 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:25:38.782781  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.766186 10047 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.783550  9912 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.729055  9892 consensus_queue.cc:260] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.785388  6116 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:38.739765  6611 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.788663  6041 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:38.769176 10029 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.797684  6009 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.841364  6084 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:38.842501  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 44866.4us
I20260709 12:25:38.736877  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:38.795735  9913 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.832079  6112 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:38.833524  6044 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:38.800694 10045 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:38.836434  9802 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.812134 10037 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:38.825922  9827 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.828012  9731 raft_consensus.cc:3055] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:38.835484 10038 raft_consensus.cc:3055] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:25:38.858850  6041 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:38.858973  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:38.848775  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 109096us
I20260709 12:25:38.846604  6009 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:38.824177  9915 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:38.862809  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.863092  6115 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:38.856608  9891 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:38.859537  6648 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:38.861326  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:38.863790  6651 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:38.862015  6118 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:38.865091  9915 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.875190 10035 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.876423  6110 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:38.877465 10035 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:38.848692  9973 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:38.850822  9731 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:38.878270  9912 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:38.850620  9975 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:38.879648  9975 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.863466  9572 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:38.858626 10038 raft_consensus.cc:740] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:38.882222 10038 consensus_queue.cc:260] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.883067  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:38.880913 10030 consensus_queue.cc:1059] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:38.885923  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:38.886372  6114 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:38.888032  6042 raft_consensus.cc:2368] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8.
I20260709 12:25:38.889189  6611 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:38.889704  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:38.850953  9996 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:38.862154 10028 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:38.896916  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:38.888649 10012 consensus_meta.cc:287] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.681s	user 0.010s	sys 0.000s
I20260709 12:25:38.900279  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:38.904023  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:38.893975 10038 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:38.878304  9916 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.906688  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.909703 10030 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:38.918766 10022 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:38.921358  9827 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.914323  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:38.917575  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.923200  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:38.923481 10029 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:38.924397 10030 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:38.925314 10030 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.927222  6650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50470 (request call id 758) took 1006 ms. Trace:
I20260709 12:25:38.927572  6650 rpcz_store.cc:276] 0709 12:25:37.921075 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.921562 (+   487us) service_pool.cc:224] Handling call
0709 12:25:38.927047 (+1005485us) spinlock_profiling.cc:243] Waited 606 ms on lock 0x7b5400580554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:38.927166 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1393932032}
I20260709 12:25:38.928737  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:38.928807  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:38.929713  6642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b70d6df693140769deef828413df1ba"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:38.930230  6642 raft_consensus.cc:606] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:38.916086 10010 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:38.931706 10019 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:38.892922 10020 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:25:38.932531 10031 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.933069 10020 raft_consensus.cc:3055] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:38.933427 10020 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:38.934180 10020 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.935226  6648 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:38.935336 10020 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:38.936558  6650 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:38.937851  6648 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:38.938138  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.941490  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.942837  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.944002  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.945204  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.950802  9916 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:38.951802  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.905824  9830 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.956528  9830 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:38.956843 10047 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:38.957929  9827 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:38.959139  6043 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:38.962810  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:38.963575  9830 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:38.963828 10022 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:38.964646  9830 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:38.965127 10022 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:38.965593  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:38.965058  9830 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:38.966027 10022 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.966638  6111 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:38.967082  9913 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.967440  9830 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:38.968806  9830 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:38.969658  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:38.970116  6117 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 10: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:38.970319  6039 raft_consensus.cc:2368] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12.
I20260709 12:25:38.973055  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:38.974756  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.975176  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:38.975870  6043 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:38.969175  9913 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:38.977833  6642 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:38.905128 10012 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:38.902177  9966 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:25:38.997797  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:38.999027  6084 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:39.000306  6084 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:39.002351  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:39.003350  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:39.028337  6037 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:39.029838  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:39.033506  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 145107us
I20260709 12:25:39.036043  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:39.037801  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:39.039845  6648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:39.034092  6084 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:39.031539 10050 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:39.040510  6648 raft_consensus.cc:606] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:39.041283  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:39.043573  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:39.029985 10047 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:39.028939  9913 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:39.031785 10054 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:39.050722  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:39.053416  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 164269us
I20260709 12:25:39.055001  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:39.055766  6111 raft_consensus.cc:2393] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 7: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:39.056425  6611 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:39.055752  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:39.059383  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:39.047804  9728 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:39.060108  6084 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:39.060180  6043 raft_consensus.cc:2393] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:39.063478  6084 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:39.064997 10035 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:39.077822  5966 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:39.043668 10032 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.084578  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:39.085355  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:39.087661  5966 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:39.085529  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:39.090112  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:39.091001  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:39.092900  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:39.092964  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:39.094506  5964 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:39.060017  9913 consensus_queue.cc:1059] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:25:39.055049 10050 consensus_queue.cc:1059] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.038s
I20260709 12:25:39.173700  6044 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:39.175712  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:39.098623  5966 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:39.129631  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:39.116807  5967 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:39.099283  5962 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:39.120304  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:39.143316  5965 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:25:39.129256  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:39.116504  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:39.179709  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.128607  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:39.099937  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:39.198191  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 59806.3us
I20260709 12:25:39.101716  6084 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:39.116101  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:39.099653  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:39.199441  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:39.200242  5963 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:25:39.200362  6041 raft_consensus.cc:2368] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8.
I20260709 12:25:39.201437  6040 raft_consensus.cc:2393] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:39.166991  5964 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
W20260709 12:25:39.198261  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.086194  9916 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:39.208261  5966 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:39.209360  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:39.228374  6039 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:39.212309  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:39.210793  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 109165us
I20260709 12:25:39.171039  9979 raft_consensus.cc:993] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:39.063038 10030 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:39.239095  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:39.108507  9728 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:25:39.143275 10062 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:25:39.117303  9892 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:39.100067 10019 consensus_queue.cc:1059] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.145s
W20260709 12:25:39.258946  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 47091.2us
I20260709 12:25:39.249353  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:39.126525 10012 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:39.250846  5934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.013s	sys 0.008s
W20260709 12:25:39.263016  5934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.013s	sys 0.009s
W20260709 12:25:39.263670  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 697514us
I20260709 12:25:39.063220 10047 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.183s
I20260709 12:25:39.264886  5934 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:39.249843  9966 raft_consensus.cc:1081] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:39.278761  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:39.229173  9891 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:25:39.172505 10032 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:39.245785  9916 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:39.239926 10054 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:39.177110 10064 consensus_queue.cc:1059] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:25:39.354936 10064 raft_consensus.cc:3055] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:39.355327 10064 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:39.355918  6644 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:39.356202 10064 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.357004  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:39.357623 10064 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:39.265460  9658 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:25:39.359333  9658 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:39.359707  9658 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:39.360544  9658 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.361938  9658 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:39.362650  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 80501.8us
I20260709 12:25:39.362813  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:39.254181  5963 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:39.264866  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:39.280381  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:39.366894  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 86588.2us
I20260709 12:25:39.367406  6647 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:39.368733  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:39.369200  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:39.117853 10028 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:39.369910  6647 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:25:39.370536  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 151421us
I20260709 12:25:39.238729  9974 consensus_queue.cc:1059] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
W20260709 12:25:39.326606  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 64780.9us
I20260709 12:25:39.146093  9731 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:39.331766  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 51706.7us
I20260709 12:25:39.286876  9827 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:39.374996  9827 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:39.375453  9827 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:39.376714  9916 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:39.333918  9728 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.378809  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:39.381197  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:39.343688  6042 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:39.347199  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:39.381659  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:39.348117  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:39.348793  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:39.349947  6025 tablet_service.cc:1558] Processing DeleteTablet for tablet ec584257f9db451c965f6b092aa9069c with delete_type TABLET_DATA_TOMBSTONED (TS 0557a7246c8945b99e5215c99d4ddf9c not found in new config with opid_index 7) from {username='slave'} at 127.0.0.1:36246
I20260709 12:25:39.228456 10044 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:25:39.369844  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:39.390818  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:39.391569  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:39.392350 10057 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:39.393116  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.393636  9916 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:39.395649  9869 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:39.396126  9869 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:39.397022  9869 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.372380  9703 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:39.347522  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:39.383081  6118 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:39.382668  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:39.383951  5965 raft_consensus.cc:606] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:39.384832  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:39.400645  6044 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:39.401037  6109 raft_consensus.cc:2368] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9.
I20260709 12:25:39.400703  5965 raft_consensus.cc:614] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:39.382325  6111 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:25:39.385727  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:39.401928  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:39.385917  5862 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 307) took 7126 ms. Trace:
I20260709 12:25:39.386502  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 6 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:39.386726  6114 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: [7.7-8.8]
I20260709 12:25:39.387375  9731 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:39.388103  9915 consensus_meta.cc:287] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.513s	user 0.010s	sys 0.000s
I20260709 12:25:39.375065 10005 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:39.402380  6117 raft_consensus.cc:2368] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10.
I20260709 12:25:39.405562  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:39.406677  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:39.413470  6110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6b70d6df693140769deef828413df1ba"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:42484
I20260709 12:25:39.439101  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:39.443506  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 71642.2us
I20260709 12:25:39.412701  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:39.411780  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:39.449755  5964 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:39.441394  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:39.450501  6109 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:39.450982 10038 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:39.452525  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:39.453406  5962 raft_consensus.cc:2393] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 7: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:39.413102  6116 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:39.441907  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:39.442931  6647 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: [6.8-6.8]
I20260709 12:25:39.412426  9703 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:25:39.446416  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 62685.9us
I20260709 12:25:39.444314  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:39.456920 10044 consensus_queue.cc:1243] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer f1bb8e63c2b448cdafd51f05d277c741 log is divergent from this leader: its last log entry 9.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:39.444917  6113 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:25:39.458768 10010 raft_consensus.cc:993] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:39.458974  6111 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:39.459270 10013 consensus_queue.cc:1059] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:39.463032 10010 raft_consensus.cc:1081] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:39.467941  6044 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:39.468940  9703 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:39.451524 10038 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.472856 10038 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:39.475821  6044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:25:39.476418  6044 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:39.476735  6044 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:39.407424  9869 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:39.440853  9915 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.484164  6042 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:39.485051  9915 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:39.441627  9979 raft_consensus.cc:3055] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:39.486229  9979 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:39.486649  5961 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:39.487126  9979 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.488481  9979 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:39.489846  9891 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:39.491255 10067 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:39.456091  6081 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:39.493708  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:39.445254  6110 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:39.496115  6110 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:39.402912  5862 rpcz_store.cc:276] 0709 12:25:32.259913 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:32.264075 (+  4162us) service_pool.cc:224] Handling call
0709 12:25:39.385853 (+7121778us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:38.158142 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:38.253304 (+ 95162us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:38.262528 (+  9224us) write_op.cc:435] Acquired schema lock
0709 12:25:38.273651 (+ 11123us) tablet.cc:662] Decoding operations
0709 12:25:38.295567 (+ 21916us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:38.295673 (+   106us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:38.295714 (+    41us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:25:38.296391 (+   677us) tablet.cc:701] Row locks acquired
0709 12:25:38.296539 (+   148us) write_op.cc:260] PREPARE: finished
0709 12:25:38.296721 (+   182us) write_op.cc:270] Start()
0709 12:25:38.296898 (+   177us) write_op.cc:276] Timestamp: P: 1783599938296649 usec, L: 0
0709 12:25:38.296920 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:25:38.297690 (+   770us) log.cc:844] Serialized 2824 byte log entry
0709 12:25:38.770551 (+472861us) op_driver.cc:464] REPLICATION: finished
0709 12:25:38.903411 (+132860us) write_op.cc:301] APPLY: starting
0709 12:25:38.903522 (+   111us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:38.911632 (+  8110us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:38.911736 (+   104us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:38.949684 (+ 37948us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:38.949882 (+   198us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:25:38.949926 (+    44us) write_op.cc:312] APPLY: finished
0709 12:25:38.950162 (+   236us) log.cc:844] Serialized 59 byte log entry
0709 12:25:38.950317 (+   155us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:38.950443 (+   126us) write_op.cc:454] Released schema lock
0709 12:25:38.950510 (+    67us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:38.950874 (+   364us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:38.950918 (+    44us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":18681,"reported_tablets":15,"child_traces":[["op",{"apply.queue_time_us":120665,"apply.run_cpu_time_us":3813,"apply.run_wall_time_us":51068,"num_ops":7,"prepare.queue_time_us":181987,"prepare.run_cpu_time_us":21563,"prepare.run_wall_time_us":340936,"raft.queue_time_us":228386,"raft.run_cpu_time_us":10249,"raft.run_wall_time_us":102115,"replication_time_us":456818,"thread_start_us":454028,"threads_started":4,"wal-append.queue_time_us":193707}]]}
I20260709 12:25:39.445919  6115 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:39.445966  6118 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:39.389657  5864 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:39.499913  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:39.500856  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:39.500581  5864 catalog_manager.cc:5697] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:25:39.506208  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 56817.8us
I20260709 12:25:39.507005  6006 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:39.511139  6035 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:25:39.491819 10067 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.513609  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:39.513499  6081 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:39.447727 10023 raft_consensus.cc:3055] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:39.519256  6042 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:39.523167  6109 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:25:39.521543  6042 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:39.524302  6044 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.553174  6081 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:39.531509  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:39.502367  5864 catalog_manager.cc:5697] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 6 to 8, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 8 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:39.555059  5864 catalog_manager.cc:5697] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 5 to 7, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 7 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:39.556680  5864 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:39.504542  9872 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:39.555388  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:39.390861  9827 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.559309  5864 catalog_manager.cc:5697] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:39.510937 10035 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:25:39.561265  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.552119  6042 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.582921  6042 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:39.571388  6044 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:39.600268  5864 catalog_manager.cc:5697] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 8 to 9, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 9 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:39.524993 10013 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:39.525205 10037 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:39.499707  9892 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.068s
I20260709 12:25:39.521766 10036 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:25:39.615199  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.521469 10023 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:39.620620 10037 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:39.621430 10023 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.624032  9703 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.627753 10067 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:25:39.630416 10023 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:39.515726 10012 consensus_queue.cc:1059] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.083s
I20260709 12:25:39.633966 10012 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:39.634377 10012 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:39.635306 10012 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 8.4, Last appended by leader: 4, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:39.636722 10012 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:39.640141  9827 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:39.566546  9913 consensus_queue.cc:1059] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.074s
I20260709 12:25:39.558238 10022 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:39.514436 10038 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.086s
I20260709 12:25:39.556423 10041 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:39.646437  6646 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3.
I20260709 12:25:39.652158  6649 raft_consensus.cc:2368] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10.
I20260709 12:25:39.659564  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
W20260709 12:25:39.661226  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 218730us
I20260709 12:25:39.664179  5932 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:39.669108  5932 leader_election.cc:400] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8.
I20260709 12:25:39.670219  5932 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:39.644259 10050 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:39.668157  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:39.671818  6042 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 11. (index mismatch)
I20260709 12:25:39.671943  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:39.675616  5932 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:39.662103 10041 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:39.689707 10050 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:39.666702 10036 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:39.689659  9703 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:39.668829  9915 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:39.710194  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 262304us
I20260709 12:25:39.723404  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:39.723764  6643 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
W20260709 12:25:39.727113  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.728395  6110 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.709854  9703 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:39.731151  9703 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:39.731643  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:39.732283  6649 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:39.732591  6649 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:39.733367  6649 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.734678 10041 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:39.719457  9827 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:39.738919 10050 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.685434 10010 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:25:39.743458  6649 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:39.748116  6110 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:39.728281 10071 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.114s	user 0.001s	sys 0.000s
I20260709 12:25:39.743623  9915 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:39.768049  9915 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.771394 10076 tablet_replica.cc:333] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:25:39.753365 10057 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:39.770401  9915 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:39.775868  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.734169 10036 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 5.3, Last appended by leader: 3, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:39.787537  6649 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:39.788785  6084 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:25:39.792181  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 236856us
W20260709 12:25:39.793704  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 225426us
I20260709 12:25:39.791108  9728 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:39.803180 10028 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:39.807848  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:39.818728  9634 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:39.836653  9634 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:39.810381 10076 raft_consensus.cc:2243] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Raft consensus shutting down.
I20260709 12:25:39.809069  9728 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:39.826926 10028 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:39.844733  9703 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:39.837678  9634 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.847111  9634 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:39.848313  9728 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.852948 10076 raft_consensus.cc:2272] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Raft consensus is shut down!
I20260709 12:25:39.864818 10076 ts_tablet_manager.cc:1916] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:25:39.862885 10028 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:39.871481 10028 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:39.885740  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:39.910321 10074 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.183s	user 0.003s	sys 0.000s
I20260709 12:25:39.911648 10083 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:39.912213 10083 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:39.913964  6037 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:39.914347  6037 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:39.915803  6037 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:39.917302  6037 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:39.917459  6649 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:39.920544 10080 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:39.924203  6037 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:25:39.924784 10031 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:25:39.926954 10083 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:39.934309  6037 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
W20260709 12:25:39.939019  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.940209 10028 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
W20260709 12:25:39.951527  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:39.957573 10076 ts_tablet_manager.cc:1929] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 5.6
I20260709 12:25:39.958209 10076 log.cc:1199] T ec584257f9db451c965f6b092aa9069c P 0557a7246c8945b99e5215c99d4ddf9c: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/wals/ec584257f9db451c965f6b092aa9069c
I20260709 12:25:40.007962 10028 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:40.008558 10028 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.011900  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.015089  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.015774 10028 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:40.020717 10028 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:40.034399 10028 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.043594 10028 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:40.045826  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.049412 10013 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:40.050031 10013 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:40.062305  6009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.003s
W20260709 12:25:40.063014  6009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.509s	user 0.007s	sys 0.003s
W20260709 12:25:40.063609  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 532127us
I20260709 12:25:40.064986  6009 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.066769  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:40.073184  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.074538  6009 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.058494 10047 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:40.083148  6009 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.071496 10031 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:40.084622  6009 leader_election.cc:400] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9.
I20260709 12:25:40.085021  6009 leader_election.cc:403] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:40.085901  6110 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:40.075587 10012 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:40.076773 10079 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:40.084509  9912 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:40.088186 10012 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:40.081950 10045 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:40.107743  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:40.108340  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.108825  6643 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:40.110330  6084 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:40.111158 10028 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:40.111585 10028 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:40.111984 10028 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.111786  9912 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:40.118891  9830 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.120525 10079 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:25:40.122035  9830 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.124161 10079 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:40.124536 10079 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:40.110250 10031 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:25:40.125321  9830 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:40.126806  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.088027 10013 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:40.127714  9912 raft_consensus.cc:3055] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:40.086437 10047 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.128134  9912 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:40.129027  9912 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.129470 10028 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.131692  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.125349 10079 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.130308  9912 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.134147 10079 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:40.109421 10012 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:40.127733  6044 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:40.145211  6082 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:40.146278  9830 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:40.147140  6040 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 5. Preceding OpId from leader: term: 7 index: 5. (term mismatch)
I20260709 12:25:40.147555  6040 pending_rounds.cc:85] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 4
I20260709 12:25:40.147778  6040 pending_rounds.cc:107] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 6.5
W20260709 12:25:40.147888  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 435198us
I20260709 12:25:40.149123  5934 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:40.149442  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:40.150074  6042 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:40.152664  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 477087us
I20260709 12:25:40.155401  6038 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:40.155759  6009 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.148125  6040 raft_consensus.cc:2889] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:40.157302  6009 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.157341  5932 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.129928 10047 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:40.164871  6009 leader_election.cc:400] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10.
I20260709 12:25:40.167708  6009 leader_election.cc:403] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:40.165109  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:40.168941  6009 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.169411  5932 leader_election.cc:400] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8.
W20260709 12:25:40.177910  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.192134  5932 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.193363  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:40.194288  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:40.194666  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:40.195185  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:40.197008  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:40.197305  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:40.197746  6643 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:40.197897  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:40.199388  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:40.158433 10045 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:40.200362  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:40.199412  6648 raft_consensus.cc:2393] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 13: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:40.201798  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.147143  9830 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.213967  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:40.203747  6042 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:40.205659  6114 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:40.214972  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:40.215106  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.217669  6651 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:40.217928  6115 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:25:40.202832  5932 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:40.212002  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.168448 10044 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.238417  6651 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:40.158383 10087 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:40.213865 10045 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:40.244539 10045 raft_consensus.cc:697] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:40.245493 10045 consensus_queue.cc:237] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.249279 10077 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:40.207147  9915 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:40.222052  9830 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:40.199352  9703 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:40.222632  6608 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.223157  9731 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:40.168829 10085 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:40.164484 10031 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:40.162983 10080 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.058s
I20260709 12:25:40.261941 10031 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:40.199321 10078 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.028s
I20260709 12:25:40.262881 10031 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.164059 10036 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.067s
I20260709 12:25:40.221567 10020 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:40.168464 10028 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:40.209277 10038 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.168716 10086 consensus_queue.cc:1059] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 6.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.070s
W20260709 12:25:40.240171  5933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.554s	user 0.013s	sys 0.005s
W20260709 12:25:40.270869  5933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.014s	sys 0.005s
W20260709 12:25:40.272007  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 49456.1us
I20260709 12:25:40.273291  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.256755  6038 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 4. Preceding OpId from leader: term: 9 index: 4. (term mismatch)
I20260709 12:25:40.263311 10078 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:40.265735 10044 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10.
I20260709 12:25:40.229740 10012 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:40.268520 10075 log.cc:927] Time spent T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.535s	user 0.001s	sys 0.002s
I20260709 12:25:40.274559  6038 pending_rounds.cc:85] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 3
I20260709 12:25:40.283787  6038 pending_rounds.cc:107] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 8.4
I20260709 12:25:40.284606  6038 raft_consensus.cc:2889] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:40.276189  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.286715  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.275447 10020 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:40.280491  9703 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.274765 10078 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:40.296644  6608 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.282225 10010 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:40.291662  9802 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:40.271804 10038 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.289098  9731 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:40.307173 10085 raft_consensus.cc:3055] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:40.290843 10047 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.023s
W20260709 12:25:40.322082  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 153217us
I20260709 12:25:40.325837  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:40.328606  6115 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:40.323557  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:40.333760  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:40.314713  9996 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:40.299674  9703 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.340631  9703 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:40.343888  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.344806  9830 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.346064  6112 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:40.346822 10078 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.348526 10078 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:40.310281 10012 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:40.353753  5934 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:40.354946  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.355693 10057 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:40.356262 10057 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:40.356622 10005 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:40.357371 10057 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.331321 10085 raft_consensus.cc:740] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:40.356688  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.358974 10077 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:40.359043 10085 consensus_queue.cc:260] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.359978 10032 raft_consensus.cc:3055] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:40.360226  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.360499 10085 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:40.361007 10077 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:40.361498 10077 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:40.362331 10077 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.364733 10038 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:40.366947  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:40.367213  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.367643  6115 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:40.368897  6611 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:40.370814  9802 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:40.371201  9802 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.371264 10012 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:40.371613  9802 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:40.371892  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:40.371807 10012 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.373999 10012 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:40.376973  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.374011  6009 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:40.384085  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 181324us
I20260709 12:25:40.390347  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.391705 10020 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:40.392863  6041 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.780s	user 0.002s	sys 0.010s
W20260709 12:25:40.393282  6041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.781s	user 0.002s	sys 0.010s
I20260709 12:25:40.393354  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.367888 10032 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:25:40.394944  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.399719  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:40.400209  6114 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 6 index: 6. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:40.400951  5964 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:40.401784  6009 leader_election.cc:400] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9.
I20260709 12:25:40.403223  6009 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.404021 10079 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:40.405982  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.394924  9974 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9.
I20260709 12:25:40.406854 10079 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:40.408313  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.409076 10079 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:40.410269  6009 leader_election.cc:400] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10.
I20260709 12:25:40.406131  5965 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:40.410983  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:40.411335 10045 consensus_queue.cc:1059] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:40.411762  9830 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:40.396481 10031 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:40.412600 10031 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.413085  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:40.413911  6041 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:40.415863  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.384094 10087 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:40.383419 10107 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:40.397783 10020 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:40.426837 10105 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:40.429399  9802 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.430624 10038 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:40.431721  9996 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:40.432616  6041 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:40.413596 10044 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:40.414009 10106 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:40.412844 10032 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.439378  6009 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.441630  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:40.442214  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.442555  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.442914  6043 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:40.442749  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.443398  6039 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 4.
I20260709 12:25:40.444175  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:40.444759  6039 raft_consensus.cc:2368] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11.
I20260709 12:25:40.445416  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.450950  9597 raft_consensus.cc:3055] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:40.451304  9597 raft_consensus.cc:740] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:40.451900  9597 consensus_queue.cc:260] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.452725  9597 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:40.453106  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:40.453846  6115 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 7: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:40.453958 10106 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.434432  9916 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:25:40.456243 10106 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:40.456642  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.457867  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.458534 10045 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:40.459103 10045 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:40.434022 10012 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:40.460167  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.441926  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:40.470691  6036 raft_consensus.cc:2393] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 7: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:40.438163  9703 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:25:40.446360  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.472316  6043 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:40.474325  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:40.487824  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.488310  5964 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:40.489784  6111 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:40.474794 10077 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.475032  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:40.470433 10087 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.476143  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.478971  5960 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:40.403738 10108 consensus_queue.cc:1059] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:25:40.479745  5967 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:40.481024  5962 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 7. (index mismatch)
I20260709 12:25:40.481801  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:40.484139 10045 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:40.485105  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.436165 10107 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:40.485211  9915 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.504345  5964 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:40.485605  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.458987 10032 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:40.470299  9912 consensus_queue.cc:1175] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" responder_term: 10 status { last_received { term: 9 index: 6 } last_committed_idx: 6 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:25:40.490710  6114 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 12: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:40.517655  9802 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:40.518651  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:40.519239  6109 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:40.491245  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.493956  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.524294  6040 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:40.525507  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.526113  6040 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:40.527604  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:40.528225  5963 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:40.528782 10081 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.529079  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:40.530347 10081 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.532560 10081 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:40.495172 10077 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.534917 10077 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:40.530158  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:40.515520  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:40.532514  6040 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:40.490638  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.512732  6044 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:25:40.513361  9915 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.545971  9915 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:40.537338  6609 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.512300  9996 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:25:40.548501  9996 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:40.547434  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:40.537489  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:40.546905  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:40.551307  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:40.551455  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:40.535835  6109 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:40.538331  6044 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
W20260709 12:25:40.539829  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 54298us
I20260709 12:25:40.541617  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:40.533342  5914 auto_rebalancer.cc:629] Failed to schedule move for tablet 42702625c5a04990a24ae81a2dede920: Illegal state: Replica 0069e2ba1f02412e8e1d6c20a1fb510f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:40.555459  6611 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:40.557865  5932 leader_election.cc:400] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11.
I20260709 12:25:40.558871  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:40.497620 10020 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.559363  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:40.559489  5962 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:40.563978  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:40.537104  9703 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:40.564945  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:40.561491  9802 consensus_queue.cc:1059] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:25:40.561056  9891 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:25:40.567224 10107 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.566310  5963 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:40.570909  9915 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.570736  9703 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.572911  9703 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:40.573357  5963 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:40.561285  9916 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:25:40.576987  5963 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:40.575635  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:40.580847  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:40.581209  5962 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:40.582973  5963 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 3. Preceding OpId from leader: term: 9 index: 4. (index mismatch)
I20260709 12:25:40.584811  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:40.585872  5964 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:40.586678  5932 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.587298  5962 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:40.588373  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.591497  5932 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.593394  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.575755 10031 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:40.594331 10105 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.575482 10020 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.575954  9916 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:40.587482 10086 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:40.587489  9703 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:40.587625 10019 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:40.595561  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:40.596217  6040 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
W20260709 12:25:40.610162  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 61220.3us
W20260709 12:25:40.601112  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.590260 10030 raft_consensus.cc:3055] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:40.592365 10108 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:40.605046  6646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50454 (request call id 1055) took 1254 ms. Trace:
I20260709 12:25:40.607355  5968 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:40.598162 10087 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:40.602350  9916 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:40.620373  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:40.626155 10057 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:40.622303  9703 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:40.618110  6082 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:40.594048 10044 consensus_queue.cc:1059] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.020s
I20260709 12:25:40.618701  6646 rpcz_store.cc:276] 0709 12:25:39.346804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.346928 (+   124us) service_pool.cc:224] Handling call
0709 12:25:40.601043 (+1254115us) spinlock_profiling.cc:243] Waited 24.9 ms on lock 0x7b540060b154. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:40.601165 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":57169152}
I20260709 12:25:40.611416 10077 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:40.645615  9913 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:40.667239 10077 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:40.667462  9913 raft_consensus.cc:697] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:40.667760 10077 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:40.668463  9913 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.671928 10048 consensus_queue.cc:1059] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:40.673509  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:40.649932 10020 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:40.650209 10119 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:25:40.654870  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:40.676173  5968 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:25:40.618718 10019 raft_consensus.cc:697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:40.675639 10116 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:40.673767  9872 raft_consensus.cc:3055] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:40.692333 10116 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.692591 10019 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.613348 10030 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:40.694681 10105 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:40.695176 10030 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.659417  6035 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:40.674158  6112 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
W20260709 12:25:40.696210  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 51709.3us
W20260709 12:25:40.660064 10114 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.085s	user 0.003s	sys 0.000s
I20260709 12:25:40.697091  5932 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:40.694761 10116 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:40.699110  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:40.700456  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:40.698424  5932 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:40.654301  9915 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:40.714552  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.673467 10048 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:25:40.696597  9872 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:40.702427  9703 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:40.720760  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.708770 10020 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:40.730050  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.723186  6006 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:40.732244  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.702586 10078 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:25:40.736330  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:40.735721  6081 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.740989  6081 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.723933  9634 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:40.744496  6081 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:40.729784 10020 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:40.729661 10030 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:40.718250 10047 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.018s
I20260709 12:25:40.731536  9830 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:25:40.755254 10118 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.003s
I20260709 12:25:40.737557  9731 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:40.756531  9731 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.757228 10079 raft_consensus.cc:3055] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:40.757652 10079 raft_consensus.cc:740] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:40.735978  9916 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.758836 10036 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:40.726626 10081 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:25:40.759563 10081 consensus_queue.cc:1243] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer f1bb8e63c2b448cdafd51f05d277c741 log is divergent from this leader: its last log entry 11.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:40.761512 10086 raft_consensus.cc:3055] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:40.761931 10086 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:40.745137 10023 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:40.762823 10086 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.764081 10086 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:40.755072  9872 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.737743 10107 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:25:40.770781  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:40.745657 10080 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:40.748474 10012 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:40.763159 10031 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:40.784410 10031 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:40.785356 10031 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.786616 10031 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:40.752221 10020 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:40.790930 10041 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.053s	user 0.006s	sys 0.016s
W20260709 12:25:40.795467 10041 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.058s	user 0.006s	sys 0.016s
I20260709 12:25:40.790972 10107 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:40.799131 10107 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.795594  9634 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.016s
I20260709 12:25:40.815531  9731 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:40.815976 10036 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:40.821168  9916 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:40.823247  9872 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:40.828392 10077 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.839536 10108 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:40.764824 10079 consensus_queue.cc:260] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:40.842154 10079 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:40.796190 10012 raft_consensus.cc:697] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:42.473572 10012 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.876418 10077 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.476689 10077 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.477154 10077 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:41.094520  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:41.356482  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:42.482084  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:41.569967  5934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.856s	user 0.009s	sys 0.019s
W20260709 12:25:42.483111  5934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.770s	user 0.009s	sys 0.020s
I20260709 12:25:42.485190  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2141) took 2006 ms. Trace:
I20260709 12:25:41.589875 10132 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.485605  5959 rpcz_store.cc:276] 0709 12:25:40.478899 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.479475 (+   576us) service_pool.cc:224] Handling call
0709 12:25:40.479742 (+   267us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:40.560211 (+ 80469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.560244 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:40.560287 (+    43us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:40.560314 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:42.484930 (+1924616us) spinlock_profiling.cc:243] Waited 55.2 ms on lock 0x7b54001def54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:42.484981 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:42.485129 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24912,"raft.queue_time_us":25310,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":108,"spinlock_wait_cycles":126984448}
I20260709 12:25:42.486757 10132 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.488847 10132 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:41.637636  6040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.906s	user 0.008s	sys 0.010s
W20260709 12:25:42.489929  6040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.760s	user 0.009s	sys 0.011s
I20260709 12:25:42.490720  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2264) took 1771 ms. Trace:
I20260709 12:25:42.491035  6040 rpcz_store.cc:276] 0709 12:25:40.719664 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.719839 (+   175us) service_pool.cc:224] Handling call
0709 12:25:40.728994 (+  9155us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:40.729315 (+   321us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.729342 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:40.729782 (+   440us) log.cc:844] Serialized 26 byte log entry
0709 12:25:42.490332 (+1760550us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:42.490373 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:42.490440 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:42.490519 (+    79us) raft_consensus.cc:1685] finished
0709 12:25:42.490532 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:42.490664 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":882,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":5521,"thread_start_us":1760162,"threads_started":1,"wal-append.queue_time_us":1010738}
I20260709 12:25:41.678429 10105 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.493252 10105 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:42.494541 10030 consensus_meta.cc:287] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 1.741s	user 0.013s	sys 0.019s
W20260709 12:25:41.739246  6009 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.013s	sys 0.011s
W20260709 12:25:42.495805  6009 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 1.303s	user 0.014s	sys 0.011s
W20260709 12:25:42.496126  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 1.30323e+06us
W20260709 12:25:42.497649  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.497807  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:41.742394  6006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.010s	user 0.011s	sys 0.036s
W20260709 12:25:42.498663  6006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.766s	user 0.011s	sys 0.037s
W20260709 12:25:42.498957  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 1.77572e+06us
I20260709 12:25:42.499065  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:41.741019 10086 consensus_meta.cc:287] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.976s	user 0.005s	sys 0.007s
I20260709 12:25:42.500296  5932 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:42.501165 10086 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:42.501854 10086 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:41.747273 10107 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.945s	user 0.003s	sys 0.013s
W20260709 12:25:42.502566 10107 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.700s	user 0.003s	sys 0.013s
W20260709 12:25:41.753118 10087 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.999s	user 0.002s	sys 0.018s
I20260709 12:25:41.802351 10005 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:41.806849  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 1338) took 1322 ms. Trace:
I20260709 12:25:42.503322  6043 rpcz_store.cc:276] 0709 12:25:40.484496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.529054 (+ 44558us) service_pool.cc:224] Handling call
0709 12:25:40.529346 (+   292us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:40.533821 (+  4475us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:40.533869 (+    48us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:40.534345 (+   476us) log.cc:844] Serialized 26 byte log entry
0709 12:25:40.592567 (+ 58222us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:40.601800 (+  9233us) log.cc:844] Serialized 14 byte log entry
0709 12:25:40.605078 (+  3278us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:41.806315 (+1201237us) spinlock_profiling.cc:243] Waited 4.14 ms on lock 0x7b5400171454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:41.806377 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:41.806428 (+    51us) raft_consensus.cc:1685] finished
0709 12:25:41.806557 (+   129us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:41.806740 (+   183us) inbound_call.cc:177] Queueing success response
0709 12:25:42.461180 (+654440us) spinlock_profiling.cc:243] Waited 4.5 ms on lock 0x7b1800229660. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df67522 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
Metrics: {"mutex_wait_us":3018,"prepare.queue_time_us":9526,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":46,"raft.queue_time_us":4738,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":2991,"spinlock_wait_cycles":19869696,"thread_start_us":57862,"threads_started":1,"wal-append.queue_time_us":76234,"wal-append.run_cpu_time_us":1990,"wal-append.run_wall_time_us":1036560}
W20260709 12:25:41.922428  6065 debug-util.cc:398] Leaking SignalData structure 0x7b080016d640 after lost signal to thread 4824
W20260709 12:25:42.503177 10087 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.753s	user 0.003s	sys 0.018s
W20260709 12:25:42.506032  6065 debug-util.cc:398] Leaking SignalData structure 0x7b08002f9da0 after lost signal to thread 5900
W20260709 12:25:42.507275  6065 debug-util.cc:398] Leaking SignalData structure 0x7b0800165a00 after lost signal to thread 5992
W20260709 12:25:42.507536  6065 debug-util.cc:398] Leaking SignalData structure 0x7b08001659e0 after lost signal to thread 5993
I20260709 12:25:42.508195 10105 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.508652 10081 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.509191 10081 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.511250 10081 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.040062 10116 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.518841 10116 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.520752  9912 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:42.520839 10116 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.251423 10118 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:42.261207  9872 consensus_meta.cc:287] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 1.437s	user 0.021s	sys 0.003s
I20260709 12:25:42.338234  9703 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.521255  9912 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.521556 10118 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.521726  9703 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.523661  9703 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.365273 10078 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.524365 10078 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.524940  9912 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.525141 10044 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.525475  9912 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.525597 10044 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.526271 10078 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.526593 10116 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.523685 10118 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.390332  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.527699 10044 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.390772  5965 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:42.528280 10044 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:42.528513 10005 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:42.390021  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.396849  9915 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:42.398046  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 1.59241e+06us
I20260709 12:25:42.529573  5967 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:25:42.529613  9915 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.531420 10081 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:42.531940 10081 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.405552  5864 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 204) took 7415 ms. Trace:
I20260709 12:25:42.424904  9731 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.533615 10077 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:42.534277 10031 consensus_meta.cc:287] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 1.747s	user 0.021s	sys 0.010s
I20260709 12:25:42.534818 10031 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.445636 10142 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.535269 10031 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.535483  5965 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:42.535933 10142 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.537321 10031 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.537987 10142 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.529357 10005 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:42.444212  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 1.74363e+06us
I20260709 12:25:42.538976 10005 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:42.459821 10144 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.540692 10144 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.442358 10045 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.460742 10143 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:42.470741 10145 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.542824 10144 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.460327  9916 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.543143 10143 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.545360 10143 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.028816 10137 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.545991 10137 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.546636  9731 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.513589  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2266) took 1785 ms. Trace:
I20260709 12:25:42.515195 10151 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:42.547994 10151 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.527093 10116 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.542735 10045 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.549063  9731 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.550160 10116 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.391666  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.552199  9916 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:40.403719  5851 catalog_manager.cc:5028] TS 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): tablet ec584257f9db451c965f6b092aa9069c (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
W20260709 12:25:42.553231  5851 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 2.15733e+06us
I20260709 12:25:42.553460 10081 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.554008 10081 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:42.554195 10116 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.554534 10081 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.555469 10116 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.556735 10081 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.557240 10081 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.557623 10116 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.557782 10081 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.547816  6035 rpcz_store.cc:276] 0709 12:25:40.728185 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.728386 (+   201us) service_pool.cc:224] Handling call
0709 12:25:42.512919 (+1784533us) spinlock_profiling.cc:243] Waited 1.72 ms on lock 0x7b5800124298. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482602dfc0 00007f4826018929 00007f48260183d2 00007f481f58fbd4
0709 12:25:42.513117 (+   198us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:42.513290 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:42.513313 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:42.513353 (+    40us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:42.513380 (+    27us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:42.513429 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:42.513527 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3945728}
I20260709 12:25:42.552219 10155 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:42.447328 10057 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.543198 10145 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.475332 10146 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.486246 10147 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.548434 10137 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.531678  9915 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.550653 10045 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.554378  9916 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.532691  5864 rpcz_store.cc:276] 0709 12:25:35.003638 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:37.345826 (+2342188us) service_pool.cc:224] Handling call
0709 12:25:40.120499 (+2774673us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:40.120529 (+    30us) write_op.cc:454] Released schema lock
0709 12:25:42.405477 (+2284948us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:39.844400 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:39.844958 (+   558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:39.844996 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:25:39.845013 (+    17us) tablet.cc:662] Decoding operations
0709 12:25:39.875021 (+ 30008us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:39.875108 (+    87us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:39.875140 (+    32us) tablet.cc:685] Acquiring locks for 7 operations
0709 12:25:39.875736 (+   596us) tablet.cc:701] Row locks acquired
0709 12:25:39.875756 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:25:39.875913 (+   157us) write_op.cc:270] Start()
0709 12:25:39.876036 (+   123us) write_op.cc:276] Timestamp: P: 1783599939875861 usec, L: 0
0709 12:25:39.876059 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:25:39.886599 (+ 10540us) log.cc:844] Serialized 2814 byte log entry
0709 12:25:39.891843 (+  5244us) op_driver.cc:464] REPLICATION: finished
0709 12:25:39.933575 (+ 41732us) write_op.cc:301] APPLY: starting
0709 12:25:39.949943 (+ 16368us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:39.950600 (+   657us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:39.950717 (+   117us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:39.951373 (+   656us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:39.951602 (+   229us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=14
0709 12:25:39.951645 (+    43us) write_op.cc:312] APPLY: finished
0709 12:25:39.951901 (+   256us) log.cc:844] Serialized 59 byte log entry
0709 12:25:39.952087 (+   186us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:39.952204 (+   117us) write_op.cc:454] Released schema lock
0709 12:25:39.952250 (+    46us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":187375,"reported_tablets":16,"child_traces":[["op",{"apply.queue_time_us":41439,"apply.run_cpu_time_us":2900,"apply.run_wall_time_us":57973,"num_ops":7,"prepare.queue_time_us":123467,"prepare.run_cpu_time_us":4033,"prepare.run_wall_time_us":45385,"replication_time_us":14378,"thread_start_us":447809,"threads_started":2}]]}
I20260709 12:25:42.569494 10145 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.525913  9912 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.551971 10151 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:42.573807  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 73588.8us
I20260709 12:25:42.558279 10116 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.581283  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:42.588399  5965 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:42.591809  6040 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:42.592561  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:42.593554  6036 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:42.589017 10045 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.574863 10019 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.578058  9915 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:42.598701  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.598968  5960 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:42.599543  6037 raft_consensus.cc:2410] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 10 because replica has last-logged OpId of term: 9 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 3.
I20260709 12:25:42.590001 10137 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.589673 10151 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.592190  9916 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.602519  5967 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:42.592835 10143 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.595590 10077 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.592471 10158 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.570755 10057 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.560029 10155 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.609038  9916 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.571225 10044 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.612324  9966 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.612483 10158 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.612869  9966 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.613610  9916 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.608741 10151 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:42.614552  5914 auto_rebalancer.cc:629] Failed to schedule move for tablet 1c1322bdafce4b389254f08a59254d2e: Illegal state: Replica 0557a7246c8945b99e5215c99d4ddf9c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 10 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:42.596622 10045 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.603461  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.606676  9912 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.606546 10137 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.615950 10151 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.608018 10157 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.609887  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.596426 10142 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.603193  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.593132 10116 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.572299 10146 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.572441 10147 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.611037  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.630228 10137 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.629299 10158 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.630827  6037 raft_consensus.cc:2393] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:42.632426 10146 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.616866 10057 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.634356 10044 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.601418 10019 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.635114  9912 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.619592  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.620689  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.635673  9912 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.621006  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:42.636662  6065 debug-util.cc:398] Leaking SignalData structure 0x7b0800083160 after lost signal to thread 6068
I20260709 12:25:42.636834  6044 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:42.618515 10143 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.622136  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.637766  6042 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:42.622413  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.638754  6039 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
W20260709 12:25:42.639161  6065 debug-util.cc:398] Leaking SignalData structure 0x7b0800083240 after lost signal to thread 6069
W20260709 12:25:42.607885 10020 consensus_meta.cc:287] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 1.805s	user 0.005s	sys 0.028s
I20260709 12:25:42.626783  5959 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:42.617142 10030 consensus_queue.cc:1059] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 5.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.026s
I20260709 12:25:42.624667  6035 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:42.624239 10155 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.629380 10151 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.629594 10142 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.629269 10153 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:42.636307 10019 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.614965 10081 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.637697  9912 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.619093  5965 raft_consensus.cc:2393] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:42.640120  5968 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:42.641291  6043 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:42.639505 10147 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.610946  9731 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.627537 10157 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.657646  9731 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.658507 10045 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.653892 10151 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.659301 10157 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:42.659788  9731 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:42.656229 10137 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.660666 10137 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.660956 10151 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.662714 10137 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.654155  6036 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:42.663691  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:42.664579 10148 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:42.664717  5932 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:42.611076 10012 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:42.634774  9966 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.650203 10019 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:25:42.650938 10142 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.651139  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:42.651515 10153 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.675308 10153 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.675978 10019 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:42.676412 10019 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.676776 10019 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:42.646888 10020 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.652325 10163 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:42.678889 10163 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.652907 10155 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:42.653514 10158 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:42.655542  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:42.638931 10143 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.656085 10044 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.614698 10077 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.666795  5932 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:42.665041 10148 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.670614 10087 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:42.679489 10020 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.662683 10116 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.657076 10031 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.652484  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.686997  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.688467  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:42.693015  6006 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:42.693826  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.707333  5966 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:42.708084  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:42.710058  5965 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:42.712380  6608 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:42.712539  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:42.714172  6006 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:42.720016  6647 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:42.720449  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:42.721117  6646 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:42.722728  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:42.723344  6647 raft_consensus.cc:3055] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:42.723623  6647 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:42.702945 10079 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:42.703897 10030 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.728507  6650 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:42.729278  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:42.704311 10157 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.734313  5966 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:25:42.704828 10148 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:42.755790  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.705979 10087 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:42.726747 10149 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:42.716820 10143 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:42.766764  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.768982  6642 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:25:42.769443  5967 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:42.730728  6647 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.768566  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.770984  6647 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:42.771203  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.749971  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.750234  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:42.772423  5966 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:42.752152  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.741787 10161 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.727980 10116 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:42.755306  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.698740 10158 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.698520 10155 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.729357 10081 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:42.694319 10012 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.753515  6646 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:42.727867 10151 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:42.759277  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.759668  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.781759  6651 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:25:42.750607  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.703722 10044 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.762531  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.786710  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.749770  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.764755  9966 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.716565 10031 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.745002 10150 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:42.730089 10079 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:42.730708 10137 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:25:42.745999 10030 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.755548 10142 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.745115 10153 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.022s
I20260709 12:25:42.774772  5963 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:42.754794  6645 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:42.762053 10087 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:42.778931  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.780174  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.801487  6642 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:42.801522  5967 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:42.762398 10149 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.782990  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:42.802928  6646 raft_consensus.cc:2376] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 3. Re-sending same reply.
I20260709 12:25:42.803088  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.785550  6647 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:42.774986 10143 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:42.786285 10020 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.776588  9731 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:25:42.790947  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 125207us
I20260709 12:25:42.792167  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.793416  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:42.794094  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.795202  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.811830  6644 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:42.755427 10157 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.812112  6650 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:42.815654  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:42.797354 10019 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.798076 10079 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:42.800420  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.794898  9966 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.800122 10150 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:42.820650  6009 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:42.786446 10151 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:42.805052  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:42.812150  6651 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:42.781149  9912 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.021s
I20260709 12:25:42.813145  9731 raft_consensus.cc:697] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:42.814734 10030 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.827351  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.827744 10147 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:42.828164 10147 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.828514 10147 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:42.831310  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.831902  5960 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:42.821950 10166 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:42.833133 10166 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.833559 10166 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:42.833909  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.834209  9830 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:42.835713  9966 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:42.836867  5854 tablet_replica.cc:1411] Time spent flushing the Log queue took a long time: real 0.379s	user 0.000s	sys 0.000s
I20260709 12:25:42.818048 10005 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:25:42.839704 10005 raft_consensus.cc:697] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:42.841091 10082 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.841595 10082 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.843116 10032 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:42.843487 10032 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:42.843664 10082 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:42.844141 10082 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.840662 10080 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.844686  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.845273  5968 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:42.845095 10080 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.846354 10036 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:42.832644  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.811237 10143 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:42.803627  5967 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:42.820930  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.821964 10153 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:42.851392  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.854256  5962 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:42.853672  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.853241  6648 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:42.823458  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:42.824201  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.805361 10149 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:42.846031 10023 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:42.846104  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.850769  5960 raft_consensus.cc:2410] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:42.823606 10151 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:42.863461  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 333611us
I20260709 12:25:42.818032 10157 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:42.801270 10142 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.855270  5967 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:25:42.777967 10161 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.856055  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2524) took 2221 ms. Trace:
I20260709 12:25:42.856727  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.857807  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.858857  5963 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:42.857883  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.878067  6651 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:42.879089  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.879671  6651 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:42.880528  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:42.881614  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.882284  6651 raft_consensus.cc:2393] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 3: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:42.883564  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.884817  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.818255  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:42.889053  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.890087  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.890782  6645 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:42.851128  9826 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:42.891767  9826 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.893154  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.894345  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.894920  6645 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:42.852233 10044 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.858608  9597 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.846881 10036 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.896647  6651 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:25:42.886874  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.888664  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.844548 10082 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.897733 10036 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.898602 10036 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.899055 10036 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.899492 10082 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.859445  6009 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:42.896494  9597 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.900532  6651 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 5 index: 7. (index mismatch)
I20260709 12:25:42.901643  9597 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.888159  6039 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:42.902664 10044 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:25:42.900030 10082 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:42.903453 10044 raft_consensus.cc:697] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:42.903611 10082 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.902967 10179 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:42.904448 10044 consensus_queue.cc:237] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.905802 10082 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:42.905591 10179 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.908432  6646 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:42.908720 10179 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:42.909906  6646 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:25:42.909983  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 50589.3us
I20260709 12:25:42.910920  6009 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:42.847079 10080 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:42.874686  6111 rpcz_store.cc:276] 0709 12:25:40.630084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.645637 (+ 15553us) service_pool.cc:224] Handling call
0709 12:25:40.645946 (+   309us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:40.646112 (+   166us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:25:40.646314 (+   202us) log.cc:844] Serialized 14 byte log entry
0709 12:25:42.554141 (+1907827us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b180037e220. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481dee1c0a 00007f4827621219 00007f481df69a40 00007f481df644e4 00007f481df64455 00007f4824a4c3c7 00007f482105e9a7 00007f482106e0bf 00007f482106e038
0709 12:25:42.554348 (+   207us) log.cc:844] Serialized 14 byte log entry
0709 12:25:42.850723 (+296375us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:42.850776 (+    53us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:42.850830 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:42.850899 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:42.851024 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":336258,"prepare.queue_time_us":1845874,"prepare.run_cpu_time_us":56,"prepare.run_wall_time_us":57,"raft.queue_time_us":332513,"raft.run_cpu_time_us":256,"raft.run_wall_time_us":6588,"spinlock_wait_cycles":4260608,"thread_start_us":32548,"threads_started":1,"wal-append.queue_time_us":51167}
I20260709 12:25:42.856906 10153 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.853408  9872 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.815826 10020 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.919104  6646 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:42.920500  5965 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:42.925099  6646 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:25:42.920971  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.856364  9913 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.857743 10048 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.862771 10137 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:42.942693  6643 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:42.874965 10077 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:42.941810  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52489.3us
I20260709 12:25:42.947502  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.947777  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.953534  6043 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:42.948202  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.954954  6651 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:42.919314 10157 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:42.950856  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.951588  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.956929  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:42.959295  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:42.959826  6642 raft_consensus.cc:2376] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6. Re-sending same reply.
I20260709 12:25:42.870967 10023 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.925698 10153 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:42.967573  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:42.915637 10013 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.039s
I20260709 12:25:42.963637  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.840675 10005 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:42.957139  6035 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:25:42.969341  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:42.943200 10048 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:42.969236  9916 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:25:42.874109  9912 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.091s
I20260709 12:25:42.952442 10137 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:42.974316  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.952808 10116 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:42.986545  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:42.988031  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:42.990585  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 125922us
I20260709 12:25:42.860996  9731 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:42.996059  6065 debug-util.cc:398] Leaking SignalData structure 0x7b0800318700 after lost signal to thread 6142
W20260709 12:25:42.996428  6065 debug-util.cc:398] Leaking SignalData structure 0x7b080026e240 after lost signal to thread 6143
W20260709 12:25:42.997681  6065 debug-util.cc:398] Leaking SignalData structure 0x7b0800389e20 after lost signal to thread 6675
W20260709 12:25:42.997959  6065 debug-util.cc:398] Leaking SignalData structure 0x7b08002de300 after lost signal to thread 6676
I20260709 12:25:42.999264  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:43.003245  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:42.938961  9872 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.006958  6109 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:43.007530  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.022863  6113 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:43.007999  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.007550  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.024505  6110 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:43.008762  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.009819  6114 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:43.018546 10036 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.005893  6006 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:43.034159  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:42.970537 10155 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.020576  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:42.990172 10144 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:42.986078 10010 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.035697  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.035806  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:43.020421  5934 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:43.036415 10154 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:43.036866  9979 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 6 current term: 6 is higher.
I20260709 12:25:43.020941  6642 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:42.943370  9913 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:43.041290  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.050626  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:43.051229  6115 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:42.968887 10157 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.046392  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:42.994805 10116 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:42.995011 10137 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:43.051646  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:43.052409  6006 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:43.052692  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:43.055706  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 205989us
I20260709 12:25:43.021373  9915 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:43.064579  6112 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:43.060479  6006 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:43.062186  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 5 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.037840 10132 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:43.048770 10144 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.154011 10144 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:43.062302  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:43.154268  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:43.154806  5865 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 318) took 13546 ms (client timeout 15000 ms). Trace:
I20260709 12:25:43.045964 10082 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.049759 10154 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:43.156173  5934 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:43.049772  9830 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.154932  6115 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:43.158001  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.159480  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.175235  6118 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:25:43.160794  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.161888  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.058494 10145 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:43.184389  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.165019  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.042124  9597 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.034426 10080 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:25:43.152649 10132 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.058703 10118 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:25:43.155222  5865 rpcz_store.cc:269] 0709 12:25:29.491565 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:29.491883 (+   318us) service_pool.cc:224] Handling call
0709 12:25:29.890642 (+398759us) spinlock_profiling.cc:243] Waited 91.5 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:25:43.037687 (+13147045us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2246017,"reported_tablets":12,"spinlock_wait_cycles":210495360}
I20260709 12:25:43.170055  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.061080 10116 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:43.166159  6040 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:43.177201  6039 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:43.064730  9915 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:43.066880 10182 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.067243 10155 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:43.188536  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.190512  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.211047  6041 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 7: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:43.191708  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.192299  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.192212  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.101006 10044 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:43.194505  6109 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:43.060667  9912 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:43.202476  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.202479  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.165736 10146 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:25:43.055392 10010 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.245784  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.230422  6113 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:43.230317  6035 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:43.211696  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.183225  9916 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:43.245954  6037 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:25:43.248593  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.193529 10145 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.003723 10150 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.193418 10158 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.255558  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.206627 10132 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:43.168835 10082 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.271965  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:43.203269 10013 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:43.209923 10118 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.246914  9912 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:43.175349 10154 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:43.296478  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:43.209189 10177 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.230136  9915 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:43.230518 10155 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:43.226030 10019 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:43.265120  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.256726  9916 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.309893  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.203685 10045 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.061s
I20260709 12:25:43.199963  9830 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.249945 10189 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.312580  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:43.398844  6642 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:43.399830  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.366684 10028 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.370702  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:43.262670 10145 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:43.204525  9597 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.312767  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:43.313421  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:43.346264  6644 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:43.262001 10142 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:43.385679  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 193840us
I20260709 12:25:43.388542  6111 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:43.311728 10118 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:43.394353  9916 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:43.319747  9912 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:43.395102  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 239085us
I20260709 12:25:43.254284 10044 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:43.366250 10175 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:43.408751  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:43.430670  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 144815us
I20260709 12:25:43.245978 10182 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:43.432724  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.407614 10048 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:43.438620  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.390676 10177 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.441046 10177 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:43.442888 10190 log.cc:927] Time spent T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:25:43.443470 10197 consensus_queue.cc:1059] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:43.411482  6648 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
W20260709 12:25:43.420913  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:43.309300 10013 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:43.392343  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 326265us
I20260709 12:25:43.391603 10161 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:43.381569 10050 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:43.427721 10187 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.258s	user 0.001s	sys 0.001s
I20260709 12:25:43.428896  5934 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:43.483223 10197 raft_consensus.cc:3055] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:43.483428 10082 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.483784  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:43.484442 10032 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.485584 10197 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:43.432548  6110 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:43.486626 10163 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.487046 10010 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:43.489912 10012 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.492869  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.493121  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.496182  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.479764  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:43.497808  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:43.498940  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.499068  6006 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:43.484408  5967 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:43.500039  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:43.500910  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.408699 10023 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.392292 10080 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:25:43.425963 10185 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:43.390858 10155 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:43.458361 10157 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:43.465540  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:43.472944  6084 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:43.426625  9872 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.444789  6609 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:43.475198  6114 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:43.413407 10028 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.430970 10044 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:43.436573  9913 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:43.466732 10148 consensus_meta.cc:287] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.705s	user 0.007s	sys 0.002s
W20260709 12:25:43.482044 10181 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:25:43.508155 10045 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:43.518918 10163 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:43.509567  9915 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:43.510505 10154 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:43.511612 10020 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:25:43.435591 10175 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:43.637811 10079 consensus_meta.cc:287] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.790s	user 0.010s	sys 0.000s
I20260709 12:25:43.474316 10177 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.515820  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.516629  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:43.526575 10185 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:43.527287 10147 consensus_meta.cc:287] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.698s	user 0.007s	sys 0.002s
W20260709 12:25:43.510633 10166 consensus_meta.cc:287] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.677s	user 0.007s	sys 0.004s
I20260709 12:25:43.407089 10189 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.554666  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.519232  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:43.593528 10153 consensus_meta.cc:287] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.607s	user 0.004s	sys 0.006s
I20260709 12:25:43.652944 10153 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:43.595330  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 166714us
I20260709 12:25:43.663170  5934 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:43.663633 10146 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20260709 12:25:43.509567 10149 consensus_meta.cc:287] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.591s	user 0.001s	sys 0.006s
I20260709 12:25:43.664388 10146 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:43.664498 10149 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:43.652889 10189 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:43.653147 10191 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:43.666709 10149 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:43.599505  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 154873us
I20260709 12:25:43.667024 10191 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.667528  5959 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:43.514360 10118 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:43.668386 10151 consensus_meta.cc:287] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.747s	user 0.008s	sys 0.000s
I20260709 12:25:43.599969  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.669430  6113 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:25:43.603322  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 130468us
I20260709 12:25:43.608304 10193 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:43.507198 10012 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:43.606637 10157 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:43.601706 10077 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:43.607753 10087 consensus_meta.cc:287] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.791s	user 0.010s	sys 0.000s
I20260709 12:25:43.513356 10116 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.598520 10144 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:43.643383  9872 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:43.639815 10163 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:43.607363 10045 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:43.652375 10175 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.738272  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:43.739184  6115 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:43.649927 10079 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:43.658519 10177 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:43.748498 10177 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:43.749413 10188 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:43.659624 10153 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.661847 10155 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:43.702533  9913 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.069s
I20260709 12:25:43.604337  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.665107  6042 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:43.652976  6009 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:43.671254  6611 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:43.519572 10050 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.641569 10182 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:43.676951  6084 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:43.778883  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 102005us
I20260709 12:25:43.644814 10178 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:43.783651  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.680503  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:43.784415  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 131525us
I20260709 12:25:43.785526  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.784308  6118 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:43.681347  6041 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:43.681978  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:43.683197  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.786810  6044 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:43.668782 10151 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:43.786103  6037 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:43.721753  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.683012  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.676007 10057 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.077s
I20260709 12:25:43.790849  6035 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:43.682432 10142 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:25:43.704910  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.672289 10193 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:43.675972 10012 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:43.678201 10077 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.731500  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.784690 10032 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:43.606943 10148 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:43.717878 10194 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:25:43.737744  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.791795 10019 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:43.652129  9912 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:43.716581  9597 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:43.740950 10200 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:25:43.741406  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.741706 10154 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:43.671401 10166 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.669229 10147 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.678328 10149 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.061s
I20260709 12:25:43.750046 10188 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.760447 10118 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.669296  6609 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:43.735667 10163 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:43.738651 10045 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:43.763590 10145 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.765654 10079 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:43.682175 10023 consensus_queue.cc:1059] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.069s
I20260709 12:25:43.769309 10028 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.770812 10116 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.755642 10191 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.683440 10108 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.060s
I20260709 12:25:43.702878 10087 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.762550 10155 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:43.776019 10143 consensus_meta.cc:287] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.917s	user 0.009s	sys 0.001s
I20260709 12:25:43.832043 10144 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:43.832129 10143 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:43.832620 10087 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.636251  9916 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.648531 10185 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:43.784123 10048 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:43.783449 10178 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.789609 10081 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:43.798939  9872 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:43.811939  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.887734  6109 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:25:43.888424 10031 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:43.888268  9872 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.889425  6110 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:25:43.798537  6111 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:43.792318  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.891680  6112 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:25:43.813249  6116 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:43.792214  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.823093  9912 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:43.893953  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:43.785920  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 114724us
I20260709 12:25:43.779592  6084 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:43.880882  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:43.764608  6036 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:43.790446  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:43.898893  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 119226us
I20260709 12:25:43.785990  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:43.769763  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.883145  6039 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:43.762801  6040 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:43.901443  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 115394us
I20260709 12:25:43.815820 10019 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:43.903061  9912 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:43.903805  9912 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.903999  5961 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:25:43.903075 10019 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:43.905849  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:43.475162  5854 maintenance_manager.cc:643] P 5def43035e3245068dbad43bca95206c: FlushMRSOp(00000000000000000000000000000000) complete. Timing: real 4.712s	user 0.153s	sys 0.052s Metrics: {"bytes_written":30026,"cfile_init":1,"delete_count":0,"dirs.queue_time_us":446485,"dirs.run_cpu_time_us":408,"dirs.run_wall_time_us":35429,"drs_written":1,"lbm_read_time_us":321,"lbm_reads_lt_1ms":4,"lbm_write_time_us":39939,"lbm_writes_1-10_ms":3,"lbm_writes_10-100_ms":1,"lbm_writes_lt_1ms":30,"peak_mem_usage":0,"reinsert_count":0,"rows_written":63,"thread_start_us":446889,"threads_started":1,"update_count":14}
I20260709 12:25:43.825932  6645 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:43.732712  5968 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:43.901470  6038 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:25:43.906796 10031 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:25:43.821173  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 151940us
I20260709 12:25:43.800117  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.780792  6115 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:25:43.913596  9912 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:43.879966  5962 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:43.914204  5961 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:43.803289 10012 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:43.911309  5855 maintenance_manager.cc:419] P 5def43035e3245068dbad43bca95206c: Scheduling UndoDeltaBlockGCOp(00000000000000000000000000000000): 11165 bytes on disk
I20260709 12:25:43.899905  6037 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:43.922030  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.912874  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.814978  6117 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 7: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:43.899981  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.810259  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.881196  5964 raft_consensus.cc:2393] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:43.909727 10023 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:43.923993  6035 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:43.882026  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:43.877451  5960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 2734) took 1081 ms. Trace:
I20260709 12:25:43.913303  6609 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:43.924082 10023 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.836155  9915 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:43.898003  9916 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.793522 10044 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:43.877485  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 171414us
I20260709 12:25:43.810333 10077 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:43.937427  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:43.793366 10132 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.827915 10147 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.945315 10019 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:43.947793 10151 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:43.947844 10148 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:43.949074 10143 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:43.949611 10050 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:43.949039 10019 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:43.824640 10161 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:43.951718 10161 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.952291  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:43.953068 10013 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:43.955616 10144 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:43.956737  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:43.956997  6040 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:43.957686  6116 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:43.952292 10161 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:43.844978 10166 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:43.959034  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:43.799494 10193 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:43.846683 10206 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.062s	user 0.000s	sys 0.001s
I20260709 12:25:43.924955  5966 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 3.
I20260709 12:25:43.923362  6043 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:43.900215  6084 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:43.927019 10023 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:43.933723 10044 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:43.936771  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:43.955996 10149 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:43.845114 10188 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:43.949115  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2284) took 1004 ms. Trace:
I20260709 12:25:43.938297  5965 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:43.963788  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50912.9us
I20260709 12:25:43.962347  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:43.969544 10048 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:43.969995 10048 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.970330 10048 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:43.965457  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 65487.8us
I20260709 12:25:43.979751 10028 raft_consensus.cc:3055] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:43.980336 10028 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:43.965868  6042 rpcz_store.cc:276] 0709 12:25:42.944127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.945440 (+  1313us) service_pool.cc:224] Handling call
0709 12:25:42.945759 (+   319us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:43.777081 (+831322us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:43.948558 (+171477us) spinlock_profiling.cc:243] Waited 713 ms on lock 0x7b54001f2554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:43.948864 (+   306us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1639059328}
I20260709 12:25:43.985140  6084 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:43.986611 10191 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:43.987097 10191 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.987512 10191 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:43.990091 10044 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:43.994369  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2715) took 1244 ms. Trace:
I20260709 12:25:43.994699  5967 raft_consensus.cc:1240] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:43.996662  6113 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
W20260709 12:25:43.988502 10173 log.cc:927] Time spent T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.815s	user 0.004s	sys 0.000s
I20260709 12:25:43.998611  5959 rpcz_store.cc:276] 0709 12:25:42.749920 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.750341 (+   421us) service_pool.cc:224] Handling call
0709 12:25:43.993886 (+1243545us) spinlock_profiling.cc:243] Waited 885 ms on lock 0x7b5400197b54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:43.994152 (+   266us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2035317120}
I20260709 12:25:43.997570  5967 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:43.975291 10166 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:43.952683  5854 maintenance_manager.cc:643] P 5def43035e3245068dbad43bca95206c: UndoDeltaBlockGCOp(00000000000000000000000000000000) complete. Timing: real 0.024s	user 0.002s	sys 0.000s Metrics: {"cfile_init":1,"lbm_read_time_us":734,"lbm_reads_lt_1ms":4}
I20260709 12:25:44.007053  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:43.981877 10028 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.010290  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:44.011142  5967 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:44.012003 10028 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.004283 10166 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:43.925236  5960 rpcz_store.cc:276] 0709 12:25:42.795431 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.872545 (+ 77114us) service_pool.cc:224] Handling call
0709 12:25:42.872904 (+   359us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:42.873142 (+   238us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:42.873168 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:42.975608 (+102440us) spinlock_profiling.cc:243] Waited 42.6 ms on lock 0x7b2c0001d508. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f94da11 00007f481f95d372 00007f482108fa01 00007f482105443a 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2
0709 12:25:42.976160 (+   552us) log.cc:844] Serialized 26 byte log entry
0709 12:25:43.422716 (+446556us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:43.422753 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:43.422825 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:43.876324 (+453499us) raft_consensus.cc:1685] finished
0709 12:25:43.876418 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:43.877116 (+   698us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":98055424,"thread_start_us":446223,"threads_started":1,"wal-append.queue_time_us":618139}
W20260709 12:25:44.018934  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 112510us
I20260709 12:25:44.027392  6009 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:44.028427 10044 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:44.031180  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.032536  6648 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:25:44.015463  9830 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.035836 10185 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.041437 10012 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.052038  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.055727  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.056702  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2166) took 1043 ms. Trace:
I20260709 12:25:44.057411  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.059002  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.059384  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.060604  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.069876  6648 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:44.070115  6650 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:44.070621  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:44.066712  5963 rpcz_store.cc:276] 0709 12:25:43.012760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.598643 (+585883us) service_pool.cc:224] Handling call
0709 12:25:43.598981 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:43.603358 (+  4377us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:43.603389 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:43.642331 (+ 38942us) log.cc:844] Serialized 26 byte log entry
0709 12:25:43.734624 (+ 92293us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:43.737681 (+  3057us) log.cc:844] Serialized 14 byte log entry
0709 12:25:43.738452 (+   771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:43.738546 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:43.775406 (+ 36860us) spinlock_profiling.cc:243] Waited 31.4 ms on lock 0x7b4800080058. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4825f7daa1 00007f4825f74b37 00007f4825f749ca 00007f482606c26f 00007f482606bf37 00007f482608055c 00007f4826080508 00007f4826080488 00007f4826080443 00007f482607f6ec 00007f4824fa9a96
0709 12:25:44.056109 (+280703us) raft_consensus.cc:1685] finished
0709 12:25:44.056245 (+   136us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:44.056516 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4029,"prepare.queue_time_us":2641,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":570,"raft.queue_time_us":4998,"raft.run_cpu_time_us":1091,"raft.run_wall_time_us":171783,"spinlock_wait_cycles":72150912,"thread_start_us":59187,"threads_started":1,"wal-append.queue_time_us":86030}
I20260709 12:25:44.017122 10166 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.077198  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.077471  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.041522 10045 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.078896  6037 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:44.078953  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.084527  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:44.090401  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.103071 10045 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:44.109666  6035 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:44.110561  5965 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:44.111420  5966 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:44.113236 10185 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:44.115660 10163 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.119351 10012 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:44.094594 10173 log.cc:927] Time spent T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:25:44.121711  6039 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:44.123224  9915 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:44.123860  9915 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.124264  9915 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.125447  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.126243  6648 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.127022  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.129621  6647 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:44.130208 10206 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
W20260709 12:25:44.132702 10137 consensus_meta.cc:287] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.980s	user 0.010s	sys 0.002s
I20260709 12:25:44.133289 10137 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.135104 10048 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.118383 10163 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:44.145123 10197 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.147126  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:44.147881 10077 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.149694  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:44.151108  5960 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:44.154629  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:44.160523  6084 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:44.160935  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 962) took 1387 ms. Trace:
I20260709 12:25:44.161473  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:44.154901  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.164341  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2723) took 1411 ms. Trace:
W20260709 12:25:44.168876  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 176928us
I20260709 12:25:44.172667  5962 rpcz_store.cc:276] 0709 12:25:42.752827 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.854925 (+102098us) service_pool.cc:224] Handling call
0709 12:25:44.164084 (+1309159us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001cacd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:44.164254 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308027776}
I20260709 12:25:44.178685  6041 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:25:44.172387  5968 rpcz_store.cc:276] 0709 12:25:42.773791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.863368 (+ 89577us) service_pool.cc:224] Handling call
0709 12:25:42.863643 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:43.910947 (+1047304us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.160487 (+249540us) spinlock_profiling.cc:243] Waited 869 ms on lock 0x7b5400277254. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:44.160746 (+   259us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1998283136}
I20260709 12:25:44.184302  6648 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:25:44.190768 10197 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:44.194104  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.194736  9872 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:44.195186  9872 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.195565  9872 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.196537 10023 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.197744  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.197881 10137 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.200438 10077 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.166160 10032 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:25:44.202565  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:44.204913 10178 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.206632  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 2022) took 1320 ms. Trace:
I20260709 12:25:44.207125  6036 rpcz_store.cc:276] 0709 12:25:42.886557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.886659 (+   102us) service_pool.cc:224] Handling call
0709 12:25:44.206223 (+1319564us) spinlock_profiling.cc:243] Waited 866 ms on lock 0x7b5400271854. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:44.206390 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1992412928}
I20260709 12:25:44.201640  6651 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:44.206981  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52620.3us
I20260709 12:25:44.219504 10185 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:44.220791  6084 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:44.218475  6042 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:25:44.178625  9912 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.217288 10032 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:44.235311  6081 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:44.235832  5863 catalog_manager.cc:5697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.237177  6081 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:44.238230 10028 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:44.238757 10050 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:44.239058 10178 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:44.239449 10178 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.239775 10178 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:44.220001 10185 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.237895  5863 catalog_manager.cc:5697] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 6 to 8, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:44.234254 10166 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.243172 10132 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:44.238765  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 50481.1us
I20260709 12:25:44.241744 10050 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.254585 10020 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:44.254760 10050 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:44.255226 10145 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.256405 10048 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.256770  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2169) took 1243 ms. Trace:
I20260709 12:25:44.247277 10185 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:44.270843  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.273684  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:44.235323 10032 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.275580  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:44.251363 10161 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.246994  9826 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:44.257490  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 69552.9us
I20260709 12:25:44.257315  5966 rpcz_store.cc:276] 0709 12:25:43.013443 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:43.976899 (+963456us) service_pool.cc:224] Handling call
0709 12:25:44.111219 (+134320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:44.111905 (+   686us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.256367 (+144462us) spinlock_profiling.cc:243] Waited 103 ms on lock 0x7b54000b8950. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:44.256688 (+   321us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":236045184}
W20260709 12:25:44.266819  5964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2720) took 1514 ms (client timeout 1703 ms). Trace:
I20260709 12:25:44.268249  9912 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.268981 10166 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:44.264680  5863 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 7 to 10, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 10 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:44.280396  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:44.279367  5964 rpcz_store.cc:269] 0709 12:25:42.752084 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.752249 (+   165us) service_pool.cc:224] Handling call
0709 12:25:44.266552 (+1514303us) spinlock_profiling.cc:243] Waited 1.11 s on lock 0x7b5400036454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:44.266744 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2551582080}
I20260709 12:25:44.283196  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:44.286360  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 84869.3us
I20260709 12:25:44.276429  6609 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:44.288414  6111 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:44.290874  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:44.291558  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:44.291698 10023 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.299670  6645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 1068) took 1575 ms. Trace:
I20260709 12:25:44.300202  6645 rpcz_store.cc:276] 0709 12:25:42.724040 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:42.895585 (+171545us) service_pool.cc:224] Handling call
0709 12:25:42.895900 (+   315us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:43.913804 (+1017904us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:44.299288 (+385484us) spinlock_profiling.cc:243] Waited 930 ms on lock 0x7b540060d6d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:44.299503 (+   215us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2138470144}
I20260709 12:25:44.298236  6651 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:44.280437 10032 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:44.305683  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:44.307854  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 59262us
I20260709 12:25:44.309186  6643 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:44.306700  6117 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:44.313212  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:44.314538  6041 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:44.317903  5863 catalog_manager.cc:5697] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 5 to 7, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 7 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:44.322080  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:44.324894  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:44.319687 10166 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:44.331328  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 109073us
I20260709 12:25:44.338115  6117 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:44.332437  5863 catalog_manager.cc:5697] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 5 to 6, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 6 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:44.337698  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:44.340118  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.331885 10166 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.351198  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:44.334000  9912 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:25:44.356134 10166 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.369899  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:44.372987  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.373878  6651 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:44.369213  5863 catalog_manager.cc:5697] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 2 to 4. New cstate: current_term: 4 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:44.377543  6112 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 12: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:44.378924  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:44.377233  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:44.380484  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.380717  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:44.378414  5863 catalog_manager.cc:5697] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 6 to 8, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:44.384982  6645 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:44.384531  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:44.384290  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:44.386268  6037 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.363693 10191 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.370327 10020 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:44.389326  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52577.4us
W20260709 12:25:44.392158  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 60259.7us
I20260709 12:25:44.393746  6035 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
I20260709 12:25:44.394873  6041 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:44.403702  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:44.405579  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:44.383844 10185 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.408356 10050 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.409682  6113 raft_consensus.cc:2368] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8.
I20260709 12:25:44.409759  9634 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:44.410137 10023 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:44.410723  9634 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:44.411264  9634 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.411615  9634 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:44.378872 10108 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:44.411494 10023 raft_consensus.cc:3055] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:44.417644 10023 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:44.392590 10161 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:44.420910  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 69812.4us
I20260709 12:25:44.421109  6037 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:44.421682  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:44.426226 10108 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.426429  6645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:44.429080 10108 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:44.429278  6645 raft_consensus.cc:606] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:44.432973 10048 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:44.418684 10185 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:44.434325  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:44.433677  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:44.434435  6609 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:44.431651  5863 catalog_manager.cc:5697] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:44.396646  9872 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.425561  9915 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.442274  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:44.438759 10222 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.077s	user 0.000s	sys 0.001s
I20260709 12:25:44.443982  6082 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:44.446519  6037 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.449126  6082 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:44.454667 10186 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:44.418699 10023 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.458000  9728 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:44.458498  9728 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.458886  9728 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:44.459210 10186 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:44.446887 10198 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:44.461964  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.436095 10193 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:44.463195  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48133.4us
W20260709 12:25:44.468840  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 43665.8us
I20260709 12:25:44.460345 10186 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.470808  6645 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:44.473027  6645 raft_consensus.cc:606] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:44.463191 10019 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:44.473255  6040 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:44.463451 10198 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:44.473508  6645 raft_consensus.cc:614] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:44.468835 10207 consensus_queue.cc:1059] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:25:44.471992 10080 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:44.473042 10197 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:44.480144 10019 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.480645  9915 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:44.481878  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 61304.2us
I20260709 12:25:44.477169 10080 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.476085 10198 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.486121 10019 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:44.490252 10048 raft_consensus.cc:3055] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:44.494428 10050 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:44.492733  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.479242 10023 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.480264 10191 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.494763 10048 raft_consensus.cc:740] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:44.500326  6643 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:44.502838  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:44.481366 10197 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:44.491765 10080 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:44.497536  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:44.506095  6646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:44.506822  6646 raft_consensus.cc:606] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:44.509080 10193 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:44.492805  9826 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:25:44.516466  9826 consensus_queue.cc:1243] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer f1bb8e63c2b448cdafd51f05d277c741 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:44.517112  9826 raft_consensus.cc:3055] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:44.517477  9826 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:44.517988  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:44.520184  5934 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:44.520504 10108 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:44.521381 10108 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:44.521554 10132 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:44.520632 10048 consensus_queue.cc:260] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.523646 10048 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:44.526777  9826 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.527663  6646 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:25:44.522256 10132 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.530210 10207 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:44.530658 10207 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.531006 10207 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.531625 10132 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:44.533030 10047 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:44.534538 10047 consensus_queue.cc:1059] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:44.535810  9830 raft_consensus.cc:3055] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:44.536190  9830 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:44.537118  9830 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.538810 10028 consensus_queue.cc:1059] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:44.540383 10050 raft_consensus.cc:3055] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:44.540864 10050 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:44.541088 10191 consensus_queue.cc:1059] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:44.542006 10191 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:44.543215 10191 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:44.544229 10191 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.545789 10191 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.546196  9830 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.541988 10050 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:44.514740 10223 log.cc:927] Time spent T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:25:44.551321 10050 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:44.553180 10178 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.556901  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.557544  6650 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:44.528249  9826 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.564855  5934 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:44.565831 10132 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:44.565454 10108 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:44.567031 10108 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.567373 10108 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:44.567965  6651 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:44.568598  6651 raft_consensus.cc:606] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:44.510504 10197 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:44.570359  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 12:25:44.572419  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.572711  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:44.573480 10145 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.573787  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:44.574011 10145 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:44.575011 10224 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:25:44.576581 10207 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:44.582355  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 98983.9us
I20260709 12:25:44.583328  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:44.584157  9912 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:44.584631  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:44.585567  9912 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:44.586180  9912 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:44.586561 10193 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:44.586716  9912 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:44.587735  9915 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:44.588809 10132 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:44.589190 10132 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:44.590066 10132 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.592476  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.592931  6650 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:44.593310  5966 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:44.593678 10132 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:44.594123  6084 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:44.594740  5964 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:44.540789  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:44.596203  6643 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:44.597213  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.601006  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.601099  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.602106  6084 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:44.587070 10193 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:44.576310 10145 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:44.612154  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 71473.9us
I20260709 12:25:44.605248  6009 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:44.618055  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:44.618257  6037 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:25:44.600400 10023 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:44.597987 10178 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.614923  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:44.621738  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 122694us
I20260709 12:25:44.628979  5968 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:44.629873  5966 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:25:44.631572  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:44.632831  5967 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 4.
I20260709 12:25:44.633554 10188 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.615278 10193 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.638516 10019 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:44.639261 10019 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:44.640340 10019 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.640831 10207 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.641532 10047 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:44.642019 10047 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.642433 10047 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.642810  9915 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:44.644490  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.645287  6651 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:44.646896  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:44.642696 10045 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:44.636060 10028 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:44.647157  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.655267  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.656090 10108 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.659870 10045 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:44.659600 10198 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.638626 10188 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.663092 10198 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.663941 10188 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:44.664146  9634 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.665059  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.665381  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:44.666484  9634 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:44.667460  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.668491  9728 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.669278  6650 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:44.670737  9728 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:44.617195 10080 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.672010 10166 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.673554 10080 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.678260 10166 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:44.619262 10050 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:44.683635  6651 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: [11.11-11.11]
I20260709 12:25:44.680866  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:44.699213  6037 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.685389  6650 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:44.684222  6611 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:44.681280  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.631193 10023 raft_consensus.cc:697] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:44.701529  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:44.635510 10137 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:44.651376  9872 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.711383  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.708041  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.658341 10108 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:44.716958  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 250499us
I20260709 12:25:44.717538  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:44.719764  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 119406us
I20260709 12:25:44.721326  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:44.725432  5968 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:44.726325  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.726367  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.710188 10050 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:44.727785  6112 raft_consensus.cc:2410] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 12 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:25:44.728696  6647 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:44.734999  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:44.738682  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.726055  9728 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:44.747506  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.748121  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:44.751178  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.752102  5960 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:44.739799  9872 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:44.739441 10186 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:44.736488  6006 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.703s (SENT) [suppressed 21 similar messages]
I20260709 12:25:44.754736  6117 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:44.757970  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.758745  6608 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:44.760408  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:44.764806  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:44.766853  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.767742  5967 raft_consensus.cc:2410] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 6.
I20260709 12:25:44.767900  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.768591  5964 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:44.769968 10186 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:44.769712 10050 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.770422 10186 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.772797 10197 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:44.776152  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 47525.2us
I20260709 12:25:44.778445  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:44.779836  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:44.780377 10023 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.758715 10166 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:44.792594 10166 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:44.793053 10166 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.790607  6643 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:44.799728 10178 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:44.800603 10228 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:44.801590  9634 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:44.801671  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:44.801875 10228 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:44.802119  9634 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:44.802354 10228 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:44.802562  9872 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.803140  9634 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.803288 10228 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.804347  9634 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.804605 10228 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:44.805562  6037 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:25:44.806582 10045 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:44.778816  9912 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.807461  6040 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:44.808100  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:44.800648 10178 consensus_queue.cc:1059] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.010s
I20260709 12:25:44.783083 10193 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.785521  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.786161  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:44.787408 10197 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:44.790500  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.790886 10137 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:44.809782  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.818714  6648 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:44.734654 10019 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.027s
I20260709 12:25:44.821452  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:44.821623  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 62933us
I20260709 12:25:44.819310  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:44.825328  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:44.815374  6117 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:44.820166 10045 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:44.827864  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:44.828423 10020 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Leader pre-election won for term 4
I20260709 12:25:44.814500  9728 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:44.828663  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.829046  6112 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:25:44.829380  5965 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:44.829955 10080 raft_consensus.cc:3055] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:44.830350 10080 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:44.831787 10080 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.833285 10080 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.813866  6643 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:44.838608 10178 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:44.839052 10178 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:44.839407 10178 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
W20260709 12:25:44.826800  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45813us
I20260709 12:25:44.839547 10185 consensus_queue.cc:1059] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:44.840605 10185 raft_consensus.cc:3055] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:44.840884  6609 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:44.841560 10188 raft_consensus.cc:993] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:44.842005 10188 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:44.842437 10188 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:44.847030  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:44.847323  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:44.847710  6118 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.842636 10020 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:44.848557 10020 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:44.848776  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:44.849551  6114 raft_consensus.cc:2410] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 12 because replica has last-logged OpId of term: 9 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:25:44.842607 10161 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.005s
I20260709 12:25:44.851290 10161 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:44.851636 10161 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:44.809581  9912 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.852530 10161 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.853950 10161 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:44.842744 10197 raft_consensus.cc:1081] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:44.845181  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:44.846107  6115 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:44.857788  5964 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:25:44.842875  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:44.858719  6647 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.858999  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.859711  5962 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:44.844255  6084 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:44.843339  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:44.863018  6040 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 7: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:44.862095  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.846442  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:44.864462  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.864732  6110 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:25:44.866950  6040 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:25:44.867636  6040 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:44.867980  6040 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.868496 10193 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:44.869546  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 61595us
I20260709 12:25:44.871449 10166 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.872390  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:44.863946  5965 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
W20260709 12:25:44.877581  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52326.5us
I20260709 12:25:44.879329  6647 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:44.881204  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:44.881672  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 43494.3us
I20260709 12:25:44.840938 10185 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:44.883316  5968 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:44.884388 10185 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.885839 10185 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.886845  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.886318  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.887643  5968 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.888067  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.888417  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.888768  5964 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:44.889164  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.889717  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.890445  5962 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:44.883270  9728 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:44.889955  5959 raft_consensus.cc:2393] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 7: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:44.890529  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.887130  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:44.883690  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 147235us
I20260709 12:25:44.891121  5934 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:44.885710  6118 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:44.786326 10047 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.900156  5965 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:44.901445  5967 raft_consensus.cc:2368] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:44.901969  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:44.902549  6082 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:44.858736  9872 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:44.911303  6109 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: [7.8-7.8]
I20260709 12:25:44.910167  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:44.908826  6040 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.911826  6115 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:44.814184 10186 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.891000  9728 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:44.911310  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:44.917234  6646 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 5 index: 8. (index mismatch)
I20260709 12:25:44.880427 10193 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:44.920737  6041 raft_consensus.cc:2393] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:44.899984  9830 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:44.924755  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:44.927402  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.928026  5966 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 6
I20260709 12:25:44.930240  6110 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:44.913811 10108 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:44.936292  6040 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:44.920413  9728 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.937805  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.940553  5967 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:44.916375 10050 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:44.847468 10188 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.939281  9966 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:44.935035  9912 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:44.932986  9830 raft_consensus.cc:697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:44.963311 10166 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:25:44.963517  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.957036  9966 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:44.967947  9966 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.972977  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:44.973799  6037 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:44.955895 10045 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:44.975345 10045 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:44.951826 10108 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:44.951081 10132 consensus_queue.cc:1059] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:25:44.979449 10108 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:44.984520  6643 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:44.984794  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.984809  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.985591  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.986704  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.987772  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.988451  5964 raft_consensus.cc:2368] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8.
I20260709 12:25:44.988710  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.989203  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.989773  5964 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:44.990082  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:44.991196  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:44.992203  5965 raft_consensus.cc:1240] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 5. Current term is 6. Ops: [5.7-5.7]
I20260709 12:25:44.992360  5959 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 11. Ops: []
I20260709 12:25:44.957089 10191 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.023s
I20260709 12:25:44.994886  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:45.003094  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:44.985440  5961 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:45.005697  9826 consensus_queue.cc:1059] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:25:45.003885 10191 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:45.006933 10191 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:45.007946 10191 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:45.008816  6039 raft_consensus.cc:1240] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:45.009148 10191 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:45.009984  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.010635  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:45.011369  6113 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:45.012102  9731 raft_consensus.cc:993] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:45.012542  9731 raft_consensus.cc:1081] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:25:44.992867  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:45.013468  5962 raft_consensus.cc:2410] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 12 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:25:45.013338  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:45.014134  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.014588  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.014752  6042 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:45.015913 10047 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:45.016590  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:45.010056  6611 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:44.980050 10132 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:45.018014  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.018339 10132 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:45.018826  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.019354  6038 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:45.019220 10132 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.020236 10132 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:44.999594  5960 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:45.023214 10166 raft_consensus.cc:2764] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election decision vote started in defunct term 8: won
I20260709 12:25:45.023850  5962 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20260709 12:25:45.025398  6042 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:45.003804  6035 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:45.010844  6044 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:45.027303  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:45.017379  6110 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:45.022058  6036 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:44.989781  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:45.033016  6115 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:45.034152  6038 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
W20260709 12:25:45.034325  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.036316  5968 raft_consensus.cc:2410] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:25:44.994596  5967 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:25:45.028568 10020 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.041374  5966 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
W20260709 12:25:45.043697  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.054755  5961 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:45.062831  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:45.067719  6611 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:45.069275  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:45.062495  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:45.070917  6112 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:45.096563  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.086869  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:45.097671  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.076273 10178 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:45.093180  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:45.087271  9830 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.083914  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:45.088249  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.072340  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:45.092758  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:45.115044  6118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:42484
I20260709 12:25:45.108166  6044 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:45.111070  5962 raft_consensus.cc:2393] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:45.092252  5966 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:45.116900  6118 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting forced leader election (received explicit request)
W20260709 12:25:45.085568  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.110131  6041 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:45.100003  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:45.102578  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:45.118427  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:45.083777  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.117364  6118 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:45.100518  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.125200  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.122696  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:45.098096  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.127305  5964 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:45.127542  6036 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:25:45.074095 10050 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:45.101516 10045 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:45.130628  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.074932 10019 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:45.107148 10239 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:45.131330  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.132045  6116 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:45.091275  9912 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:45.143127  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:45.087746 10186 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:45.087040 10020 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:45.147531  6035 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:45.130142  9872 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:45.082226  9728 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:45.084383  9731 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.066s
I20260709 12:25:45.152248  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.153085  6038 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:45.154850  9634 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:45.123174 10132 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:45.166956  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:45.167021  6036 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 7 index: 6. (index mismatch)
I20260709 12:25:45.168605  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:45.169466  6042 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:45.169493  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:45.170305  6037 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:45.170650  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.162634  6118 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.177106  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.130071 10228 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:45.182101  6039 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:45.187776  6645 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:45.189183  6118 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:45.183555  6082 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:45.192231  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:45.194303  6038 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:45.195577  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:45.197351  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:45.198562  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:45.203662  6643 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: []
I20260709 12:25:45.208042  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:45.209082  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:45.212008  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:45.213253  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:45.215188  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:45.216334  6006 leader_election.cc:400] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8.
I20260709 12:25:45.216698  6006 leader_election.cc:403] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
I20260709 12:25:45.216780  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:45.219117  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:45.219312  6646 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:45.196376 10048 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election won for term 6
W20260709 12:25:45.221621  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 269382us
I20260709 12:25:45.221546  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:45.203987 10050 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:45.209053  9634 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:45.223131  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:45.223178  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:45.225668  6115 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:45.227988  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:45.224418  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:45.212463 10020 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:45.228636  6647 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:45.209147 10188 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:25:45.187819 10228 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:45.279538  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 53103.7us
I20260709 12:25:45.226819  5934 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:45.310971  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:45.281543 10050 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:45.212953  9872 consensus_queue.cc:1059] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.064s
W20260709 12:25:45.319693  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 95352.1us
I20260709 12:25:45.229642 10048 raft_consensus.cc:697] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:25:45.321875  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 45971.2us
I20260709 12:25:45.322415  9634 raft_consensus.cc:697] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:45.322597  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:45.324206  6648 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
W20260709 12:25:45.337558 10080 consensus_meta.cc:287] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.504s	user 0.009s	sys 0.000s
I20260709 12:25:45.229858  9915 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.108s
I20260709 12:25:45.229697 10108 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:45.338701 10045 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:45.186105 10132 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:45.351012  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.392266  6044 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:45.351212  6043 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:45.353794  6109 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:45.361253  6645 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:45.366003 10137 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8.
I20260709 12:25:45.366876  6110 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:25:45.373040  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:45.385039  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 165992us
I20260709 12:25:45.361377  6646 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
W20260709 12:25:45.419806  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 46841.3us
I20260709 12:25:45.425426 10259 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:45.426220 10259 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:45.365796  9912 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.050s
I20260709 12:25:45.392545  9826 raft_consensus.cc:3055] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Stepping down as leader of term 7
W20260709 12:25:45.430682  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.430934  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:45.430990  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:45.433660  6009 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:45.399053 10032 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:45.434502  6118 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.437490  6112 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:45.438974  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:45.439705  6111 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:45.426723 10259 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:45.445631  6118 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:25:45.447139 10047 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.466249  6116 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:45.450994 10050 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:45.453523 10048 consensus_queue.cc:237] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 4.3, Last appended by leader: 3, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:45.433171  9826 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:45.472548  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:45.461042  6650 raft_consensus.cc:3055] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:45.473100  6650 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:45.462750  9728 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:45.450986  9634 consensus_queue.cc:237] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:45.473994  6038 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:45.475116  6115 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:45.468945 10047 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.479808 10047 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:45.470258 10228 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:45.431046 10193 consensus_queue.cc:1059] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.040s
I20260709 12:25:45.470718  6039 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:45.481030 10193 raft_consensus.cc:3055] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:45.471514  6042 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:45.473842  6650 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.482666  6650 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.481395 10193 raft_consensus.cc:740] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:45.458272  6114 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:45.485339 10166 consensus_queue.cc:1059] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:45.485504 10193 consensus_queue.cc:260] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.471796 10045 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:45.493074 10045 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:45.477738 10132 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:45.477300  9826 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.495878  9826 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:45.497532  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 270766us
W20260709 12:25:45.497876  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 60727.1us
I20260709 12:25:45.508679  6650 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:25:45.501132  6044 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:45.503597  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:45.492563 10193 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:45.493924 10045 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:45.513108 10245 log.cc:927] Time spent T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.283s	user 0.006s	sys 0.000s
I20260709 12:25:45.516103  6651 raft_consensus.cc:3055] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:45.532771  6651 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:45.537508  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:45.538575  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:45.519765  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 94453.2us
I20260709 12:25:45.515173  5934 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:45.514585 10137 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:45.514402  9915 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:25:45.523455  9912 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:45.524271 10032 consensus_queue.cc:1059] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:45.529021 10108 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:45.517761 10145 consensus_queue.cc:1059] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.014s
I20260709 12:25:45.512070 10132 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:45.533661  6651 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.512061  9731 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:25:45.543373  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:45.512703 10188 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
W20260709 12:25:45.549278  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 76789.5us
I20260709 12:25:45.540606  9728 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:45.552521  6116 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:45.551578  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:45.561528  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.562114  6651 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:45.550621  9830 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:25:45.569521  6651 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:45.559862 10137 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:45.554451 10260 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:45.571899 10032 raft_consensus.cc:3055] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Stepping down as leader of term 6
W20260709 12:25:45.572999 10166 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 7 current term: 7 is higher.
I20260709 12:25:45.548928 10048 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.039s
W20260709 12:25:45.642673  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 87778.4us
I20260709 12:25:45.648607  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:45.680485  6110 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:25:45.687005  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 53233.6us
W20260709 12:25:45.666982  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:45.588359  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 64205us
W20260709 12:25:45.713994  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 65485.8us
I20260709 12:25:45.713994  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:45.637478  6039 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:25:45.748999  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 205696us
I20260709 12:25:45.750600  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:45.758388  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:45.735078  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.644977 10258 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.129s
I20260709 12:25:45.587482 10032 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:45.772195 10132 raft_consensus.cc:697] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:25:45.775998  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 76651.6us
W20260709 12:25:45.693543 10261 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:25:45.633198  9912 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.137s
I20260709 12:25:45.775619 10137 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:45.675737 10248 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:45.681984 10186 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:25:45.780812  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 69078.9us
W20260709 12:25:45.782119  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 68197.8us
I20260709 12:25:45.804399  6006 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:45.746992  9728 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:45.678013 10028 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:45.670749 10178 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:45.588044 10260 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:45.583436 10259 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:45.778640  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 237042us
I20260709 12:25:45.644061  9915 consensus_queue.cc:1243] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer 0069e2ba1f02412e8e1d6c20a1fb510f log is divergent from this leader: its last log entry 8.8 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 7
I20260709 12:25:45.775328 10266 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:45.805226  9728 raft_consensus.cc:697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:45.807943 10028 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:45.807248  9728 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.808818 10028 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.809681 10260 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.794013 10272 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.587266  9872 consensus_queue.cc:1059] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.201s
I20260709 12:25:45.750648 10020 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
W20260709 12:25:45.799126  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 48655.9us
I20260709 12:25:45.690325 10197 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.103s
I20260709 12:25:45.790364 10228 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:45.801591  5934 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:45.817248  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:45.819720  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:45.818686  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.797003 10145 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:45.827656  6035 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:45.798923 10193 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:25:45.830329  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:45.832496 10267 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:45.821242 10258 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:45.835026 10271 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:45.853019 10271 raft_consensus.cc:697] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:25:45.835420  5934 consensus_peers.cc:597] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7d1c158430bb487aa1d4c5a69165aa32. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:25:45.836392 10266 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:45.837301  6647 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:45.838719 10132 consensus_queue.cc:237] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.798738 10019 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.025s
I20260709 12:25:45.842413  6036 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:45.834313  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:45.825150 10028 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:45.821929 10278 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:45.854710  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:45.874691  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:45.876438  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:45.877923 10191 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:45.878842 10198 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:45.882858 10266 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:45.815343 10186 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.892096  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:45.824759  9912 consensus_queue.cc:1059] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.045s
I20260709 12:25:45.851325 10258 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:45.909948 10268 raft_consensus.cc:3055] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:45.913167 10270 raft_consensus.cc:3055] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:45.823844 10272 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:45.917935  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.831655 10145 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:45.923491  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 106321us
I20260709 12:25:45.850232  9830 consensus_queue.cc:1059] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.057s
I20260709 12:25:45.927634  6009 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:45.930305  6081 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:45.933064  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 78428.5us
I20260709 12:25:45.933787  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:45.869338 10050 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.054s
I20260709 12:25:45.915594 10191 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:45.863680 10248 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.066s
I20260709 12:25:45.937623  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:45.939247 10259 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:45.923122 10270 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:45.939731  9915 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:45.941156 10272 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:45.919194 10137 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.923235 10268 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:45.930748 10193 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:45.905854 10278 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:45.944401  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:45.859025 10032 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.954380  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:45.955819  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:45.919868 10080 consensus_queue.cc:1059] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 9.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.025s
I20260709 12:25:45.931602 10266 raft_consensus.cc:3055] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:25:45.942570 10228 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:25:45.935379 10267 raft_consensus.cc:697] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:45.967295 10268 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:45.950183  9912 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:45.949939  9872 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:45.971539 10186 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:45.971117 10270 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.982964 10270 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:45.976593  6044 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:45.950022 10132 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:45.977558  6081 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:45.907758 10271 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.6, Last appended by leader: 6, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.976227 10258 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:45.981372 10080 raft_consensus.cc:3055] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:45.943388 10045 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:45.986174  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 151828us
I20260709 12:25:45.989373  9915 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.010s
I20260709 12:25:45.999416  6111 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:25:46.002504  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.005656  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:46.005808  6044 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:46.002978 10080 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:46.006963  6608 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:45.998169  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:46.008790  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:46.010289  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:45.977314 10266 raft_consensus.cc:740] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:46.011744  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:46.010315  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.012749  6650 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:46.007973  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:46.014690  6116 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:46.015358 10268 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:46.015897 10260 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.018128 10260 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:46.019093  6114 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:46.002876  9634 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.018s
I20260709 12:25:45.988647  9912 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:46.011098  6609 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:46.069602  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:45.995937 10048 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:46.008090 10272 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:46.027532 10191 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.005159 10108 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:46.076510  6608 leader_election.cc:400] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:46.078779 10191 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:46.079202  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 73627us
I20260709 12:25:46.004695 10045 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.080438  5932 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:46.080881 10045 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:46.081555 10191 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:46.079118 10108 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:46.022615 10197 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:46.087688 10197 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:46.087473 10108 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.088165 10197 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:46.088605 10197 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:46.089006 10108 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:45.996112 10289 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:45.989059 10193 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.021904 10186 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:45.995792 10248 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.077s
I20260709 12:25:46.076915 10284 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:46.027145 10259 consensus_queue.cc:1175] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "24012af7747d4c4ea89c3da2ff950099" responder_term: 13 status { last_received { term: 13 index: 12 } last_committed_idx: 11 last_received_current_leader { term: 13 index: 12 } }
W20260709 12:25:46.118364  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 115020us
W20260709 12:25:46.112224 10282 log.cc:927] Time spent T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:25:46.104383 10289 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:46.112254 10260 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:46.156787  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:46.156602  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 145654us
I20260709 12:25:46.123610 10277 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:46.127548 10295 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:25:46.168715  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 88356.6us
I20260709 12:25:46.170432  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:46.172684  5932 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:46.173374  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.155937 10272 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.165064  9912 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.180166  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:46.180609 10288 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:25:46.180814  5964 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 3 FOLLOWER]: Advancing to term 4
W20260709 12:25:46.181077 10291 log.cc:927] Time spent T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:25:46.114760 10266 consensus_queue.cc:260] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.187310 10266 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:25:46.188623  5964 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:25:46.160924 10145 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:46.179960 10286 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.108s
I20260709 12:25:46.179863  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:46.160861 10132 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:46.181685 10178 raft_consensus.cc:3055] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:46.102990 10267 consensus_queue.cc:237] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.173698 10137 raft_consensus.cc:2764] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:25:46.192435 10080 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.172060 10260 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:46.216045 10260 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:25:46.204165  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.201256  9826 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.218778  9826 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:46.221184 10287 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.282s	user 0.003s	sys 0.000s
I20260709 12:25:46.221035 10045 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.174837 10295 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:46.200865 10145 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:46.212047 10289 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.195235  9634 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:46.235917  9634 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.193194 10278 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:46.215247  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:46.231717  5962 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:46.174115 10248 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:46.220949  9826 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:46.238533  6650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:46.252063  6650 raft_consensus.cc:606] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:46.195880 10178 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:46.252434  6650 raft_consensus.cc:614] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:46.238916  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:46.215227 10188 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:46.239362  6608 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:46.239594  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:46.259915  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:46.235174  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 78465.8us
I20260709 12:25:46.190956 10272 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.248919  5960 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:25:46.261963  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 46808.6us
I20260709 12:25:46.249543  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:46.262926  5965 raft_consensus.cc:2393] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 6: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:46.251003  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:46.253736  5967 raft_consensus.cc:2410] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 9 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:25:46.260481  6114 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:46.263026  5966 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:46.263684  6116 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:46.264739  6647 raft_consensus.cc:2393] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 4: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:46.238230 10198 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.266705  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:46.266067  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:46.240231 10295 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:46.208634 10132 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.253468  9634 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:46.235213 10145 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.274804  5961 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:46.267491  9915 consensus_queue.cc:1243] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer 24012af7747d4c4ea89c3da2ff950099 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:25:46.259483 10188 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:46.285176 10272 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:46.258708 10248 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.266574 10278 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:46.271426 10080 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:46.271466 10284 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Leader election won for term 4
W20260709 12:25:46.283116 10306 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.110s	user 0.001s	sys 0.000s
I20260709 12:25:46.271564 10198 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.270187 10302 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:46.316704 10145 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:46.291491 10193 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:46.302572 10298 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.148s	user 0.000s	sys 0.002s
I20260709 12:25:46.318578  6038 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:46.318990  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.303802 10248 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:46.305508 10284 raft_consensus.cc:697] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:46.311292  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.311776  6043 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:46.315138  5961 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:25:46.316377 10302 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.297570  6009 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.303227 10045 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:46.318807  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.293988  9915 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
W20260709 12:25:46.327595  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 60938.7us
I20260709 12:25:46.279223 10297 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.329619  6647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:46.337281  6647 raft_consensus.cc:606] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:46.337648  6647 raft_consensus.cc:614] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:46.337888  5967 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 3. Current term is 4. Ops: [3.6-3.6]
I20260709 12:25:46.331712  6044 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:46.314785  5934 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:46.338249  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:46.333717 10299 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.331569  6035 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:46.341706  5965 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:25:46.338990  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:46.332981  6036 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:46.339460  6082 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:46.342252  5965 pending_rounds.cc:85] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 10
I20260709 12:25:46.347119  5966 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:46.348198  5962 raft_consensus.cc:2393] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:46.296708  9912 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:46.349246  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:46.344456 10297 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.346539 10299 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.344508 10145 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:46.285910 10188 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.346774  5965 pending_rounds.cc:107] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:25:46.366079  5965 raft_consensus.cc:2889] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:46.364100  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 66576.5us
I20260709 12:25:46.367499  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.361883 10268 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:46.370684 10019 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.003s
I20260709 12:25:46.380882 10137 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:46.358197 10047 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:46.382761 10289 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:46.385351  5934 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:46.386945 10198 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:46.387388 10108 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.389529  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:46.390651  5966 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:46.391180  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:46.364660 10145 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.394940 10197 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.396013 10301 consensus_queue.cc:1059] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.054s
I20260709 12:25:46.398093 10299 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:46.399909  6009 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.402714  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:46.380637 10284 consensus_queue.cc:237] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.432264 10047 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.422427 10297 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:46.425170 10302 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:46.357647 10045 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:46.433845  6036 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
W20260709 12:25:46.434770  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 49508.6us
I20260709 12:25:46.436045  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.436394  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.439390 10137 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:46.452823  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:46.453997  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:46.420810 10315 log.cc:927] Time spent T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
W20260709 12:25:46.465167  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 119407us
I20260709 12:25:46.464254  6037 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:46.461885 10305 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.454350 10132 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:46.439117 10278 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:46.460351  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:46.454674  5962 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 8. (term mismatch)
I20260709 12:25:46.458225 10047 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:46.463306  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 63473.9us
I20260709 12:25:46.440223 10145 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:46.463652  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:46.463994  6044 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:46.465951  6647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:46.419229 10268 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.462415  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:46.437146 10270 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:25:46.477864  5962 pending_rounds.cc:85] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 7
I20260709 12:25:46.439041  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.478610  6081 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.484906  5962 pending_rounds.cc:107] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 7.8
I20260709 12:25:46.485262  5962 raft_consensus.cc:2889] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:46.485782  6081 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.486637 10301 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:46.480023  6009 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.487092  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.487427 10045 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:46.487843  6009 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.487988 10299 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:46.488559 10045 raft_consensus.cc:2764] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:25:46.488965  6009 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.489593 10299 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:46.490154  6009 leader_election.cc:400] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8.
I20260709 12:25:46.463421 10267 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:46.490995 10267 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:46.439184 10289 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.492733 10289 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:46.481525  6647 raft_consensus.cc:606] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:46.493278  6647 raft_consensus.cc:614] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:46.495229  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.470499 10193 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:46.496460  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:46.498070  6009 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.498319  6110 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:46.499385  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:46.441184 10108 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.483618  5967 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:46.486637 10297 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:46.438561 10295 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.540164  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:46.540781  6114 raft_consensus.cc:2410] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 11 because replica has last-logged OpId of term: 10 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
I20260709 12:25:46.479463 10278 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:46.538192  6009 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:46.535097 10312 log.cc:927] Time spent T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:25:46.550058  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:46.550848  6110 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:25:46.494647 10308 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.104s
W20260709 12:25:46.560159  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.475874 10137 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.496026  9966 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:46.536630 10020 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.571924  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:46.571791  6112 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:46.575510  6042 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:25:46.572083  5960 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:46.536269 10289 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:46.539429 10302 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:46.538652 10267 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:46.587702  6647 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 8: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:46.539326 10301 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.591792  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:46.555199 10278 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:46.592514  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:46.592703  6643 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:46.591569  6081 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:46.591949  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:46.615355  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.613870  6035 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:46.558889  9915 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.616113  9915 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.617673  6643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:46.618273  6643 raft_consensus.cc:606] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:46.620157 10319 log.cc:927] Time spent T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:25:46.476233 10305 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:46.623900  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 124605us
I20260709 12:25:46.546242 10193 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.629123  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:25:46.629374  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:46.632800  6644 raft_consensus.cc:2393] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:46.609108 10302 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:46.639971  6608 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.634087  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:46.646831  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:46.647104 10294 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:46.647716 10294 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:46.647977  9915 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:46.648903 10321 log.cc:927] Time spent T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:25:46.649504 10178 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.649856  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:46.613210 10161 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:46.652980  9872 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:46.653389  9872 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:46.653728  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:46.596292 10020 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.655628 10045 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:46.656360 10045 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.656670 10020 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:46.656803  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:46.648793  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:46.658241  5960 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:46.660645  6650 raft_consensus.cc:1217] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Deduplicated request from leader. Original: 9.9->[10.10-10.10]   Dedup: 10.10->[]
I20260709 12:25:46.661115  6650 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:25:46.657519  5965 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:25:46.625039  9826 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:46.649868  6648 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:46.665661  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.665827  6084 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:46.666612  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 106744us
I20260709 12:25:46.608500 10297 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:25:46.632261 10274 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:46.675436  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:46.674328  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.653750  9872 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:46.596118  9966 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.621857 10301 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.692016  6009 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.645174 10302 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:46.667497  9826 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.649135 10268 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:46.710651  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45474.9us
I20260709 12:25:46.712687  5960 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 13 index: 7. (index mismatch)
I20260709 12:25:46.691560 10080 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:46.715056  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:46.717670  6115 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:46.700181 10266 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:46.718773  6644 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:46.726326  6651 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:25:46.704783 10197 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:46.702037 10161 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:46.729115  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:46.710217  9826 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:46.707926 10274 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:46.694578 10228 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.032s
I20260709 12:25:46.729174  6646 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:25:46.732122  5960 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
W20260709 12:25:46.743166  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 103279us
I20260709 12:25:46.729135 10186 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:46.729653 10328 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:46.711458 10326 consensus_queue.cc:1059] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:25:46.742129 10284 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.742551 10108 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:46.751564  6039 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:46.865969  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 4 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.866855  6039 raft_consensus.cc:2410] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 4 because replica has last-logged OpId of term: 3 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 2 index: 5.
I20260709 12:25:46.752121 10274 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.752465  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:46.867759  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.868206  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.868975  6037 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:46.868836  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.869625  6039 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:46.753103  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.870744  6036 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:46.871896 10268 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:46.872990 10268 consensus_queue.cc:1243] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer 24012af7747d4c4ea89c3da2ff950099 log is divergent from this leader: its last log entry 11.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:25:46.873183 10259 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:46.748638 10290 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:25:46.753715  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.876236  6041 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:46.876992 10048 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:46.877547 10048 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.753856 10137 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:46.879680  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 204782us
I20260709 12:25:46.880770  6081 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:46.881750  6081 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:46.754035 10328 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:46.883195 10328 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.885092  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:46.885764  5964 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 8 index: 10. (index mismatch)
I20260709 12:25:46.886426  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.886646 10228 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:46.886910  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.755324 10305 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:46.750429 10266 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:46.756649 10161 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.887670  6036 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:46.757205  6009 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:46.759832 10326 raft_consensus.cc:3055] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:25:46.761466 10301 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:46.739059 10294 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:46.764766 10324 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.121s	user 0.000s	sys 0.001s
I20260709 12:25:46.765466 10045 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:46.753123 10334 ts_tablet_manager.cc:933] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:25:46.768775  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.771521  9966 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:46.746452 10197 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:25:46.772508  5963 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:46.778982  6042 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:46.779520  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:46.779068 10193 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:46.787904  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:46.805913  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:46.781229  5960 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:46.824515  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:46.887086 10228 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.887219  6037 raft_consensus.cc:2393] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:46.754612 10295 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:46.888898  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 131795us
I20260709 12:25:46.976255  6609 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:46.890487  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:46.897591  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 218829us
I20260709 12:25:46.903963  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:46.979236  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:46.979633  5959 raft_consensus.cc:2393] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 6: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:25:46.788250 10318 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.308s	user 0.000s	sys 0.001s
I20260709 12:25:46.812029 10258 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:46.887606  9728 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:46.799705 10032 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:46.911887  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:46.813627 10080 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:46.912096  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:46.911302  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:46.808616 10302 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.971982  5967 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
W20260709 12:25:46.972888  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 61761.3us
I20260709 12:25:46.999099  5932 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:46.862836 10272 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:46.903472 10297 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.085s
I20260709 12:25:46.979861  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:46.898644 10326 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:47.006156  5932 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:46.961061 10108 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 12:25:46.797679  9872 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.800081 10047 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.780918 10278 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.995527  6116 raft_consensus.cc:2393] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:46.998392 10248 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:46.801203  9826 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.996851 10349 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:46.879774 10048 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:47.001235  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 240545us
I20260709 12:25:47.001744  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.021915  5959 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:46.981798 10228 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:47.023486 10350 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.024081 10350 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:46.888504 10284 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.004391  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:46.904259 10341 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:46.816483 10145 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.026398 10350 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:47.028239 10284 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:46.905223 10266 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:46.985507  9966 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:47.026832  5960 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:25:47.029115  9966 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:46.988629  9728 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.033888  9728 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.034528 10047 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:47.037635  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:47.009907  5967 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:47.038379  6039 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:25:47.013278  5961 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:47.040051 10267 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:47.040465 10267 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:47.041325 10267 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.042994  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:47.043689  6651 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:47.045279  6082 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:47.045857 10047 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.046480 10047 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.048307  6037 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 6 index: 4. (index mismatch)
I20260709 12:25:47.049062  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:47.049719  6043 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:47.050701  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:47.051126 10342 log.cc:927] Time spent T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:25:47.051854  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:47.052388  5968 raft_consensus.cc:3055] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:47.052829  5968 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:47.052398  6038 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:47.054986 10048 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:47.055382 10048 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.055745 10048 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.057142  9826 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:47.058588 10349 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.060787 10349 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:47.029568  9966 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.055765 10188 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.066394  5962 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:47.070641 10341 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:47.071107 10341 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:47.072077 10178 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.019757 10272 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.076151 10272 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:47.077852 10340 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:47.070376  6039 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:47.082594 10302 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:47.083868  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:47.085738  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:47.086040 10278 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:46.980113 10343 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.047s
I20260709 12:25:47.088358  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:47.091210  6651 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
W20260709 12:25:47.072371  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.092648  6041 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:47.097905  6038 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
W20260709 12:25:46.971462  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 80031.9us
W20260709 12:25:47.100381  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:46.982770 10259 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:25:46.989355 10293 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.032s
I20260709 12:25:47.101015 10311 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.032397  6009 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:47.033396  9872 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:47.028569 10145 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:47.102800  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 56316.9us
W20260709 12:25:47.105522  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 73210.4us
I20260709 12:25:47.104156 10311 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:47.013751  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 123359us
I20260709 12:25:47.106618 10349 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.111948  6609 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:25:47.114306  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 68765.7us
I20260709 12:25:47.117373  5934 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:47.096720 10197 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.106015 10267 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.114073 10290 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:47.162230  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50357.3us
I20260709 12:25:47.159185  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:47.106812 10137 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:47.167570  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:47.166240  6609 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:47.110955 10248 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20260709 12:25:47.150220 10305 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.118206 10166 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.107589 10272 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.061s
I20260709 12:25:47.163408 10259 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:47.113332 10028 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:25:47.170115 10278 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:47.147125 10301 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:25:47.191745 10352 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.022s
I20260709 12:25:47.181912 10166 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.195055 10166 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:47.195228 10354 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:47.191979 10351 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:47.195969 10354 consensus_queue.cc:1059] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:47.179926 10305 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.198525  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:47.198975 10305 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:47.200395  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:47.186559  9826 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.194772 10304 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:47.161409 10349 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.212635 10354 raft_consensus.cc:3055] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:47.212924 10311 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:47.213201 10354 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:47.204445  9826 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.215840  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:47.216775 10304 raft_consensus.cc:697] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:47.217903 10304 consensus_queue.cc:237] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 5.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.221652 10341 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.169880 10290 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.223201 10028 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:47.223810 10028 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.225239 10290 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:47.225898 10028 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:47.227146 10047 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:47.205202 10297 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.228019 10297 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.186738 10259 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:47.228948 10259 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:47.195479 10320 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:47.230906 10320 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.231237 10320 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.214188 10354 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.189998  9915 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:25:47.232713 10354 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:47.203621 10334 tablet_copy_client.cc:323] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.65:42981
I20260709 12:25:47.235095 10349 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:47.111799 10326 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.202795  9728 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.167447 10197 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:47.237726  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 50986.1us
I20260709 12:25:47.230154 10297 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:47.204903 10350 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.239996 10248 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:47.240692 10350 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.251580  6084 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:47.255872 10301 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:47.256299 10301 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.256629 10301 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:47.261617  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:47.265208  6116 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
W20260709 12:25:47.275158  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 269071us
I20260709 12:25:47.275267  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:47.276212  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:47.236653 10048 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.280352  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:47.296006  6113 raft_consensus.cc:2368] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:25:47.296236  6112 raft_consensus.cc:2955] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:25:47.268064 10258 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:47.304250  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.277674 10272 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:47.307986  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:47.266278  9966 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.311230  6118 raft_consensus.cc:2368] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11.
I20260709 12:25:47.312696  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:47.318399 10032 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.318602  9728 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:47.319005 10032 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.319864 10048 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:47.321059 10032 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:47.312898 10360 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:47.317422  5934 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:47.324072  5932 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:47.324008 10285 consensus_queue.cc:1059] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:47.307679 10080 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.406865 10080 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.409042 10080 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:47.314579 10350 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:47.276549 10228 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.364833  5934 leader_election.cc:400] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:25:47.416524  5934 leader_election.cc:403] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:25:47.322347 10272 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.324951 10145 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:47.308185 10258 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:47.419806  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 303034us
W20260709 12:25:47.420617  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 96634.1us
I20260709 12:25:47.422672  5932 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:47.425297  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 98240.2us
I20260709 12:25:47.405930 10132 raft_consensus.cc:2955] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:25:47.413918 10278 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:47.422569  6082 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:47.434378  5934 leader_election.cc:400] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11.
I20260709 12:25:47.435001  5934 leader_election.cc:403] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
W20260709 12:25:47.419868 10362 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.108s	user 0.009s	sys 0.000s
I20260709 12:25:47.423705 10108 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:47.460271  5932 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:47.462677  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.462908  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:47.463431  5967 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:47.460106  6082 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:47.458323 10350 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:47.434103 10145 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:47.466166  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:47.466156  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.467589  5960 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:47.435678 10341 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:47.471524  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:47.459244 10248 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:47.470449  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:47.434515 10278 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:47.473834  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.479089  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:47.477301  5967 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:47.424145 10272 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.464386 10360 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:47.486361  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:47.468086 10350 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:47.487903  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:47.493732  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.494350  6116 raft_consensus.cc:2393] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:47.494401  5967 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:47.464586 10363 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.495076  6113 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 7: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:47.473726 10047 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:47.500756 10337 raft_consensus.cc:993] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:47.497505  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:47.481539 10278 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.509605  6111 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:47.514344 10337 raft_consensus.cc:1081] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:47.515033  9826 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:47.517745  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.517663  6113 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:25:47.515529 10047 raft_consensus.cc:697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:47.516323  6118 raft_consensus.cc:2393] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:47.493173  9966 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:47.495915 10350 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:47.532608  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 43578.4us
I20260709 12:25:47.533609  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.536405  5959 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:25:47.537981 10366 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:25:47.539455  5967 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:25:47.513808 10320 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.541203  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:47.541815  6114 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:25:47.542867  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:47.543449  6042 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.544200  6044 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 7 index: 7. (term mismatch)
I20260709 12:25:47.544520  6044 pending_rounds.cc:85] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 6
I20260709 12:25:47.544723  6044 pending_rounds.cc:107] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 6.7
I20260709 12:25:47.544950  6044 raft_consensus.cc:2889] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:47.547035  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.547704  5962 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:25:47.548477  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.549872  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:47.550444  6038 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:47.550776  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:47.529558  9826 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:47.552660  6044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:25:47.559643  6044 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:47.554034  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:47.560348  6035 raft_consensus.cc:2368] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:25:47.554776  5962 raft_consensus.cc:2393] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:47.557256  6040 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:25:47.557842  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:47.562076  6043 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:25:47.559011  6036 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 6. (term mismatch)
I20260709 12:25:47.562937  6036 pending_rounds.cc:85] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 5
I20260709 12:25:47.563190  6036 pending_rounds.cc:107] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 3.6
I20260709 12:25:47.563408  6036 raft_consensus.cc:2889] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:47.553927  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:47.565044  6039 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:47.565975  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:47.566610  6037 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:47.570713 10047 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.573637  6038 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:47.557258  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:47.575652  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:47.576543  6608 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:47.576918  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:47.577934  5978 tablet_copy_service.cc:140] P f1bb8e63c2b448cdafd51f05d277c741: Received BeginTabletCopySession request for tablet 7d1c158430bb487aa1d4c5a69165aa32 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:37174)
I20260709 12:25:47.578503  5978 tablet_copy_service.cc:161] P f1bb8e63c2b448cdafd51f05d277c741: Beginning new tablet copy session on tablet 7d1c158430bb487aa1d4c5a69165aa32 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:37174: session id = 24012af7747d4c4ea89c3da2ff950099-7d1c158430bb487aa1d4c5a69165aa32
I20260709 12:25:47.578917  6117 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:47.582273 10188 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:47.582717 10188 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.583042 10188 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:47.583906 10320 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:47.584479 10320 consensus_queue.cc:1059] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:47.585258 10320 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:47.585582 10320 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:47.585918 10320 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:47.586158 10331 raft_consensus.cc:3055] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:47.586551 10331 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:47.587402 10331 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.587800 10302 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:47.588270 10302 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:47.588758 10331 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:47.589215 10302 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.565326  5960 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:47.594086  6038 raft_consensus.cc:1217] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Deduplicated request from leader. Original: 9.9->[10.10-10.10]   Dedup: 10.10->[]
I20260709 12:25:47.594609  6038 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:25:47.562330  6042 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:25:47.597884  6609 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:47.598727 10019 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:47.599269 10019 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:47.600132 10019 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.596729  6044 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:47.595196  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:47.608803  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:47.609457  6114 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:47.593014 10258 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:47.551124 10228 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:47.620036  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:47.625303  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.625653  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:47.626242  5960 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:47.590338 10302 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:47.626271  6118 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:47.623847  6113 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:25:47.626312  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:47.628456  6037 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.573671 10108 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:47.630062 10341 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.006s
I20260709 12:25:47.625185 10028 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.640182  5968 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.641167  5968 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.641660  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:47.642239  5960 raft_consensus.cc:2376] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11. Re-sending same reply.
I20260709 12:25:47.644097  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:47.648214  5932 leader_election.cc:400] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:25:47.651126  5968 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:25:47.651628  5968 pending_rounds.cc:85] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 9
I20260709 12:25:47.651887  5968 pending_rounds.cc:107] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:25:47.652143  5968 raft_consensus.cc:2889] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:47.652859 10300 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 11 current term: 11 is higher.
I20260709 12:25:47.632666 10080 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.640102 10028 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.653643 10080 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.652856  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 988) took 1417 ms. Trace:
I20260709 12:25:47.656652  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:47.657414  6118 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:47.657320  6037 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:25:47.660162  6044 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.660288  6609 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:47.661571 10161 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:47.656271  5968 rpcz_store.cc:276] 0709 12:25:46.235843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.238022 (+  2179us) service_pool.cc:224] Handling call
0709 12:25:46.238322 (+   300us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:47.052280 (+813958us) spinlock_profiling.cc:243] Waited 29.8 ms on lock 0x7b54003014a0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fcbdc0 00007f48210561c0 00007f4821057231 00007f4821053d8f 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c
0709 12:25:47.639827 (+587547us) spinlock_profiling.cc:243] Waited 94 ms on lock 0x7b54003014a0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fd206f 00007f482104af60 00007f482104c7de 00007f4821056b49 00007f4821057416 00007f4821053d8f 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62
0709 12:25:47.652583 (+ 12756us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.652793 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":284875392}
I20260709 12:25:47.630976 10145 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:25:47.662256  6044 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:47.606230 10337 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:25:47.603432  9826 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.662567 10248 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.006s
I20260709 12:25:47.655246 10028 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:47.680789  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:47.657828  9966 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:47.679858 10228 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.729612  9966 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:47.729661 10228 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.730710  9966 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.731950 10228 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:47.680086 10198 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.732751 10198 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.734880 10198 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:47.687623 10080 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:47.690346  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.736608  5934 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:47.737859  9915 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:47.690912 10266 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:47.738242  9915 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:47.691738 10197 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:47.662225 10161 raft_consensus.cc:697] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:47.692618  5932 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:25:47.740036  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 47506.3us
I20260709 12:25:47.715867  5968 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:47.740705  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:47.697764  6081 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:47.740309 10161 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:47.741742  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 44059.6us
I20260709 12:25:47.742426  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:47.743214  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:47.743939  6081 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:47.744172 10355 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:47.744614 10228 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:47.634295 10267 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:25:47.745411 10228 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:47.745903 10228 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:47.747108 10198 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:47.747704 10198 raft_consensus.cc:697] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:47.748588 10198 consensus_queue.cc:237] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.662874 10372 consensus_queue.cc:1059] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 4.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:25:47.698405 10368 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.751683 10368 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.754091 10368 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:47.710091 10326 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:47.714866  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:47.714418  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.685073 10284 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:25:47.728323 10259 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.647419 10301 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.739095  9915 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.744591 10355 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:47.746757 10228 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.719100 10343 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20260709 12:25:47.707888  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.724247  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:47.790298  5967 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:47.795001  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:47.757812  5968 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:25:47.796767  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.797369  5968 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:47.744717  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:47.801047  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 56399.3us
I20260709 12:25:47.768334  6117 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:25:47.770326  5932 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:47.781694  6118 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:47.798144  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.746656 10080 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:47.786365  6113 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:47.740293  9826 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:47.803619  5968 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:47.806787  6645 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:47.807781  6651 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:47.808764  6646 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:25:47.820312  6115 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:47.786553  6110 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:47.785259 10248 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:47.825431  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:47.829082  6643 raft_consensus.cc:3055] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:47.829397  6643 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:47.774995 10145 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:47.786049 10355 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:47.832382  6009 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:47.833432  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.831689  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.662388 10320 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.814925 10080 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.841925  5968 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 4 index: 6. (index mismatch)
I20260709 12:25:47.835369 10032 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:47.838264  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:47.845016  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 74750.5us
W20260709 12:25:47.840279  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:47.854450  6651 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:47.828578 10248 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.818693  9872 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:47.838408 10193 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:47.836277  6643 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.799795 10267 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:25:47.844688 10080 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.824774 10278 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.840845  5965 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:47.864370  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:47.872342  6647 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:47.845826 10197 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:47.881448  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.835716 10188 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.864564 10372 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:47.881940  6643 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:47.873896 10193 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.880151 10132 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48350 (request call id 0) took 3732 ms. Trace:
I20260709 12:25:47.882640  6651 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:47.862557  5967 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:25:47.868858 10248 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:47.885226  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:47.869127  9872 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:47.838912 10145 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.882418  5963 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:47.881438  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:47.890453  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:47.861042 10032 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.896905 10268 raft_consensus.cc:3055] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:47.947359  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:47.948395  6038 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:47.897363 10045 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:47.897784 10295 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:47.861550 10290 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.022s
I20260709 12:25:47.879653 10351 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.910241 10374 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.922267 10372 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:47.865675 10350 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.921231  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:47.923389  5959 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:47.907449  6081 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:47.999504  5967 raft_consensus.cc:2410] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:47.927680  6648 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:25:47.941641  6643 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:48.000888  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:47.956224  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:47.878784  9826 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.910002 10284 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:47.902820 10193 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:47.960793  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:47.967449  6651 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:47.926875  9872 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:47.881373 10363 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11.
I20260709 12:25:48.002513  6647 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:48.002629  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:47.999634  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 92265.3us
I20260709 12:25:47.946792 10268 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:48.008574  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:48.035954  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:48.038337  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:48.029052  6112 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:48.038765  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:48.039527  5961 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:48.038160  6081 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:48.040542  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:48.041090  6081 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:48.039487  6116 raft_consensus.cc:2368] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 8. Current term is 9.
I20260709 12:25:48.042629  5934 leader_election.cc:400] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 8. Current term is 9.
I20260709 12:25:48.027215  6649 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:48.042897  5934 leader_election.cc:403] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:48.038142  6647 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:48.046824  6081 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:48.047502  9634 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:48.047824  9634 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.048072  9634 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:48.042454  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:48.049649  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 98325.7us
I20260709 12:25:47.954989 10293 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.073s
I20260709 12:25:48.054144  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:48.050511  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:48.055121  5961 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:48.008002 10028 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:48.055224  6643 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:48.054419  6081 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:47.955493 10341 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:25:48.051643  6009 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:47.958590 10045 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:47.986918 10295 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:47.989938 10351 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:48.080933 10045 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:48.067476 10278 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:47.991704 10266 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.062s
I20260709 12:25:48.081729 10045 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:48.081441 10351 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:48.050813 10343 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:48.083851 10343 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.084271 10343 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:47.902987 10132 rpcz_store.cc:276] 0709 12:25:44.148101 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:44.148289 (+   188us) service_pool.cc:224] Handling call
0709 12:25:44.200901 (+ 52612us) log.cc:844] Serialized 499 byte log entry
0709 12:25:47.880067 (+3679166us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":49,"raft.queue_time_us":484,"raft.run_cpu_time_us":2246,"raft.run_wall_time_us":30021,"spinlock_wait_cycles":158848,"thread_start_us":75657,"threads_started":1,"wal-append.queue_time_us":120333,"wal-append.run_cpu_time_us":3229,"wal-append.run_wall_time_us":1130861}
W20260709 12:25:48.087432 10373 log.cc:927] Time spent T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.452s	user 0.000s	sys 0.006s
I20260709 12:25:48.089648 10350 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:48.090646  5967 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:48.069416  9728 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:48.044608 10301 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:48.126389  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:48.127625  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:48.070741 10268 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:48.070322  6642 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:48.073814 10188 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:48.000548 10374 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:48.075256  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:48.058239 10028 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.037603 10259 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:48.099593  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:48.157296  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:48.081369 10295 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:48.107838  6042 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: [5.8-5.8]
I20260709 12:25:48.205871  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:48.108397  5962 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:48.206632  6116 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
W20260709 12:25:48.206817 10385 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:25:48.155107 10028 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:48.057384 10267 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.093s
I20260709 12:25:48.112828  9728 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:48.223318  9728 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:48.227694  9915 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:48.109181  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:48.073714 10377 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.230s	user 0.000s	sys 0.001s
I20260709 12:25:48.070987 10145 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:48.054067 10178 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:48.231709 10178 raft_consensus.cc:697] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:48.232688 10178 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:48.132011  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:48.082264 10045 raft_consensus.cc:697] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:48.236589 10045 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:48.238713 10388 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:25:48.090600 10272 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:48.139106  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:48.142480  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:48.025955  9826 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:48.145501  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:48.153429  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:48.161983 10370 log.cc:927] Time spent T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.681s	user 0.003s	sys 0.000s
I20260709 12:25:48.183152  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:48.243099  5968 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:48.230183  9915 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:48.192487  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:48.198071 10375 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.547s	user 0.002s	sys 0.000s
I20260709 12:25:48.201145  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:48.202566 10358 log.cc:927] Time spent T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.759s	user 0.009s	sys 0.000s
I20260709 12:25:48.203293  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:48.256630  6110 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:48.105752  9634 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:48.090663 10320 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:48.120394 10266 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:48.046095 10284 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:48.136461  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:48.185602  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:48.247145  6040 raft_consensus.cc:2393] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:25:48.274212  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 137851us
I20260709 12:25:48.248319  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:48.274979  6643 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:48.250051  5963 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:25:48.252383  5968 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:48.252445  9872 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:48.265962  9728 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:48.248296  5934 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:48.246940  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 192590us
I20260709 12:25:48.276330  6084 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:48.156750 10268 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:48.279516  9634 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:48.299629  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:48.280683  5959 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:48.281580  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:48.320791  5966 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:25:48.322952  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 46693.3us
I20260709 12:25:48.323766  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:48.324595  5959 raft_consensus.cc:2368] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11.
I20260709 12:25:48.251353 10267 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.297281 10228 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:48.318585 10393 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.338325  6110 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:25:48.071537 10372 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:48.253674 10295 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:48.340118  9634 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.356382  9634 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:48.343832  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 95621.8us
I20260709 12:25:48.254590 10293 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.087s
I20260709 12:25:48.343302 10259 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
W20260709 12:25:48.352929 10383 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.294s	user 0.001s	sys 0.000s
I20260709 12:25:48.355624  6643 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:25:48.361068  6650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1105) took 1698 ms. Trace:
I20260709 12:25:48.341650 10048 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:48.342427 10350 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:48.347659 10032 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:48.353224 10267 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:48.282994 10266 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:48.359401  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:48.329988  5965 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:25:48.379686  5966 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:48.338805 10392 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 8. Current term is 9.
I20260709 12:25:48.325273 10340 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:25:48.367719  6650 rpcz_store.cc:276] 0709 12:25:46.662280 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.662707 (+   427us) service_pool.cc:224] Handling call
0709 12:25:46.664049 (+  1342us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:47.001794 (+337745us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:47.001832 (+    38us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:47.005826 (+  3994us) log.cc:844] Serialized 26 byte log entry
0709 12:25:47.177742 (+171916us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:47.177781 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:47.178004 (+   223us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:48.201857 (+1023853us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:48.353978 (+152121us) raft_consensus.cc:1685] finished
0709 12:25:48.354005 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:48.360979 (+  6974us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":46832,"raft.run_cpu_time_us":122,"raft.run_wall_time_us":123,"spinlock_wait_cycles":3602304,"thread_start_us":399310,"threads_started":2,"wal-append.queue_time_us":318602}
W20260709 12:25:48.389810  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 263183us
I20260709 12:25:48.352600 10228 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:48.397269  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:48.407765  5966 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:48.411794 10293 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.412449 10293 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:48.396488  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:48.361912 10341 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:48.422209  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 62865.9us
I20260709 12:25:48.367657 10259 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:48.423358 10080 consensus_meta.cc:287] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.539s	user 0.007s	sys 0.002s
I20260709 12:25:48.427843  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:48.381479 10350 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.381210 10048 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.433086  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:48.442214 10374 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:48.443514  6608 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:48.444501  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:48.435369  5966 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:25:48.445338 10311 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:48.417662 10145 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:48.448957  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 297230us
I20260709 12:25:48.448782  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:48.418375 10228 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:48.449443  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:48.366986 10295 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:48.452581  5959 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:48.430792 10259 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:48.438696 10350 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:48.440872 10048 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:48.360502 10393 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:48.421914 10032 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.056s
I20260709 12:25:48.478785 10311 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:48.493605 10311 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:48.494804 10340 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
W20260709 12:25:48.488380 10390 log.cc:927] Time spent T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.163s	user 0.001s	sys 0.000s
I20260709 12:25:48.499619 10266 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:48.500252 10266 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:48.502733  6081 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:48.503747  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:48.504226 10400 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.142s	user 0.000s	sys 0.000s
I20260709 12:25:48.504354  5967 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:48.488636  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:48.489177  9728 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:48.489696 10193 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:48.439931 10028 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:48.440302 10080 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:48.472229  5978 tablet_copy_source_session.cc:215] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:25:48.506755  5968 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:48.479490 10161 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:48.507375  6081 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:48.510633  5959 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:25:48.516430  6043 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:48.432344 10341 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:48.504367 10352 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:25:48.519357  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 44429.4us
I20260709 12:25:48.525590  5968 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:48.527726  5967 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
W20260709 12:25:48.508402  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:48.540393  6081 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:48.550704  6040 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:25:48.552237  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 207328us
I20260709 12:25:48.554987 10407 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.554549  6037 raft_consensus.cc:2955] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Committing config change with OpId 7.6: config changed from index -1 to 6, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:25:48.563423  6084 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:48.565585  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2334) took 1013 ms. Trace:
I20260709 12:25:48.564128  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:48.574007  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 140985us
I20260709 12:25:48.573956  6081 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:48.577440  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:48.580173  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:48.550916 10355 consensus_meta.cc:287] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.716s	user 0.005s	sys 0.006s
I20260709 12:25:48.584635  6043 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:48.588392  6041 rpcz_store.cc:276] 0709 12:25:47.552515 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.552630 (+   115us) service_pool.cc:224] Handling call
0709 12:25:47.552908 (+   278us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:47.553192 (+   284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:47.553220 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:48.474177 (+920957us) spinlock_profiling.cc:243] Waited 5.08 ms on lock 0x7b2c00000238. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f94da11 00007f481f95d372 00007f482108fa01 00007f482105443a 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2
0709 12:25:48.474580 (+   403us) log.cc:844] Serialized 26 byte log entry
0709 12:25:48.565155 (+ 90575us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:48.565195 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.565265 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:48.565311 (+    46us) raft_consensus.cc:1685] finished
0709 12:25:48.565320 (+     9us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:48.565518 (+   198us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":74,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":36089,"spinlock_wait_cycles":11682688,"thread_start_us":74360,"threads_started":1,"wal-append.queue_time_us":74969}
I20260709 12:25:48.550148  9728 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:48.593672  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:48.597847  5959 raft_consensus.cc:2410] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 10 because replica has last-logged OpId of term: 8 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
I20260709 12:25:48.593993  6110 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
W20260709 12:25:48.594619  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 44627.5us
I20260709 12:25:48.571822 10352 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:48.564584  9826 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:48.607353  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:48.613869  6041 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:48.574766 10161 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:48.610428  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:48.610591 10415 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:48.587237  9872 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:48.594743 10340 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:48.616511  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:48.629410  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:48.596284 10047 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:25:48.625229  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 61070.6us
I20260709 12:25:48.555616 10407 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:48.625653  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:48.600723 10284 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:48.596499 10411 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:48.754091  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:48.619441 10320 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:48.755846  5978 rpcz_store.cc:275] Call kudu.tserver.TabletCopyService.BeginTabletCopySession from 127.0.0.1:37174 (request call id 1001) took 1213 ms. Trace:
I20260709 12:25:48.756798 10341 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:48.759220 10426 consensus_queue.cc:1059] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:48.760217 10161 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 6.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:48.592495 10355 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:48.614936 10045 raft_consensus.cc:476] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Not starting pre-election -- already a leader
I20260709 12:25:48.763921  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:48.618511  9728 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:48.774350  6041 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:48.618126 10290 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.147s
I20260709 12:25:48.778893  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:48.633513 10401 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:48.763455 10326 consensus_meta.cc:287] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.987s	user 0.012s	sys 0.000s
I20260709 12:25:48.798899  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:48.765388  5978 rpcz_store.cc:276] 0709 12:25:47.565733 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.577691 (+ 11958us) service_pool.cc:224] Handling call
0709 12:25:48.439342 (+861651us) spinlock_profiling.cc:243] Waited 451 ms on lock 0x7b540008be54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482105e3f7 00007f4825ff4036 00007f4825ffda3e 00007f481d8c127b 00007f4825ffd9ba 00007f4825ff8acc 00007f4825ff3c7b 00007f4825fe88d1 00007f482509c4b4 00007f482509c442
0709 12:25:48.755754 (+316412us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1038283136}
I20260709 12:25:48.753221 10411 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.815562  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:48.819609  6041 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:48.628633  9966 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.152s
I20260709 12:25:48.634661 10340 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:48.823902  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 260619us
I20260709 12:25:48.824488  6648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 1105) took 1035 ms. Trace:
I20260709 12:25:48.764688 10320 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:48.862293  6041 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:25:48.762843 10267 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:48.628871 10415 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:48.934603  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 114785us
I20260709 12:25:48.934985  6648 rpcz_store.cc:276] 0709 12:25:47.789099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.818148 (+ 29049us) service_pool.cc:224] Handling call
0709 12:25:47.826936 (+  8788us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:47.999935 (+172999us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.824215 (+824280us) spinlock_profiling.cc:243] Waited 100 ms on lock 0x7b540066dfd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:48.824427 (+   212us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":231104256}
I20260709 12:25:48.937608  6611 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:48.821297 10402 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:48.932698  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 318812us
I20260709 12:25:48.940595 10402 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:48.941045 10402 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:48.933825 10320 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:48.971753  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:48.796160 10363 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:48.947633  5960 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:48.937084 10409 raft_consensus.cc:3055] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:48.994635  6042 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:48.970505  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 5 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:48.998386  6035 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:49.006213  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:49.000157 10080 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:48.947613 10326 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:49.000479 10259 consensus_meta.cc:287] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.515s	user 0.000s	sys 0.008s
I20260709 12:25:48.972235 10228 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.002791  6006 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:49.003479  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2587) took 1740 ms. Trace:
I20260709 12:25:49.004925  5968 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:48.881747 10331 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:48.881105 10266 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:48.992587 10108 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:48.970427 10392 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.008122  6081 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:49.009749 10394 log.cc:927] Time spent T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
I20260709 12:25:49.013656  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:49.013602  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 394077us
W20260709 12:25:48.995289 10420 log.cc:927] Time spent T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.061s	user 0.001s	sys 0.000s
W20260709 12:25:49.000394 10343 consensus_meta.cc:287] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.916s	user 0.010s	sys 0.000s
I20260709 12:25:49.026607 10198 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:48.948024 10295 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:48.826040 10411 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:49.023896  6115 rpcz_store.cc:276] 0709 12:25:47.254063 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.254232 (+   169us) service_pool.cc:224] Handling call
0709 12:25:47.254583 (+   351us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:47.820731 (+566148us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.974514 (+1153783us) spinlock_profiling.cc:243] Waited 564 ms on lock 0x7b540021cad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:48.994661 (+ 20147us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1296866176}
I20260709 12:25:49.011710  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:48.996423 10028 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:49.017000 10350 consensus_meta.cc:287] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.507s	user 0.008s	sys 0.000s
I20260709 12:25:49.036540 10395 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:49.037164 10422 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
W20260709 12:25:49.038010 10381 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 1.001s	user 0.004s	sys 0.003s
I20260709 12:25:49.038190  5960 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 8. (index mismatch)
I20260709 12:25:49.038348 10108 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.041108 10293 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:49.044255 10248 consensus_meta.cc:287] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 1.114s	user 0.010s	sys 0.000s
I20260709 12:25:49.045913 10228 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.015506 10193 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:49.047268 10384 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 1.039s	user 0.002s	sys 0.004s
I20260709 12:25:46.981316  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:25:49.029843 10423 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.216s	user 0.001s	sys 0.000s
I20260709 12:25:49.068571  6644 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:49.009999 10409 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:49.081945  6035 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
W20260709 12:25:49.084031  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 76003.3us
W20260709 12:25:49.041127 10268 consensus_meta.cc:287] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.718s	user 0.007s	sys 0.000s
I20260709 12:25:49.023797  6006 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:49.083387  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2230) took 1614 ms. Trace:
I20260709 12:25:49.030192 10393 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.029325 10331 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:48.823252 10401 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:49.082674 10385 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
I20260709 12:25:49.146687 10193 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.134232 10248 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.066102 10354 raft_consensus.cc:3055] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:49.018639 10363 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.109754  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.083926  9872 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.025832 10259 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.113281  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:49.153307 10406 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.143s	user 0.000s	sys 0.001s
I20260709 12:25:49.088925 10045 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:25:48.825407 10352 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.019696  9728 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.050730 10266 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.131081  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:49.136543  5962 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 2236) took 1575 ms (client timeout 1657 ms). Trace:
W20260709 12:25:49.198230  5962 rpcz_store.cc:269] 0709 12:25:47.560885 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.594974 (+ 34089us) service_pool.cc:224] Handling call
0709 12:25:49.136325 (+1541351us) spinlock_profiling.cc:243] Waited 446 ms on lock 0x7b54002f1a54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:49.136454 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1025326464}
I20260709 12:25:49.170900 10355 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.083068 10392 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.098826 10198 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:49.121141 10028 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:49.090970 10343 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.161741  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:49.155092  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:49.149446  5964 rpcz_store.cc:276] 0709 12:25:47.469365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.469538 (+   173us) service_pool.cc:224] Handling call
0709 12:25:47.469850 (+   312us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:47.509523 (+ 39673us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:47.509554 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:47.516386 (+  6832us) log.cc:844] Serialized 26 byte log entry
0709 12:25:47.646734 (+130348us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:47.646894 (+   160us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.065375 (+1418481us) spinlock_profiling.cc:243] Waited 39.3 ms on lock 0x7b5400198054. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:49.066282 (+   907us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:49.066342 (+    60us) raft_consensus.cc:1685] finished
0709 12:25:49.066356 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:49.083319 (+ 16963us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":15425,"raft.run_cpu_time_us":107,"raft.run_wall_time_us":3726,"spinlock_wait_cycles":90289920,"thread_start_us":114250,"threads_started":1,"wal-append.queue_time_us":254714}
I20260709 12:25:49.176709  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:49.215466  6111 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:49.181224  6041 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
W20260709 12:25:49.177438  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.217051  5934 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:49.217427  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:49.218009  5962 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:49.177801  6650 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:25:49.219431  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:49.193814 10080 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:49.179688  9634 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:49.178715  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:49.175316  6608 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:49.180738  6040 raft_consensus.cc:2410] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:25:49.172730  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 148988us
I20260709 12:25:49.184648  6649 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:49.111599 10350 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.186841  6036 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:49.113351  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1006) took 1233 ms. Trace:
I20260709 12:25:49.187424  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:49.200028 10393 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:49.228039  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:49.189695  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:49.225044  5965 rpcz_store.cc:276] 0709 12:25:47.880417 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.440433 (+560016us) service_pool.cc:224] Handling call
0709 12:25:48.474173 (+ 33740us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:48.474629 (+   456us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:48.474658 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:48.475094 (+   436us) log.cc:844] Serialized 26 byte log entry
0709 12:25:48.587214 (+112120us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:48.595332 (+  8118us) log.cc:844] Serialized 14 byte log entry
0709 12:25:48.600992 (+  5660us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.601183 (+   191us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:49.113136 (+511953us) raft_consensus.cc:1685] finished
0709 12:25:49.113154 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:49.113288 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4868,"prepare.queue_time_us":8737,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":41,"raft.queue_time_us":6588,"raft.run_cpu_time_us":315,"raft.run_wall_time_us":14718,"thread_start_us":71675,"threads_started":1,"wal-append.queue_time_us":334004}
I20260709 12:25:49.190320  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:49.197256  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:49.200488  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:49.172129 10331 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.202179  6038 raft_consensus.cc:2393] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:49.142033  5960 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:49.180083 10354 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:25:49.204941  6037 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.011s	sys 0.014s
W20260709 12:25:49.238950  6037 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.655s	user 0.011s	sys 0.014s
I20260709 12:25:49.205598 10340 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.204840  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:49.243691  6115 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:49.207929  6647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 838) took 1105 ms. Trace:
I20260709 12:25:49.171916 10434 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:49.172190 10047 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:25:49.195127 10417 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.377s	user 0.000s	sys 0.001s
I20260709 12:25:49.220156  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:49.116953 10395 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.222307  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:49.172049  5966 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: [6.4-6.4]
I20260709 12:25:49.255646  6036 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:49.256645  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:49.215344  6117 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:49.195034 10368 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:49.225898  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 50681.5us
I20260709 12:25:49.189457  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:49.232113  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:49.232991  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.184796 10193 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.179605 10407 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.193353  9872 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.242220 10108 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.244102  6647 rpcz_store.cc:276] 0709 12:25:48.102276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.172093 (+ 69817us) service_pool.cc:224] Handling call
0709 12:25:48.172499 (+   406us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:48.341173 (+168674us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:48.341203 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:48.347438 (+  6235us) log.cc:844] Serialized 26 byte log entry
0709 12:25:48.531709 (+184271us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:48.531743 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.203501 (+671758us) spinlock_profiling.cc:243] Waited 168 ms on lock 0x7b5400823f54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:49.203555 (+    54us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:49.203610 (+    55us) raft_consensus.cc:1685] finished
0709 12:25:49.203625 (+    15us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:49.207849 (+  4224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":457,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":5206,"spinlock_wait_cycles":387075328,"thread_start_us":150817,"threads_started":1,"wal-append.queue_time_us":200286}
I20260709 12:25:49.222029 10272 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.249716  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:49.249603  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:49.233294 10410 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.147s	user 0.000s	sys 0.001s
I20260709 12:25:49.252100  6116 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:49.231637 10080 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.322643  6038 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:49.246344 10268 consensus_queue.cc:1059] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:25:49.221170 10293 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:49.243889  6113 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:49.254527  5967 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.223205  5964 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:25:49.246294 10405 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.254s	user 0.001s	sys 0.001s
I20260709 12:25:49.232589 10197 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:49.271734  6039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.000s	sys 0.013s
W20260709 12:25:49.361465  6039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.595s	user 0.001s	sys 0.016s
I20260709 12:25:49.362147  6651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 1111) took 1259 ms. Trace:
I20260709 12:25:49.362589  6651 rpcz_store.cc:276] 0709 12:25:48.102772 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.187156 (+ 84384us) service_pool.cc:224] Handling call
0709 12:25:48.187627 (+   471us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:48.188012 (+   385us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:48.188041 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:48.188674 (+   633us) log.cc:844] Serialized 26 byte log entry
0709 12:25:48.475128 (+286454us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:48.475166 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.475224 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:49.361915 (+886691us) raft_consensus.cc:1685] finished
0709 12:25:49.361936 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:49.362076 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":25243,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":86,"thread_start_us":285799,"threads_started":1,"wal-append.queue_time_us":629263}
I20260709 12:25:49.363734  6039 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:25:49.364739 10393 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:49.313473 10433 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:49.282222  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 59988us
I20260709 12:25:49.229803 10028 raft_consensus.cc:697] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:49.227747 10258 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:49.286530  6114 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.373893  5967 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:25:49.289647 10341 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:49.289995  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 71574.4us
W20260709 12:25:49.290524  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 60232.6us
W20260709 12:25:49.290948  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 97537.8us
I20260709 12:25:49.299391 10248 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.292394  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.289361 10448 raft_consensus.cc:2764] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 6: won
I20260709 12:25:49.231106 10295 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:25:49.253399  5962 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:49.302580  6115 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:49.326519 10080 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.327021 10401 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.284324 10434 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.328464 10350 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.365731 10433 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:49.334523 10430 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:25:49.334900  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2339) took 1430 ms. Trace:
I20260709 12:25:49.335026 10415 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.336545 10193 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.339287  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2240) took 1464 ms. Trace:
I20260709 12:25:49.298251 10178 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:49.211951 10409 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.323099 10354 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.344506 10411 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.345185 10331 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.346010 10395 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.284534 10047 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.346935 10320 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.347597 10392 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:49.348430 10436 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:49.339784 10343 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:49.349689 10266 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.300187 10198 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.293471 10402 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.444001  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1009) took 1197 ms. Trace:
I20260709 12:25:49.296422 10368 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.447196 10368 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.301247 10431 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.053s
I20260709 12:25:49.450729  6648 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:25:49.352440 10304 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:49.451515 10304 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.445430 10402 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.453704 10304 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:49.352496 10334 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7d1c158430bb487aa1d4c5a69165aa32. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:25:49.353243 10272 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:49.333595 10437 log.cc:927] Time spent T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.137s	user 0.000s	sys 0.001s
I20260709 12:25:49.284523 10340 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.073s
I20260709 12:25:49.455229 10340 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:49.455570 10340 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:49.455848 10272 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.456415 10340 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.428082 10439 consensus_queue.cc:1059] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.029s
W20260709 12:25:49.404844 10048 consensus_meta.cc:287] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.894s	user 0.008s	sys 0.004s
I20260709 12:25:49.457634 10340 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:49.360474  6111 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:49.457811 10048 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:49.458873  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.387007 10341 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.366659  6006 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:25:49.289023  6044 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.008s	sys 0.001s
I20260709 12:25:49.377465  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:49.460311  6044 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.847s	user 0.008s	sys 0.001s
W20260709 12:25:49.460623  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 94020.8us
W20260709 12:25:49.460814  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 83412.4us
I20260709 12:25:49.242636 10267 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:25:49.387323  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 169131us
I20260709 12:25:49.462085  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:49.462395  6006 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:49.462965  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:49.463135 10047 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:49.389539  5967 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:25:49.291540 10045 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:25:49.462549  5934 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:49.402105 10028 consensus_queue.cc:237] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.8, Last appended by leader: 8, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.464569  6006 leader_election.cc:400] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11.
I20260709 12:25:49.391294  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:49.392342  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:49.464907  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:49.392679  6038 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:49.394840  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:49.466053  5962 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.466413  5964 raft_consensus.cc:2376] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11. Re-sending same reply.
I20260709 12:25:49.466656 10248 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:49.467073 10248 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.467378 10372 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:49.467499 10248 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.468187 10407 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:49.395135  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:49.468575 10407 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:49.468886  5963 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:49.395164  6114 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:25:49.358139 10363 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.391763  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:49.470487  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 78779.8us
I20260709 12:25:49.464860  6006 leader_election.cc:403] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:25:49.313687 10284 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:25:49.333595 10188 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:49.401790  6112 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:25:49.399887  6037 rpcz_store.cc:276] 0709 12:25:47.904161 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.904342 (+   181us) service_pool.cc:224] Handling call
0709 12:25:47.929290 (+ 24948us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:47.929622 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:47.929646 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:48.165262 (+235616us) spinlock_profiling.cc:243] Waited 27.2 ms on lock 0x7b4c002236c0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f320a20 00007f481f331a29 00007f481f2f7644 00007f481f31ef2d 00007f481f31eb93 00007f482104f18b 00007f482104fcb5 00007f4821051004 00007f4821050729 00007f4821055d96 00007f482104aadb
0709 12:25:48.194099 (+ 28837us) log.cc:844] Serialized 499 byte log entry
0709 12:25:48.554411 (+360312us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:48.579078 (+ 24667us) log.cc:844] Serialized 14 byte log entry
0709 12:25:49.239340 (+660262us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.239428 (+    88us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:49.313126 (+ 73698us) raft_consensus.cc:1685] finished
0709 12:25:49.334644 (+ 21518us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:49.334814 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":17916,"raft.queue_time_us":38369,"raft.run_cpu_time_us":177,"raft.run_wall_time_us":11449,"spinlock_wait_cycles":62472960,"thread_start_us":1014904,"threads_started":2,"wal-append.queue_time_us":621841}
I20260709 12:25:49.364699 10293 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.402010  5961 rpcz_store.cc:276] 0709 12:25:47.874927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.061064 (+186137us) service_pool.cc:224] Handling call
0709 12:25:48.061421 (+   357us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:48.143699 (+ 82278us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:48.143730 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:48.152552 (+  8822us) log.cc:844] Serialized 26 byte log entry
0709 12:25:48.554068 (+401516us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:48.554118 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:48.554208 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:49.339066 (+784858us) raft_consensus.cc:1685] finished
0709 12:25:49.339090 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:49.339221 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":81832,"raft.queue_time_us":82258,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":56440,"thread_start_us":280380,"threads_started":1,"wal-append.queue_time_us":764320}
I20260709 12:25:49.408209 10411 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:49.390754 10258 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.410741 10409 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:49.410864 10434 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.416875 10433 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.401568 10259 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.444423  5959 rpcz_store.cc:276] 0709 12:25:48.246878 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.761063 (+514185us) service_pool.cc:224] Handling call
0709 12:25:48.761478 (+   415us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:48.761877 (+   399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:48.761909 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:48.762429 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 12:25:49.086766 (+324337us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:49.086838 (+    72us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.086963 (+   125us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:49.443765 (+356802us) raft_consensus.cc:1685] finished
0709 12:25:49.443785 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:49.443940 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2015,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":28956,"thread_start_us":183442,"threads_started":1,"wal-append.queue_time_us":415178}
I20260709 12:25:49.471962  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:49.472599  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.495296  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:49.474082  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:49.474980  5960 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:49.475121  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:49.472934  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:49.475654  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:49.475764  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:49.497004  5964 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:49.497184 10295 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:49.497992 10451 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:25:49.494241 10401 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11.
I20260709 12:25:49.476145  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:49.471987  6081 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:49.469077 10415 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:49.477564 10407 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:49.487851 10272 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.479213  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:49.479974  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:49.480379  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:49.508121  6643 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:49.481302  6645 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:49.482304  5962 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
W20260709 12:25:49.486501  6644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50454 (request call id 1103) took 2387 ms (client timeout 1732 ms). Trace:
I20260709 12:25:49.476562 10372 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.490199  5934 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:49.394260 10425 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.048s
I20260709 12:25:49.497475  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:49.477171  6651 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:49.512137  9634 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:49.486922 10343 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:25:49.509481  6644 rpcz_store.cc:269] 0709 12:25:47.083411 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.085418 (+  2007us) service_pool.cc:224] Handling call
0709 12:25:49.470799 (+2385381us) spinlock_profiling.cc:243] Waited 1.79 s on lock 0x7b54006167d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:49.470896 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4126327552}
I20260709 12:25:49.491247 10448 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:49.515082  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:49.511898  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:49.402050 10440 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.104s
I20260709 12:25:49.493234 10045 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:49.534168  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:49.569159  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:49.569685  6084 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:49.568991  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 97039.4us
W20260709 12:25:49.570657  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 58835.8us
I20260709 12:25:49.532644  9826 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.004s
I20260709 12:25:49.515002  9634 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:49.538262 10293 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.539806 10259 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:49.511826 10372 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:49.540203 10341 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.583606  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:49.540342 10331 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.493100 10368 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:49.584226  6644 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.541492 10048 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.494483 10266 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:49.514681 10272 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.546877  9872 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:49.491377 10304 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:25:49.494727 10258 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.535161 10448 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:25:49.534343  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 44224.9us
I20260709 12:25:49.562067 10286 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:49.550113  5963 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:49.594415  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:49.578018  9826 consensus_queue.cc:1243] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer f1bb8e63c2b448cdafd51f05d277c741 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:25:49.577512 10228 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:49.516894  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:49.572044  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:49.573235  5960 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:49.600503  5962 raft_consensus.cc:2368] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13.
I20260709 12:25:49.576236  5964 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:49.573091  9634 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 9.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.601428  6647 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.579629  5961 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:49.589553  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:49.602277  6081 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:49.590673  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 117798us
I20260709 12:25:49.592115  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:49.594341  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:49.572259 10343 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:49.567181  6643 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:49.606649  5959 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:49.606810  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:49.607278  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:49.607544  5964 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:49.607921  5962 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:25:49.593828 10415 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.603945  5967 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:49.604221  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:49.614935  5963 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:49.615926  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:49.616531  5963 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:49.617368  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:49.617864  5963 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:49.618620 10441 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.042s
I20260709 12:25:49.622646  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:49.604733  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:49.605172  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:49.623642  5962 raft_consensus.cc:2410] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 15 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:25:49.599097  6644 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:25:49.609689  6081 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:49.612164  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:49.612569  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:49.625664  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:49.626312  5960 raft_consensus.cc:2393] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:49.590061 10425 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:49.613813  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:49.626915  5964 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:49.628016  5964 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:49.629312  5964 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:49.629913 10320 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.595440 10286 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:49.634239 10286 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.13, Last appended by leader: 13, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.595419 10448 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:49.635535 10286 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.604455 10434 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 13.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.034s
I20260709 12:25:49.608803 10411 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:49.592329 10259 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:49.630288  5964 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:49.624351  5961 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:25:49.644928  5963 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:49.649518  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:49.652257  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:49.658938  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.665310  6647 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:25:49.656191  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.690115  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.691313  6037 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:49.690356  6043 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 12: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:49.621469 10048 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:49.593585 10368 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.699250  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 2095) took 1092 ms. Trace:
I20260709 12:25:49.702605  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.648051 10266 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:49.717051  6043 rpcz_store.cc:276] 0709 12:25:48.607327 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.607953 (+   626us) service_pool.cc:224] Handling call
0709 12:25:49.656053 (+1048100us) spinlock_profiling.cc:243] Waited 1.2 ms on lock 0x7b5800124298. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2ff8c 00007f481df2fef6 000000000036eb39 00007f4825fa31e0 00007f482606c0c4 00007f482606c131 00007f482601a0a0 00007f4826019984 00007f481f5946d4 00007f481f594662
0709 12:25:49.699183 (+ 43130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2790784}
I20260709 12:25:49.719990  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.723201  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:49.688023 10080 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:49.656020 10293 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.614530 10395 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.102s
I20260709 12:25:49.688529 10411 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:49.639961 10415 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.638876 10398 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.131s
I20260709 12:25:49.730074  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.729971  6009 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:49.727409 10434 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:49.727617 10048 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:49.697943 10407 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:49.747802  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 153541us
I20260709 12:25:49.750835  6042 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:25:49.731434  9872 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:49.738634 10458 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:49.748148 10460 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.128s	user 0.001s	sys 0.000s
W20260709 12:25:49.755023  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 145157us
I20260709 12:25:49.745242 10266 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:49.752556 10272 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.772468 10411 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.773635  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:49.775143  6115 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:49.776230  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:49.776835 10415 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.752940  9872 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:49.776860  6116 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:49.778237  9872 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.778750  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:49.779739  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:49.779786  6035 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:49.780377  6115 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:49.779407  6118 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:49.773216  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:49.782940  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:49.784104 10266 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:49.785068 10266 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.788095 10178 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:49.788573 10178 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:49.789125  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:49.789707  6117 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:25:49.779384  9872 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.791559  5934 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:49.792464  5934 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:49.793288  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:49.794139  6038 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:49.796674  6041 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:25:49.802024 10272 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:49.802507 10272 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.802824 10272 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.804719  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:49.798074  6608 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:49.806396  5934 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:49.735462 10293 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:49.815413  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.816056  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:49.818784  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 62370.4us
I20260709 12:25:49.816579  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:49.816824  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.757758 10434 raft_consensus.cc:697] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:49.735002 10343 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 10.12, Last appended by leader: 12, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.823972  6039 raft_consensus.cc:2393] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 6: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:49.805399 10374 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:49.807724 10392 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:49.823853  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:49.807545 10108 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:49.818804 10446 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:49.803891 10304 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:49.817497  6084 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:49.745858 10259 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.817977 10284 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:49.830318  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 220709us
I20260709 12:25:49.836088  6082 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:49.830425 10374 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.811151 10372 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.856362 10354 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:49.841322 10304 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.859783  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1011) took 1413 ms. Trace:
I20260709 12:25:49.860486 10304 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.861841  5964 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 9. Current term is 10. Ops: [9.10-9.10]
I20260709 12:25:49.794755 10458 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:49.829922 10048 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.834757 10446 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:49.853927 10403 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:25:49.864573  6041 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:49.866922  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.867548  6043 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:49.868597  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:49.869714  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:49.832953 10392 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:49.860214  5968 rpcz_store.cc:276] 0709 12:25:48.446545 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.023109 (+576564us) service_pool.cc:224] Handling call
0709 12:25:49.023333 (+   224us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:49.198010 (+174677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:49.198039 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:49.198076 (+    37us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:49.198102 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.859514 (+661412us) spinlock_profiling.cc:243] Waited 174 ms on lock 0x7b54000f8054. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:49.859563 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:49.859718 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":401296640}
I20260709 12:25:49.833909 10228 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:49.870302  6043 raft_consensus.cc:2376] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11. Re-sending same reply.
I20260709 12:25:49.878629  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.881320  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:49.843148 10284 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:49.881667  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:49.881816  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45826.6us
I20260709 12:25:49.888302  6035 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:49.864838 10446 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:49.866807 10374 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:49.866254 10267 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.862437 10372 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.872714 10198 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:49.889968 10284 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:49.899175  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:49.902293 10466 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:25:49.903847 10466 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:49.892485  6006 leader_election.cc:400] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13.
I20260709 12:25:49.864221 10458 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.906039  6006 leader_election.cc:403] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:49.908294 10458 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13.
W20260709 12:25:49.908988  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:49.912146  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.850204  6084 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:49.874910 10392 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:49.923982 10465 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:49.924335 10293 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.894769  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.928573  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:49.933017  6035 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:49.933666  6006 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:49.929319  6043 raft_consensus.cc:2376] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13. Re-sending same reply.
I20260709 12:25:49.892846 10368 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:49.936940  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:49.924058 10467 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:49.912340 10267 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:49.943063 10429 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.756s	user 0.004s	sys 0.000s
I20260709 12:25:49.945600  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:49.947285  6043 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:49.950639  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 5 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.951437  6039 raft_consensus.cc:2393] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:49.949568  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:49.954488 10032 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:49.955119 10441 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:49.955621 10441 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:49.957751 10441 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.936919 10266 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:25:49.959278 10266 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:49.959631 10266 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:49.963099  6113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 2754) took 1381 ms. Trace:
I20260709 12:25:49.938844  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.963485  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:49.963485  6113 rpcz_store.cc:276] 0709 12:25:48.582131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.582524 (+   393us) service_pool.cc:224] Handling call
0709 12:25:48.582803 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:49.364450 (+781647us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:49.962857 (+598407us) spinlock_profiling.cc:243] Waited 661 ms on lock 0x7b5400206a54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:49.963043 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1519736704}
I20260709 12:25:49.968001  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:49.974784  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.975414 10415 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:49.975818 10415 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:49.975972  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.976197 10415 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:49.977151  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.978237  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:49.978765  6035 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:49.892565 10434 consensus_queue.cc:237] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:49.984740  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 134608us
I20260709 12:25:49.983108  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:49.974349  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:49.966354 10407 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:49.998096  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:49.971545 10441 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:49.998540  6035 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:49.970980 10032 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:49.998116  6039 raft_consensus.cc:2376] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11. Re-sending same reply.
W20260709 12:25:49.962381 10337 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.872s	user 0.029s	sys 0.030s
W20260709 12:25:50.001157 10337 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.957s	user 0.030s	sys 0.030s
I20260709 12:25:49.937794 10458 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.034s
I20260709 12:25:50.003123  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:50.003108  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.006333  6035 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
W20260709 12:25:50.002753 10248 consensus_meta.cc:287] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.535s	user 0.008s	sys 0.001s
I20260709 12:25:49.973623 10409 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.033s
W20260709 12:25:50.020048  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 83201.3us
I20260709 12:25:49.999781 10465 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:50.001403 10045 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 6.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:25:50.021515 10457 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:50.000730 10441 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:49.991608 10340 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.033s
I20260709 12:25:50.018011 10449 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:25:50.027993 10482 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:50.028604 10441 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:50.005864 10467 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:49.967314 10228 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 9.4, Last appended by leader: 4, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.029850  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:49.969290 10266 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.023831 10368 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:50.049625  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:50.050665  9826 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:25:50.051075 10476 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:50.051119  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:50.054638 10440 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:50.055400 10440 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:50.057301 10468 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:50.047225 10465 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:50.063594 10478 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.065598  6113 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:50.066555  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:50.015866 10178 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.067867  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:50.069706  6647 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:50.064234 10478 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.043301 10467 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.072407  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:50.072806 10446 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:50.049232 10473 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
I20260709 12:25:50.064893 10368 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.081247  6115 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 12: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:50.023209 10248 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.090731  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:50.110939  5965 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 12: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:50.091817 10409 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:50.092438 10368 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:50.121805 10248 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:50.122709 10409 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.102242 10483 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:25:50.101274 10197 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.126302 10426 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:50.126786 10476 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:25:50.130682  5914 auto_rebalancer.cc:629] Failed to schedule move for tablet 117509103bb449868a97cf0ba4fdda89: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:25:50.132676 10476 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.134582 10465 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.126932 10284 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.137586  9826 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:50.138082 10284 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:50.122706 10478 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.155267  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:50.157192  6037 raft_consensus.cc:2393] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 6: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:25:50.163906 10480 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:25:50.170562 10476 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.171054 10272 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.173316 10272 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:50.169174 10392 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.176944 10392 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.128960 10267 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.186005  6043 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:25:50.193403 10374 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.209059 10442 raft_consensus.cc:3055] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:50.209486 10442 raft_consensus.cc:740] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:50.195380 10178 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:50.210305 10374 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:50.197412 10258 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.199489 10415 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.129966 10197 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.201857 10341 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:50.203799  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.203819  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.204581 10295 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:50.230243 10197 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:50.230996 10341 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:50.231817  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2114) took 1231 ms. Trace:
I20260709 12:25:50.231959 10341 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.233489 10341 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:50.234890  6643 raft_consensus.cc:2368] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12.
I20260709 12:25:50.235827 10295 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:50.236987 10295 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.238039 10295 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:50.238226  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:50.238993  6650 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: [8.10-8.10]
I20260709 12:25:50.221848  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.243074  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2246) took 2350 ms. Trace:
I20260709 12:25:50.243489  5966 rpcz_store.cc:276] 0709 12:25:47.892820 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.446051 (+553231us) service_pool.cc:224] Handling call
0709 12:25:48.446364 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:49.256361 (+809997us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.242760 (+986399us) spinlock_profiling.cc:243] Waited 722 ms on lock 0x7b54001c98d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:50.243006 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1660876672}
I20260709 12:25:50.232247  6040 rpcz_store.cc:276] 0709 12:25:49.000886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.291538 (+290652us) service_pool.cc:224] Handling call
0709 12:25:49.291915 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:49.498136 (+206221us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:49.498166 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:49.498647 (+   481us) log.cc:844] Serialized 26 byte log entry
0709 12:25:49.592737 (+ 94090us) raft_consensus.cc:1645] Marking committed up to 3
0709 12:25:49.592778 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.231380 (+638602us) spinlock_profiling.cc:243] Waited 201 ms on lock 0x7b54000d6e54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:50.231436 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:50.231488 (+    52us) raft_consensus.cc:1685] finished
0709 12:25:50.231511 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:50.231753 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":689,"raft.queue_time_us":827,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":81,"spinlock_wait_cycles":463423232,"thread_start_us":84533,"threads_started":1,"wal-append.queue_time_us":232207}
I20260709 12:25:50.205477 10446 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:50.207186  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.207988  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.251823  6644 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:50.216104  6651 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:50.210430 10442 consensus_queue.cc:260] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.255766  9634 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.253758  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.256373  9634 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.256809  6644 raft_consensus.cc:2410] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:25:50.254689  6009 leader_election.cc:400] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12.
I20260709 12:25:50.258114  6009 leader_election.cc:403] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:25:50.271330  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.273917  6037 raft_consensus.cc:1240] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:50.275024  6009 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:50.131778 10426 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.275952  9634 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.291237  6040 raft_consensus.cc:3055] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:50.304730  6040 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:50.305707  6040 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.318862  6040 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:50.271106 10258 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.270922 10374 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:50.288604 10334 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50470 (request call id 824) took 3665 ms. Trace:
I20260709 12:25:50.323485 10334 rpcz_store.cc:276] 0709 12:25:46.627902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:46.628134 (+   232us) service_pool.cc:224] Handling call
0709 12:25:46.974070 (+345936us) ts_tablet_manager.cc:934] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
0709 12:25:49.298940 (+2324870us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:25:49.844950 (+546010us) tablet_metadata.cc:665] Metadata flushed
0709 12:25:49.850183 (+  5233us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:25:50.194333 (+344150us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:25:50.274853 (+ 80520us) tablet_replica.cc:206] Creating consensus instance
0709 12:25:50.288424 (+ 13571us) ts_tablet_manager.cc:989] Replica registered.
0709 12:25:50.288493 (+    69us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":41112,"tablet-copy.queue_time_us":91978,"thread_start_us":157476,"threads_started":2}
I20260709 12:25:50.324970 10334 tablet_copy_client.cc:806] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:25:50.325560 10334 tablet_copy_client.cc:670] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:25:50.327629 10415 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.318534 10340 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.021s
I20260709 12:25:50.330710 10340 raft_consensus.cc:3055] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:50.331058 10340 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:50.331838  6648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 1112) took 1155 ms. Trace:
I20260709 12:25:50.332230  6648 rpcz_store.cc:276] 0709 12:25:49.175612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.175760 (+   148us) service_pool.cc:224] Handling call
0709 12:25:49.184280 (+  8520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:49.451153 (+266873us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.330200 (+879047us) spinlock_profiling.cc:243] Waited 266 ms on lock 0x7b540002bf54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:50.330439 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":612167936}
I20260709 12:25:50.333128  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:50.270891 10193 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12.
I20260709 12:25:50.274089 10442 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:50.308990 10414 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:50.281754 10409 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:50.329183 10458 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:50.353132  6040 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:25:50.341136 10414 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.322722 10374 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:50.361083  5934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.553s	user 0.017s	sys 0.021s
W20260709 12:25:50.363695 10489 log.cc:927] Time spent T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.155s	user 0.003s	sys 0.000s
W20260709 12:25:50.348300 10448 consensus_meta.cc:287] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.709s	user 0.013s	sys 0.000s
I20260709 12:25:50.343173 10458 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:50.335493 10258 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.386832  6040 pending_rounds.cc:85] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 9
W20260709 12:25:50.389078  5934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.581s	user 0.019s	sys 0.022s
I20260709 12:25:50.354773 10340 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.393625  6040 pending_rounds.cc:107] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:25:50.388227 10414 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:50.393983  6040 raft_consensus.cc:2889] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:50.393792  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 587415us
I20260709 12:25:50.397359  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:50.398049  5967 raft_consensus.cc:2368] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:50.403978  5962 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:25:50.414027  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 2757) took 1826 ms. Trace:
I20260709 12:25:50.392227 10448 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.394781 10441 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.414529  6112 rpcz_store.cc:276] 0709 12:25:48.587762 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:48.587931 (+   169us) service_pool.cc:224] Handling call
0709 12:25:48.599748 (+ 11817us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:49.489885 (+890137us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:50.413708 (+923823us) spinlock_profiling.cc:243] Waited 802 ms on lock 0x7b54001031d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:50.413938 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1843873536}
I20260709 12:25:50.421224  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:50.423257  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.426920 10197 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:50.411279 10340 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:50.437011  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:50.438201  6044 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:50.438195  5962 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:25:50.439862  6043 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:50.442003 10494 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.116s	user 0.000s	sys 0.001s
I20260709 12:25:50.442416 10441 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.436069 10193 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.007s
I20260709 12:25:50.443708 10193 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:50.445147  5967 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
W20260709 12:25:50.435405 10497 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:25:50.444058 10193 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:50.410938 10019 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.027s
I20260709 12:25:50.459584  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:50.460299  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.452188 10446 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.462880 10446 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.465070 10446 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:50.469317 10414 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.446594 10374 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.416420 10458 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.502610 10374 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.503159 10374 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.504419 10266 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:50.504961 10448 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:50.505259 10374 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:50.506343 10019 consensus_queue.cc:1059] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:50.506744  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.507444  6646 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:50.488934 10426 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:50.502138 10407 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:50.553663 10458 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:50.548121 10407 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:50.575464  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:50.576035  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.564659 10258 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.547281 10193 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:50.586869  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.611716 10407 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.619244  6649 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:50.619938  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2785) took 1044 ms. Trace:
I20260709 12:25:50.620311  5965 rpcz_store.cc:276] 0709 12:25:49.575781 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:49.575921 (+   140us) service_pool.cc:224] Handling call
0709 12:25:50.619770 (+1043849us) spinlock_profiling.cc:243] Waited 499 ms on lock 0x7b54001cacd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:50.619886 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1148493184}
I20260709 12:25:50.627365  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:50.628185 10350 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:50.630626 10352 consensus_queue.cc:1059] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 4.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:25:50.631522 10352 raft_consensus.cc:3055] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:50.631844 10352 raft_consensus.cc:740] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:50.632205  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:50.632675 10352 consensus_queue.cc:260] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.633462  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:50.633876 10352 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:50.634093  6044 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:50.645745 10467 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:50.646632  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:50.646808 10483 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:50.647325 10483 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.647699  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:50.648382  6044 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:50.649067  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:50.649783 10483 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.649977  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:50.634801  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:50.651181  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:50.651827  6040 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:50.635463  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:50.653443  6042 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:50.636157  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:50.657701  6038 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:50.661283  6042 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:25:50.638760 10374 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.639196 10446 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:50.641774 10368 consensus_meta.cc:287] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.515s	user 0.001s	sys 0.009s
I20260709 12:25:50.645037  5932 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:50.658200 10504 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.001s
I20260709 12:25:50.667727  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.668495  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:50.669600  6044 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:50.671473  5932 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:50.673734  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:50.670349 10442 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:50.669725 10368 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.670773 10258 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:50.675261 10268 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.007s
I20260709 12:25:50.683069 10368 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:50.668620 10446 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.688637  6044 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:25:50.689479  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:50.690881  6110 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:25:50.676151 10363 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:50.692402  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:50.691792 10483 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:50.666582 10374 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.679421  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:50.695358  6114 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:50.690788  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:50.697482  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:50.695996  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:50.697862  6118 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:50.698518  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:50.699242  6115 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:50.699870  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:50.680599 10442 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:50.700212  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:50.698052  6112 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:50.700574  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:50.703282  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:50.704039  5960 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 14: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:50.705433  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:50.706094  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:50.706133  5966 raft_consensus.cc:2368] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12.
I20260709 12:25:50.710621  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:50.711534  5967 raft_consensus.cc:2410] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 7 because replica has last-logged OpId of term: 5 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 7.
I20260709 12:25:50.712407  6118 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:25:50.713258  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:50.700232 10483 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.717167  5965 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:50.718634 10483 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:50.700879 10258 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:50.724927 10290 raft_consensus.cc:3055] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:50.725381 10290 raft_consensus.cc:740] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:50.726227 10290 consensus_queue.cc:260] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.728796 10290 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:50.732378  6608 leader_election.cc:400] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:50.732739  6608 leader_election.cc:403] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Cancelling election due to peer responding with higher term
I20260709 12:25:50.732882 10019 consensus_queue.cc:1059] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:50.735141 10337 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:50.735571 10337 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:50.736358 10337 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.737540 10337 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:50.734309 10019 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election lost for term 8. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9.
I20260709 12:25:50.738593 10350 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:50.740828 10374 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.697288 10340 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:50.743856 10340 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.746013 10340 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.747957 10446 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:50.760151  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:50.761823  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:50.762645  6036 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:50.763542 10258 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:50.763386  6037 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:50.764074 10258 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.762580  6111 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:50.766095 10258 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.766216  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:50.766821  6611 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:50.769212  6038 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:50.771090  6042 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 7. (term mismatch)
I20260709 12:25:50.771436  6042 pending_rounds.cc:85] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 6
I20260709 12:25:50.771641  6042 pending_rounds.cc:107] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 11.7
I20260709 12:25:50.771870  6042 raft_consensus.cc:2889] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:50.772747  6111 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:25:50.773111  5960 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:50.773430  6040 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 9 index: 6. (term mismatch)
I20260709 12:25:50.774590  5965 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:50.775924  6040 pending_rounds.cc:85] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 5
I20260709 12:25:50.776011  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:50.776343  6040 pending_rounds.cc:107] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 8.6
I20260709 12:25:50.776641  6040 raft_consensus.cc:2889] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:50.776810  6112 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:50.777678  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:50.778417  5965 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 14: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:50.779803  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:50.781139  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:50.781803  6038 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
W20260709 12:25:50.782580  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.784893  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:50.786063  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:50.786878  6038 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:50.762166 10161 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:50.797868  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:50.798667  5960 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:50.800240  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:50.766954  5862 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 5 to 6, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 6 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.763571 10286 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:50.806054  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:50.807482  5965 pending_rounds.cc:85] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 6
I20260709 12:25:50.807811  5965 pending_rounds.cc:107] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:25:50.807948  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:50.808037  5965 raft_consensus.cc:2889] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:50.809091  5862 catalog_manager.cc:5697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 8 to 9, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 9 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:50.814990  5964 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:25:50.817203  5962 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 9. (index mismatch)
I20260709 12:25:50.817463  5964 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:50.818830  5959 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
W20260709 12:25:50.819319  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.793182 10019 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:50.813431  5862 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 5 to 9, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 9 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.794613 10258 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:50.796715 10446 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:50.829602  5862 catalog_manager.cc:5697] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.830129  6036 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
W20260709 12:25:50.837925 10487 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.640s	user 0.003s	sys 0.000s
I20260709 12:25:50.841969  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:50.842779  5959 raft_consensus.cc:2393] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:50.847616  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:50.852460  5959 raft_consensus.cc:2410] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 11 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:25:50.853339  5863 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 325) took 11779 ms (client timeout 15000 ms). Trace:
W20260709 12:25:50.849946 10434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.652s	user 0.006s	sys 0.009s
I20260709 12:25:50.874974  5959 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:50.880167  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:50.849963 10268 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.874907  5862 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 5 to 7, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 7 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:50.899142 10193 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:50.914862  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:50.916431  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.918586  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.920869  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:50.922287  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.923072  6646 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:25:50.924072 10374 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.924690 10374 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.925932  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.926970 10374 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:50.927963  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.932497  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.937076  6037 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:50.940804  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.942965  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:50.945955  5934 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:50.946846  9915 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:50.947247  9915 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:50.947600  9915 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:50.833271 10258 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:50.834617 10446 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:50.950278  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:50.955258  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:50.961503  5862 catalog_manager.cc:5697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.971741  5963 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:25:50.971431  5862 catalog_manager.cc:5697] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:50.962832  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:50.879015 10434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.006s	sys 0.009s
W20260709 12:25:50.967303  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.973973  5962 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:50.975797  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:50.977022  5962 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:50.977959  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:50.980515  5862 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:25:50.963968  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 169747us
I20260709 12:25:50.983505  5862 catalog_manager.cc:5697] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 6 to 9, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 9 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
W20260709 12:25:50.988360  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:50.989804  5862 catalog_manager.cc:5697] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 5 to 7, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 7 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.991722  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:51.000329 10446 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:50.853883  5863 rpcz_store.cc:269] 0709 12:25:39.064679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:39.070575 (+  5896us) service_pool.cc:224] Handling call
0709 12:25:50.844141 (+11773566us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:45.088315 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:45.088988 (+   673us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:45.089046 (+    58us) write_op.cc:435] Acquired schema lock
0709 12:25:45.089081 (+    35us) tablet.cc:662] Decoding operations
0709 12:25:45.090065 (+   984us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:45.090155 (+    90us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:45.090179 (+    24us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:25:45.229401 (+139222us) tablet.cc:701] Row locks acquired
0709 12:25:45.323019 (+ 93618us) write_op.cc:260] PREPARE: finished
0709 12:25:45.323194 (+   175us) write_op.cc:270] Start()
0709 12:25:45.323340 (+   146us) write_op.cc:276] Timestamp: P: 1783599945323130 usec, L: 0
0709 12:25:45.323372 (+    32us) op_driver.cc:348] REPLICATION: starting
0709 12:25:45.324070 (+   698us) log.cc:844] Serialized 3229 byte log entry
0709 12:25:45.664823 (+340753us) op_driver.cc:464] REPLICATION: finished
0709 12:25:45.932094 (+267271us) write_op.cc:301] APPLY: starting
0709 12:25:45.943980 (+ 11886us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:46.215960 (+271980us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:46.216073 (+   113us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:46.305327 (+ 89254us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:46.305600 (+   273us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:25:46.305660 (+    60us) write_op.cc:312] APPLY: finished
0709 12:25:46.306113 (+   453us) log.cc:844] Serialized 81 byte log entry
0709 12:25:46.306315 (+   202us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:46.306538 (+   223us) write_op.cc:454] Released schema lock
0709 12:25:46.306629 (+    91us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:46.315794 (+  9165us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:46.315827 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":87836,"reported_tablets":24,"child_traces":[["op",{"apply.queue_time_us":204959,"apply.run_cpu_time_us":18939,"apply.run_wall_time_us":390877,"cfile_cache_hit":30,"cfile_cache_hit_bytes":31365,"cfile_cache_miss":4,"cfile_cache_miss_bytes":6218,"cfile_init":2,"lbm_read_time_us":1245,"lbm_reads_lt_1ms":12,"num_ops":8,"prepare.queue_time_us":263845,"prepare.run_cpu_time_us":16672,"prepare.run_wall_time_us":350982,"raft.queue_time_us":121067,"raft.run_cpu_time_us":36819,"raft.run_wall_time_us":177998,"replication_time_us":318813,"thread_start_us":408844,"threads_started":4,"wal-append.queue_time_us":114817,"wal-append.run_cpu_time_us":14648,"wal-append.run_wall_time_us":1976367}]]}
I20260709 12:25:51.003454 10352 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:51.004961 10483 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:51.005481  9826 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:25:51.008056 10414 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:51.010445 10258 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:50.963300 10268 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:51.012523 10268 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:51.013671  5963 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 12 index: 13. (index mismatch)
I20260709 12:25:51.013991  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:51.015087  6006 leader_election.cc:400] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12.
I20260709 12:25:51.015142  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:51.013671  5959 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:51.022286  6006 leader_election.cc:403] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:51.023276  6006 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.024003 10193 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12.
I20260709 12:25:51.024706 10193 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:51.025516  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.026188 10340 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:51.027549 10340 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
W20260709 12:25:51.028369  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.029526  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:51.031173  6646 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:51.032464  6642 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 13. Preceding OpId from leader: term: 12 index: 13. (term mismatch)
I20260709 12:25:51.032800  6642 pending_rounds.cc:85] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 12
I20260709 12:25:51.033007  6642 pending_rounds.cc:107] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 11.13
I20260709 12:25:51.033239  6642 raft_consensus.cc:2889] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:51.035282  6035 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:25:50.996814 10466 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:25:50.996923 10350 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:25:51.037374  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:51.037700 10355 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:50.992892  5862 catalog_manager.cc:5697] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 5 to 9, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 9 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:25:50.996690 10047 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.042s
I20260709 12:25:51.038383 10355 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:51.039201  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:51.039765  6043 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:51.040458 10355 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:51.044446  6006 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.045972  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:51.046707  6035 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:25:51.048790  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:51.042268  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:51.037771  9915 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:51.048806  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:51.051214  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 271789us
I20260709 12:25:51.051760  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.056104  6006 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.056842  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:25:51.059522  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 325903us
I20260709 12:25:51.059024  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.068295  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:51.083370  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:51.084414  6036 raft_consensus.cc:2410] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 12 because replica has last-logged OpId of term: 10 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 7.
I20260709 12:25:51.084715  5932 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:51.088102 10340 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:51.052620 10414 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:51.085650  6608 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:51.089728  5932 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:51.087195  6651 raft_consensus.cc:2410] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 10 because replica has last-logged OpId of term: 9 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
W20260709 12:25:51.091228  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 49048.7us
I20260709 12:25:51.096320  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:51.088704 10446 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:51.057192 10193 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:51.086607  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.087603 10258 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:51.098328  5932 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:51.094740  6608 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:51.101998  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.082299 10268 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
W20260709 12:25:51.139212  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 46858.5us
W20260709 12:25:51.134341  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 75395.9us
I20260709 12:25:51.090056 10442 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
W20260709 12:25:51.150442  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 55784.9us
I20260709 12:25:51.099458 10427 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:51.087170 10286 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.053s
W20260709 12:25:51.143034 10393 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 9 current term: 9 is higher.
I20260709 12:25:51.157598  9634 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:51.158478 10301 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:25:51.159039 10331 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:51.159379 10228 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:51.142428 10467 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:51.160789  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 64586.3us
I20260709 12:25:51.141160 10258 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.147969 10355 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:51.169492  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:51.172180  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:51.174494  6116 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 14: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:51.170719  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:51.176754  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 78492.7us
I20260709 12:25:51.177659  6113 raft_consensus.cc:2410] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 7 because replica has last-logged OpId of term: 6 index: 4, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 3.
I20260709 12:25:51.174597 10427 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:51.179404  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:51.180264 10427 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:51.180905  6114 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:51.181694 10268 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:51.156678 10483 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:25:51.182264 10268 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:51.183121 10268 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:51.187731  6118 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:51.173830 10355 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.188489 10355 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:51.189055  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:51.169013 10258 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:51.194635  9915 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:51.099911 10337 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:51.196899 10337 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:51.199440 10337 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:51.198071  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:51.202854 10393 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.203115  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:51.203725  9915 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:51.206177  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:51.166134 10374 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:51.227814  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:51.211462  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:51.224210  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:51.171723 10350 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
W20260709 12:25:51.233239  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 285872us
I20260709 12:25:51.209055 10334 tablet_copy_client.cc:538] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:25:51.236366  6115 raft_consensus.cc:2368] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12.
I20260709 12:25:51.162653 10028 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.064s
I20260709 12:25:51.204387  9915 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:25:51.239925  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.208235 10331 raft_consensus.cc:697] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:51.251005  6113 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:51.253707  6111 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: [8.6-8.6]
I20260709 12:25:51.256333  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:51.256996  6115 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:25:51.215097 10446 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:25:51.226696 10442 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:51.259658 10442 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.260028 10442 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:51.263172 10258 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:51.263676  9915 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:51.265202  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:51.266862  6115 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:25:51.282133  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.301729  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.235386 10350 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:51.209178 10393 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:51.305488  6042 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:51.306511  6040 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:51.307566  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.313838  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:51.314725  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:51.264374 10331 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:51.327211 10178 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:51.327864 10178 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:51.286986 10508 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.140s	user 0.001s	sys 0.000s
I20260709 12:25:51.334940  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:51.287281 10517 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.079s	user 0.000s	sys 0.001s
I20260709 12:25:51.343393  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:51.335932  6043 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 11 index: 5. (index mismatch)
I20260709 12:25:51.324122 10350 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:51.318356 10028 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.358359  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:51.374845  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 212751us
W20260709 12:25:51.375594  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 218371us
I20260709 12:25:51.380098  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.394742  9634 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:51.396157  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.361707 10047 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:25:51.374672 10522 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:51.362098  9826 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.038s
W20260709 12:25:51.438551  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.383906 10301 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.062s
I20260709 12:25:51.378192 10028 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:51.435228 10522 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:51.494977  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:51.383600 10527 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.115s
I20260709 12:25:51.509407 10374 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.510062 10374 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:51.512863 10374 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:51.410607 10193 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:51.507503  6037 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:51.520656 10337 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:51.521806  6642 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:51.522575 10334 tablet_bootstrap.cc:492] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:25:51.523151 10393 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:51.524752 10518 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.182s	user 0.000s	sys 0.001s
I20260709 12:25:51.526131 10258 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:51.529701  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 298178us
I20260709 12:25:51.533304  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:51.538893  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:51.556130  5962 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:51.560395 10527 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:51.560956 10527 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:51.561352 10527 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:51.562726  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 216352us
W20260709 12:25:51.564550  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 188125us
I20260709 12:25:51.565809 10340 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:51.566419 10340 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:51.568753 10340 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:51.569070 10352 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:51.569744 10352 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:51.570761 10528 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:25:51.571943 10528 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:51.572288 10528 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:51.573002 10352 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:51.570287  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 135167us
I20260709 12:25:51.577334 10434 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:51.577941 10434 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:51.564600 10193 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:51.527940 10514 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:25:51.492324 10178 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:51.588076  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 155026us
I20260709 12:25:51.604431  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.606110  9634 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:51.606406  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:51.607319  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 299834us
I20260709 12:25:51.620256  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.625064  9634 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:51.530433 10522 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:51.637635  6009 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.626518  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.641754  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:51.642717  6649 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:25:51.648816  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:51.612011 10178 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
I20260709 12:25:51.655397  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:51.656296  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 1473) took 1147 ms. Trace:
I20260709 12:25:51.654119  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.658937  6009 leader_election.cc:400] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12.
I20260709 12:25:51.661754  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:51.601074 10193 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:51.668244  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.672962  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:51.656737  6039 rpcz_store.cc:276] 0709 12:25:50.509173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.510579 (+  1406us) service_pool.cc:224] Handling call
0709 12:25:50.549044 (+ 38465us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:50.549425 (+   381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.549457 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:50.552496 (+  3039us) log.cc:844] Serialized 26 byte log entry
0709 12:25:50.793741 (+241245us) spinlock_profiling.cc:243] Waited 2.17 ms on lock 0x7b1800459760. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:25:51.124961 (+331220us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:51.125009 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.125086 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:51.645421 (+520335us) raft_consensus.cc:1685] finished
0709 12:25:51.645444 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:51.656217 (+ 10773us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":2490,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":2010,"spinlock_wait_cycles":4995840,"thread_start_us":330981,"threads_started":1,"wal-append.queue_time_us":722621}
I20260709 12:25:51.624639 10352 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.036s
I20260709 12:25:51.652922 10393 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:51.679351  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:51.573191 10528 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:51.689311  6009 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.659343 10337 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:51.715935  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:51.714809  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:51.718127  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:51.658746 10340 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:51.640241 10350 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:51.713826 10520 log.cc:927] Time spent T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.347s	user 0.000s	sys 0.001s
I20260709 12:25:51.679872 10178 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:51.728143  5934 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:51.643649 10527 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:51.730978  6110 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:51.742800  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:51.716910 10363 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:51.749276  6117 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:51.724999 10434 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:51.760639 10519 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
I20260709 12:25:51.746412 10340 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:51.764494  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.761271 10527 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:51.768534 10363 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:51.789804  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:51.805205  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:51.782763 10414 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:51.780257 10537 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:51.787237 10340 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:51.751358 10427 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:25:51.791706 10028 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:51.800961 10532 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:51.775704 10542 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:25:51.788355 10539 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:51.851415 10193 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:51.853009 10442 consensus_meta.cc:287] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.593s	user 0.010s	sys 0.000s
I20260709 12:25:51.853529 10442 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:51.856117 10442 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:51.812325 10363 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:51.857568 10363 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:51.808296 10540 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:51.864362 10350 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:51.865495  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:51.866657 10355 consensus_meta.cc:287] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.678s	user 0.002s	sys 0.009s
I20260709 12:25:51.867163 10355 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:51.869535 10355 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:51.827435 10537 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:51.870898 10539 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:51.899533  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:51.909266  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:51.913908  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 185838us
I20260709 12:25:51.921622  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:51.922437  5962 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:25:51.917140  5934 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:51.943578  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:51.946990  5934 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:51.914852 10519 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.091s	user 0.000s	sys 0.006s
I20260709 12:25:51.898705 10539 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:51.958069  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:51.901203 10545 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:51.914652 10530 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.290s	user 0.003s	sys 0.003s
I20260709 12:25:51.912760 10531 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.939574 10523 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:51.963936  6038 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
W20260709 12:25:51.933059 10512 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.669s	user 0.000s	sys 0.007s
W20260709 12:25:51.944809 10547 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.092s	user 0.001s	sys 0.005s
I20260709 12:25:51.967536  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:51.968724  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 250656us
W20260709 12:25:52.019189 10551 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
W20260709 12:25:51.990144  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 337547us
I20260709 12:25:51.962152  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:51.948944 10532 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:52.095767  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:52.109874  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 147833us
I20260709 12:25:52.091904  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:52.111004  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:52.112274  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:52.112813  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:52.091380  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:51.956128 10442 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:51.953285 10258 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:52.080236  5967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2280) took 1252 ms. Trace:
I20260709 12:25:51.950434 10393 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:25:51.939929 10536 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:51.974797  9915 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:52.126786  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:52.084733 10537 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:52.080871 10487 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:25:52.114339  6642 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:25:52.123210  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:52.077315  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 421359us
I20260709 12:25:52.113390  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:52.119331 10374 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:52.151049  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:52.151566  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:52.118618  5967 rpcz_store.cc:276] 0709 12:25:50.827746 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.827886 (+   140us) service_pool.cc:224] Handling call
0709 12:25:50.828237 (+   351us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:50.828658 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.828685 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:50.835194 (+  6509us) log.cc:844] Serialized 52 byte log entry
0709 12:25:51.160976 (+325782us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:51.165003 (+  4027us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.165296 (+   293us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.165381 (+    85us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:52.080008 (+914627us) raft_consensus.cc:1685] finished
0709 12:25:52.080028 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.080178 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":10374,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":42,"raft.queue_time_us":179,"raft.run_cpu_time_us":426,"raft.run_wall_time_us":38353,"thread_start_us":285234,"threads_started":1,"wal-append.queue_time_us":516094}
I20260709 12:25:52.016697 10545 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.125913  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:52.195652  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 69810us
I20260709 12:25:52.197039 10545 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:52.197629 10545 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:52.140873  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 5 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:52.078660 10523 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.198962  6042 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:52.200688 10523 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:52.202710  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 2801) took 1494 ms. Trace:
I20260709 12:25:52.107358 10542 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.091226  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:52.204742  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:52.204630 10542 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.204507  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:52.019201 10531 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.207295  6116 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:52.207489  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:52.207991 10531 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:52.208142  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 282018us
I20260709 12:25:52.209017 10393 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:52.209455 10393 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:52.209810 10393 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:52.210256  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:52.082394 10352 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.149714  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:52.128444 10355 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:52.150871  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:52.154034  6043 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:52.219230  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:52.219949  6043 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:52.122924 10350 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:25:52.139174 10532 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.019s
W20260709 12:25:52.155561  5968 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.007s	sys 0.030s
I20260709 12:25:52.154336  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:52.223956  5968 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.599s	user 0.007s	sys 0.030s
I20260709 12:25:52.224270  6645 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:52.126883 10368 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:25:52.156169 10537 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.156715  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:52.154521 10446 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.010s	sys 0.027s
W20260709 12:25:52.163167 10554 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:25:52.182852 10561 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:52.147718  9826 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.041s
I20260709 12:25:52.203094  5966 rpcz_store.cc:276] 0709 12:25:50.708325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.708892 (+   567us) service_pool.cc:224] Handling call
0709 12:25:50.709269 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:50.760939 (+ 51670us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.760970 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:50.761368 (+   398us) log.cc:844] Serialized 26 byte log entry
0709 12:25:51.099601 (+338233us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:51.099643 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.099706 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:51.863063 (+763357us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:52.202401 (+339338us) raft_consensus.cc:1685] finished
0709 12:25:52.202423 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.202651 (+   228us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":48993,"raft.queue_time_us":51445,"raft.run_cpu_time_us":81,"raft.run_wall_time_us":80,"spinlock_wait_cycles":9021696,"thread_start_us":337828,"threads_started":1,"wal-append.queue_time_us":502114}
W20260709 12:25:52.204385 10521 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.793s	user 0.002s	sys 0.000s
I20260709 12:25:52.213153  6109 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:52.216174  6042 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:25:52.152498  5959 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:25:52.221912  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 71137.9us
I20260709 12:25:52.252295  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:52.228709  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:52.116120 10540 consensus_queue.cc:1059] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.107s
I20260709 12:25:52.233367  6609 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:52.217108 10193 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.252887  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:52.262141  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 310216us
W20260709 12:25:52.248492 10522 consensus_meta.cc:287] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.594s	user 0.010s	sys 0.000s
W20260709 12:25:52.272444  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.227589  6038 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:25:52.232048 10446 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.973s	user 0.010s	sys 0.027s
I20260709 12:25:52.256138  5959 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:52.225728 10352 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:52.228542 10363 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.224983 10543 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:52.253501  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:52.298797  6608 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:52.255569 10258 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.307696 10559 raft_consensus.cc:3055] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:25:52.302114 10554 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:52.236706 10537 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.290266 10524 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election won for term 6
W20260709 12:25:52.368356  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 69629.2us
I20260709 12:25:52.298290 10374 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:52.395532  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:52.395610  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:52.377847  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:52.396600  6109 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
W20260709 12:25:52.401710  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.269043 10193 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.408598  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:52.304936 10442 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.097s
I20260709 12:25:52.429720 10577 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:52.430352 10577 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:52.431249 10577 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:52.435370 10290 consensus_queue.cc:1059] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:52.436470 10290 raft_consensus.cc:3055] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:52.436807 10290 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:52.437618 10290 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.394727 10542 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:52.440338  6643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 849) took 1546 ms. Trace:
I20260709 12:25:52.440781  6643 rpcz_store.cc:276] 0709 12:25:50.893924 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.908846 (+ 14922us) service_pool.cc:224] Handling call
0709 12:25:50.909185 (+   339us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:50.909548 (+   363us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.909576 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:50.910180 (+   604us) log.cc:844] Serialized 52 byte log entry
0709 12:25:51.152694 (+242514us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:51.152737 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.152806 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:52.203810 (+1051004us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:52.439834 (+236024us) raft_consensus.cc:1685] finished
0709 12:25:52.439911 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.440261 (+   350us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3226,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":105,"spinlock_wait_cycles":26898304,"thread_start_us":242147,"threads_started":1,"wal-append.queue_time_us":425060}
I20260709 12:25:52.443739 10537 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:52.420742 10193 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:52.447715 10557 log.cc:927] Time spent T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.606s	user 0.003s	sys 0.002s
I20260709 12:25:52.393873 10434 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.449241 10434 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.449764 10393 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.451498 10434 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:52.447783 10290 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:52.460260  6647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1173) took 1202 ms. Trace:
I20260709 12:25:52.460754  6647 rpcz_store.cc:276] 0709 12:25:51.257867 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.262567 (+  4700us) service_pool.cc:224] Handling call
0709 12:25:51.262914 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:51.558449 (+295535us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:25:51.558796 (+   347us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.791821 (+233025us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:51.850377 (+ 58556us) spinlock_profiling.cc:243] Waited 7.9 ms on lock 0x7b2c000ab958. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f94da11 00007f481f95d372 00007f482108fa01 00007f482105443a 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2
0709 12:25:51.850940 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:25:51.851130 (+   190us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:51.851167 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.851241 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:52.459880 (+608639us) raft_consensus.cc:1685] finished
0709 12:25:52.459995 (+   115us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.460184 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":295095,"prepare.queue_time_us":3263,"prepare.run_cpu_time_us":48,"prepare.run_wall_time_us":48,"raft.queue_time_us":304830,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":9021,"spinlock_wait_cycles":72977024,"thread_start_us":232633,"threads_started":1,"wal-append.queue_time_us":394134}
I20260709 12:25:52.463943  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:52.466173 10374 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:52.466852 10374 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:52.468685  6035 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:25:52.408914  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 135610us
I20260709 12:25:52.362892 10559 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:52.410650  6115 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:25:52.363175 10572 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.101s
W20260709 12:25:52.412802 10558 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.183s	user 0.000s	sys 0.000s
I20260709 12:25:52.414124 10352 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:52.415596 10570 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
W20260709 12:25:52.418910 10510 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 1.156s	user 0.009s	sys 0.010s
W20260709 12:25:52.420698 10571 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:25:52.423259 10584 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:52.424420  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:52.300876 10522 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:52.376536 10524 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.251132 10561 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.507160  6084 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:52.508757  5960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2272) took 1701 ms. Trace:
I20260709 12:25:52.303642 10363 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.525857  5960 rpcz_store.cc:276] 0709 12:25:50.807013 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.808327 (+  1314us) service_pool.cc:224] Handling call
0709 12:25:50.808585 (+   258us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:50.989453 (+180868us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:50.997471 (+  8018us) log.cc:844] Serialized 14 byte log entry
0709 12:25:51.632999 (+635528us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:51.633060 (+    61us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:51.633826 (+   766us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:52.508458 (+874632us) spinlock_profiling.cc:243] Waited 181 ms on lock 0x7b54000f8a54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:52.508525 (+    67us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.508686 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":8614,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":185063,"raft.run_cpu_time_us":150,"raft.run_wall_time_us":12491,"spinlock_wait_cycles":415500672,"thread_start_us":634654,"threads_started":2,"wal-append.queue_time_us":412146}
I20260709 12:25:52.528003  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:52.509581 10531 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.308840 10258 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:52.509426 10438 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:52.510210 10442 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:52.532896  6044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2162) took 1230 ms. Trace:
I20260709 12:25:52.513013 10523 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:52.537233  5968 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 12:25:52.541337  6044 rpcz_store.cc:276] 0709 12:25:51.302073 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.307630 (+  5557us) service_pool.cc:224] Handling call
0709 12:25:51.307909 (+   279us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:51.635292 (+327383us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:51.635325 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:51.649517 (+ 14192us) log.cc:844] Serialized 26 byte log entry
0709 12:25:51.782568 (+133051us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:51.782610 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.783187 (+   577us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:52.447099 (+663912us) spinlock_profiling.cc:243] Waited 5.29 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:52.519096 (+ 71997us) raft_consensus.cc:1685] finished
0709 12:25:52.519122 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.532820 (+ 13698us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":67514,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":5148,"spinlock_wait_cycles":12169600,"thread_start_us":443344,"threads_started":2,"wal-append.queue_time_us":191457}
I20260709 12:25:52.548799  5962 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 12. Current term is 13. Ops: [12.7-12.7]
I20260709 12:25:52.511204  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:52.538729 10414 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.550491 10414 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:52.552090 10561 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:52.552534 10414 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:52.557130  5964 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:25:52.510627 10539 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:52.559630 10539 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:52.560135 10516 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 1.225s	user 0.000s	sys 0.013s
I20260709 12:25:52.529940 10524 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:52.575376  5960 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:25:52.580497  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 310632us
W20260709 12:25:52.583989  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 72887.1us
I20260709 12:25:52.584789  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:52.586622  5932 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:52.558018 10552 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.419s	user 0.001s	sys 0.007s
I20260709 12:25:52.540822 10584 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:52.599107  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:52.599540  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2160) took 1298 ms. Trace:
I20260709 12:25:52.604611  6041 rpcz_store.cc:276] 0709 12:25:51.301527 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.306883 (+  5356us) service_pool.cc:224] Handling call
0709 12:25:51.307211 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:51.603952 (+296741us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:51.603983 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:51.630706 (+ 26723us) log.cc:844] Serialized 26 byte log entry
0709 12:25:51.911095 (+280389us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:51.911142 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.911527 (+   385us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:52.599331 (+687804us) raft_consensus.cc:1685] finished
0709 12:25:52.599351 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.599485 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":50319,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5476,"thread_start_us":532339,"threads_started":2,"wal-append.queue_time_us":468404}
I20260709 12:25:52.549077 10393 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:52.566304 10352 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:52.612076  6109 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:25:52.612128  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:52.539588 10531 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.586123 10545 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:25:52.625888  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 230422us
I20260709 12:25:52.596931 10532 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:52.548946 10523 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:52.548286 10442 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.602640 10534 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:52.620429 10374 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:52.635277  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2271) took 1828 ms. Trace:
I20260709 12:25:52.638886  5965 rpcz_store.cc:276] 0709 12:25:50.806683 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:50.806997 (+   314us) service_pool.cc:224] Handling call
0709 12:25:50.807295 (+   298us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:50.809371 (+  2076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:50.809401 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:50.809914 (+   513us) log.cc:844] Serialized 52 byte log entry
0709 12:25:51.090357 (+280443us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:51.090401 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.090612 (+   211us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:52.529318 (+1438706us) spinlock_profiling.cc:243] Waited 3.42 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:52.630042 (+100724us) raft_consensus.cc:1685] finished
0709 12:25:52.630067 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.635209 (+  5142us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":562,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"spinlock_wait_cycles":7857920,"thread_start_us":280046,"threads_started":1,"wal-append.queue_time_us":429103}
I20260709 12:25:52.543181 10438 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.619923 10584 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.630352 10583 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.549432 10559 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.662789 10583 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.669768 10522 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:52.636827  9915 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:52.672094 10363 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:52.672551 10523 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:52.685338 10442 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:52.687816 10583 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:52.669803 10538 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:52.692047 10559 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:52.693135 10258 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:52.644667 10355 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:25:52.695739 10531 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:52.696352  9915 raft_consensus.cc:697] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:52.697258  9915 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 5.8, Last appended by leader: 8, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.699102 10538 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.701059 10538 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:52.671990 10438 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:52.639497  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:25:52.714035  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 74612.7us
I20260709 12:25:52.717031 10258 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.717800 10258 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:52.702124 10524 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.720258 10564 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:25:52.733242  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 134226us
I20260709 12:25:52.737012  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:25:52.738796  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 117181us
I20260709 12:25:52.742518  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:52.745018  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 161452us
I20260709 12:25:52.745808  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:52.746752  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:52.747340  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:52.748153  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:52.748430  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:52.745335  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:52.749763  6043 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:25:52.750833  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:52.751849  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:52.752441  6042 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:52.771513  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:52.734287 10564 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:52.753226  6044 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:25:52.805931  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:52.765434  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:52.772310  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:52.807381  6035 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:52.759373  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:52.753508  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:52.761268  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:52.753132  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:52.778033  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:52.759538 10533 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.920s	user 0.010s	sys 0.002s
I20260709 12:25:52.740444 10393 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:52.818740  6036 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:52.830165  6043 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:25:52.830818  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:52.834769  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:52.746189 10523 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:52.843315  6115 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:25:52.839111  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:52.755841 10258 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:52.862088  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:52.804663 10363 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.877061  6117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 2772) took 1706 ms. Trace:
W20260709 12:25:52.878113 10574 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.439s	user 0.000s	sys 0.002s
I20260709 12:25:52.867136 10531 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:52.880640  6117 rpcz_store.cc:276] 0709 12:25:51.171054 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.171681 (+   627us) service_pool.cc:224] Handling call
0709 12:25:51.179442 (+  7761us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:51.750390 (+570948us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:52.876771 (+1126381us) spinlock_profiling.cc:243] Waited 569 ms on lock 0x7b5400163d54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:52.876985 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1309754880}
I20260709 12:25:52.883195  6609 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:52.840155 10539 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.844493 10393 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.878304 10334 tablet_bootstrap.cc:492] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=6 overwritten=0 applied=6 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:25:52.838070 10572 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:52.895975 10572 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:52.898867  6651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1171) took 1706 ms. Trace:
I20260709 12:25:52.899331  6651 rpcz_store.cc:276] 0709 12:25:51.192174 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:51.192426 (+   252us) service_pool.cc:224] Handling call
0709 12:25:51.192767 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:51.232176 (+ 39409us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:51.232211 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:51.232699 (+   488us) log.cc:844] Serialized 26 byte log entry
0709 12:25:51.644013 (+411314us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:51.644067 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:51.644136 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:52.758997 (+1114861us) spinlock_profiling.cc:243] Waited 7.06 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:52.898575 (+139578us) raft_consensus.cc:1685] finished
0709 12:25:52.898597 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:52.898800 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":270038,"raft.queue_time_us":72262,"raft.run_cpu_time_us":183,"raft.run_wall_time_us":50383,"spinlock_wait_cycles":16241408,"thread_start_us":381021,"threads_started":1,"wal-append.queue_time_us":584541}
I20260709 12:25:52.887198 10446 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:52.902940 10446 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.903349 10446 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:52.879180 10197 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:52.740254 10597 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.141s
I20260709 12:25:52.842957 10524 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:52.847095 10545 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:52.804277 10564 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.884143 10363 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:52.911337 10595 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:52.894304 10539 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:52.911898 10438 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:52.825986 10599 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.090s
I20260709 12:25:52.912514 10197 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.880041 10523 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.883121 10340 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:52.924712  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:52.893822 10393 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:52.936074  5967 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:25:52.929034 10595 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.924234 10573 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:52.925040  6114 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:25:52.842502 10598 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.082s
I20260709 12:25:52.935025 10539 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:52.928368 10334 tablet_bootstrap.cc:492] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:25:52.890156 10531 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.893700  9915 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:25:52.944101  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:52.916566 10572 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:52.935601 10523 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:52.942915  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:52.957401  6036 raft_consensus.cc:2393] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 7: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:52.931429 10438 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.960623  5961 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:25:52.963236  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:52.965396 10286 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:52.967806 10595 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:52.945088 10573 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.966286 10438 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:52.945580 10340 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:52.968950 10286 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:52.979578  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:52.980815  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:52.983397 10414 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:52.983808 10414 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:52.984025  6009 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:52.984144 10414 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:52.991674 10531 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:52.994737 10414 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:52.975086 10334 ts_tablet_manager.cc:1403] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 1.453s	user 0.031s	sys 0.021s
I20260709 12:25:52.998265 10393 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:53.012766 10363 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:53.012992 10340 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:53.013602 10340 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:53.014567  6041 raft_consensus.cc:2393] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 6: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:53.015223 10197 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:53.012131 10446 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:53.032961 10446 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:53.041069 10561 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:53.041714 10561 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:53.015969 10393 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:53.016813 10573 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:53.017235 10334 raft_consensus.cc:359] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:53.049512 10334 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:25:53.050388 10334 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:53.052554 10334 ts_tablet_manager.cc:1434] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.053s	user 0.005s	sys 0.002s
I20260709 12:25:52.999747 10286 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:53.018965 10528 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:53.020268 10414 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:53.055482 10414 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.055959 10414 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:53.057976 10414 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:53.025076  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.059526  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:53.059588  5978 tablet_copy_service.cc:342] P f1bb8e63c2b448cdafd51f05d277c741: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-7d1c158430bb487aa1d4c5a69165aa32 received from {username='slave'} at 127.0.0.1:37174
I20260709 12:25:53.060288  5978 tablet_copy_service.cc:434] P f1bb8e63c2b448cdafd51f05d277c741: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-7d1c158430bb487aa1d4c5a69165aa32 on tablet 7d1c158430bb487aa1d4c5a69165aa32 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:53.060319  6036 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:53.063534 10561 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:53.063735  6044 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:53.066205  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:53.067991  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:53.068792  6042 raft_consensus.cc:2410] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:25:53.026342  6609 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:53.026716  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2173) took 1151 ms. Trace:
I20260709 12:25:53.069207  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:53.069772  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:53.070291  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:53.070770  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:53.071583  6043 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:53.072584  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:53.069545  6040 rpcz_store.cc:276] 0709 12:25:51.874853 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:52.166287 (+291434us) service_pool.cc:224] Handling call
0709 12:25:52.166641 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:52.406296 (+239655us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:52.406339 (+    43us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:52.406813 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:25:52.586683 (+179870us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:52.586723 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:53.026312 (+439589us) spinlock_profiling.cc:243] Waited 239 ms on lock 0x7b5400171454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:53.026363 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:53.026423 (+    60us) raft_consensus.cc:1685] finished
0709 12:25:53.026436 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:53.026660 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3098,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":116,"spinlock_wait_cycles":550348032,"thread_start_us":70443,"threads_started":1,"wal-append.queue_time_us":123589}
I20260709 12:25:53.079350  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:53.079607  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:53.080092  5965 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
W20260709 12:25:53.081679  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 97788.4us
I20260709 12:25:53.082576  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:53.086927  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 60668.9us
I20260709 12:25:53.088382  5961 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 14: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:53.071241  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:53.091508  5962 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:53.091779  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:53.082635  5932 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:53.103042  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:53.104110  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:53.104672  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.109337  6113 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:53.109503  6043 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:53.116801  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:53.073823 10414 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.119808  6038 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:53.140448  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:53.141184  6112 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:53.142032  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.142696  6043 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:25:53.161856 10268 raft_consensus.cc:3055] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:53.162408 10268 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:53.163302 10268 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:53.184309 10584 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:53.185761  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:53.187840 10047 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:53.190625  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:53.197238  6081 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:53.199997 10198 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:53.200999  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.201713  6115 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:53.202876  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.204715  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:53.207883  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.208529  6114 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:25:53.211130  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.140828  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:53.089655 10393 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:53.108425 10446 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:53.094383 10197 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:53.116493 10301 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:53.240665  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:53.245026  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 47869.4us
W20260709 12:25:53.248510  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 107770us
W20260709 12:25:53.251956  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 103968us
I20260709 12:25:53.252432 10604 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:53.252871 10604 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.253230 10604 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:53.253332  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.254186 10572 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.254724 10572 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:53.258374  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.232825 10446 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.271675  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:53.272279  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.272614  6112 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
W20260709 12:25:53.250771 10547 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
I20260709 12:25:53.118268 10582 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.139s
I20260709 12:25:53.228765  9915 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:53.247089 10301 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.230039 10581 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.278949  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:53.280269  5959 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:25:53.281175  6115 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:53.281104  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:53.223522 10414 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:53.233117 10393 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:53.289315  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.355170  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.345149  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:53.799504  6043 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:53.349519  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.408413  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:53.346522  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:53.804311  6113 consensus_meta.cc:287] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.694s	user 0.011s	sys 0.017s
I20260709 12:25:53.804787  6113 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:53.296557 10301 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:53.278935  9915 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:53.806645 10541 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:53.287846 10446 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:53.807277 10541 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:53.808235  9915 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:53.809602 10541 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:53.422049  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:53.814590  6041 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:53.818756  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.463970  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.823273  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.824898  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:53.825696  6112 raft_consensus.cc:2393] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 10: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:53.828212  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:53.370203  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:53.829056  5963 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:53.829625  6643 raft_consensus.cc:2393] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 6: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:25:53.635663  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:53.328895  9634 consensus_queue.cc:1059] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 9.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.504s
I20260709 12:25:53.327265  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:53.368379 10438 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:53.415062  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:53.858598  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:53.806370 10618 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.351s	user 0.000s	sys 0.000s
I20260709 12:25:53.785741 10539 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:53.779064 10538 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:53.301990 10601 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:53.367457 10572 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:53.422919 10617 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:53.890342  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:53.868491 10622 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.413s	user 0.001s	sys 0.000s
I20260709 12:25:53.351516 10616 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:53.835487 10523 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:53.860188 10178 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:53.375468 10368 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.522s
W20260709 12:25:53.887075 10563 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:25:53.345225 10576 consensus_queue.cc:1059] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.544s
I20260709 12:25:53.859745 10258 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:53.907790  5962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.613s	user 0.000s	sys 0.037s
I20260709 12:25:53.881083 10561 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:53.910884  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:53.428015 10286 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:53.914714  6040 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.687s	user 0.013s	sys 0.016s
W20260709 12:25:53.914995  6644 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.649s	user 0.000s	sys 0.030s
W20260709 12:25:53.935859  6644 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.670s	user 0.000s	sys 0.031s
I20260709 12:25:53.889497 10355 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:53.918027  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:53.935032  6040 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.013s	sys 0.016s
W20260709 12:25:53.938385  6037 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.823s	user 0.018s	sys 0.013s
I20260709 12:25:53.939248  6642 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
W20260709 12:25:53.939503  6037 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.824s	user 0.018s	sys 0.013s
I20260709 12:25:53.906631 10466 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.027s
I20260709 12:25:53.940368  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:53.941126  6642 raft_consensus.cc:2368] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8.
W20260709 12:25:53.942169  5962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.647s	user 0.000s	sys 0.039s
I20260709 12:25:53.902890 10538 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:53.951751  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:53.953429  6646 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 12. Current term is 13. Ops: []
W20260709 12:25:53.954242  6038 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.546s	user 0.005s	sys 0.029s
W20260709 12:25:53.954779  6038 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.006s	sys 0.029s
I20260709 12:25:53.308290 10581 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:53.920157 10523 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:53.910187 10539 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:53.922096  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2300) took 1669 ms. Trace:
I20260709 12:25:53.982854  5966 rpcz_store.cc:276] 0709 12:25:52.252934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:52.263613 (+ 10679us) service_pool.cc:224] Handling call
0709 12:25:52.263880 (+   267us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:52.271711 (+  7831us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:52.271745 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:53.056506 (+784761us) spinlock_profiling.cc:243] Waited 16.8 ms on lock 0x7b1800446bc0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df352a6 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f94da11 00007f481f95d372 00007f482108fa01 00007f482105443a
0709 12:25:53.057323 (+   817us) spinlock_profiling.cc:243] Waited 1.93 ms on lock 0x7b2c0001d508. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f94da11 00007f481f95d372 00007f482108fa01 00007f482105443a 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2
0709 12:25:53.057868 (+   545us) log.cc:844] Serialized 26 byte log entry
0709 12:25:53.222731 (+164863us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:53.222775 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:53.222856 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:53.921862 (+699006us) raft_consensus.cc:1685] finished
0709 12:25:53.921885 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:53.922026 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7432,"raft.queue_time_us":8107,"raft.run_cpu_time_us":193,"raft.run_wall_time_us":14779,"spinlock_wait_cycles":43122432,"thread_start_us":164254,"threads_started":1,"wal-append.queue_time_us":270232}
I20260709 12:25:53.925347 10178 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:53.906566 10617 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:53.906838 10601 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:53.932488 10513 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:53.949481 10589 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.012s	sys 0.026s
W20260709 12:25:53.966399  6036 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.012s	sys 0.029s
W20260709 12:25:53.966853 10434 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.000s	sys 0.041s
W20260709 12:25:53.968454 10559 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.716s	user 0.008s	sys 0.025s
I20260709 12:25:53.968796 10628 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:53.976779  6044 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.728s	user 0.017s	sys 0.026s
I20260709 12:25:53.977388 10638 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:53.977587  5965 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.007s	sys 0.010s
I20260709 12:25:53.936724 10350 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:53.989431  6642 raft_consensus.cc:1217] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEARNER]: Deduplicated request from leader. Original: 7.5->[7.6-7.6]   Dedup: 7.6->[]
I20260709 12:25:53.992681  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:54.020123  6036 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.770s	user 0.012s	sys 0.029s
I20260709 12:25:53.917307 10616 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.021150  6651 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
W20260709 12:25:53.983732 10619 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.515s	user 0.001s	sys 0.000s
W20260709 12:25:54.027051 10559 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.775s	user 0.009s	sys 0.025s
I20260709 12:25:54.036631 10350 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:54.037595 10350 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:54.038846 10350 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:53.940497  9966 consensus_queue.cc:1059] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.057s
I20260709 12:25:53.935235 10258 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:54.027437  6044 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.793s	user 0.018s	sys 0.026s
W20260709 12:25:54.027702  5965 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.007s	sys 0.010s
W20260709 12:25:54.022030 10589 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.013s	sys 0.026s
I20260709 12:25:53.937783 10561 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:54.031036  6006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.938s	user 0.003s	sys 0.022s
I20260709 12:25:53.948185 10355 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.033349  6642 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 10. (term mismatch)
I20260709 12:25:54.030411 10616 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.027109 10513 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:54.022500 10434 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.765s	user 0.000s	sys 0.041s
I20260709 12:25:54.049798 10286 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:54.050913 10178 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.051617 10258 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:54.052707 10301 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:54.056239  6006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.964s	user 0.003s	sys 0.022s
I20260709 12:25:53.996224 10617 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:54.058053  6642 pending_rounds.cc:85] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 9
I20260709 12:25:54.057835 10559 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:53.995350 10539 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:54.001441 10592 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.694s	user 0.000s	sys 0.010s
I20260709 12:25:54.077589  6642 pending_rounds.cc:107] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 9.10
W20260709 12:25:54.076824  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 994279us
I20260709 12:25:54.042454 10628 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.077931  6642 raft_consensus.cc:2889] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:25:54.011153 10340 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.895s	user 0.035s	sys 0.038s
W20260709 12:25:54.089900  6116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.654s	user 0.000s	sys 0.013s
W20260709 12:25:54.111120  6116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.000s	sys 0.014s
W20260709 12:25:54.080389  5967 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.734s	user 0.001s	sys 0.012s
W20260709 12:25:54.112099  5967 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.001s	sys 0.012s
W20260709 12:25:54.074290  6035 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.009s	sys 0.005s
W20260709 12:25:54.114049  6035 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.806s	user 0.009s	sys 0.005s
I20260709 12:25:54.114651  6041 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:54.047560 10638 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:54.097765  6009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.863s	user 0.038s	sys 0.055s
W20260709 12:25:54.128497  6009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.894s	user 0.041s	sys 0.056s
W20260709 12:25:54.129124  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 938578us
I20260709 12:25:54.131623  6009 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:54.106714  6006 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:54.081358 10592 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.780s	user 0.000s	sys 0.013s
I20260709 12:25:54.075030 10438 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:54.136264  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 304986us
W20260709 12:25:54.091315 10340 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.036s	sys 0.039s
I20260709 12:25:54.087982 10616 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:54.081408 10414 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.156118 10355 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.159801 10301 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:54.160377 10528 consensus_meta.cc:287] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 1.106s	user 0.007s	sys 0.003s
I20260709 12:25:54.144505 10340 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:54.163817 10340 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:54.166210 10616 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:54.168413  6645 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
W20260709 12:25:54.173456  6042 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.901s	user 0.000s	sys 0.020s
W20260709 12:25:54.176252  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 375127us
W20260709 12:25:54.178824  5964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.824s	user 0.046s	sys 0.070s
W20260709 12:25:54.179888  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:54.268364  6042 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.996s	user 0.000s	sys 0.021s
I20260709 12:25:54.087817 10559 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.141162 10393 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.162987 10631 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.220767  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2195) took 1138 ms. Trace:
I20260709 12:25:54.173303 10290 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.177336 10258 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:54.190651 10363 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.191032 10355 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:25:54.247198 10604 consensus_meta.cc:287] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.994s	user 0.011s	sys 0.000s
I20260709 12:25:54.247908 10268 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:54.248217 10539 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:54.226015 10624 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:54.268085  5964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.913s	user 0.046s	sys 0.070s
I20260709 12:25:54.283758  6038 rpcz_store.cc:276] 0709 12:25:53.082229 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.122200 (+ 39971us) service_pool.cc:224] Handling call
0709 12:25:53.122540 (+   340us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:53.122730 (+   190us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:53.961914 (+839184us) log.cc:844] Serialized 14 byte log entry
0709 12:25:54.220355 (+258441us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:54.220420 (+    65us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:54.220473 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:54.220547 (+    74us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:54.220692 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":185064,"prepare.queue_time_us":798955,"prepare.run_cpu_time_us":64,"prepare.run_wall_time_us":5782,"thread_start_us":806928,"threads_started":2}
I20260709 12:25:54.280097 10538 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:54.244489 10523 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:54.136327 10601 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:54.286230 10597 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:54.286217 10648 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:54.294226  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 404932us
I20260709 12:25:54.263969 10581 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:54.283435 10368 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:25:54.266848 10565 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.899s	user 0.011s	sys 0.009s
I20260709 12:25:54.289201 10511 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:54.288125  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:54.289407 10290 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.293036 10355 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.291301 10363 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:54.290987 10258 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.292073 10631 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:54.293856 10393 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:54.434558 10446 consensus_meta.cc:287] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.627s	user 0.010s	sys 0.000s
W20260709 12:25:54.478513 10642 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
W20260709 12:25:54.469334 10637 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:25:54.291167 10629 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:54.293174 10647 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:54.294904 10604 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:54.395344 10641 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
W20260709 12:25:54.395324 10640 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.132s	user 0.000s	sys 0.000s
W20260709 12:25:54.447381 10646 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:25:54.396591 10539 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:54.781243 10528 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:54.781971 10539 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.782240 10528 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.785337 10528 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:25:54.637872  5960 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:25:54.639210  5967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2308) took 1388 ms. Trace:
I20260709 12:25:54.646613  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2316) took 1373 ms. Trace:
W20260709 12:25:54.646938  6006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.514s	user 0.001s	sys 0.006s
W20260709 12:25:54.649394  6035 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.009s	sys 0.004s
I20260709 12:25:54.305927  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2189) took 1242 ms. Trace:
I20260709 12:25:54.651088  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2191) took 1587 ms. Trace:
I20260709 12:25:54.654596  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:54.656260  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2317) took 1287 ms. Trace:
I20260709 12:25:54.687827  6116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2672) took 1372 ms. Trace:
W20260709 12:25:54.711210  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 423109us
I20260709 12:25:54.781308 10599 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.712150  6646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1186) took 1470 ms. Trace:
I20260709 12:25:54.715065  6650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 870) took 1246 ms. Trace:
W20260709 12:25:54.717955  6651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 1185) took 1478 ms (client timeout 1969 ms). Trace:
I20260709 12:25:54.718972  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:54.720325  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:54.724056 10019 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:54.727695  9966 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:54.734179 10355 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.735929 10258 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.737254 10363 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:54.519363 10393 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:54.844727  6116 rpcz_store.cc:276] 0709 12:25:53.315423 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.315763 (+   340us) service_pool.cc:224] Handling call
0709 12:25:53.325745 (+  9982us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:53.329491 (+  3746us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:53.329521 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:53.367758 (+ 38237us) log.cc:844] Serialized 52 byte log entry
0709 12:25:54.111670 (+743912us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:54.111716 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:54.111800 (+    84us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:54.687166 (+575366us) raft_consensus.cc:1685] finished
0709 12:25:54.687203 (+    37us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:54.687565 (+   362us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3318,"raft.queue_time_us":3437,"raft.run_cpu_time_us":184,"raft.run_wall_time_us":22414,"thread_start_us":675519,"threads_started":1,"wal-append.queue_time_us":850793}
I20260709 12:25:54.854439 10393 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:54.845146  6650 rpcz_store.cc:276] 0709 12:25:53.468578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:54.028441 (+559863us) service_pool.cc:224] Handling call
0709 12:25:54.042879 (+ 14438us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:54.043266 (+   387us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:54.043293 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:54.043849 (+   556us) log.cc:844] Serialized 52 byte log entry
0709 12:25:54.283410 (+239561us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:54.283452 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:54.284458 (+  1006us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:54.714556 (+430098us) raft_consensus.cc:1685] finished
0709 12:25:54.714589 (+    33us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:54.714882 (+   293us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8671,"raft.queue_time_us":2318,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":1912,"thread_start_us":234197,"threads_started":1,"wal-append.queue_time_us":521353}
I20260709 12:25:54.738826 10442 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:54.739737 10374 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.740732 10290 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:54.510183 10368 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:54.858887 10442 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.741163 10438 consensus_queue.cc:1059] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:54.346153 10414 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:54.860251 10228 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:54.860811 10414 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:54.861253 10228 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:54.737767 10161 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:54.750490 10268 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:54.500360 10511 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.318086 10513 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:54.347267 10561 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.491467 10559 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:54.507752 10565 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.193s	user 0.011s	sys 0.016s
I20260709 12:25:54.424337 10589 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:54.570803 10604 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:54.945510 10228 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:54.438124 10616 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:54.514768 10597 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:54.947412 10340 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.592s	user 0.037s	sys 0.055s
W20260709 12:25:54.949046 10340 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.643s	user 0.038s	sys 0.056s
I20260709 12:25:54.572402 10617 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:54.550978 10620 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 1.204s	user 0.005s	sys 0.006s
W20260709 12:25:54.451195 10621 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.993s	user 0.009s	sys 0.000s
I20260709 12:25:54.310683 10624 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.927503  9966 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.961083 10624 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.431728 10628 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.576568 10631 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:54.443576 10638 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.540195 10647 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.962790  9966 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:54.779614 10531 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
W20260709 12:25:54.635360  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.978322  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:54.785220 10539 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.834848  5960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2307) took 1584 ms. Trace:
W20260709 12:25:54.838790  6006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.001s	sys 0.007s
W20260709 12:25:54.841128  6035 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.723s	user 0.010s	sys 0.005s
I20260709 12:25:54.782291 10659 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:54.842198  5865 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 9 to 11, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 11 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:54.781255 10523 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:54.528585 10446 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:54.858649  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:54.845068  6646 rpcz_store.cc:276] 0709 12:25:53.241547 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.242062 (+   515us) service_pool.cc:224] Handling call
0709 12:25:53.242361 (+   299us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:53.954349 (+711988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:54.711415 (+757066us) spinlock_profiling.cc:243] Waited 708 ms on lock 0x7b540053edd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:54.711813 (+   398us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1629353344}
I20260709 12:25:54.858600 10669 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:54.983314 10669 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:54.980744  5960 rpcz_store.cc:276] 0709 12:25:53.250699 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.251638 (+   939us) service_pool.cc:224] Handling call
0709 12:25:54.636774 (+1385136us) spinlock_profiling.cc:243] Waited 1.56 ms on lock 0x7b5800010598. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2feee 000000000036eb39 00007f4825fa31e0 00007f482606c0c4 00007f482606c131 00007f482602dfc0 00007f4826018929 00007f48260183d2 00007f481f58fbd4
0709 12:25:54.637231 (+   457us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:54.806517 (+169286us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:54.834743 (+ 28226us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3593472}
I20260709 12:25:54.984467  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:54.982838 10659 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:54.985807 10669 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:54.845384  6651 rpcz_store.cc:269] 0709 12:25:53.239388 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.240385 (+   997us) service_pool.cc:224] Handling call
0709 12:25:54.717546 (+1477161us) spinlock_profiling.cc:243] Waited 773 ms on lock 0x7b54004e2fd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:54.717741 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1777072512}
I20260709 12:25:54.905241  6039 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:54.987394  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:54.989823 10446 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:54.858774 10599 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.990664 10523 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:54.991812  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 885152us
I20260709 12:25:54.992391 10599 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:54.908331  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 262265us
I20260709 12:25:54.993188 10523 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.787243  5964 rpcz_store.cc:276] 0709 12:25:53.264633 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.264763 (+   130us) service_pool.cc:224] Handling call
0709 12:25:53.265071 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:53.279289 (+ 14218us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:53.279320 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:53.290114 (+ 10794us) log.cc:844] Serialized 26 byte log entry
0709 12:25:54.307123 (+1017009us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:54.445021 (+137898us) spinlock_profiling.cc:243] Waited 19.1 ms on lock 0x7b4800080058. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4825f7daa1 00007f4825f74b37 00007f4825f749ca 00007f482606c26f 00007f482606bf37 00007f482608055c 00007f4826080508 00007f4826080488 00007f4826080443 00007f482607f6ec 00007f4824fa9a96
0709 12:25:54.636898 (+191877us) log.cc:844] Serialized 14 byte log entry
0709 12:25:54.637449 (+   551us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:54.637602 (+   153us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:54.637696 (+    94us) raft_consensus.cc:1685] finished
0709 12:25:54.637864 (+   168us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:54.638233 (+   369us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14705,"prepare.queue_time_us":149377,"prepare.run_cpu_time_us":51,"prepare.run_wall_time_us":49,"raft.queue_time_us":115294,"raft.run_cpu_time_us":13736,"raft.run_wall_time_us":1161681,"spinlock_wait_cycles":43946368,"thread_start_us":940585,"threads_started":1,"wal-append.queue_time_us":978968}
I20260709 12:25:54.902617 10355 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:54.990499  6036 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.606s	user 0.004s	sys 0.008s
I20260709 12:25:54.994027  5959 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:54.994192 10355 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.916191  6038 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:54.910640 10649 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.844183  6040 rpcz_store.cc:276] 0709 12:25:53.063797 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.075000 (+ 11203us) service_pool.cc:224] Handling call
0709 12:25:53.075247 (+   247us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:53.075444 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 5
0709 12:25:53.938345 (+862901us) log.cc:844] Serialized 14 byte log entry
0709 12:25:54.650220 (+711875us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:54.650334 (+   114us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:25:54.650446 (+   112us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:54.650604 (+   158us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:54.650812 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":40029,"prepare.queue_time_us":352062,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":140462,"raft.run_cpu_time_us":132,"raft.run_wall_time_us":5967,"thread_start_us":1426099,"threads_started":3,"wal-append.queue_time_us":456527}
I20260709 12:25:54.913008 10442 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.844376  5968 rpcz_store.cc:276] 0709 12:25:53.368880 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.369383 (+   503us) service_pool.cc:224] Handling call
0709 12:25:53.369724 (+   341us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:53.817019 (+447295us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:53.817513 (+   494us) log.cc:844] Serialized 14 byte log entry
0709 12:25:54.140020 (+322507us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:54.140133 (+   113us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:54.140180 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:54.641641 (+501461us) spinlock_profiling.cc:243] Waited 2.75 ms on lock 0x7b180016a320. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df352a6 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419
0709 12:25:54.655793 (+ 14152us) spinlock_profiling.cc:243] Waited 447 ms on lock 0x7b54000b8954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:54.655844 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:54.656106 (+   262us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":642,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":12715,"raft.queue_time_us":91,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":11889,"spinlock_wait_cycles":1033902336,"thread_start_us":322136,"threads_started":1,"wal-append.queue_time_us":473551}
W20260709 12:25:54.956509  6084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.007s	sys 0.005s
I20260709 12:25:54.786926  5967 rpcz_store.cc:276] 0709 12:25:53.251037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.251527 (+   490us) service_pool.cc:224] Handling call
0709 12:25:53.259018 (+  7491us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:53.275445 (+ 16427us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:53.275474 (+    29us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:53.276050 (+   576us) log.cc:844] Serialized 52 byte log entry
0709 12:25:54.112512 (+836462us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:25:54.137137 (+ 24625us) log.cc:844] Serialized 14 byte log entry
0709 12:25:54.137618 (+   481us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:54.137699 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:54.638704 (+501005us) raft_consensus.cc:1685] finished
0709 12:25:54.638743 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:54.639054 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16025,"prepare.queue_time_us":24403,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":16991,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":27275,"spinlock_wait_cycles":13874560,"thread_start_us":766503,"threads_started":1,"wal-append.queue_time_us":984256}
W20260709 12:25:54.933097  6043 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.004s	sys 0.008s
I20260709 12:25:54.929663 10019 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.934823 10541 raft_consensus.cc:3055] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:55.016520 10541 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:55.018069 10541 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.9, Last appended by leader: 9, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.019421  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:54.938504 10661 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:54.927949 10258 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:54.921636 10629 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:55.020514 10661 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.021222 10629 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:55.022905  6084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.730s	user 0.007s	sys 0.006s
W20260709 12:25:54.950932  6007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.637s	user 0.008s	sys 0.004s
I20260709 12:25:54.922937 10268 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.950217 10597 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:54.954964  6083 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.006s	sys 0.018s
I20260709 12:25:54.964709 10647 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:55.030380  6042 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.647s	user 0.000s	sys 0.014s
I20260709 12:25:54.993367  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:54.966747 10513 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.925648 10161 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.967352 10511 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:54.968458  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:54.969658  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:54.925693 10374 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:54.974952  6611 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:54.942780 10589 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:54.980698 10561 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:54.998544  6043 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.651s	user 0.005s	sys 0.008s
I20260709 12:25:54.999085  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:54.996486 10355 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:54.999022 10649 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:54.994062  6036 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.004s	sys 0.009s
W20260709 12:25:54.990667  6009 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.777s	user 0.008s	sys 0.004s
I20260709 12:25:55.000583  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.001344 10666 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:55.001466 10019 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:54.993513  5934 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:55.003800 10617 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:55.006330  9915 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:54.996474 10604 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:55.008510 10414 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.008970 10672 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:54.996580  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2194) took 1914 ms. Trace:
I20260709 12:25:55.010102  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:54.924371  6037 rpcz_store.cc:276] 0709 12:25:53.063266 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.067122 (+  3856us) service_pool.cc:224] Handling call
0709 12:25:53.067363 (+   241us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:53.067567 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:53.949963 (+882396us) log.cc:844] Serialized 14 byte log entry
0709 12:25:54.293857 (+343894us) log.cc:844] Serialized 14 byte log entry
0709 12:25:54.305559 (+ 11702us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:54.305617 (+    58us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:54.305663 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:54.305729 (+    66us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:54.305868 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24773,"prepare.queue_time_us":342160,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":86,"raft.queue_time_us":306242,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":1015,"thread_start_us":1166560,"threads_started":2,"wal-append.queue_time_us":446028}
I20260709 12:25:55.015205  5865 catalog_manager.cc:5697] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:25:55.037984  6083 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.731s	user 0.007s	sys 0.018s
I20260709 12:25:55.020315 10258 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.019809 10541 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:54.511684 10648 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:54.966347 10528 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:55.033624  6007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.772s	user 0.009s	sys 0.005s
I20260709 12:25:55.137728 10528 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.042811  5965 raft_consensus.cc:2393] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:55.138540  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.138818 10669 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:55.001884 10368 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:55.043947  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 102798us
I20260709 12:25:55.140445 10528 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:55.140877  6040 raft_consensus.cc:2393] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:55.141069 10539 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:55.141413  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:55.049006  6009 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.910s	user 0.008s	sys 0.004s
I20260709 12:25:55.044371 10589 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.044766 10561 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.143735  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:55.144541  5967 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:55.144845 10524 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:55.145601 10561 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:55.050417  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 57116.9us
I20260709 12:25:54.987286 10659 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.132236 10672 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.147012  5934 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:55.143615 10589 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:55.139441 10669 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.149076 10672 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:55.149818 10669 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.147478 10414 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:55.151170 10414 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.153535  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2309) took 1902 ms. Trace:
W20260709 12:25:55.143611  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 1.01207e+06us
I20260709 12:25:55.146127  6041 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:55.154008  5961 rpcz_store.cc:276] 0709 12:25:53.251324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.256560 (+  5236us) service_pool.cc:224] Handling call
0709 12:25:54.258652 (+1002092us) spinlock_profiling.cc:243] Waited 2.24 ms on lock 0x7b5800010598. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482602dfc0 00007f4826018929 00007f48260183d2 00007f481f58fbd4
0709 12:25:54.258916 (+   264us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:54.259168 (+   252us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:54.259194 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:54.261348 (+  2154us) log.cc:844] Serialized 26 byte log entry
0709 12:25:54.928896 (+667548us) raft_consensus.cc:1645] Marking committed up to 4
0709 12:25:54.931614 (+  2718us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:54.941981 (+ 10367us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:55.152997 (+211016us) raft_consensus.cc:1685] finished
0709 12:25:55.153014 (+    17us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:55.153256 (+   242us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5145344,"thread_start_us":276974,"threads_started":1,"wal-append.queue_time_us":861267}
I20260709 12:25:55.141804 10539 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.155762  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.156317  5964 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: [11.5-11.5]
I20260709 12:25:55.156704  6041 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:25:55.150406  5968 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: [9.6-9.6]
W20260709 12:25:55.034787  6042 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.766s	user 0.000s	sys 0.015s
I20260709 12:25:55.043869  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2318) took 1674 ms. Trace:
I20260709 12:25:55.116020 10677 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:25:55.118351  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 125202us
I20260709 12:25:55.160758  5959 rpcz_store.cc:276] 0709 12:25:53.369201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.795544 (+426343us) service_pool.cc:224] Handling call
0709 12:25:53.795837 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:55.001924 (+1206087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:55.043482 (+ 41558us) spinlock_profiling.cc:243] Waited 1.18 s on lock 0x7b540008c354. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:25:55.043793 (+   311us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2716372736}
I20260709 12:25:55.041621 10350 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:55.123258 10604 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.126888  6044 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:55.041817  6649 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:55.123337  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2192) took 2059 ms. Trace:
I20260709 12:25:55.045702  6038 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:55.044289 10511 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:55.036713 10629 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.041306  6647 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:55.153805 10414 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.131022 10258 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:55.045321 10268 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:55.031996 10434 raft_consensus.cc:3055] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:55.050477 10666 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.147352 10290 raft_consensus.cc:3055] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:55.135205 10393 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.111819  6035 rpcz_store.cc:276] 0709 12:25:53.081965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.089148 (+  7183us) service_pool.cc:224] Handling call
0709 12:25:53.089449 (+   301us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:53.089653 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:54.118133 (+1028480us) log.cc:844] Serialized 14 byte log entry
0709 12:25:54.996130 (+877997us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:54.996207 (+    77us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:54.996263 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:54.996359 (+    96us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:54.996523 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":184759,"prepare.queue_time_us":790776,"prepare.run_cpu_time_us":82,"prepare.run_wall_time_us":1839,"raft.queue_time_us":15801,"raft.run_cpu_time_us":153,"raft.run_wall_time_us":150,"thread_start_us":1668944,"threads_started":2,"wal-append.queue_time_us":455622}
I20260709 12:25:55.157977 10539 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:55.195430 10290 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:55.206595  9915 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.207065  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2193) took 2142 ms. Trace:
I20260709 12:25:55.203044 10649 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.168172  6611 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:55.169013 10178 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:55.170745  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.040458 10161 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.045231 10374 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:55.233493  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.162118 10677 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:55.166198  5865 catalog_manager.cc:5697] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.184572 10350 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.247730  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.249879 10350 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:55.197257  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.193485 10434 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:55.250881  6037 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:25:55.251464 10434 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.253098 10434 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:55.252863  5865 catalog_manager.cc:5697] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.254537 10666 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.202992 10601 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:55.203397  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.257041  6115 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:55.257905  5865 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 12 to 13, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 13 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:55.211472 10411 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:55.207515  6042 rpcz_store.cc:276] 0709 12:25:53.064345 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.087239 (+ 22894us) service_pool.cc:224] Handling call
0709 12:25:53.087640 (+   401us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:53.087900 (+   260us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:25:54.268912 (+1181012us) log.cc:844] Serialized 14 byte log entry
0709 12:25:55.195429 (+926517us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:55.206607 (+ 11178us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:25:55.206689 (+    82us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:55.206801 (+   112us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:55.206990 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":162536,"prepare.queue_time_us":339979,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":60,"raft.queue_time_us":86,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":132,"thread_start_us":1887933,"threads_started":2,"wal-append.queue_time_us":754979}
I20260709 12:25:55.259409 10411 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:55.211961  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 65164.1us
W20260709 12:25:55.212174 10681 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.174s	user 0.000s	sys 0.001s
I20260709 12:25:55.175078  6036 rpcz_store.cc:276] 0709 12:25:53.064078 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:53.075053 (+ 10975us) service_pool.cc:224] Handling call
0709 12:25:53.075357 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:53.075553 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:54.043967 (+968414us) log.cc:844] Serialized 14 byte log entry
0709 12:25:55.122688 (+1078721us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:55.122776 (+    88us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:55.122834 (+    58us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:55.122960 (+   126us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:55.123273 (+   313us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":147789,"prepare.queue_time_us":352160,"prepare.run_cpu_time_us":23,"prepare.run_wall_time_us":24,"raft.queue_time_us":140754,"raft.run_cpu_time_us":49,"raft.run_wall_time_us":49,"spinlock_wait_cycles":1792,"thread_start_us":1780475,"threads_started":3,"wal-append.queue_time_us":337860}
I20260709 12:25:55.205821 10290 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.212563 10664 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:55.261418 10290 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:55.261657 10664 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.262804  5934 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:55.265985 10411 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:55.213083  6043 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12. Ops: []
W20260709 12:25:55.260294  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 92265.4us
I20260709 12:25:55.213240 10228 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:55.264863 10664 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.268157  6611 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:55.269169 10161 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:55.269913  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:55.278218  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.223253 10604 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.195844 10661 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:55.209141  9915 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.209126 10659 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:55.247645 10677 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:55.260099 10511 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:55.221215 10178 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.038405 10513 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.277550  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.275676  5865 catalog_manager.cc:5697] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 4 to 5, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 5 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:55.273135 10393 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:55.139494 10648 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:55.276485  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.298898  5967 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:55.314340  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.301997  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.308506  6039 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:55.309864  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.310721  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.303654 10374 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:55.258280 10258 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:55.320137 10532 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.956s	user 0.000s	sys 0.013s
W20260709 12:25:55.320562 10532 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.067s	user 0.000s	sys 0.014s
I20260709 12:25:55.320680  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.322037  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.335054  5961 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:25:55.336192  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.336530 10368 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:55.337106  5961 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:55.327220  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.339931  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.340500  6112 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:25:55.327646  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:55.341457  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 71635.1us
I20260709 12:25:55.341603  6649 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:25:55.328215  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.328428  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.329192  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.329614  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.329912  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.321767 10228 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:55.330078 10513 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.330962  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.331583  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.331869  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.332621  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.333086  6648 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:55.333588  6113 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:55.334750  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.334370  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.323936 10258 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:55.338325  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.338912  6609 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:55.338579  5865 catalog_manager.cc:5697] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 9 to 11, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 11 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.335052 10411 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.005s
I20260709 12:25:55.331203  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.328445  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.342422  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:55.314517 10161 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:55.349136  6647 raft_consensus.cc:2410] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:25:55.327073  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:55.352955  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 48750us
I20260709 12:25:55.356014  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:55.356189  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 175554us
I20260709 12:25:55.353101  6118 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:25:55.358289  5967 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 12: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:55.361219  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.361222  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:55.364790  5960 raft_consensus.cc:2410] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 9.
I20260709 12:25:55.344671 10228 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:25:55.366842  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 104198us
I20260709 12:25:55.360397  6643 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:55.368264  6111 raft_consensus.cc:2410] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:25:55.367090  6646 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:55.334767 10178 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:55.372864  6649 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:55.376438  6038 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:55.379802  6644 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:25:55.381825  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:55.382575  6043 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:55.383832  5934 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:55.374606 10393 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:25:55.386849  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 44582.3us
I20260709 12:25:55.387135 10393 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.388236  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.388991  6040 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:55.389464 10393 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:55.389993  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.390714  6036 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:25:55.393065 10664 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.393693 10664 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.394829 10228 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.395882 10664 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.373036  6609 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:55.394768  5961 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 13
I20260709 12:25:55.404568  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:55.411576  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 54360.3us
I20260709 12:25:55.413496  6609 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:55.417488  6043 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
W20260709 12:25:55.419078  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 51856.6us
I20260709 12:25:55.421933  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.374709 10528 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:55.357414 10589 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:25:55.430218  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.432605  6646 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 5.
W20260709 12:25:55.439213  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.439352 10161 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:55.430702  6035 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:25:55.435324  5865 catalog_manager.cc:5697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:25:55.429528 10178 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:55.442761 10682 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
W20260709 12:25:55.443089  5862 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 308) took 14795 ms (client timeout 15000 ms). Trace:
I20260709 12:25:55.444998  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.445647  6642 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:25:55.442675 10178 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.447535 10290 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:55.447974 10290 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:55.448340 10290 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:55.449100 10178 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:55.454574 10538 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:55.455081 10538 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:55.455440 10538 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:55.439908 10161 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:55.456156 10161 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:55.448441  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.459051 10228 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:55.463656 10589 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:55.464112 10589 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:55.465086 10589 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.467321  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:55.468199  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:55.468709 10685 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
I20260709 12:25:55.469012  6609 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:55.470777 10411 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:55.470824  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.480932 10331 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:25:55.482897  5934 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.68:45477 timed out after 1.508s (SENT) [suppressed 11 similar messages]
I20260709 12:25:55.484699  6036 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 9. (index mismatch)
I20260709 12:25:55.485608  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.486213  6043 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:25:55.426591 10374 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.485500  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.491607  6039 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:55.403891 10368 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.495965  5865 catalog_manager.cc:5697] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 7 to 8, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 8 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:25:55.466391 10589 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:55.501768  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.504944 10538 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.506088  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:55.512317  6039 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:55.513132  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.513959  6036 raft_consensus.cc:2393] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:55.506947  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.515507  6038 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:25:55.525477  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 153804us
I20260709 12:25:55.491534 10331 raft_consensus.cc:697] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:55.513829 10659 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:55.481209 10411 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.533793  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.541375  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.541616  6650 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 6 index: 9. Preceding OpId from leader: term: 7 index: 9. (term mismatch)
I20260709 12:25:55.542078  6650 pending_rounds.cc:85] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 8
I20260709 12:25:55.543728  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.544500  6036 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:55.525046 10564 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:55.549103  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.511216 10374 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:55.553088 10689 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:25:55.553503 10562 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:55.549890 10511 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:55.558990 10350 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:55.559713 10684 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.097s	user 0.002s	sys 0.001s
I20260709 12:25:55.563997 10538 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:55.542299  6650 pending_rounds.cc:107] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 6.9
I20260709 12:25:55.583873  6650 raft_consensus.cc:2889] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:55.576530  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.585203  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:55.585220  6038 raft_consensus.cc:2410] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:55.577601  6115 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:55.563828 10527 raft_consensus.cc:3055] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:55.553424 10438 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:55.590193  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:55.593397  6035 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:55.594120  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.596956  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.609975  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:55.611907  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 129049us
I20260709 12:25:55.612270  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.607818  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.607870  6644 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:55.604936  5961 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:25:55.615437  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.613896  6081 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:55.620105  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.590132 10527 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:55.623816  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.628938  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.614945  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:55.443482  5862 rpcz_store.cc:269] 0709 12:25:40.565212 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:40.565805 (+   593us) service_pool.cc:224] Handling call
0709 12:25:55.354589 (+14788784us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:51.507882 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:51.508415 (+   533us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:51.508453 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:25:51.508473 (+    20us) tablet.cc:662] Decoding operations
0709 12:25:51.509453 (+   980us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:51.509528 (+    75us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:51.509559 (+    31us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:25:51.517191 (+  7632us) tablet.cc:701] Row locks acquired
0709 12:25:51.517212 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:25:51.517347 (+   135us) write_op.cc:270] Start()
0709 12:25:51.517466 (+   119us) write_op.cc:276] Timestamp: P: 1783599951517306 usec, L: 0
0709 12:25:51.517485 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:25:51.518262 (+   777us) log.cc:844] Serialized 4359 byte log entry
0709 12:25:52.556863 (+1038601us) spinlock_profiling.cc:243] Waited 2.39 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:52.902402 (+345539us) op_driver.cc:464] REPLICATION: finished
0709 12:25:52.998795 (+ 96393us) write_op.cc:301] APPLY: starting
0709 12:25:52.998912 (+   117us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:53.090700 (+ 91788us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:53.093033 (+  2333us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:53.921129 (+828096us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:53.921382 (+   253us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:25:53.921428 (+    46us) write_op.cc:312] APPLY: finished
0709 12:25:53.996976 (+ 75548us) log.cc:844] Serialized 105 byte log entry
0709 12:25:54.311127 (+314151us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:54.345899 (+ 34772us) write_op.cc:454] Released schema lock
0709 12:25:54.372181 (+ 26282us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:54.469750 (+ 97569us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:54.476707 (+  6957us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":3542980,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":71670,"apply.run_cpu_time_us":31097,"apply.run_wall_time_us":1442561,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50129,"num_ops":11,"prepare.queue_time_us":300872,"prepare.run_cpu_time_us":22572,"prepare.run_wall_time_us":310475,"raft.queue_time_us":194070,"raft.run_cpu_time_us":11193,"raft.run_wall_time_us":120816,"replication_time_us":1363838,"spinlock_wait_cycles":5492096,"thread_start_us":880819,"threads_started":5,"wal-append.queue_time_us":1066571,"wal-append.run_cpu_time_us":26304,"wal-append.run_wall_time_us":2703290}]]}
I20260709 12:25:55.592162 10562 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.637737  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.637926  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.642364  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.640211  6084 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:55.647874  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.645617  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.649889  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.649274  6041 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:55.598857 10350 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.596560 10511 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.663463  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.666081  6043 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:25:55.596339 10564 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.629987 10427 raft_consensus.cc:2764] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:25:55.672585  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.673666  6645 raft_consensus.cc:2368] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12.
I20260709 12:25:55.665326  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.644049 10368 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:55.683404  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.686249  6112 raft_consensus.cc:2410] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:25:55.684223  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.688082  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.692662  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.621208 10438 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.667905 10648 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:55.694242  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.688813  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.707065  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:55.699470  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.708643  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:55.716228  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 86782.5us
I20260709 12:25:55.719743  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.725648  6084 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:55.727105  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.747236  6642 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 13: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:55.747632  6115 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:55.749035  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:55.749843  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.751034  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:55.752130  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.708078 10541 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:55.766471  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.758842  5960 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:55.711361 10019 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:55.643636 10331 consensus_queue.cc:237] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.770202  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.782346  6646 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:55.783973  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.784679  6037 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:55.791564  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:55.747255 10648 raft_consensus.cc:697] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:55.794494  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.802541  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:55.803349  5962 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:55.803627  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.804186  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.804764  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.805771  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.806712  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.807843  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:55.808394  6109 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:55.809957  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.810896 10592 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:55.811342 10592 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:55.811682 10592 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:55.819072 10690 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:25:55.791886 10019 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.779371 10411 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:55.734748 10527 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.823596 10527 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:55.827399 10564 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:55.829044 10350 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:55.831458  5934 leader_election.cc:400] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8.
I20260709 12:25:55.831799  5934 leader_election.cc:403] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:55.832201 10374 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.832446 10532 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 8
W20260709 12:25:55.832616  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 55364.5us
I20260709 12:25:55.833559  5934 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:55.835139 10019 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.789790 10679 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:55.795694 10178 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:25:55.780781 10541 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.803134  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.843103  6646 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:55.840183  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.839401  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.839141  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:55.846129  6109 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:25:55.851698  6112 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:55.839846  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.838393  6035 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:25:55.848515  6642 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:55.806263  6645 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:25:55.854089  6115 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
W20260709 12:25:55.856527  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 65040us
I20260709 12:25:55.750754 10677 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.858601  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:55.876637  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.877867  6039 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:25:55.831331 10511 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:55.882412  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:55.884910  6039 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:25:55.838675 10659 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:55.840556 10532 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 7. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8.
I20260709 12:25:55.838759 10679 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:55.894686 10679 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:55.896938 10677 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.897795  6040 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:55.839814 10648 consensus_queue.cc:237] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 6.4, Last appended by leader: 4, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:55.885805 10438 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:55.903823  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.904835  6037 raft_consensus.cc:2410] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:55.905776  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.906785  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.907258  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.909299  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 4 index: 3 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.909686  6111 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:25:55.910048  6044 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:55.905023  6009 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:55.911813  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:55.912719  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:55.915823 10541 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:55.916711  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:55.883857  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:55.890609 10631 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:55.843640 10562 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:55.907351  6043 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
W20260709 12:25:55.925765  6649 consensus_meta.cc:287] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.522s	user 0.007s	sys 0.002s
I20260709 12:25:55.926183  6649 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:25:55.931313  6109 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:55.931618  6112 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:25:55.931006 10524 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:55.933694  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:55.910306 10161 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:55.927110 10631 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:55.934691 10664 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:55.942584  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:55.949147  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.979256  6644 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:55.954874  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.988476  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:55.989286  6035 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:55.958112 10631 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:25:55.995194  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:55.957824 10659 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:25:55.984577  6609 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:55.960144 10677 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:25:55.938529 10290 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.014816  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:55.978973 10601 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:56.023028  9915 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:55.987246 10524 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:56.023630  9915 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:56.022967  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 60901.5us
I20260709 12:25:56.027052  9915 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:56.027509  5934 leader_election.cc:400] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12.
I20260709 12:25:56.021221 10438 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election won for term 12
W20260709 12:25:56.028083  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.027884  5934 leader_election.cc:403] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:56.039784  6643 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:56.024674 10601 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:56.029090 10524 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:56.042513 10438 raft_consensus.cc:697] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:56.047704 10601 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:56.061899  6109 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:25:56.068162  6113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42702625c5a04990a24ae81a2dede920"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:56.069097  6113 raft_consensus.cc:606] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:56.069466  6113 raft_consensus.cc:614] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:56.073083  6082 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.075542 10647 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:56.074170  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:56.078627  6117 raft_consensus.cc:2410] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:25:56.086423  9915 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.081328  6082 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:56.090147  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 214541us
I20260709 12:25:56.054232 10532 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:56.091854  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:56.095237  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:56.106320  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.078425 10647 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:56.125002  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.130442  9915 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:56.131081  6082 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.133384 10178 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:56.133831 10178 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:56.134192 10178 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:56.139791 10695 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:25:56.139642 10648 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:56.146886 10178 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:56.154783 10161 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:56.123421 10647 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:56.115170 10228 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:25:56.165696  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:56.167919  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 374854us
I20260709 12:25:56.198989  6084 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:56.197834  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 396021us
I20260709 12:25:56.200467  6084 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:56.201730  6084 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:56.089493 10592 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.167758  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:56.158867 10438 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.199003  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:56.203707  6118 raft_consensus.cc:606] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.204068  6118 raft_consensus.cc:614] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:56.197544 10228 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:56.209740 10178 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:56.209985 10592 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:56.209645  6110 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:56.205734 10562 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:56.211117  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:56.212231  6118 raft_consensus.cc:606] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:56.215196  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:56.215786  6118 raft_consensus.cc:606] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:56.216142  6118 raft_consensus.cc:614] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:56.207438 10648 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:56.220690 10648 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:56.221127 10648 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:56.207661 10661 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:56.198050 10647 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:56.223747  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 196401us
W20260709 12:25:56.230777  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 65202.5us
I20260709 12:25:56.233096  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:56.207679 10228 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:56.234045  5934 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:56.225203 10161 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:56.239256  9915 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:56.239975  9915 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.240512  9915 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:56.239666  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 306023us
I20260709 12:25:56.243134  6611 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:56.226537 10290 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:56.246219  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:56.247982 10701 consensus_queue.cc:1059] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:56.248360  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:56.248822  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:56.248967  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:56.253014  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:56.258819  9915 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.262590  6647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:25:56.263218  6647 raft_consensus.cc:606] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:56.270673  6648 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:56.260691  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:56.240103 10374 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:56.272119  6611 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:56.228888 10659 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:25:56.277268  6611 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:56.283812  9915 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:56.258946 10427 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.250305 10350 consensus_queue.cc:1059] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.025s
I20260709 12:25:56.261060 10677 raft_consensus.cc:697] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:56.294706  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.298686  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:56.282343 10528 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:25:56.276646 10604 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:56.301509 10604 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.301954 10604 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:56.302721 10286 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:56.303404 10286 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:56.304482 10286 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.311494  6611 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:56.313845  5964 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 12: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:56.271642 10664 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:25:56.315920  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 185981us
I20260709 12:25:56.338721  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.316841  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:56.339936  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.340642  5967 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:25:56.291579 10019 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:56.339416  5960 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:56.343070  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:56.355886  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.356767  5965 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 15: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:25:56.366400  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 115572us
I20260709 12:25:56.378731  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:56.336862 10290 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:56.384071  6084 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:56.347782 10019 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.346249 10710 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:56.398147 10677 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.398769 10710 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:56.406746 10710 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:56.408073 10592 raft_consensus.cc:3055] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:56.408484 10592 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:56.409346 10592 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.411393  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.412587 10713 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:56.413201 10713 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:56.414170 10713 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.370342 10564 raft_consensus.cc:3055] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:56.310247 10427 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:56.426837  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 184263us
I20260709 12:25:56.415225 10228 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:56.432648  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.418094 10710 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.396109 10019 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:56.459381  6038 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:56.418766 10564 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:56.465319  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.444034 10374 raft_consensus.cc:697] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:25:56.471854 10708 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.196s	user 0.001s	sys 0.000s
I20260709 12:25:56.496857 10290 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:25:56.476234  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:56.490945  5967 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:56.499624  5961 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:56.431164 10709 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:56.476783  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.466415  6035 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:56.476415  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:56.478839  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.466583 10411 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:56.529225 10411 raft_consensus.cc:697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:25:56.529732  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 145768us
I20260709 12:25:56.513723  5965 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:56.500523  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:56.534968  5961 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:25:56.536304  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:56.536442  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 6 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:56.446151 10666 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:56.538170  5960 raft_consensus.cc:2368] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12.
I20260709 12:25:56.531987  6648 raft_consensus.cc:2376] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11. Re-sending same reply.
I20260709 12:25:56.464311 10434 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:56.538951  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 73705.7us
I20260709 12:25:56.548015  6009 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:56.484658 10679 consensus_meta.cc:287] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.589s	user 0.007s	sys 0.004s
W20260709 12:25:56.479135 10707 log.cc:927] Time spent T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:25:56.489778 10592 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:56.559095  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:56.560002  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:56.562610  5967 raft_consensus.cc:2376] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13. Re-sending same reply.
W20260709 12:25:56.548821  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 232069us
I20260709 12:25:56.565158  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.569810  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:56.570031 10411 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.570756  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.571907  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:56.572233 10524 consensus_meta.cc:287] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.518s	user 0.004s	sys 0.004s
I20260709 12:25:56.501780 10709 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:56.572986  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.487383 10717 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:56.570387  6643 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:25:56.569691  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.491628 10228 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:56.579221  5959 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
W20260709 12:25:56.552031  5934 connection.cc:256] RPC call timeout handler was delayed by -1.0049051800001507s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.27140000000000003s for a response
I20260709 12:25:56.582381  6110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:56.583019  6110 raft_consensus.cc:606] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.584445  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:56.572641 10524 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.592885  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.596814  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.496646 10604 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.498607 10664 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.593423  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.560513 10711 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:25:56.604686  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.579850 10677 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:56.610037 10677 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:56.603952  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:56.604806 10714 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:56.610888 10714 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:56.611263 10714 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:56.612146 10677 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:56.561369 10434 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:56.616173 10427 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:56.593127 10532 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12.
I20260709 12:25:56.618579  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.619226  5967 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
W20260709 12:25:56.616359  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51289.6us
I20260709 12:25:56.620599  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.614270 10161 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:56.622747  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:56.624282 10524 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:56.624583  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:56.625303  6039 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:25:56.627337 10710 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:56.628017 10710 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:56.628522 10710 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:56.629220  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:56.579061 10709 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:56.485765 10564 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.633538 10564 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:56.635386 10713 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:56.635748  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.635939 10713 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:56.636358  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:56.637988 10713 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:56.639631 10601 consensus_meta.cc:287] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.548s	user 0.005s	sys 0.005s
I20260709 12:25:56.640066 10601 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.641018  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:56.642050 10601 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:56.642825  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:56.644245  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:25:56.645910  5963 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:56.648375 10604 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:56.566630 10679 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.650003 10661 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:56.647925 10374 consensus_queue.cc:237] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:56.653410  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 47747.2us
W20260709 12:25:56.630554  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 170235us
I20260709 12:25:56.619622 10677 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:56.645929  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:25:56.664589  5964 raft_consensus.cc:2368] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9.
W20260709 12:25:56.672256  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.681825  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:56.689412  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:56.689582  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:56.696020  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:56.696672  6644 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:56.699126  6648 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:56.700385  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:56.701489  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 58079.3us
I20260709 12:25:56.609252 10711 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:56.650374 10679 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:56.707957  6118 raft_consensus.cc:2410] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:25:56.707912  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:56.712122  6110 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:25:56.718617  6110 pending_rounds.cc:85] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 7
I20260709 12:25:56.718873  6110 pending_rounds.cc:107] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:25:56.719072  6110 raft_consensus.cc:2889] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:56.713019  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:25:56.709741  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52977.9us
I20260709 12:25:56.602962 10724 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:56.711184  6084 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:56.616180 10434 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:56.717434  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 96916.4us
I20260709 12:25:56.723814  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:56.650398 10661 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:56.720172  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:56.732901  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:56.737429  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:56.741236  5959 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:25:56.688382 10715 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:56.684314 10710 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:56.651132 10727 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 5, Time since last communication: 0.075s
I20260709 12:25:56.651460 10019 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.717221 10711 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:56.744784 10368 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:25:56.752372 10631 consensus_meta.cc:287] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.732s	user 0.011s	sys 0.000s
I20260709 12:25:56.769675  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:56.770865  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:56.731530 10661 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:56.776577  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51713.3us
I20260709 12:25:56.775218  5961 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 3. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:56.792999  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:56.761297 10601 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:56.787340  6009 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.786734  6042 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:56.751260 10715 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:56.798528  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:56.805509  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.773984 10368 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.776268  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:56.802294  5964 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:56.798337  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:56.789578  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.799129  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.748674 10434 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.046s
I20260709 12:25:56.823333  5965 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:56.813031  6643 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:25:56.824894  6009 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.813452  5968 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:56.816308 10411 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:56.817956  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.818923  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:56.812626  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:56.820356 10019 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:56.821130 10368 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:56.774820 10161 consensus_queue.cc:1059] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.036s
W20260709 12:25:56.836187  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 59982.4us
I20260709 12:25:56.847396  5934 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:56.793669 10730 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:56.826839  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:56.811080 10715 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:56.843513 10647 consensus_meta.cc:287] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.601s	user 0.010s	sys 0.000s
I20260709 12:25:56.854074  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:56.857076 10724 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:56.857872  5934 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:56.858364 10719 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:56.859158 10719 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:56.859503 10719 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:56.859848 10719 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:56.835522 10710 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
W20260709 12:25:56.857259 10729 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:25:56.843945 10712 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:56.844097 10562 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:56.793447 10631 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.860211 10604 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:56.863636 10659 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:25:56.864459 10736 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:56.865271 10732 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:25:56.861050 10648 consensus_meta.cc:287] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.635s	user 0.011s	sys 0.000s
I20260709 12:25:56.849619 10730 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:56.875303  6081 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.822309 10714 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.874255 10564 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:56.887061 10731 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:25:56.887598 10368 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.889319 10631 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:56.894729  6036 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:56.880038 10677 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:56.898756 10659 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:56.935451 10659 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.7, Last appended by leader: 7, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:56.935940 10714 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:56.930380 10564 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:56.936846 10564 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:56.903138  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:56.939920 10368 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:56.940517 10368 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:56.940841 10368 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.940913  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:56.941212 10368 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:56.943703 10730 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:56.944929 10730 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:56.945304  6042 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 4. Preceding OpId from leader: term: 8 index: 5. (index mismatch)
I20260709 12:25:56.947371  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:56.953377 10564 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.956108 10564 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:56.882745 10736 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:56.895711 10709 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:56.884255 10604 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:25:56.928793  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 53567.8us
W20260709 12:25:56.958338  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 98349.5us
I20260709 12:25:56.958382  6118 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:56.962502  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:56.933969  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 51839.5us
I20260709 12:25:56.967872  5968 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 12: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:56.927691 10411 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:56.862699 10647 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:56.933260 10679 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:56.980638  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:25:56.964218 10738 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.080s	user 0.000s	sys 0.000s
I20260709 12:25:56.988282  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.989389  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.990689  6009 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.991094  5965 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:56.992467  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:56.992765 10666 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:56.993358 10677 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:56.993074 10661 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:56.994081 10709 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:56.990959 10715 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:56.986685  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:56.986810  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.964802 10736 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:56.994836  6039 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:56.995381  6081 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:56.996126 10427 raft_consensus.cc:993] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:25:56.996618 10604 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:56.997761 10701 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:25:56.985612  5968 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:56.990330  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:56.988106  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:57.018792  5967 raft_consensus.cc:2376] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8. Re-sending same reply.
I20260709 12:25:57.001856  5961 raft_consensus.cc:2368] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12.
I20260709 12:25:56.979446 10527 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.019s
I20260709 12:25:57.002588  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:57.002839  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:57.004887  6608 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.002570  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:56.927876 10648 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.009743  6111 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:57.010550 10290 raft_consensus.cc:993] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:57.011278 10427 raft_consensus.cc:1081] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:25:57.011847 10592 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:57.013127  6081 leader_election.cc:400] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9.
I20260709 12:25:57.014106 10705 consensus_queue.cc:1059] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:57.036710 10705 consensus_queue.cc:1059] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:57.037421 10564 raft_consensus.cc:3055] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:57.037848 10564 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:57.038749 10564 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.035765 10527 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 3, Time since last communication: 0.004s
I20260709 12:25:57.040109 10564 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:57.041213  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:56.958742 10368 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:57.044734 10368 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:57.007112 10715 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:57.015782  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:56.984921 10411 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:57.000618 10702 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.016777  5965 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:57.017374  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:57.059022  6044 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:57.059603  6117 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:57.060580  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:57.060762  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.061589  6646 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:57.065515  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:57.066210  6040 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:57.028113  5962 raft_consensus.cc:2393] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 9: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:57.031067  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:57.016660 10647 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:57.035696  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.052551  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.068110  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:57.037765 10705 raft_consensus.cc:3055] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Stepping down as leader of term 9
W20260709 12:25:57.071971  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 270497us
W20260709 12:25:57.079236  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 43617.1us
I20260709 12:25:57.080281  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.058406 10524 raft_consensus.cc:3055] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:57.035861 10228 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:57.085167 10524 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:57.088948  6114 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:57.089753 10524 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.091482 10753 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.092046 10753 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:57.095036  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 90217.7us
I20260709 12:25:57.092289  5934 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:57.093801  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 78072.6us
I20260709 12:25:57.095983  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.096928  6646 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:25:57.086145 10368 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:57.099743  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:57.073194 10715 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:25:57.081313 10427 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:57.073635 10705 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:57.030603 10701 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:57.109560  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:57.114035 10753 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:25:57.116752  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.118165  6044 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:25:57.123483  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.126550 10700 consensus_queue.cc:1059] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:57.123132  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.128196  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:57.129654 10511 consensus_queue.cc:1059] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 9.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:25:57.084860 10736 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:57.130512 10659 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:57.131489 10524 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:57.132529 10736 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:57.133522  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:57.134124  5959 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:57.126297  6650 raft_consensus.cc:2393] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:25:57.126893 10745 log.cc:927] Time spent T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.262s	user 0.001s	sys 0.003s
I20260709 12:25:57.134588 10746 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:57.138769  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:57.095786 10228 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:57.130173  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:57.103482 10513 raft_consensus.cc:1081] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:25:57.148352  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:57.145320  6082 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:57.102847 10290 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:57.150218  5959 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:57.103307 10374 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:57.147469  5934 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:57.157080  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:57.110159 10715 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:57.161027  6009 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:57.167701  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52018.4us
W20260709 12:25:57.168309  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 72426.6us
I20260709 12:25:57.169044  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.169438  5962 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:57.149434 10532 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:57.069142 10702 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:57.149468 10661 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:57.165889 10717 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:57.166158 10712 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:57.162101 10562 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:57.168845 10715 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
W20260709 12:25:57.197059  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 80631.9us
I20260709 12:25:57.151085 10711 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:57.158293 10677 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:25:57.204999  6009 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:57.207891  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 51613.1us
I20260709 12:25:57.187912 10631 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:57.208796  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:57.192770 10743 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:57.211617  6084 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:57.212399  5959 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:57.216764 10647 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:25:57.217404 10647 raft_consensus.cc:697] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:57.219745  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:57.220402  5965 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:57.216014  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.224344 10647 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 4.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.230726 10705 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:57.234400  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 65405.9us
I20260709 12:25:57.235343  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.237471  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:57.240020 10736 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:57.241324 10648 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:57.206208 10712 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:57.243222 10712 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.244755  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.208252 10562 raft_consensus.cc:697] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:57.248636 10719 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.194672 10228 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.251137 10562 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 6, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:25:57.252398 10228 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:57.248974  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:57.211326  5961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:34550
I20260709 12:25:57.261327  6040 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:57.261704  5961 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:57.262104  5961 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:57.237037  9966 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:57.265023  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:57.265890  6043 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:57.266863  6039 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:25:57.269142  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 54694.3us
I20260709 12:25:57.278226  5959 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
W20260709 12:25:57.280630  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 75707.4us
I20260709 12:25:57.281440  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:57.280659  6035 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:25:57.259059 10631 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:57.281664  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:57.283672  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:57.285351  6037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:25:57.257233 10711 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:57.288214  6037 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:25:57.288583  6037 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:57.287606 10754 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:57.294227  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:57.271689 10438 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:57.260933 10743 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:57.298763  6118 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:57.294224 10666 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:57.319088 10666 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:57.319576 10666 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:57.320570 10532 raft_consensus.cc:1064] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:25:57.312148  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:57.327406  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.305528 10760 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:25:57.295758 10705 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:57.293982 10524 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:25:57.331640 10719 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:57.336192 10331 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:57.336675 10331 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:57.310755 10411 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:57.340626  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:57.341372 10532 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.6, Last appended by leader: 4, Current term: 7, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.343175  6608 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.343431  9966 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:57.344118  9966 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:25:57.310174  5961 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.345525  6608 leader_election.cc:400] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12.
I20260709 12:25:57.343233  6609 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:57.346024  6608 leader_election.cc:403] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:57.347770  5965 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:25:57.348284  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:57.354205  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:57.360605  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:57.362699  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.354298  6037 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.366431  5961 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:57.373517  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.373544  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:57.374166  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.352761 10631 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:57.379293  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.382474  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 9 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:57.383272  6044 raft_consensus.cc:2410] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 13 because replica has last-logged OpId of term: 11 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 4.
I20260709 12:25:57.352524 10711 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:57.381134  6037 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:57.366216 10161 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:25:57.367434 10746 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:57.363765 10712 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:57.397464  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:57.397837  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:57.398355  5932 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:57.393827 10701 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:57.393910 10743 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:57.412403  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:57.400635  9966 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12.
I20260709 12:25:57.401199 10331 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.403277  5960 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
W20260709 12:25:57.389066  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45888us
I20260709 12:25:57.350659 10528 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:25:57.408525  5964 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:57.408672  6044 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:25:57.410323  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 64926us
I20260709 12:25:57.413873  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:57.414606  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:57.374758 10700 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.035s
I20260709 12:25:57.416612 10760 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:57.382246 10631 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:57.431732  9966 raft_consensus.cc:3055] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:57.432168  9966 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:57.432996  9966 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.434186  9966 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:57.460026  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:57.461621  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:57.462298  6115 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:25:57.460327  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:57.463261  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:57.463760  6115 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:57.418594  6035 raft_consensus.cc:2393] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:57.418843  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:57.465124  6041 raft_consensus.cc:2393] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 15: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:57.422935  6038 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:57.405067 10711 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:57.423609  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:57.417743 10743 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.426522  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:57.427349  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:57.469898  6039 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:57.417963  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:57.431732 10631 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:57.428025  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.468590  6651 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
W20260709 12:25:57.472566  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 44614.1us
I20260709 12:25:57.473296  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.454386  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:57.459043  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:57.458933  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:57.474539  6037 raft_consensus.cc:2376] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12. Re-sending same reply.
I20260709 12:25:57.467176  6110 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:57.468261  6117 raft_consensus.cc:2368] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14.
I20260709 12:25:57.413564 10604 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.017s
I20260709 12:25:57.469195  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:57.475587  6109 raft_consensus.cc:2368] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11.
I20260709 12:25:57.469843  6044 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:25:57.424671  6009 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.476959  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:57.460031 10715 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:57.479465 10742 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.614s	user 0.000s	sys 0.005s
I20260709 12:25:57.480497  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:57.474529  6116 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:25:57.488605  6035 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:57.488974  6035 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:57.490572  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:57.498903  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 74330.6us
I20260709 12:25:57.499913  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.470379 10711 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:57.420825 10712 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.082s
I20260709 12:25:57.513590  6035 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:57.519189  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.502646 10709 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:57.521550  6035 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:57.515803 10161 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.006s
I20260709 12:25:57.527446 10715 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:57.536211  6111 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:25:57.493633 10528 consensus_queue.cc:1059] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.044s
I20260709 12:25:57.516507 10767 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:57.517580 10717 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:25:57.471472 10743 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:25:57.544202  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.545713  6608 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:57.556862  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 146959us
I20260709 12:25:57.558007  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:57.488197 10766 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election lost for term 6. Reason: could not achieve majority
W20260709 12:25:57.575285  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 75459.4us
I20260709 12:25:57.549036 10700 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:57.579685  6113 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:25:57.578778  6009 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.582347  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:57.585839  6035 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 8. (term mismatch)
I20260709 12:25:57.586270  6035 pending_rounds.cc:85] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 7
I20260709 12:25:57.586520  6035 pending_rounds.cc:107] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 14.8
I20260709 12:25:57.586760  6035 raft_consensus.cc:2889] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:57.581586 10528 raft_consensus.cc:3055] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:57.585516 10709 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:57.588532 10666 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.588915  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:57.582330  6009 leader_election.cc:400] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14.
I20260709 12:25:57.591715  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:57.586582  6115 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:25:57.584676 10767 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:25:57.597122 10756 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.419s	user 0.000s	sys 0.003s
I20260709 12:25:57.597756 10711 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.592871 10528 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:57.599717 10528 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.600875 10528 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:57.601903 10666 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:57.585160 10743 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.600262 10711 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:57.608729  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:57.612208 10631 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.619560 10631 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:57.620381  6035 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:57.622359 10753 raft_consensus.cc:3055] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:25:57.622814 10753 raft_consensus.cc:740] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:57.623612 10753 consensus_queue.cc:260] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.624620 10753 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:57.621219  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:57.617422 10743 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:57.593276  6009 leader_election.cc:403] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:57.627691 10771 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:57.628002  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 45797.4us
I20260709 12:25:57.629058  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:57.631063  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.635185 10771 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:57.635723  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:57.636312  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:57.636919  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:57.637084 10771 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:25:57.638213  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:57.638607 10631 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:25:57.593825 10709 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:57.639564 10709 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:57.643225 10483 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:25:57.650982  6111 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:57.657333  6113 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
W20260709 12:25:57.668838  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.669144  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:57.669914 10368 consensus_queue.cc:1059] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:57.670673 10647 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:57.671397 10647 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:57.671833  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:57.672294 10647 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:57.673745 10702 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:57.674432  6115 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:57.674943  6042 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:57.674707 10769 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:25:57.677448  6116 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: []
I20260709 12:25:57.674377 10702 raft_consensus.cc:3055] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:57.679934  6035 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:25:57.682724  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:57.684077  6609 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:57.685256  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:57.691486  5932 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:25:57.694170  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.697433 10754 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:57.697602 10774 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:57.697911 10754 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:57.701907  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:57.702972  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:57.703573  6111 raft_consensus.cc:3055] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:57.703881  6111 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:57.705145  6115 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:57.678712 10702 raft_consensus.cc:740] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:57.713769  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:57.714607  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.706700 10774 raft_consensus.cc:697] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:57.715883 10774 consensus_queue.cc:237] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:57.708083 10715 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:57.717955 10754 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.719439 10754 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:57.720218 10527 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 6.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:57.721352 10527 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:57.699725 10286 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:25:57.722005 10286 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:57.683801 10350 consensus_queue.cc:1059] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.026s
W20260709 12:25:57.725031  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 179385us
I20260709 12:25:57.716773 10562 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:57.723875 10527 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:57.734447  6081 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:57.740293 10527 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.741624 10527 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:57.745095 10677 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:57.745471  6116 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:57.751156 10771 consensus_queue.cc:1059] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:57.751595 10761 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:25:57.735571  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 44205.5us
I20260709 12:25:57.753459  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:57.755651  6081 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:57.794435  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:57.799006  6118 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8. Ops: []
W20260709 12:25:57.801795  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.807997  6648 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:57.807185  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.812690  6647 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:57.812844  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.808140  6644 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 7 LEARNER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 7 index: 7. (index mismatch)
I20260709 12:25:57.811542  6116 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12. Ops: []
I20260709 12:25:57.816157  6118 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:57.718691 10715 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:57.817749  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.821075  6648 raft_consensus.cc:2393] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 8: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:57.818884  5932 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:57.821313  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.824761  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.825282  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.798027 10648 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:57.826603  5932 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:25:57.825743  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.798448 10601 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:57.810352 10679 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:57.831028  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:57.751080 10769 consensus_queue.cc:1059] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 5.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.072s
I20260709 12:25:57.810894 10374 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:25:57.752787 10019 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.072s
I20260709 12:25:57.826188 10701 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:57.895002  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:57.813689 10677 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.824318 10702 consensus_queue.cc:260] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:57.872453 10374 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:58.024299 10524 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:58.076880  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 211732us
I20260709 12:25:57.816989 10746 consensus_queue.cc:1059] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.061s
W20260709 12:25:58.090957  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.091768 10715 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:58.093077  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 266420us
I20260709 12:25:58.093353 10766 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:58.094933  6111 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:57.833285 10286 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:58.095852  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 292475us
I20260709 12:25:58.096988 10631 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14.
I20260709 12:25:58.097105 10604 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:25:58.119132 10601 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:58.101888 10712 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:58.102612  6644 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:58.102707 10719 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:58.106088  6650 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:25:58.109709  6647 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:58.111019  6036 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
I20260709 12:25:57.806241 10760 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.063s
W20260709 12:25:58.117280  5865 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 205) took 12447 ms (client timeout 15000 ms). Trace:
I20260709 12:25:58.124269  6648 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:25:58.125764  6642 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:58.165364 10774 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:58.137346  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.147749  5932 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:58.149281  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:58.150836  6111 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:58.147758  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:58.162088  6110 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 6. Current term is 7. Ops: []
I20260709 12:25:58.235792  6041 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:25:58.099910 10768 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:58.167543  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:58.223603  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:58.242449  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 93250.8us
I20260709 12:25:58.243547  6009 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:58.245494  6009 leader_election.cc:400] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11.
I20260709 12:25:58.245939  6009 leader_election.cc:403] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:58.164410 10604 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:58.126609 10701 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.147851 10709 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:58.269394  6009 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:58.224088  5865 rpcz_store.cc:269] 0709 12:25:45.669866 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:45.670733 (+   867us) service_pool.cc:224] Handling call
0709 12:25:45.875958 (+205225us) spinlock_profiling.cc:243] Waited 129 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:25:58.117201 (+12241243us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:25:56.336105 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:25:56.482823 (+146718us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:25:56.482886 (+    63us) write_op.cc:435] Acquired schema lock
0709 12:25:56.482905 (+    19us) tablet.cc:662] Decoding operations
0709 12:25:56.483840 (+   935us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:25:56.483937 (+    97us) write_op.cc:641] Partition lock acquired for write op
0709 12:25:56.483964 (+    27us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:25:56.484801 (+   837us) tablet.cc:701] Row locks acquired
0709 12:25:56.484850 (+    49us) write_op.cc:260] PREPARE: finished
0709 12:25:56.485045 (+   195us) write_op.cc:270] Start()
0709 12:25:56.485184 (+   139us) write_op.cc:276] Timestamp: P: 1783599956484969 usec, L: 0
0709 12:25:56.485218 (+    34us) op_driver.cc:348] REPLICATION: starting
0709 12:25:56.485939 (+   721us) log.cc:844] Serialized 3574 byte log entry
0709 12:25:57.090795 (+604856us) op_driver.cc:464] REPLICATION: finished
0709 12:25:57.210109 (+119314us) write_op.cc:301] APPLY: starting
0709 12:25:57.210239 (+   130us) tablet.cc:1367] starting BulkCheckPresence
0709 12:25:57.335723 (+125484us) tablet.cc:1370] finished BulkCheckPresence
0709 12:25:57.335854 (+   131us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:25:57.478872 (+143018us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:25:57.479159 (+   287us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:25:57.479225 (+    66us) write_op.cc:312] APPLY: finished
0709 12:25:57.479567 (+   342us) log.cc:844] Serialized 89 byte log entry
0709 12:25:57.481605 (+  2038us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:57.481733 (+   128us) write_op.cc:454] Released schema lock
0709 12:25:57.481791 (+    58us) write_op.cc:341] FINISH: Updating metrics
0709 12:25:57.482214 (+   423us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:25:57.482242 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":201388,"reported_tablets":17,"spinlock_wait_cycles":296398080,"child_traces":[["op",{"apply.queue_time_us":117322,"apply.run_cpu_time_us":15703,"apply.run_wall_time_us":272091,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41765,"num_ops":9,"prepare.queue_time_us":429529,"prepare.run_cpu_time_us":25979,"prepare.run_wall_time_us":403336,"raft.queue_time_us":148302,"raft.run_cpu_time_us":37870,"raft.run_wall_time_us":102683,"replication_time_us":605402,"thread_start_us":579123,"threads_started":4,"wal-append.queue_time_us":284551}]]}
I20260709 12:25:58.231994 10774 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.209300 10679 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:25:58.279222  6043 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:25:58.151755 10524 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.256564 10768 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.289197 10774 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:58.163630 10766 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.289892 10774 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:58.282301 10791 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:58.169162 10776 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.143s
I20260709 12:25:58.270334 10715 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:58.282950  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:58.263342 10631 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11.
I20260709 12:25:58.305650  6037 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:58.263111 10717 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:58.341849 10792 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:25:58.289564 10524 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:58.320394 10774 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:25:58.346144 10783 log.cc:927] Time spent T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:25:58.347122 10709 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:58.347680 10799 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:58.348286 10799 raft_consensus.cc:697] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:58.350639 10679 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:58.291121 10789 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.069s
I20260709 12:25:58.320526 10715 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:58.354156 10715 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:58.354709 10766 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:58.291891 10648 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:58.355564 10528 consensus_meta.cc:287] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.754s	user 0.016s	sys 0.002s
I20260709 12:25:58.355455 10648 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.259990 10374 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.356823 10374 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:58.357592 10648 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:58.290025 10768 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:58.292536 10769 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.072s
W20260709 12:25:58.348807 10527 consensus_meta.cc:287] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.607s	user 0.007s	sys 0.006s
W20260709 12:25:58.368419  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 220743us
I20260709 12:25:58.369285  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:58.376137  6643 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
W20260709 12:25:58.380295  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 156771us
I20260709 12:25:58.381889  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:58.383876  6111 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:25:58.389629  6642 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:25:58.347713 10631 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:25:58.395051  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:58.380901 10771 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:25:58.394034 10368 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.501s	user 0.026s	sys 0.012s
I20260709 12:25:58.301199 10791 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.391256 10789 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:58.396715 10754 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:58.463266  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 180382us
W20260709 12:25:58.460813  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.433578 10760 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:25:58.483325  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 47087.7us
I20260709 12:25:58.478717  6110 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 15 index: 8. (index mismatch)
I20260709 12:25:58.488528  5932 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:58.480705  6009 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:58.486955  6113 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:25:58.486734  6082 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:58.493666  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:58.506924  6041 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 6. Preceding OpId from leader: term: 8 index: 7. (index mismatch)
I20260709 12:25:58.509820  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:58.476790 10528 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.477401 10781 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:58.531852  6042 raft_consensus.cc:3055] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:25:58.532250  6042 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:58.536335  6042 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.8, Last appended by leader: 8, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.499141 10677 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:58.537235 10795 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.537343  6042 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:25:58.536747 10808 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:58.538378 10808 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:58.536681 10368 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.540254 10368 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.541630  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:58.542251  6117 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:25:58.543447  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:58.497730 10789 raft_consensus.cc:697] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:58.544283  6611 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:58.544827 10648 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:58.545167 10789 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:58.547118 10798 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
I20260709 12:25:58.441788 10799 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.542357 10368 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:58.550001 10513 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:58.550407 10513 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:58.550782 10513 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:58.552513 10791 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:58.458325 10774 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 11.5, Last appended by leader: 5, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:58.486536 10754 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.546797 10795 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.503171 10562 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:25:58.529968 10778 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.382s	user 0.000s	sys 0.001s
I20260709 12:25:58.574237  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:58.575369  6111 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:58.577539  6611 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:58.508000 10780 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:58.531492 10631 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:58.579761  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:58.582032  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:58.583626  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:58.503149 10411 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:25:58.606400  6114 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:25:58.610191  5965 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:58.566176 10562 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.621532  5968 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:58.566609 10754 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:58.620949 10631 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:25:58.603672 10794 log.cc:927] Time spent T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
I20260709 12:25:58.611502 10700 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:25:58.561756 10781 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.629235 10631 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.638196 10331 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:58.639443 10781 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:58.640473 10795 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:58.641043 10701 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:58.630882  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:58.632956  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:25:58.643020 10803 log.cc:927] Time spent T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.108s	user 0.001s	sys 0.000s
I20260709 12:25:58.643147  5961 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:58.637099 10700 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.644686 10700 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:58.647696  6646 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:58.652967 10700 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.622641 10562 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:58.612335 10780 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:58.672675 10780 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:58.687290 10792 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:25:58.687824 10792 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:58.688711 10792 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:58.695025 10604 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.696106 10719 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:25:58.696414 10604 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:58.697628 10712 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:25:58.698576  5964 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:58.702898  6042 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 7 index: 8. (term mismatch)
I20260709 12:25:58.703410  6042 pending_rounds.cc:85] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 7
I20260709 12:25:58.703753  6042 pending_rounds.cc:107] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 6.8
I20260709 12:25:58.704104  6042 raft_consensus.cc:2889] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:58.712218  6040 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
W20260709 12:25:58.713898 10784 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.236s	user 0.000s	sys 0.003s
I20260709 12:25:58.714811  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:58.715613  6040 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:58.716378  5964 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:25:58.558730 10528 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.719941  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:58.720577 10528 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:58.720932  6042 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:25:58.721195 10715 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:58.722172 10727 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:58.723490 10715 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:58.724246  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:58.724867  6115 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:25:58.721822 10228 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:25:58.715453 10702 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:58.731513 10796 raft_consensus.cc:3055] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:25:58.731940 10796 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:58.732705 10796 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:58.733865 10796 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:58.734489 10700 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:58.743398  5965 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:25:58.743700  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:58.744335  5968 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:25:58.744493  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:58.745108  5965 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:58.746560 10513 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.750501  5967 raft_consensus.cc:3055] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:25:58.750941  5967 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:25:58.751780  5967 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.752866  5967 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:58.754726 10700 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:58.755329 10700 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.757827 10700 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:58.758423 10715 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:58.722313  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:58.764189  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:58.765053 10019 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:25:58.765455 10019 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.765803 10019 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:58.769198 10647 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:58.769721 10647 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:58.770076 10647 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:58.755205  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 2254) took 1085 ms. Trace:
I20260709 12:25:58.777215  6043 rpcz_store.cc:276] 0709 12:25:57.669871 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.671574 (+  1703us) service_pool.cc:224] Handling call
0709 12:25:58.754983 (+1083409us) spinlock_profiling.cc:243] Waited 561 ms on lock 0x7b54000d8754. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:58.755109 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1290603392}
I20260709 12:25:58.779369  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 2259) took 1100 ms. Trace:
I20260709 12:25:58.779834  6037 rpcz_store.cc:276] 0709 12:25:57.679359 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.682369 (+  3010us) service_pool.cc:224] Handling call
0709 12:25:58.779146 (+1096777us) spinlock_profiling.cc:243] Waited 598 ms on lock 0x7b540030f2d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:58.779301 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1376459008}
I20260709 12:25:58.776350 10019 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.784116 10812 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.784734 10812 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:58.787225 10715 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.788609 10019 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:58.786897  5931 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.015s	sys 0.013s
W20260709 12:25:58.790709  5931 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.618s	user 0.015s	sys 0.013s
W20260709 12:25:58.791797  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.794991  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:58.797156 10703 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:25:58.797610 10703 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:25:58.799069  6646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50454 (request call id 1159) took 1445 ms (client timeout 1557 ms). Trace:
I20260709 12:25:58.799431 10562 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:58.806897  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 6 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:58.807170 10513 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:58.799470  6646 rpcz_store.cc:269] 0709 12:25:57.353670 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.353940 (+   270us) service_pool.cc:224] Handling call
0709 12:25:58.798905 (+1444965us) spinlock_profiling.cc:243] Waited 1.29 s on lock 0x7b5400532d54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:25:58.799013 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2972747008}
W20260709 12:25:58.809247  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.810915  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:58.811574  6110 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:58.790144 10715 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:58.817060  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:58.817862  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.817378 10703 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.823637 10764 raft_consensus.cc:3055] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:25:58.824029  6646 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:25:58.824957  6006 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 6 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:58.825119  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:58.825958  5961 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:25:58.826220 10715 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election lost for term 6. Reason: could not achieve majority
I20260709 12:25:58.829682  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:58.835984  6115 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:58.836563 10703 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:25:58.838912  6084 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.522s	user 0.017s	sys 0.017s
I20260709 12:25:58.839187  6113 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
W20260709 12:25:58.839571  6609 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.017s	sys 0.017s
W20260709 12:25:58.839874  6609 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.697s	user 0.017s	sys 0.017s
W20260709 12:25:58.840137  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 716777us
I20260709 12:25:58.824066 10764 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:25:58.842662  6651 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.526s	user 0.012s	sys 0.024s
W20260709 12:25:58.843034  6651 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.012s	sys 0.024s
I20260709 12:25:58.843740  6651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 906) took 1041 ms. Trace:
I20260709 12:25:58.844126  6651 rpcz_store.cc:276] 0709 12:25:57.804466 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:57.804596 (+   130us) service_pool.cc:224] Handling call
0709 12:25:57.804913 (+   317us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:57.805126 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:25:58.116439 (+311313us) log.cc:844] Serialized 14 byte log entry
0709 12:25:58.126338 (+  9899us) log.cc:844] Serialized 14 byte log entry
0709 12:25:58.315900 (+189562us) spinlock_profiling.cc:243] Waited 5.99 ms on lock 0x7b1800442480. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481dee1c0a 00007f4827621219 00007f481df69a40 00007f481df644e4 00007f481df64455 00007f482104c060 00007f482105e716 00007f482106f287 00007f482106f208
0709 12:25:58.782207 (+466307us) spinlock_profiling.cc:243] Waited 2.99 ms on lock 0x7b1800442480. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:25:58.784147 (+  1940us) spinlock_profiling.cc:243] Waited 11.7 ms on lock 0x7b1800442480. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:25:58.843393 (+ 59246us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:25:58.843454 (+    61us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:25:58.843498 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.843563 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:58.843682 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":88649,"prepare.queue_time_us":484131,"prepare.run_cpu_time_us":78,"prepare.run_wall_time_us":81,"raft.queue_time_us":254582,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":3522,"spinlock_wait_cycles":47597056,"thread_start_us":804681,"threads_started":2,"wal-append.queue_time_us":26390}
I20260709 12:25:58.845849  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:58.842181 10764 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.846907  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:58.847373 10764 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:25:58.846647  5961 raft_consensus.cc:2393] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:25:58.839334  6084 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.018s	sys 0.017s
I20260709 12:25:58.848672  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:58.863323  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:58.864111  6044 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:25:58.864106  5961 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:25:58.865231  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 349232us
I20260709 12:25:58.906281  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:58.907902 10823 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:25:58.908443  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 44986.2us
I20260709 12:25:58.908535 10823 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.910754  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:58.911512  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:58.912293  6044 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:58.913496  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:58.914062  6113 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:58.869103  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:25:58.913972  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:58.915211  6044 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
W20260709 12:25:58.912355  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 49305us
I20260709 12:25:58.916342  6611 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:58.918648  6110 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:58.911386  6114 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
W20260709 12:25:58.921126  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52112us
I20260709 12:25:58.922921  6009 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:58.929965  5962 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:58.931232 10709 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:25:58.920243 10513 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.931752 10821 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.043s
W20260709 12:25:58.964109  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:58.920413 10715 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:58.964756 10715 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:58.967049 10715 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:58.968642 10374 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:25:58.970659 10604 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:58.970378  5864 catalog_manager.cc:5697] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 10 to 11, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 11 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.972522  5864 catalog_manager.cc:5697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 6 to 8, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 8 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:58.938761  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:58.939137  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:58.977556  6043 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:58.940371  6113 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:25:58.941749  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:58.979861  6111 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:25:58.944283  6609 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:58.946767  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:58.952641  6114 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15. Ops: []
I20260709 12:25:58.960083  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:58.942814  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:59.008144  6040 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 7: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:25:59.026304  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.006188  5967 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:25:59.032692  5967 pending_rounds.cc:85] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 6
W20260709 12:25:59.038966  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 78960.5us
I20260709 12:25:59.039839  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:58.960928  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:59.050753  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 89890.5us
I20260709 12:25:59.052589  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:59.054634 10781 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:25:59.055393 10781 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:25:59.056197 10792 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:25:59.056797  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:59.057741  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:59.058406 10774 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:25:59.059814 10774 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:25:59.065714  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:59.066588  5964 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:59.062573  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:25:59.081459  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.108641 10562 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:59.050246 10019 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.110239 10019 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:58.950757 10483 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.113385  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:25:58.959600 10709 raft_consensus.cc:697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:59.039376 10766 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:25:59.123508  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.125547  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:59.033030  5967 pending_rounds.cc:107] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.7
W20260709 12:25:59.125864  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 68196.6us
I20260709 12:25:59.148330  5967 raft_consensus.cc:2917] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Aborting config change with OpId 7.7: Aborted: Op aborted by new leader
I20260709 12:25:58.959781 10814 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:25:59.129009  6642 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:59.129793  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:58.958910 10823 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:58.952119 10727 consensus_queue.cc:1059] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.171s
I20260709 12:25:59.135440 10709 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.006151 10532 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.145s
I20260709 12:25:58.938892 10513 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.138541 10711 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:58.947091 10812 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:58.931867 10771 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.191s
I20260709 12:25:58.944881 10719 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.195s
I20260709 12:25:59.051520 10524 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.936436 10824 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:59.143579 10019 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:59.137876 10703 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.149019  6037 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:59.153940 10780 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:59.064059 10666 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:25:59.154414  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:59.102767 10438 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:58.963275 10411 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.159s
I20260709 12:25:59.159005  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:59.082401 10817 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:58.964694 10647 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.165652  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:59.229255  6642 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 14: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:59.229393  5965 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:25:59.164621 10819 log.cc:927] Time spent T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.317s	user 0.000s	sys 0.011s
I20260709 12:25:59.163478  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.169133 10374 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.148937  5967 raft_consensus.cc:2889] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:59.151763 10483 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.185541  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:59.150142 10631 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:59.161070 10800 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.149384  5964 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:25:59.186239  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:59.195343  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.200941  5961 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:59.245748  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:25:59.205699  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:59.177639 10711 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:59.230566  6651 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:59.231701  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:59.234058  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:59.152833 10702 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:25:59.154933  5864 catalog_manager.cc:5697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 7 to 8, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 8 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.207801 10774 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.237581  6647 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:59.204275  6648 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 4 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:25:59.210325 10701 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.190588 10524 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.219244 10666 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:25:59.220584 10438 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.264290 10774 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.265594 10524 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:59.266055 10438 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:59.248164 10825 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.266870 10825 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.266975  5864 catalog_manager.cc:5697] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 9 to 10, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 10 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:59.267472  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.268393  5964 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:25:59.268688 10666 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.270548 10647 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:59.255240 10761 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.271569 10761 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:59.275288  6650 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:25:59.275846  6037 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:25:59.277765 10524 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.278379  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:25:59.278343 10524 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.255411 10702 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.267671 10513 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:59.282414  6608 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:59.253795 10789 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.705s	user 0.002s	sys 0.012s
I20260709 12:25:59.283664  5965 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:59.269799  5864 catalog_manager.cc:5697] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 5 to 6, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 6 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:25:59.300957  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 346557us
I20260709 12:25:59.206826 10809 consensus_queue.cc:1059] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.089s
I20260709 12:25:59.266371 10774 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:59.255198 10711 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:59.195355 10824 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.251585 10679 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:25:59.244201 10374 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:59.317526  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:59.489343  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:59.489754  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:25:59.490223  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.208103 10703 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:59.253866 10800 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.375425  5864 catalog_manager.cc:5697] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.284806 10702 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:59.207464 10780 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:25:59.358111 10819 log.cc:927] Time spent T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 12:25:59.300839 10789 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.753s	user 0.003s	sys 0.012s
W20260709 12:25:59.470826  6038 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.702s	user 0.011s	sys 0.007s
W20260709 12:25:59.522337  6038 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.754s	user 0.011s	sys 0.007s
I20260709 12:25:59.300336 10701 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:59.307717 10438 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:59.300216 10705 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:25:59.471458  6643 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.642s	user 0.009s	sys 0.008s
I20260709 12:25:59.299113 10647 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:25:59.492615  6039 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.784s	user 0.046s	sys 0.067s
I20260709 12:25:59.487972  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:25:59.528396  6643 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.009s	sys 0.009s
I20260709 12:25:59.260850 10817 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.530066 10817 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:59.530985 10800 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:59.525104 10438 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.533572 10438 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:59.534258 10795 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.534767 10795 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.535627 10374 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:59.536767 10795 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:59.495002  5965 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:25:59.517834  5963 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
W20260709 12:25:59.543092  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 55308.3us
I20260709 12:25:59.543540 10564 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:25:59.489045 10743 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.544642 10743 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.279597 10631 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.546712 10743 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:59.547133 10736 consensus_queue.cc:1059] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:25:59.548125 10631 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:25:59.528841  6039 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.821s	user 0.047s	sys 0.068s
I20260709 12:25:59.549914  6645 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:25:59.551342 10483 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:59.551873 10483 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:25:59.552508 10831 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.252s	user 0.000s	sys 0.000s
I20260709 12:25:59.552348 10483 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:59.553437 10812 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.553556  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:59.553792  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:59.554251  6110 raft_consensus.cc:2368] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11.
I20260709 12:25:59.554000 10812 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.488649 10513 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:59.556898  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:59.557578  6113 raft_consensus.cc:2368] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12.
I20260709 12:25:59.558320  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:25:59.542281  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.492558 10764 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.487800 10776 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.555962  6111 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:59.561182  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:59.488703 10823 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:25:59.562040  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:59.546743  6611 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:59.549329  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:59.558938  6113 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:59.564085  6645 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 7. (term mismatch)
I20260709 12:25:59.565609  6645 pending_rounds.cc:85] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 6
I20260709 12:25:59.565912  6645 pending_rounds.cc:107] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 7.7
I20260709 12:25:59.566248  6645 raft_consensus.cc:2917] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Aborting config change with OpId 7.7: Aborted: Op aborted by new leader
I20260709 12:25:59.529975 10524 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:59.566090  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:59.604434  6109 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 15: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:59.585886  5960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 2849) took 1005 ms. Trace:
I20260709 12:25:59.564749  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:59.607244  6114 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:25:59.566751  6645 raft_consensus.cc:2889] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEARNER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:25:59.567363 10776 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.568411  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:59.554392 10483 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:59.558907 10513 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.570874 10702 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:59.572149 10829 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:25:59.572551  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1089) took 1407 ms. Trace:
I20260709 12:25:59.572896 10764 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:59.573791 10824 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:59.576807 10711 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.577481 10795 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.585402 10438 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.582346 10564 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:25:59.587020  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:59.557773 10647 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.598935 10780 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:25:59.601339 10792 consensus_meta.cc:287] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.545s	user 0.008s	sys 0.000s
I20260709 12:25:59.602026  5864 catalog_manager.cc:5697] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 2 to 3, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 3 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.610430  6643 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:25:59.568941 10743 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:25:59.605535  5960 rpcz_store.cc:276] 0709 12:25:58.580741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.580904 (+   163us) service_pool.cc:224] Handling call
0709 12:25:58.611201 (+ 30297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:58.623043 (+ 11842us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:58.623077 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:58.822301 (+199224us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b2c0001d508. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f94da11 00007f481f95d372 00007f482108fa01 00007f482105443a 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2
0709 12:25:58.822756 (+   455us) log.cc:844] Serialized 26 byte log entry
0709 12:25:59.237479 (+414723us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:59.237548 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.237648 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:59.585620 (+347972us) raft_consensus.cc:1685] finished
0709 12:25:59.585639 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.585826 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6117,"raft.queue_time_us":12543,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":121,"spinlock_wait_cycles":26297728,"thread_start_us":414321,"threads_started":1,"wal-append.queue_time_us":726645}
W20260709 12:25:59.611956  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 43620us
I20260709 12:25:59.631735  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:59.614562 10524 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:25:59.633375 10524 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:59.630872  5864 catalog_manager.cc:5697] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 9 to 10, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 10 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:25:59.609710 10823 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.620618 10795 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:59.622648 10513 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:59.623329 10702 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:59.625103 10711 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:59.614758  5966 rpcz_store.cc:276] 0709 12:25:58.165240 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.166005 (+   765us) service_pool.cc:224] Handling call
0709 12:25:58.167136 (+  1131us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:58.172512 (+  5376us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:58.379609 (+207097us) log.cc:844] Serialized 14 byte log entry
0709 12:25:58.557612 (+178003us) log.cc:844] Serialized 14 byte log entry
0709 12:25:58.621232 (+ 63620us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:58.621689 (+   457us) log.cc:844] Serialized 26 byte log entry
0709 12:25:58.621814 (+   125us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:25:58.622087 (+   273us) log.cc:844] Serialized 14 byte log entry
0709 12:25:58.622356 (+   269us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:58.622420 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:59.142025 (+519605us) spinlock_profiling.cc:243] Waited 64.8 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:25:59.572339 (+430314us) raft_consensus.cc:1685] finished
0709 12:25:59.572361 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.572492 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":70710,"prepare.queue_time_us":374274,"prepare.run_cpu_time_us":107,"prepare.run_wall_time_us":112,"raft.queue_time_us":199228,"raft.run_cpu_time_us":519,"raft.run_wall_time_us":58415,"spinlock_wait_cycles":150417408,"thread_start_us":255406,"threads_started":2,"wal-append.queue_time_us":450631}
I20260709 12:25:59.627167  6112 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:25:59.635079  6611 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:59.642768  6611 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:59.643090  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:59.636094  5968 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:25:59.637189  5864 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 10 to 11, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 11 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:25:59.633805 10524 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:25:59.643652 10715 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.645311 10715 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:59.646123 10438 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:59.647310 10715 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:59.629242 10776 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:59.637511 10286 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:25:59.639271 10792 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.653065 10776 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:59.656826 10825 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:59.660506 10812 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:59.662058  6038 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:25:59.662868  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:59.663976  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.692034  5967 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:25:59.665504  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.665788 10513 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:59.666128  6040 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:25:59.666172 10768 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:59.666791  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.667124  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.668464 10795 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:59.669584 10647 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:25:59.670684 10764 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:59.672220 10823 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:59.672861  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.676090 10703 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:25:59.636941 10743 raft_consensus.cc:697] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:59.681371  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:59.688422  6035 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: []
I20260709 12:25:59.643391 10780 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.664986 10817 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.692739  5961 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:25:59.692140  5965 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:25:59.654054 10019 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:25:59.697937  6009 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:59.695869  5966 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
W20260709 12:25:59.698959  6008 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.008s	sys 0.031s
I20260709 12:25:59.709473  6035 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:25:59.707921  6036 raft_consensus.cc:2376] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12. Re-sending same reply.
I20260709 12:25:59.744735  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:25:59.744743  6007 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.585s	user 0.035s	sys 0.025s
I20260709 12:25:59.717814  5967 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:25:59.693845 10513 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.692054 10286 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:59.749498  6043 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
W20260709 12:25:59.706668 10766 consensus_meta.cc:287] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.554s	user 0.009s	sys 0.000s
I20260709 12:25:59.690953 10792 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:59.747246  6035 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:25:59.744652  6008 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.576s	user 0.008s	sys 0.031s
I20260709 12:25:59.745729  6037 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: []
I20260709 12:25:59.745783  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:25:59.746744  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48917.9us
I20260709 12:25:59.753104  6647 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:59.771732  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.772506  5967 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:25:59.773109  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.758348  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:59.691807 10776 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.776186  5968 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:25:59.775741  6009 leader_election.cc:400] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12.
W20260709 12:25:59.745379  6007 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.036s	sys 0.025s
I20260709 12:25:59.776818  6009 leader_election.cc:403] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:25:59.775019  6643 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 13: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:25:59.771723  6648 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:59.722726 10823 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:59.785799  5966 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 4. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:25:59.788457  6038 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:25:59.788552  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.789230  5967 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 6.
I20260709 12:25:59.790062  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:59.793008  6009 leader_election.cc:400] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11.
I20260709 12:25:59.793424  6009 leader_election.cc:403] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:25:59.794111  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.752169 10513 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:25:59.751390 10715 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:25:59.795782  6609 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:59.829507  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:59.830634  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:59.798516  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.799345 10703 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.799659 10705 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:25:59.799542 10700 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:25:59.802246 10647 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:25:59.833927 10774 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 11
I20260709 12:25:59.834738 10711 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:25:59.833397 10703 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:25:59.803184  6081 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:25:59.836335  6109 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 12 index: 6. (index mismatch)
I20260709 12:25:59.804855  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:25:59.805156  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:25:59.837924  5962 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:59.806289 10743 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.806998  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.842624  5965 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:25:59.751394 10019 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:25:59.808787  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2275) took 1105 ms. Trace:
I20260709 12:25:59.808887  6042 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: []
I20260709 12:25:59.810001 10524 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.810864  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.812245  6115 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:25:59.813225  6112 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:25:59.754189 10766 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:25:59.813642  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:59.833555 10821 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:25:59.814146  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:25:59.815102  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:59.819088  6644 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:25:59.825904  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:25:59.826237  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 4 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:59.825933  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:59.811425 10817 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:59.882026  6110 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:59.881919  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:59.839149  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:59.882359  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:59.840631  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.884014  5959 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:25:59.844033  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:25:59.847494  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:59.848336  5963 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:25:59.848793  6117 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:25:59.706238 10768 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.891976  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:59.742741 10780 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.845355  6039 rpcz_store.cc:276] 0709 12:25:58.704169 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.704284 (+   115us) service_pool.cc:224] Handling call
0709 12:25:58.706917 (+  2633us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:58.707240 (+   323us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:58.707265 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:58.707788 (+   523us) log.cc:844] Serialized 26 byte log entry
0709 12:25:59.549962 (+842174us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:25:59.550001 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.550063 (+    62us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:25:59.808587 (+258524us) raft_consensus.cc:1685] finished
0709 12:25:59.808607 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:25:59.808733 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7418,"raft.run_cpu_time_us":100,"raft.run_wall_time_us":102,"thread_start_us":841779,"threads_started":1,"wal-append.queue_time_us":1034380}
I20260709 12:25:59.833846 10705 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:25:59.811661 10823 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.808816 10776 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:59.901361  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:59.902130  6110 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:25:59.902910  6111 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:25:59.852943  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:59.867656 10843 log.cc:927] Time spent T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:25:59.849028 10825 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:25:59.870004 10727 raft_consensus.cc:3055] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:25:59.871052 10761 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:25:59.874712 10286 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:25:59.795593 10781 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:59.836763 10814 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:25:59.832605  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:59.881673 10817 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:25:59.892252  6115 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:59.892716  6642 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:25:59.850366  6113 raft_consensus.cc:2393] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 13: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:59.892052  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:25:59.895284  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 56212.7us
I20260709 12:25:59.939653  6114 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:25:59.941087  6009 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:59.866528 10513 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:59.917356  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 64571.7us
I20260709 12:25:59.903579  6111 raft_consensus.cc:606] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:59.943202  6111 raft_consensus.cc:614] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:25:59.883315 10647 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:25:59.933048  6037 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:25:59.934623  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:59.948921  6042 raft_consensus.cc:2376] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14. Re-sending same reply.
I20260709 12:25:59.866662 10564 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:25:59.938015  6116 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:25:59.923476 10825 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:25:59.977855  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:59.979959  6039 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:25:59.958307  6084 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:25:59.985721  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:25:59.943027  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:25:59.970804  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:25:59.986416  6116 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:25:59.922801 10562 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:25:59.893184 10821 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:25:59.946961 10746 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.035s	user 0.007s	sys 0.028s
W20260709 12:26:00.003281 10746 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.095s	user 0.008s	sys 0.030s
I20260709 12:25:59.997087  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:00.004513  6042 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:00.005578  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:59.978132 10483 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.007347 10483 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:00.009564 10483 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:00.010102 10483 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:00.002256 10564 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.011605 10564 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.013957 10564 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:00.010864  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:25:59.989425  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 48407.3us
I20260709 12:26:00.000461  6115 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:25:59.989588 10411 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.014s
I20260709 12:26:00.001926  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:00.023880  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:00.022910  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:00.030867  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:25:59.901839 10844 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:25:59.988233 10825 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:00.044515 10703 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:00.014693 10564 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:00.046849  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:25:59.938891 10817 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:59.978266 10715 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:25:59.922382 10727 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:00.010414 10483 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.028842 10717 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:25:59.996023 10562 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.016604 10845 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:25:59.981086 10631 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:26:00.064373  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:00.057968  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:00.053567 10709 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:00.071386  6118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2722) took 1094 ms. Trace:
I20260709 12:26:00.087003  5962 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:00.059213 10564 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.085526  6116 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:26:00.085235  6042 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:26:00.045334 10761 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:00.086788  6118 rpcz_store.cc:276] 0709 12:25:58.976564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.976711 (+   147us) service_pool.cc:224] Handling call
0709 12:25:58.977060 (+   349us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:59.063450 (+ 86390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:59.063484 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:59.114437 (+ 50953us) log.cc:844] Serialized 52 byte log entry
0709 12:25:59.521494 (+407057us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:59.521571 (+    77us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.521674 (+   103us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:00.071096 (+549422us) raft_consensus.cc:1685] finished
0709 12:26:00.071121 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:00.071302 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":61123,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":32848,"thread_start_us":394486,"threads_started":1,"wal-append.queue_time_us":576023}
I20260709 12:26:00.091043  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:00.050354 10844 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.094687  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:25:59.950057 10781 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:00.055605 10846 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.047s
I20260709 12:26:00.095844 10524 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:00.098165  6115 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:00.066409 10817 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:00.103242 10768 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:00.064558 10799 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:26:00.072711 10483 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:00.134913  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 260159us
I20260709 12:26:00.023674 10019 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.142731  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:00.085153 10562 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:00.155648  6039 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:00.151624  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:00.105180 10564 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:00.163568  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:00.104907 10761 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.172960  6609 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:00.139240 10631 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:00.127821 10824 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:00.138295 10766 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.135944 10844 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:00.179546  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:00.138790 10701 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:00.085685 10717 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:00.232951  6648 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:26:00.233122  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:00.257922  6649 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:00.233831  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:00.235864  6646 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:26:00.236094  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:00.153059 10746 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.095010 10709 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:00.130367 10666 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.100s
I20260709 12:26:00.246925 10513 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:00.231025 10761 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:00.248170 10824 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.155190 10727 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.239874  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:00.178746 10524 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
I20260709 12:26:00.285130  6647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 1249) took 1007 ms. Trace:
I20260709 12:26:00.246930 10823 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:00.304579  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:00.300994  6647 rpcz_store.cc:276] 0709 12:25:59.278002 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.278125 (+   123us) service_pool.cc:224] Handling call
0709 12:26:00.284908 (+1006783us) spinlock_profiling.cc:243] Waited 470 ms on lock 0x7b54000e01d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:00.285044 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1081984256}
I20260709 12:26:00.275537 10647 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:00.273175 10846 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:00.309911  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:00.314404  6647 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:26:00.276894 10774 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11.
I20260709 12:26:00.261035 10766 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.277607 10746 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:00.296022  6039 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:00.316797 10780 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:00.334769  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 376516us
I20260709 12:26:00.335623  6084 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:00.299329  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 274550us
W20260709 12:26:00.342712  6044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60122 (request call id 1570) took 1401 ms (client timeout 1571 ms). Trace:
W20260709 12:26:00.320778  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 377799us
I20260709 12:26:00.339020  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:00.343194  6044 rpcz_store.cc:269] 0709 12:25:58.941131 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:58.946546 (+  5415us) service_pool.cc:224] Handling call
0709 12:26:00.342523 (+1395977us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b540025bf54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:00.342650 (+   127us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2305346944}
I20260709 12:26:00.356475  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:00.415808  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 59442.3us
I20260709 12:26:00.314227 10821 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:00.320475 10727 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:00.439661 10746 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:00.441248 10746 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:00.306608 10799 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:00.441730 10746 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:00.351194  6645 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:26:00.442160 10799 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:00.444154 10799 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:00.420113  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 81183.6us
I20260709 12:26:00.426623  6642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1247) took 1191 ms. Trace:
I20260709 12:26:00.444926  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:00.445451 10799 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:00.444725  6642 rpcz_store.cc:276] 0709 12:25:59.236402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.236587 (+   185us) service_pool.cc:224] Handling call
0709 12:25:59.236892 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:25:59.947663 (+710771us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:00.426369 (+478706us) spinlock_profiling.cc:243] Waited 656 ms on lock 0x7b54006b6f54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:00.426563 (+   194us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1507843456}
I20260709 12:26:00.439594 10666 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:00.447091 10666 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.447639 10666 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:00.450306 10853 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.220s	user 0.001s	sys 0.000s
W20260709 12:26:00.451721  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.452021 10746 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:00.427907 10711 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:00.457746  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:00.458395  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:00.458791  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:00.432289 10792 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:00.433907  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:00.459913  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:00.334313 10700 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:00.453245  6651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 917) took 1171 ms. Trace:
I20260709 12:26:00.461292  6651 rpcz_store.cc:276] 0709 12:25:59.282001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.374913 (+ 92912us) service_pool.cc:224] Handling call
0709 12:25:59.489738 (+114825us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:59.490138 (+   400us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:25:59.490166 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:59.525603 (+ 35437us) log.cc:844] Serialized 26 byte log entry
0709 12:25:59.943733 (+418130us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:25:59.943777 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:25:59.943846 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:00.449726 (+505880us) spinlock_profiling.cc:243] Waited 4.23 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:00.452953 (+  3227us) raft_consensus.cc:1685] finished
0709 12:26:00.452974 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:00.453181 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":4736,"raft.run_cpu_time_us":175,"raft.run_wall_time_us":23796,"spinlock_wait_cycles":9725184,"thread_start_us":357392,"threads_started":1,"wal-append.queue_time_us":550818}
I20260709 12:26:00.464937  6114 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:00.454193 10715 raft_consensus.cc:3055] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:00.465570 10715 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:00.466208 10711 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:00.453423  6043 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:00.456074  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:00.466423 10715 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.467909 10715 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:00.456619 10851 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.456679 10800 raft_consensus.cc:3055] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:00.471114 10800 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:00.471184 10851 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.472043 10800 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.473241 10800 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:00.474117 10851 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:00.454766  6006 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:00.464802 10850 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:00.474632  6116 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:00.459967  6650 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:00.436758 10562 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:00.478075 10562 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:00.479565 10824 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:00.482669  6116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:00.483300 10709 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:00.488626 10709 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:00.490136 10709 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:00.490567 10709 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:00.490934 10709 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:00.491307 10717 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:00.350835 10774 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:00.492410 10774 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:00.485630 10715 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:00.349822 10795 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.150s
I20260709 12:26:00.486941 10711 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:00.502341 10666 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.327987 10846 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.437924 10781 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:00.445952 10799 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:00.447119 10852 log.cc:927] Time spent T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.171s	user 0.000s	sys 0.000s
I20260709 12:26:00.513021  6084 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:00.512667  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 481866us
I20260709 12:26:00.350085 10701 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:00.523953  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:00.514219  6611 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:00.524726  6038 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:00.523232  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:00.525614  6650 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:26:00.528330  6084 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:00.499006 10709 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:00.504452 10703 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:00.531344  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:00.535372  6084 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:00.527947 10774 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:00.426231  6081 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:00.521152  6009 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:00.528782 10795 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:00.532317 10700 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:00.541461  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:00.529973 10781 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.536782 10703 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:00.568231  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 395347us
I20260709 12:26:00.549523 10851 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:00.529729 10821 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:00.543450  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 117292us
I20260709 12:26:00.482649 10647 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:00.580201  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:00.581059  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.555189 10795 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:00.561048 10814 consensus_meta.cc:287] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.619s	user 0.005s	sys 0.005s
I20260709 12:26:00.567127 10703 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:00.552079 10774 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:00.556300 10411 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:00.558166 10700 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.570339  6609 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:00.581534  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:00.648240  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:00.578859  6081 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:00.554987 10524 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:00.568921 10776 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:00.582345 10532 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:00.532837 10562 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:00.681535  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:00.599166 10855 log.cc:927] Time spent T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.182s	user 0.000s	sys 0.000s
W20260709 12:26:00.600199 10857 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.253s	user 0.000s	sys 0.000s
W20260709 12:26:00.600241 10825 consensus_meta.cc:287] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.536s	user 0.010s	sys 0.000s
I20260709 12:26:00.594971 10821 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.713944 10821 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:00.604286 10799 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:00.618383  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:00.620333  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:00.714712  5962 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:00.714946  5967 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:26:00.682070 10438 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:00.715728 10524 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:00.715864 10438 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.716377 10438 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:00.717114 10869 raft_consensus.cc:1064] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:26:00.716696 10524 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:00.680038 10705 consensus_meta.cc:287] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.757s	user 0.007s	sys 0.004s
I20260709 12:26:00.718780 10705 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.719784  6116 raft_consensus.cc:606] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:00.720166  6116 raft_consensus.cc:614] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:00.720836  6117 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:00.721724  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:00.594442  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 415003us
I20260709 12:26:00.624002 10411 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.637375  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:00.726532  5968 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:00.642817  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 72524.5us
I20260709 12:26:00.728199  6609 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:00.586163 10795 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:00.568598 10781 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:00.680996  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:00.680996  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:00.738436  5965 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:00.585623 10868 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:00.586726 10824 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:00.685913  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 74137.5us
I20260709 12:26:00.686007  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:00.612699 10814 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12.
I20260709 12:26:00.690543  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:00.656415 10700 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:00.698422 10766 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:00.641299 10780 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.701213 10867 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:26:00.702442  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 123414us
I20260709 12:26:00.705787  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2452) took 1062 ms. Trace:
I20260709 12:26:00.831213  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:00.707059 10666 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:00.711256 10846 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:00.714159  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2460) took 1046 ms. Trace:
I20260709 12:26:00.702792  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:00.723304  6608 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:00.844305  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 121067us
I20260709 12:26:00.845235  6608 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:00.573105 10851 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.730289  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:00.733155  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:00.734583  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 85375.8us
I20260709 12:26:00.684732 10776 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:00.739439  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 284721us
I20260709 12:26:00.831440  6041 rpcz_store.cc:276] 0709 12:25:59.643033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.653669 (+ 10636us) service_pool.cc:224] Handling call
0709 12:25:59.654047 (+   378us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:59.654998 (+   951us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:59.655028 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:59.658591 (+  3563us) log.cc:844] Serialized 52 byte log entry
0709 12:26:00.051694 (+393103us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:00.567821 (+516127us) log.cc:844] Serialized 14 byte log entry
0709 12:26:00.575160 (+  7339us) log.cc:844] Serialized 14 byte log entry
0709 12:26:00.601838 (+ 26678us) spinlock_profiling.cc:243] Waited 5.37 ms on lock 0x7b180004a440. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df67522 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:26:00.611904 (+ 10066us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:00.611980 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:00.705535 (+ 93555us) raft_consensus.cc:1685] finished
0709 12:26:00.705556 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:00.705725 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43261,"prepare.queue_time_us":401085,"prepare.run_cpu_time_us":71,"prepare.run_wall_time_us":74,"raft.queue_time_us":44601,"raft.run_cpu_time_us":461,"raft.run_wall_time_us":35095,"spinlock_wait_cycles":12350336,"thread_start_us":892154,"threads_started":2,"wal-append.queue_time_us":640864}
I20260709 12:26:00.689394 10562 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.687037 10746 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:00.549782  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:00.643057 10761 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.596392 10483 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.807061  6651 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:00.772768  6040 raft_consensus.cc:3055] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:00.900969  6040 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:00.809191  5932 leader_election.cc:336] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 1.952s (SENT)
I20260709 12:26:00.830637 10867 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:00.750614  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:00.719530 10869 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.7, Last appended by leader: 6, Current term: 8, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.737778 10863 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:00.695700 10532 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:00.806507 10845 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.544s	user 0.000s	sys 0.011s
I20260709 12:26:00.901831  6040 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.925196  6040 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:00.732481 10411 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:00.725067 10825 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.814337 10764 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.843475  6036 rpcz_store.cc:276] 0709 12:25:59.668085 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.745340 (+ 77255us) service_pool.cc:224] Handling call
0709 12:25:59.768313 (+ 22973us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:25:59.787229 (+ 18916us) raft_consensus.cc:1534] Early marking committed up to index 6
0709 12:25:59.787265 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:25:59.787745 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:26:00.109883 (+322138us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:00.109924 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:00.109991 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:00.712364 (+602373us) raft_consensus.cc:1685] finished
0709 12:26:00.712391 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:00.713914 (+  1523us) spinlock_profiling.cc:243] Waited 22.6 ms on lock 0x7b540025b550. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:00.714100 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44017,"raft.queue_time_us":27249,"raft.run_cpu_time_us":74,"raft.run_wall_time_us":75,"spinlock_wait_cycles":52055808,"thread_start_us":321844,"threads_started":1,"wal-append.queue_time_us":517119}
I20260709 12:26:00.889202  6110 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 14: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:00.870836  6035 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:00.871616 10562 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:00.872754  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:00.902797  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 93647.6us
W20260709 12:26:00.940913  5932 leader_election.cc:336] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 1.988s (SENT)
I20260709 12:26:00.765969  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:00.943077  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:00.943346  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:00.943840  5967 raft_consensus.cc:2393] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 16: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:26:00.903872  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 354032us
I20260709 12:26:00.901471 10823 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:00.901896 10814 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.912948  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:00.744887 10792 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.147s
I20260709 12:26:00.851766 10865 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:00.842626 10883 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:00.873185 10851 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:00.871372 10776 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:01.065189  6648 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:00.756147 10844 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:00.936013  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:00.945251  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:00.911957  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:01.071492  6038 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:00.904376 10864 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:26:00.945778  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 165746us
I20260709 12:26:00.953691  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:01.073448  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:01.014407 10886 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:26:00.919050 10705 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.020745  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:01.084821  5964 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
W20260709 12:26:01.088148  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 242986us
I20260709 12:26:01.089128  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:01.041101 10709 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:01.094254  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:00.907121 10702 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:00.912349 10821 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:00.837468 10780 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:00.916401 10867 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:01.031361  6649 raft_consensus.cc:2368] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11.
I20260709 12:26:01.014052  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:00.819073 10868 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:00.748070 10862 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.212s
W20260709 12:26:01.019037 10564 consensus_meta.cc:287] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.784s	user 0.002s	sys 0.009s
I20260709 12:26:01.040251  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:00.832227 10824 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.054364  6651 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:00.958982 10878 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:00.912535 10746 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:01.040659 10019 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.005s	sys 0.006s
I20260709 12:26:01.083846  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:01.166553  6645 raft_consensus.cc:2393] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 16: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:01.019147 10764 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:01.174645 10871 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:01.094009  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:01.116272 10875 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 12:26:01.175390 10871 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.115063  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:01.179544  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.122258  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:01.115267 10893 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.273s	user 0.000s	sys 0.000s
I20260709 12:26:01.110445 10532 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:01.047019 10823 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.117233  6036 pending_rounds.cc:85] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 10
I20260709 12:26:01.060992 10892 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:01.028311  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 195133us
I20260709 12:26:01.129172  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:01.129416  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 210932us
W20260709 12:26:01.083846 10727 consensus_meta.cc:287] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.644s	user 0.010s	sys 0.001s
I20260709 12:26:01.131907  6042 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:01.132467  6608 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:01.064564 10865 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:01.147323  5964 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:01.064491 10883 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.037858 10814 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.138912 10524 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:01.171991  6651 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
W20260709 12:26:01.166033 10019 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.662s	user 0.006s	sys 0.006s
I20260709 12:26:01.191169  5966 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 11
W20260709 12:26:01.214207  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.214890  6036 pending_rounds.cc:107] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 13.11
W20260709 12:26:01.195932  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 141719us
I20260709 12:26:01.215767  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2400) took 1435 ms. Trace:
I20260709 12:26:01.231379  6036 raft_consensus.cc:2889] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:01.229305  6112 raft_consensus.cc:2410] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:26:01.140085 10821 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:01.219314  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:01.195436 10886 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.061s	user 0.000s	sys 0.000s
I20260709 12:26:01.222584 10532 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:01.178838 10871 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.223515  5934 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:01.223806 10884 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:01.225174 10892 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:01.138170 10702 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.094923 10864 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.228837 10881 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.231818  5961 rpcz_store.cc:276] 0709 12:25:59.780473 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.780614 (+   141us) service_pool.cc:224] Handling call
0709 12:25:59.780932 (+   318us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:25:59.781312 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:25:59.781343 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:25:59.794376 (+ 13033us) log.cc:844] Serialized 52 byte log entry
0709 12:26:00.104396 (+310020us) spinlock_profiling.cc:243] Waited 8.02 ms on lock 0x7b18001e27a0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:26:00.515659 (+411263us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:00.628307 (+112648us) log.cc:844] Serialized 14 byte log entry
0709 12:26:00.628682 (+   375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:00.628764 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:01.178530 (+549766us) raft_consensus.cc:1685] finished
0709 12:26:01.215528 (+ 36998us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:01.215700 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":67062,"prepare.run_cpu_time_us":45,"prepare.run_wall_time_us":47,"raft.queue_time_us":63918,"raft.run_cpu_time_us":263,"raft.run_wall_time_us":33178,"spinlock_wait_cycles":18438016,"thread_start_us":503654,"threads_started":2,"wal-append.queue_time_us":889077}
I20260709 12:26:01.154728 10564 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.247265  5934 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:01.252926  5965 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:01.221441 10878 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:01.220989 10483 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.233592 10524 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:01.283113  5968 consensus_meta.cc:287] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.556s	user 0.008s	sys 0.003s
I20260709 12:26:01.284823  5968 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
W20260709 12:26:01.259564 10879 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.225s	user 0.000s	sys 0.001s
I20260709 12:26:01.296824  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:01.221625 10823 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.194624 10438 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.297914  6040 raft_consensus.cc:2393] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:26:01.288465  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52809.2us
I20260709 12:26:01.259322 10761 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.248135 10532 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:01.311988  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 179598us
I20260709 12:26:01.290166 10019 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:01.340749 10019 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.341187 10019 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:01.341686 10532 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:01.350703  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 125843us
I20260709 12:26:01.288652 10524 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:01.288429 10871 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:01.298014 10825 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:01.298434 10901 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:01.272989 10878 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:01.533459  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:01.426003 10817 consensus_meta.cc:287] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 1.273s	user 0.008s	sys 0.003s
I20260709 12:26:01.515511 10911 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:01.544692 10871 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:01.547770 10701 consensus_meta.cc:287] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 1.018s	user 0.011s	sys 0.000s
I20260709 12:26:01.547520 10911 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:01.548204 10701 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:01.549561 10871 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:01.549898 10911 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:01.485638 10411 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:01.551118  6115 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:01.551970 10411 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:01.432726 10896 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:26:01.517553 10823 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:01.369907  6608 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:01.553470  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 183660us
I20260709 12:26:01.554183  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:01.554762 10825 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:01.555383 10825 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:01.555962 10513 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:01.556309 10825 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.555619  6646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1260) took 1128 ms. Trace:
I20260709 12:26:01.559134 10878 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.560534 10878 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:01.560716 10862 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:01.561288 10862 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.543779 10901 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:01.564420 10901 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:01.539089 10922 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:01.566104 10922 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:01.565703  6035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 2291) took 1713 ms (client timeout 1553 ms). Trace:
W20260709 12:26:01.568794  6035 rpcz_store.cc:269] 0709 12:25:59.851868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:59.881605 (+ 29737us) service_pool.cc:224] Handling call
0709 12:26:01.565507 (+1683902us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b540025c454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:01.565627 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2166674816}
I20260709 12:26:01.559890  6646 rpcz_store.cc:276] 0709 12:26:00.426758 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.436020 (+  9262us) service_pool.cc:224] Handling call
0709 12:26:00.436385 (+   365us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:00.530610 (+ 94225us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:00.530640 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:00.537691 (+  7051us) log.cc:844] Serialized 26 byte log entry
0709 12:26:00.769545 (+231854us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:00.842236 (+ 72691us) log.cc:844] Serialized 14 byte log entry
0709 12:26:00.842443 (+   207us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:00.931580 (+ 89137us) spinlock_profiling.cc:243] Waited 24.5 ms on lock 0x7b54006167d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:00.931637 (+    57us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:01.548691 (+617054us) spinlock_profiling.cc:243] Waited 8.66 ms on lock 0x7b18003b7460. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df67522 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:26:01.555398 (+  6707us) raft_consensus.cc:1685] finished
0709 12:26:01.555423 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:01.555558 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":64665,"prepare.queue_time_us":73129,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":39,"raft.queue_time_us":86761,"raft.run_cpu_time_us":358,"raft.run_wall_time_us":35627,"spinlock_wait_cycles":76206208,"thread_start_us":230651,"threads_started":1,"wal-append.queue_time_us":744646}
W20260709 12:26:01.403008 10906 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.224s	user 0.001s	sys 0.000s
I20260709 12:26:01.518720 10892 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:01.389549 10780 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.449638  5966 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
W20260709 12:26:01.403944 10895 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.145s	user 0.000s	sys 0.000s
W20260709 12:26:01.514998 10899 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:26:01.411504 10814 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.522164 10438 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:01.516423 10883 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.519971 10761 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
W20260709 12:26:01.423069 10795 consensus_meta.cc:287] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.674s	user 0.009s	sys 0.001s
I20260709 12:26:01.585253  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 1585) took 1244 ms. Trace:
I20260709 12:26:01.290551 10909 consensus_queue.cc:1059] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.061s
W20260709 12:26:01.411412 10910 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:26:01.585397 10795 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.422996 10868 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:01.387706 10900 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:26:01.416599 10564 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.285969 10881 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:01.389472 10889 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.221s	user 0.001s	sys 0.000s
I20260709 12:26:01.588083 10795 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:01.389545 10872 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:26:01.392117 10764 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:01.430972 10824 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.486346  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:01.337468 10865 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.589697  6648 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:26:01.485205  6650 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:26:01.431283  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2728) took 1450 ms. Trace:
I20260709 12:26:01.590309  6037 rpcz_store.cc:276] 0709 12:26:00.340420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.340552 (+   132us) service_pool.cc:224] Handling call
0709 12:26:00.340899 (+   347us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:00.341209 (+   310us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:00.341235 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:00.419311 (+ 78076us) log.cc:844] Serialized 26 byte log entry
0709 12:26:00.627004 (+207693us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:00.627046 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:00.627119 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:01.585058 (+957939us) raft_consensus.cc:1685] finished
0709 12:26:01.585079 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:01.585196 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":98122,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"thread_start_us":89396,"threads_started":1,"wal-append.queue_time_us":666205}
I20260709 12:26:01.593868  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:01.536948 10700 consensus_meta.cc:287] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.705s	user 0.010s	sys 0.000s
I20260709 12:26:01.540488  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:01.544404  6036 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:01.482193 10776 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:01.539556 10562 consensus_meta.cc:287] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 12:26:01.580886  6115 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:01.366124 10821 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.589008  6118 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:01.500263 10869 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:01.594877  6646 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:01.590893  6111 rpcz_store.cc:276] 0709 12:25:59.980635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.060641 (+ 80006us) service_pool.cc:224] Handling call
0709 12:26:00.061168 (+   527us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:00.068515 (+  7347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:00.068549 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:00.077147 (+  8598us) log.cc:844] Serialized 26 byte log entry
0709 12:26:00.562573 (+485426us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:00.562615 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:00.562682 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:01.431041 (+868359us) raft_consensus.cc:1685] finished
0709 12:26:01.431063 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:01.431215 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6990,"raft.queue_time_us":6922,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6706,"thread_start_us":390001,"threads_started":1,"wal-append.queue_time_us":726569}
W20260709 12:26:01.597038  6649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50470 (request call id 922) took 1429 ms (client timeout 1901 ms). Trace:
I20260709 12:26:01.624483  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 2298) took 1703 ms. Trace:
I20260709 12:26:01.600308  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:01.625993  6035 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:26:01.625629  6042 rpcz_store.cc:276] 0709 12:25:59.921276 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.179294 (+258018us) service_pool.cc:224] Handling call
0709 12:26:01.624275 (+1444981us) spinlock_profiling.cc:243] Waited 875 ms on lock 0x7b54001ba154. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:01.624420 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2012297472}
I20260709 12:26:01.601557  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:01.631157  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.602638  6040 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:26:01.603299  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:01.633566  6044 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:01.607079  6043 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
W20260709 12:26:01.608728  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 68334.5us
W20260709 12:26:01.614773  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 367532us
I20260709 12:26:01.543992 10884 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:01.637918  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:01.618762  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 315580us
I20260709 12:26:01.510337 10019 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.617395 10727 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:01.635035  6081 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:01.539665 10867 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:01.625154  6649 rpcz_store.cc:269] 0709 12:26:00.167135 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.290270 (+123135us) service_pool.cc:224] Handling call
0709 12:26:01.596823 (+1306553us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b540066dfd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:01.596976 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1669458304}
I20260709 12:26:01.637182  6035 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:01.640808  6648 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:26:01.641064  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1016) took 1810 ms. Trace:
W20260709 12:26:01.654611  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.656992  6044 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:01.659888 10922 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.660511 10922 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.660983 10922 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.646804 10884 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.663092 10795 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:01.663488 10795 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.663812 10795 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:01.664601 10884 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.668900  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:01.610667 10700 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.672222 10700 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:01.642087 10869 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.673292 10867 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:01.674845 10869 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.648753  6112 rpcz_store.cc:276] 0709 12:25:59.815071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.455787 (+640716us) service_pool.cc:224] Handling call
0709 12:26:01.625060 (+1169273us) spinlock_profiling.cc:243] Waited 762 ms on lock 0x7b540020c954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:01.625191 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1752359680}
I20260709 12:26:01.677250  6647 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 14: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:01.666256 10776 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:01.679986  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:01.681118  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:01.681246  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:01.682996  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:01.683533  6036 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:01.684224  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:01.685158  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:01.674767  6109 raft_consensus.cc:2393] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 12: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:01.687464  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:01.694489  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 50957.1us
I20260709 12:26:01.592883 10817 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.710507  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:01.708168  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:01.690063 10851 consensus_meta.cc:287] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.606s	user 0.010s	sys 0.000s
I20260709 12:26:01.709205  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:01.709628  6084 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:01.726082  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:01.727914 10019 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:01.706451  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 66805.6us
I20260709 12:26:01.729471  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:01.649212 10727 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:01.648811 10824 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.078s
I20260709 12:26:01.735833  6646 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:26:01.621237 10562 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.757004  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:01.755290  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:01.737061  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:01.745272  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:01.741470  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:01.744135  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:01.740648  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:01.742645  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:01.746806  6644 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:26:01.715904 10911 consensus_queue.cc:1059] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.032s
I20260709 12:26:01.747934  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:01.748268 10902 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.158s	user 0.000s	sys 0.001s
I20260709 12:26:01.750727  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:01.751118 10881 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.727272 10564 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.024s
I20260709 12:26:01.707046 10868 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:26:01.753764 10869 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:01.730278 10780 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.025s
I20260709 12:26:01.743659 10892 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:26:01.758234  6037 raft_consensus.cc:2368] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11.
I20260709 12:26:01.758191  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:01.769877  5932 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:01.785791  6111 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:01.755978  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:01.728413 10814 raft_consensus.cc:2764] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:26:01.769066  6084 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:01.740949 10727 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:01.800912  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:01.807900  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:01.804631  6649 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:26:01.805527  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:01.738229 10927 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:01.799022 10703 consensus_meta.cc:287] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 1.157s	user 0.009s	sys 0.003s
I20260709 12:26:01.815788  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:01.734906  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:01.739327 10862 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:01.820109  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:01.826977  6651 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 15: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:01.759694 10851 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.799511 10871 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:01.807688 10869 raft_consensus.cc:697] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:01.806588 10881 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:01.814837 10922 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.843729  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2415) took 1224 ms. Trace:
I20260709 12:26:01.843730  6118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1027) took 1143 ms. Trace:
W20260709 12:26:01.820204  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 85415.3us
I20260709 12:26:01.810817 10916 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:01.922184  6110 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:01.873296  6111 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:26:01.822834 10867 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:26:01.853242  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 218280us
I20260709 12:26:01.854161 10864 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:01.945816  6611 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.658s (SENT) [suppressed 25 similar messages]
I20260709 12:26:01.819849 10631 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:01.948889  6116 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:01.949409  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:01.965906  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:01.898895  6117 raft_consensus.cc:2368] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11.
I20260709 12:26:01.902535 10871 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:01.968360 10871 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:01.849360 10702 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.823211 10703 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.845852 10746 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.972486 10703 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.851006 10562 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:01.937163  5963 rpcz_store.cc:276] 0709 12:26:00.619219 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.619359 (+   140us) service_pool.cc:224] Handling call
0709 12:26:00.619680 (+   321us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:00.623641 (+  3961us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:00.623672 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:00.663308 (+ 39636us) log.cc:844] Serialized 52 byte log entry
0709 12:26:00.887870 (+224562us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:01.033812 (+145942us) log.cc:844] Serialized 14 byte log entry
0709 12:26:01.219473 (+185661us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:01.219540 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:01.843491 (+623951us) raft_consensus.cc:1685] finished
0709 12:26:01.843511 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:01.843663 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7245,"prepare.queue_time_us":150305,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":38,"raft.queue_time_us":132885,"raft.run_cpu_time_us":234,"raft.run_wall_time_us":20873,"thread_start_us":344246,"threads_started":2,"wal-append.queue_time_us":659057}
I20260709 12:26:01.933391  6118 rpcz_store.cc:276] 0709 12:26:00.699970 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.732893 (+ 32923us) service_pool.cc:224] Handling call
0709 12:26:01.843507 (+1110614us) spinlock_profiling.cc:243] Waited 720 ms on lock 0x7b54001018d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:01.843659 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1655625088}
I20260709 12:26:01.974242  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:01.975127  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:01.928716 10909 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.850875 10905 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:01.851727 10824 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:01.849712 10924 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:01.979403  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:01.989061  6082 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:01.846931 10918 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:01.978672  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:02.011757  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:02.007671  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:02.009037  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:02.010010  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 204389us
I20260709 12:26:02.013670  6111 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 5.
I20260709 12:26:02.014246  6082 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:26:02.013780  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.014446  5932 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:02.016750 10926 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:02.016878 10869 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 5.7, Last appended by leader: 7, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.017521 10926 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.020525 10926 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:02.021651 10849 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:02.022244 10849 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.977077 10927 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:02.016103  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:02.024565  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:02.027393  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:02.029131  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 83056.3us
I20260709 12:26:01.955766 10881 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:01.986490 10851 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:02.031466  6118 raft_consensus.cc:2368] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14.
I20260709 12:26:02.067845  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:02.030804  5963 raft_consensus.cc:2368] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11.
I20260709 12:26:02.068693 10881 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:02.009598 10900 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:02.069554 10900 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.052480  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:02.023494 10702 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:02.056389 10795 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.068744  6118 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:02.076305  6118 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:26:02.076448 10795 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:02.076668 10871 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:02.078189  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:02.048128  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.079061  5965 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:26:01.953409 10821 consensus_queue.cc:1059] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.059s
I20260709 12:26:01.986581 10867 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:02.084110  6039 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:02.084610  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:02.084193  5963 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:02.057242  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:01.986629 10817 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.057490 10925 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:01.986289 10909 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.029564 10524 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.012205 10924 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.006198 10905 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.089725  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:02.065059  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:02.066064 10933 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:02.080063  6609 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:02.071875  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:02.082208  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.077777 10871 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.026494 10926 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:02.088071  5963 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:02.088156  5959 raft_consensus.cc:2393] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:02.089051  5932 leader_election.cc:400] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11.
I20260709 12:26:02.089710  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:02.101641  5932 leader_election.cc:403] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:02.078619 10780 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.092264  6117 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:02.097994  6037 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:26:02.080224 10901 consensus_meta.cc:287] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.515s	user 0.007s	sys 0.004s
I20260709 12:26:02.103056 10901 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.105350 10901 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:02.106395  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.114670  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:02.115481  5962 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:02.117164  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:02.119385  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:02.119692  6117 raft_consensus.cc:2410] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 10 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 7.
I20260709 12:26:02.099828 10933 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.121338 10933 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:02.122745 10905 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:02.118080 10780 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.125182  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:02.125453  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:02.126101  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:02.126119  5963 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:26:02.127312  5967 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:02.127033 10867 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.128114  6117 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:02.127082 10780 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.127444  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:02.132184  5966 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:02.133841 10524 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.134756  5964 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:02.130784 10925 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 10. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11.
I20260709 12:26:02.099339 10564 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.097718 10881 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:02.116149 10666 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:02.140494 10795 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.140285 10666 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.141007 10795 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:02.140185  6644 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 1257) took 1978 ms (client timeout 2154 ms). Trace:
I20260709 12:26:02.144253  6039 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 7: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:02.125932  5934 leader_election.cc:400] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11.
I20260709 12:26:02.138052 10564 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.145900  6006 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:02.147449  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.152341  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.153770  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.154810  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.154963  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.155493  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.155573  6042 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:26:02.156607  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.157122  5966 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:02.157750  6040 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 15: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:02.159358  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:02.154929  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.160750  6043 raft_consensus.cc:2410] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:26:02.160979  6044 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
W20260709 12:26:02.143065  6644 rpcz_store.cc:269] 0709 12:26:00.162191 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.163207 (+  1016us) service_pool.cc:224] Handling call
0709 12:26:02.139974 (+1976767us) spinlock_profiling.cc:243] Waited 1.57 s on lock 0x7b54006aead4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:02.140117 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3621013376}
I20260709 12:26:02.165580  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.166478  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:02.167327  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:02.167745  6608 leader_election.cc:400] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11.
I20260709 12:26:02.169181  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:02.172093 10849 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:02.172936 10666 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.148294  6041 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:26:02.173152 10900 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.186180  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:02.186215  6038 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6. Ops: []
I20260709 12:26:02.187235  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:02.188504  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 7 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:02.189138  5961 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:02.195662  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:02.207980  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 63926.8us
I20260709 12:26:02.110615 10926 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.211269  6111 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:26:02.208827  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:02.184557  6043 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: [12.10-12.10]
I20260709 12:26:02.072762 10727 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:02.213151  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 66426.7us
W20260709 12:26:02.210722  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 63655.9us
I20260709 12:26:02.214039  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:02.177484 10814 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:02.115715 10924 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:02.166250 10821 raft_consensus.cc:2764] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election decision vote started in defunct term 13: won
I20260709 12:26:02.167160 10764 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:02.229924  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:02.211505  5966 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:02.220846  6611 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:02.219997  6009 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:02.206549 10666 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:02.184906 10792 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:02.206398 10824 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:02.254267  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:02.253710 10700 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:02.216782 10814 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:02.211953 10925 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:02.233439  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:02.227154 10702 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:02.238763 10909 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:02.239068 10926 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.259974  5968 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:02.244421  5932 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:02.244831  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:02.261359  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:02.245414 10900 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:02.246001  6109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 2735) took 1565 ms. Trace:
W20260709 12:26:02.248462  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 168477us
I20260709 12:26:02.249081 10817 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:02.265931  5959 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:02.267135  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:02.267516  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.260458  5961 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
W20260709 12:26:02.249468 10897 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 1.078s	user 0.000s	sys 0.012s
W20260709 12:26:02.250393  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 81315us
I20260709 12:26:02.268344  6043 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:26:02.257830  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:02.272791  5964 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:02.223837 10871 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.184020  5962 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:02.226895 10851 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:02.261965  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:02.274642  5962 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:02.268826  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:02.262552  6109 rpcz_store.cc:276] 0709 12:26:00.680629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.680768 (+   139us) service_pool.cc:224] Handling call
0709 12:26:02.245782 (+1565014us) spinlock_profiling.cc:243] Waited 936 ms on lock 0x7b5400207954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:02.245935 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2153562880}
I20260709 12:26:02.254838  6611 leader_election.cc:400] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11.
I20260709 12:26:02.282648  6611 leader_election.cc:403] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:26:02.283980  5934 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:02.288812  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 93240.6us
I20260709 12:26:02.283104  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:02.323478  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:02.324877  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:02.325158  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.320287  5961 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:26:02.326766  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 54562.7us
I20260709 12:26:02.327220  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:02.330874  5964 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
W20260709 12:26:02.330751  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 110822us
I20260709 12:26:02.332078 10925 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:02.332283 10926 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:02.332302  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48429.6us
I20260709 12:26:02.332832  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.330276  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:02.254936 10666 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:02.334672  6039 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:02.334906  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:02.260999 10846 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
W20260709 12:26:02.331351  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 69458.5us
I20260709 12:26:02.335640  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.338965  5932 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:02.338366  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:02.335788  6009 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:02.341060  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:02.335820  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.331707 10909 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:02.343205  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:02.336860  6118 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:26:02.269692 10647 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:02.342303  5968 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:02.321650 10944 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:02.329155 10871 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:02.341881  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:02.344825  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:02.234514 10764 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:02.346573 10950 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.119s	user 0.001s	sys 0.000s
I20260709 12:26:02.321803 10743 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.262686 10814 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:02.365767 10957 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:02.363714 10766 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:02.363234 10862 consensus_queue.cc:1059] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:26:02.371507 10766 raft_consensus.cc:3055] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:02.371959 10766 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:02.348528 10911 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:02.373085 10766 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.373870 10631 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:02.374415 10766 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:02.322304 10702 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:02.379932 10702 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.329478 10865 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.334174 10924 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:02.255153 10792 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.289463 10809 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:02.351795 10919 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:02.352299  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.257536 10824 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.390957 10824 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.334355 10817 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:02.346948  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:02.359596  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:02.393318  6608 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:02.361490  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:02.341480 10846 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:02.365306 10666 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.348524  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:02.377229  6036 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
W20260709 12:26:02.394290  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 47915.3us
I20260709 12:26:02.344856 10851 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:02.377938  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:02.348363 10825 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:02.386526  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:02.395041  5932 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:02.395624  6043 raft_consensus.cc:2376] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12. Re-sending same reply.
I20260709 12:26:02.395844 10901 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:02.354401 10844 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.371932 10821 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:02.388859 10764 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.397608  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:02.398020  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:02.397959  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 7 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:02.333300 10925 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.407276  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:02.392066 10919 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:02.408695  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:02.396368 10901 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:02.408437 10957 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:02.412674 10647 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:02.412933 10825 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:02.382658 10743 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.407863  6039 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:02.394026 10862 raft_consensus.cc:2764] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election decision vote started in defunct term 5: won
I20260709 12:26:02.400538 10824 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:02.396921 10846 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:02.401396 10956 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:02.396811 10809 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:02.415000  6009 leader_election.cc:400] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14.
I20260709 12:26:02.429783 10844 consensus_queue.cc:1059] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:02.424460  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:02.430894  6116 raft_consensus.cc:2368] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12.
I20260709 12:26:02.408954 10867 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:02.431768  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:02.433175  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:02.434196  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:02.410182 10727 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:02.439059  6043 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:02.438265  6116 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:02.418642 10919 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:02.441661  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:02.443539  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.401362 10909 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:26:02.444260  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:02.445312 10851 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.447750 10564 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:02.401209 10911 consensus_queue.cc:1059] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 5.4, Next index: 5, Last known committed idx: 4, Time since last communication: 0.026s
I20260709 12:26:02.386727 10865 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.449405 10933 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.420370 10901 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:02.426204 10824 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:02.454917 10809 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.438963 10825 raft_consensus.cc:697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:02.449421 10814 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.466818 10924 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11.
I20260709 12:26:02.469476  6038 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:26:02.418226 10821 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
I20260709 12:26:02.471503  6039 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
W20260709 12:26:02.472458  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 61469.1us
I20260709 12:26:02.501443  6116 raft_consensus.cc:2410] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:26:02.501808  6109 raft_consensus.cc:2368] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8.
I20260709 12:26:02.444365 10792 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:02.503883 10564 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:02.501034  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:02.497195 10824 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:02.502822 10780 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:02.505546  6081 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:02.511288 10825 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.512689 10564 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:02.513273 10564 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:02.424795 10817 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.514142 10564 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.500993 10821 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:02.516091 10821 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:02.518141 10743 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.522576 10780 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.524902 10780 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.527284 10727 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:02.527995 10727 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:02.528927 10727 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:02.534052  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 140781us
I20260709 12:26:02.571538 10780 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:02.591918 10865 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:02.593111 10927 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:02.572741 10918 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:02.612733 10919 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:02.620101  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 114633us
I20260709 12:26:02.596825 10927 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:02.613559 10711 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:02.630328 10792 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:02.633208 10792 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.634613 10846 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.635463 10919 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.635387 10792 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.636951  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:02.637729 10965 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
W20260709 12:26:02.638173 10964 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:26:02.647372 10933 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:02.619741 10968 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:02.598419 10780 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.636873 10846 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:02.615090 10918 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.654348 10711 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:02.704481  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.701737 10958 raft_consensus.cc:3055] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:02.682735 10968 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.720290 10958 raft_consensus.cc:740] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:02.734908 10967 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:26:02.738128 10824 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.740631 10824 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.746548 10968 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:02.748682 10918 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.736572 10825 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.742334 10711 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:02.743319 10956 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:02.686515 10927 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.764844 10780 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.768083  5960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2416) took 2148 ms. Trace:
I20260709 12:26:02.768515  5960 rpcz_store.cc:276] 0709 12:26:00.619505 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.619615 (+   110us) service_pool.cc:224] Handling call
0709 12:26:00.661308 (+ 41693us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:01.019679 (+358371us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:01.019709 (+    30us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:01.019752 (+    43us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:01.019781 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:02.767810 (+1748029us) spinlock_profiling.cc:243] Waited 358 ms on lock 0x7b54001c98d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:02.767858 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:02.767995 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":822526720}
I20260709 12:26:02.771466 10883 raft_consensus.cc:3055] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Stepping down as leader of term 5
I20260709 12:26:02.771979 10883 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:02.772819 10883 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 5, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.773974 10883 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:02.758219 10926 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:02.754416 10825 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.787962 10825 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:02.864181  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:02.794657 10532 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:02.798929 10845 raft_consensus.cc:3055] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:02.735180 10958 consensus_queue.cc:260] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.770191  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:02.755574 10956 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.864914  5960 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:02.757699 10927 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:02.868319  6112 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:02.876760  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:02.878206  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:02.881989  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:02.883150  6112 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:02.893718  6112 raft_consensus.cc:2410] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:26:02.895193  6112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:02.896000  6112 raft_consensus.cc:606] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:02.897722  6112 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12. Ops: [11.8-11.8]
I20260709 12:26:02.903574 10781 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:02.905040  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.752681 10821 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.864365 10892 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.866509 10532 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:02.867409 10845 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:02.901868 10901 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.913038  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:02.916409 10968 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:02.908347 10958 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:02.929255  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:02.927325 10483 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:26:02.927834 10863 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:02.936908  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:02.923779 10705 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.011s
I20260709 12:26:02.927189 10532 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:02.943823 10532 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:02.939884 10916 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:02.913383 10892 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.948294  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:02.952029  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:02.949257 10916 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:02.952625 10809 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:02.950501 10705 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:02.959461 10956 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:02.956552 10647 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election won for term 11
W20260709 12:26:02.966033 10904 log.cc:927] Time spent T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 1.853s	user 0.017s	sys 0.004s
W20260709 12:26:02.966958  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.937954 10727 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:02.959697 10821 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:02.974831 10934 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.911s	user 0.005s	sys 0.003s
W20260709 12:26:02.976141 10951 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.779s	user 0.006s	sys 0.000s
I20260709 12:26:02.953284 10845 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.954156 10863 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.988087 10845 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:02.992455  6114 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:02.976851 10647 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:02.994364  6113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2734) took 2314 ms. Trace:
I20260709 12:26:02.995180 10647 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:02.995918  6116 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:02.994765  6113 rpcz_store.cc:276] 0709 12:26:00.680297 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.681382 (+  1085us) service_pool.cc:224] Handling call
0709 12:26:00.681686 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:00.691590 (+  9904us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:00.691620 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:00.697871 (+  6251us) log.cc:844] Serialized 26 byte log entry
0709 12:26:00.900896 (+203025us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:00.900935 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:00.901014 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:02.965738 (+2064724us) spinlock_profiling.cc:243] Waited 6.31 ms on lock 0x7b240020b3b8. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481dded9c4 00007f481ddebacb 00007f481dfa6dc9 00007f481dfa6a55 00007f481dfa609d 00007f4820bd810e 00007f4820bef88c 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221
0709 12:26:02.994079 (+ 28341us) raft_consensus.cc:1685] finished
0709 12:26:02.994098 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:02.994289 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9463,"raft.queue_time_us":16830,"raft.run_cpu_time_us":86,"raft.run_wall_time_us":86,"spinlock_wait_cycles":14523264,"thread_start_us":92530,"threads_started":1,"wal-append.queue_time_us":375500}
I20260709 12:26:02.996917 10927 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:02.997414 10927 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:03.000385  6116 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:26:02.997133  6113 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:03.003264  6113 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:26:03.005597 10863 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:03.005977  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 734867us
I20260709 12:26:03.006808 10892 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:03.010689 10901 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:03.014024  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:02.986425 10727 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:03.015683 10727 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.023578 10930 raft_consensus.cc:3055] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:03.024652  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:03.042011 10930 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:03.043224 10892 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.043028 10930 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:03.043390  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:03.042384 10864 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:03.026981  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.044184 10930 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:03.029155  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 2858) took 1051 ms. Trace:
I20260709 12:26:03.030773  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.046615  6111 rpcz_store.cc:276] 0709 12:26:01.977441 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.045676 (+ 68235us) service_pool.cc:224] Handling call
0709 12:26:03.028992 (+983316us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540023aad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:03.029099 (+   107us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260182784}
I20260709 12:26:03.027928  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:03.031884 10863 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:03.047536  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.048002 10863 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.048738  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:03.049247  6645 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:03.050036 10863 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:03.032572  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.033499  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:03.031435  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.035746  6651 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 10 index: 12. (index mismatch)
I20260709 12:26:03.036895  6647 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:26:03.037516  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.051270  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.052304  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:03.052469  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:03.033766  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:03.052810  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.036906  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:03.050873  6650 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:03.053510 10868 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:03.053820  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:03.055401  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.056020  6643 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:26:03.056770  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.057746  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.052812  6644 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:03.058737 10901 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:03.059491 10901 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:03.037966  6648 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9. Ops: [8.9-8.9]
I20260709 12:26:03.051292  6642 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:26:03.062292 10868 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:03.063519  6642 raft_consensus.cc:3055] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:03.063860  6642 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:03.064158  6643 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:26:03.065821  6647 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:26:03.053442  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:03.067036  6609 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:03.067866 10864 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:03.068234 10864 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:03.068591 10864 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:03.070595  5934 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:03.071831 10881 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:03.072752  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:03.043737 10892 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.075846 10892 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:03.064594  6642 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.077793  6642 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:03.078794  5960 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:26:03.082710  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.083930  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:03.086882 10795 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:03.064677 10868 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:03.089967  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:03.091099  6036 pending_rounds.cc:85] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 8
I20260709 12:26:03.092154  6611 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:03.093057  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:03.114187  6036 pending_rounds.cc:107] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:26:03.114571  6036 raft_consensus.cc:2889] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:03.115381  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:03.093783  6644 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:03.094115  6044 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:26:03.120499  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.104377  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:03.121785  6611 leader_election.cc:400] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12.
I20260709 12:26:03.122149  6611 leader_election.cc:403] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:26:03.105839  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:03.122757  6041 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:03.109177  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:03.123653  6042 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:03.111137  6650 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:03.089170  6084 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:03.061111  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.115289  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:03.120698  6044 raft_consensus.cc:3055] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:03.127120  6044 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:03.127343  6035 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:03.127730  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:03.128756  6645 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:26:03.128872  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:03.129733  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.130029  6084 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:03.130559  6645 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:03.132086  5934 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:03.134007  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.134095  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:03.134945  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.135210  6647 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:03.133332  6009 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:03.134838  6041 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:26:03.137228  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:03.138597  6084 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:03.141801  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.142513  6645 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
W20260709 12:26:03.143558  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.101671  6646 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:03.128293  6044 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.147025  6611 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:03.140594  6609 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:03.147540  6044 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:03.145488 10905 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:03.150949  6651 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:26:03.153270  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.163111  6042 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:26:03.167210  6044 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 9 index: 9. (term mismatch)
I20260709 12:26:03.167639  6044 pending_rounds.cc:85] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 8
I20260709 12:26:03.167836  6044 pending_rounds.cc:107] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 8.9
I20260709 12:26:03.168087  6044 raft_consensus.cc:2889] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:03.152825  6084 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:03.149761 10700 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12.
I20260709 12:26:03.171029  6611 leader_election.cc:400] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8.
I20260709 12:26:03.213584  6611 leader_election.cc:403] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 7 election: Cancelling election due to peer responding with higher term
W20260709 12:26:03.214419  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 43546us
I20260709 12:26:03.137506 10823 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:03.174407 10019 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:03.136058 10883 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:03.169238 10927 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:03.137166 10850 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:03.136725 10868 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:03.146675 10932 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:03.136853 10821 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:03.142586 10878 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:03.144366 10851 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:03.215852 10564 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:03.144907 10795 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:03.149963 10944 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:03.188426 10780 consensus_queue.cc:1059] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 11.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260709 12:26:03.189312 10711 consensus_queue.cc:1059] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:03.174638 10966 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:03.183145 10958 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.009s
I20260709 12:26:03.182972 10956 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:03.174718 10286 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.020s
I20260709 12:26:03.160466 10867 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.035s
I20260709 12:26:03.161015 10562 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:26:03.169314 10768 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:03.204180 10864 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.146392 10907 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
W20260709 12:26:03.213439  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 60671.6us
I20260709 12:26:03.137318 10881 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:03.217957 10438 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election lost for term 7. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 7. Current term is 8.
I20260709 12:26:03.235291  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:03.241956  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2747) took 1056 ms. Trace:
I20260709 12:26:03.218210 10863 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:03.248152  6111 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: [9.6-9.6]
I20260709 12:26:03.223160 10868 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.249648  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:03.275767 10700 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:03.298029 10700 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.280241 10881 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:03.299456 10881 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:03.300258 10700 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:03.300849 10943 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 1.237s	user 0.004s	sys 0.008s
I20260709 12:26:03.249415  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:03.227524 10932 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.259626 10019 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:03.278878  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:03.304455  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:03.302269  6114 rpcz_store.cc:276] 0709 12:26:02.185261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.993263 (+808002us) service_pool.cc:224] Handling call
0709 12:26:02.993526 (+   263us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:02.993707 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:26:02.993988 (+   281us) log.cc:844] Serialized 14 byte log entry
0709 12:26:03.241283 (+247295us) log.cc:844] Serialized 14 byte log entry
0709 12:26:03.241536 (+   253us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:03.241603 (+    67us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:03.241652 (+    49us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.241739 (+    87us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:03.241885 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5632,"prepare.queue_time_us":571,"prepare.run_cpu_time_us":28,"prepare.run_wall_time_us":5214,"raft.queue_time_us":6127,"raft.run_cpu_time_us":3793,"raft.run_wall_time_us":11129,"spinlock_wait_cycles":70121856,"thread_start_us":238252,"threads_started":1}
I20260709 12:26:03.306627  5968 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:03.306813  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.309849  5964 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:03.310988  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.310678 10019 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.311645  5964 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:03.312969  5964 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:26:03.250447 10966 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:03.307220  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.316996  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.309095  5963 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:03.250056 10944 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:03.251636 10956 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:03.236560 10821 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.301677  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:03.323477  6109 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:26:03.319561  6650 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:03.319864  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.325029  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:03.325544  6109 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:26:03.327100  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:03.330936  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:03.332224  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.338901  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.279381 10892 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:03.338907  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:03.339871  5968 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
W20260709 12:26:03.338981  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.350101  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:03.314777 10932 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:03.351713  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 167909us
I20260709 12:26:03.348315  6038 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:26:03.350766  6109 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 5 FOLLOWER]: Advancing to term 7
I20260709 12:26:03.346879  5961 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 9: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:03.275923 10781 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.066s
I20260709 12:26:03.365463  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.322851 10956 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:03.322476 10850 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:03.362609  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:03.366632  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.319217 10966 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:03.246222 10564 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:03.245735 10823 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:03.308349 10868 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:03.352465  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:03.355221  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.370836  5959 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:26:03.355957  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:03.349107  6043 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:26:03.367338  5961 raft_consensus.cc:2410] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:26:03.367865  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.372409  5968 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:03.372627 10019 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:03.373070  6642 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:26:03.373742  6642 pending_rounds.cc:85] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 10
I20260709 12:26:03.374060  6642 pending_rounds.cc:107] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:26:03.318073 10916 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:03.387321  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.379773  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.374744  6113 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:03.371059  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:03.315409 10863 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.393761  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.374369  6642 raft_consensus.cc:2889] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:03.348848 10892 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:03.396102  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.397502  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:03.398275 10564 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 6.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.400381 10438 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:03.401921  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:03.403155  6109 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:26:03.403141  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:03.406209  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:03.407004  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:03.410081  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.411131  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:03.413223  5961 raft_consensus.cc:2410] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 13 because replica has last-logged OpId of term: 12 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:26:03.430529  6608 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:03.415994  6041 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:03.439087  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:03.441679  6642 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:03.444581  5961 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:03.447413  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:03.449998  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:03.453742  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2745) took 1306 ms. Trace:
I20260709 12:26:03.452309  6038 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 7. Ops: []
I20260709 12:26:03.460150 10814 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:03.463399 10992 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:03.445779 10438 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:03.468461 10851 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:03.469755 10851 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:03.471509 10821 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:03.472210 10821 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:03.472790 10821 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:03.409118 10631 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:03.476476 10631 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:03.449095 10916 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:03.479892 10863 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:26:03.454162  6112 rpcz_store.cc:276] 0709 12:26:02.147729 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.898776 (+751047us) service_pool.cc:224] Handling call
0709 12:26:02.899197 (+   421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:02.977246 (+ 78049us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:26:02.990644 (+ 13398us) log.cc:844] Serialized 14 byte log entry
0709 12:26:03.238574 (+247930us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:03.238631 (+    57us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:03.238677 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.451983 (+213306us) spinlock_profiling.cc:243] Waited 2.04 ms on lock 0x7b48000b0c58. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4825f7daa1 00007f4825f74b37 00007f4825f749ca 00007f482606c26f 00007f482606bf37 00007f482608055c 00007f4826080508 00007f4826080488 00007f4826080443 00007f482607f6ec 00007f4824fa9a96
0709 12:26:03.453532 (+  1549us) spinlock_profiling.cc:243] Waited 77.8 ms on lock 0x7b54001ead54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:03.453575 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:03.453688 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5390,"prepare.queue_time_us":10577,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":5599,"raft.run_cpu_time_us":3577,"raft.run_wall_time_us":209310,"spinlock_wait_cycles":183659648,"thread_start_us":242040,"threads_started":1,"wal-append.queue_time_us":413352}
I20260709 12:26:03.485478  5932 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:03.486289 10916 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:03.486704 10916 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:03.486990  6117 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:03.487762  5932 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:03.486924  6115 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1025) took 3027 ms (client timeout 1658 ms). Trace:
I20260709 12:26:03.490253  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.490844  5963 raft_consensus.cc:2410] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 13 because replica has last-logged OpId of term: 12 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 5.
I20260709 12:26:03.491634  5959 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:03.491622  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.445377  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:03.492442  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.472049 10851 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:03.515590 10851 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:03.443666 10825 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:03.516500 10825 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.516950 10825 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:03.516647 10851 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.379166 10823 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:03.519258  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 74016.8us
I20260709 12:26:03.520071 10850 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:03.520493 10850 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.520617 10823 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:03.520963 10881 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.494092  5932 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:03.493266 10532 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:26:03.496279 10987 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
I20260709 12:26:03.518213 10851 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:03.405471 10944 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:03.489063  6115 rpcz_store.cc:269] 0709 12:26:00.459578 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:00.459682 (+   104us) service_pool.cc:224] Handling call
0709 12:26:03.486658 (+3026976us) spinlock_profiling.cc:243] Waited 1.09 s on lock 0x7b5400101dd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:03.486802 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2507962752}
I20260709 12:26:03.540107  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:03.540479  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:03.522250  5963 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:26:03.542184  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:03.542765  5963 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:03.530699  6116 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 8. (term mismatch)
I20260709 12:26:03.531769  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:03.487133 10916 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:03.538842  6649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:26:03.549491  6649 raft_consensus.cc:606] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:03.549499  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:03.539364  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 157165us
I20260709 12:26:03.552335  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:03.555239  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:03.547266  6116 pending_rounds.cc:85] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 7
I20260709 12:26:03.558213  6116 pending_rounds.cc:107] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 8.8
I20260709 12:26:03.558557  6116 raft_consensus.cc:2889] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:03.560093  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:03.561201  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:26:03.564158  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.565562  5964 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:03.536690 10850 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:03.563490  5961 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:03.574679  5961 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:03.536325 10532 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:03.550504 10883 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:03.579243 10958 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:03.580686  5963 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 7.
I20260709 12:26:03.584579 10863 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
W20260709 12:26:03.594264  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 152068us
I20260709 12:26:03.596264  6649 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:03.600432  6006 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:03.593351 10883 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.611636  6118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 2847) took 1809 ms. Trace:
I20260709 12:26:03.588642 10532 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:03.613814  6608 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:03.614012  6649 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:03.590582 10958 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.615099  6118 rpcz_store.cc:276] 0709 12:26:01.801907 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.077210 (+275303us) service_pool.cc:224] Handling call
0709 12:26:02.077524 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:02.346584 (+269060us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.611329 (+1264745us) spinlock_profiling.cc:243] Waited 259 ms on lock 0x7b54001018d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:03.611570 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":595718016}
I20260709 12:26:03.621069  6006 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:03.636236 10845 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:03.636773 10845 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:03.637158 10845 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:03.639357 10864 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:03.641083  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.644887 10892 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:03.597930 10821 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:03.653527  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1028) took 1854 ms. Trace:
W20260709 12:26:03.672489  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.653414 10781 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:26:03.686718  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.646217 10892 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:03.759454  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:03.779842  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 166130us
W20260709 12:26:03.780308  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.656759  6110 rpcz_store.cc:276] 0709 12:26:01.799605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:01.799849 (+   244us) service_pool.cc:224] Handling call
0709 12:26:01.800163 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:01.948299 (+148136us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.653278 (+1704979us) spinlock_profiling.cc:243] Waited 122 ms on lock 0x7b5400206554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:03.653463 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":280117120}
I20260709 12:26:03.785838  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.787238  5959 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 8. (index mismatch)
I20260709 12:26:03.619122 10883 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:03.786226  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:03.791710  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:03.608827 10932 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.789037 10821 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:03.802870  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:03.778864 10781 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:03.789006 10864 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:03.619825 10958 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:03.788676 10930 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:03.819443  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.850948 10930 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:03.795838 10768 consensus_meta.cc:287] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.516s	user 0.010s	sys 0.000s
I20260709 12:26:03.819018 10919 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:03.826197 10532 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:03.834168  6110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:03.798226 10700 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:03.810101 10845 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.804154 10711 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:03.875269 10711 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:03.876119 10711 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:03.876879 10845 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:03.877305 10711 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:03.855022  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:03.841739 10868 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.878609  6042 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:03.879089  6037 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:03.880048 10868 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:03.823204 10631 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:03.890059  6042 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:26:03.871014  6110 raft_consensus.cc:606] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:03.650678 10996 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.235s
I20260709 12:26:03.894068  6044 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14. Ops: []
W20260709 12:26:03.858162  5966 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.506s	user 0.014s	sys 0.051s
W20260709 12:26:03.898854  5966 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.547s	user 0.015s	sys 0.052s
I20260709 12:26:03.902940  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:03.903679  6039 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:03.854357 10781 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:03.855479 10930 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:03.855131 10916 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:03.873641 10768 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:03.891815 10780 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:03.925035  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:03.925134  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:03.925973  6118 raft_consensus.cc:606] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:03.926301  6118 raft_consensus.cc:614] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:03.928155 10881 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:03.933911 10966 consensus_meta.cc:287] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.549s	user 0.008s	sys 0.000s
I20260709 12:26:03.934417 10966 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:03.934854 10959 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 1.614s	user 0.008s	sys 0.007s
I20260709 12:26:03.936547 10966 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:03.943468  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1113) took 1885 ms. Trace:
I20260709 12:26:03.943919  5965 rpcz_store.cc:276] 0709 12:26:02.080982 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.087061 (+  6079us) service_pool.cc:224] Handling call
0709 12:26:02.111651 (+ 24590us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:02.111979 (+   328us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:02.112008 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:02.179727 (+ 67719us) log.cc:844] Serialized 26 byte log entry
0709 12:26:02.320718 (+140991us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:02.320761 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:02.320831 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:03.788922 (+1468091us) spinlock_profiling.cc:243] Waited 6.81 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:03.943136 (+154214us) raft_consensus.cc:1685] finished
0709 12:26:03.943159 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:03.943400 (+   241us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3983,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":119,"spinlock_wait_cycles":15663488,"thread_start_us":95228,"threads_started":1,"wal-append.queue_time_us":109258}
I20260709 12:26:03.947525 10532 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:03.950081  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:03.958087 10825 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:03.960743  6645 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:03.964222 10932 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:03.967231  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:03.974130  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:03.971853 10825 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:03.945101 10916 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:03.996122  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:03.996827  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:03.999985  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:04.000411  6118 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 7. Ops: []
I20260709 12:26:04.001654  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:04.011601  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 390582us
I20260709 12:26:04.015065  6006 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:04.019409  6006 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:04.021402  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:04.024900  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:04.032938  6006 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:04.034344  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:04.035200  6114 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 13: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:04.036404  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:04.037787  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:04.039229  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:04.039935  6114 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:04.041316  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:04.043416  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:04.045217 10825 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.045729 10825 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.048074 10825 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:04.056133  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 494957us
I20260709 12:26:04.056941  6006 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:04.057745  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:04.059446  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:04.063671  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:04.063807  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:04.064841  6006 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:04.072868  6114 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: [12.6-12.6]
I20260709 12:26:04.067045  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:04.074075  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:04.075196  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:04.075594  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:04.075785  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:04.077821  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:04.075105  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:04.079360  6040 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:04.031726 10996 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:04.084918  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:04.086210  6039 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:26:04.055987 10927 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:04.054543 11002 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:04.066985 10780 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:04.066242 10821 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:04.071693 10845 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:04.071903 10868 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:04.070899 10532 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.054370 11007 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:04.087945 10631 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election won for term 7
I20260709 12:26:04.088843 10711 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:26:04.113747  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 200186us
I20260709 12:26:04.105983 10774 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:04.094331 10916 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:04.124210  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:04.128217  5934 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:04.112848 11002 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:04.134126  5932 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:04.135861 10901 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:04.141247  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 308250us
I20260709 12:26:04.126490 10774 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:04.128829 10916 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.155241  5968 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:04.133450 10881 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:04.127345 11015 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:04.132153 10631 raft_consensus.cc:697] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:04.148661 10956 consensus_meta.cc:287] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.764s	user 0.010s	sys 0.001s
I20260709 12:26:04.166023  6609 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:04.172106  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:04.173163  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.161518 10916 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:04.159143 10901 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:04.137225 10532 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:04.203155  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 118323us
I20260709 12:26:04.139150 10930 consensus_queue.cc:1059] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 7.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.031s
I20260709 12:26:04.204104  6006 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:04.201619  6609 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:04.205142 10768 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:04.216703  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:04.174217 10956 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:04.226805 11009 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.001s
W20260709 12:26:04.227137 11012 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:26:04.227711 10532 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:04.228724 11028 raft_consensus.cc:3055] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:04.229148 11028 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:04.230015 11028 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.231498 10883 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.231912  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:04.232462  6039 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:04.214785 10892 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:04.231287 11028 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:04.234428 10892 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:04.234858 10892 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:04.225378  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:04.233688 10883 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:04.213189 10966 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:26:04.218073 11003 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:26:04.252588 10919 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.243053 10631 consensus_queue.cc:237] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 5.4, Last appended by leader: 4, Current term: 7, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:04.253425 10883 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:04.259027 11006 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.001s
W20260709 12:26:04.259725 10850 consensus_meta.cc:287] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.668s	user 0.007s	sys 0.003s
I20260709 12:26:04.260281 10958 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.262369  6036 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:04.250741 11015 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:04.205000 10700 consensus_queue.cc:1059] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
W20260709 12:26:04.265673  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 61571.3us
I20260709 12:26:04.264135 10966 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:04.275111 10821 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:04.259632 11010 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.156s	user 0.001s	sys 0.000s
I20260709 12:26:04.270949  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:04.271198  6044 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:04.277869  6039 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:26:04.281401 11011 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.280898  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:04.283169  6040 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:04.290210  6036 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:04.207130 10774 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.12, Last appended by leader: 12, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.268656  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:04.264242 10768 raft_consensus.cc:697] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:04.276347 11026 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.269767  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:04.270265 11002 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:26:04.279182  6041 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:04.331880  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 2885) took 1011 ms. Trace:
I20260709 12:26:04.304399 10863 raft_consensus.cc:3055] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:04.306032  6609 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:04.301894 10825 consensus_queue.cc:1059] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.005s
W20260709 12:26:04.310348  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.312765  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:04.313867 10956 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:04.293726  5934 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:04.329293 10768 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 7.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.332319  5968 rpcz_store.cc:276] 0709 12:26:03.320513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:03.388553 (+ 68040us) service_pool.cc:224] Handling call
0709 12:26:03.388929 (+   376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:04.157902 (+768973us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:04.331651 (+173749us) spinlock_profiling.cc:243] Waited 766 ms on lock 0x7b540008b954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:04.331822 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1761872128}
I20260709 12:26:04.303547 10966 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:04.301492 10532 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.282100 10919 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.283100 10883 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.368086 10883 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:04.368744  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:04.290740 10901 raft_consensus.cc:697] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:04.336112 10863 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:04.334944 11026 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.345376 10711 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:04.362900  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 69245us
I20260709 12:26:04.362888 10746 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:26:04.369629  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.369570  6114 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:04.288968 10850 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:04.327244 10564 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.044s
I20260709 12:26:04.355048 10700 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:04.381722  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:04.323839 10821 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:04.394275  5934 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:04.344485 10774 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:04.337004 10865 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:26:04.399644  5934 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:04.403584  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:04.404335  5962 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:04.406083  6116 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 14. Ops: []
I20260709 12:26:04.326913 11011 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.413765  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:04.414568  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:04.417002  5965 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:04.419409  5968 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:26:04.369747 10532 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:04.420881  6118 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: [10.12-10.12]
I20260709 12:26:04.422873  6038 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:04.409780 10700 raft_consensus.cc:697] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:04.400918 10883 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:26:04.373293 10781 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:04.400992 11031 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:04.404975 10884 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.406169 11030 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:04.388109 10711 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.438968  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:04.441113  6645 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: [10.12-10.12]
I20260709 12:26:04.433418 10944 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:04.465756  5965 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:04.472823  6643 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:04.469571  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:04.476225  6645 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:04.476783  6644 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:04.436316 11002 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.443189  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:04.483155  6644 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 6 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:04.485255  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:04.493534  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 72292.8us
I20260709 12:26:04.499822  6645 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:26:04.464061 10944 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:04.424098 10863 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.508656  5963 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:04.438012 10901 consensus_queue.cc:237] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:04.484875 10869 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:04.517342  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:04.511845  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:04.469755 10892 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.445794 10884 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.515347  6650 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:04.512396  5961 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:04.482288 10958 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:04.502554 10944 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:04.502043 10821 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:04.514573 11027 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:04.516968 10746 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.538895  5963 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 5 index: 7. Preceding OpId from leader: term: 7 index: 8. (index mismatch)
I20260709 12:26:04.539363  6651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 947) took 1130 ms. Trace:
I20260709 12:26:04.542312  6651 rpcz_store.cc:276] 0709 12:26:03.408645 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:03.642811 (+234166us) service_pool.cc:224] Handling call
0709 12:26:03.643154 (+   343us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:04.368696 (+725542us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:04.368728 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:04.368773 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:04.368805 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:04.539144 (+170339us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b54004b96d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:04.539189 (+    45us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:04.539305 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668089088}
I20260709 12:26:04.530820 10564 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.496212 11002 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.566372 11002 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:04.568367  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:04.568555  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:04.568764  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:04.571115 10768 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:26:04.571794 11001 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.440s	user 0.000s	sys 0.007s
I20260709 12:26:04.572103 10992 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:04.572510 10992 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:04.573733  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2448) took 1268 ms. Trace:
I20260709 12:26:04.573295 10992 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.574918 10992 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:04.498975 10700 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.577204 10932 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:04.578663 10746 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.580717 10746 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:04.582288 10562 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:04.582682 10564 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.584738 10564 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:04.585632 10564 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:04.545192 11027 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:04.587795 10711 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:04.521286 10869 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.588726 11027 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:04.547981 11037 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:26:04.589974 10869 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:04.590642  6116 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:04.548395 10532 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:04.548625 11036 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.051s	user 0.001s	sys 0.000s
I20260709 12:26:04.603255  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:04.606437  6117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 2856) took 2653 ms. Trace:
I20260709 12:26:04.608657  6109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1046) took 1079 ms. Trace:
I20260709 12:26:04.609086  6109 rpcz_store.cc:276] 0709 12:26:03.528851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:03.528967 (+   116us) service_pool.cc:224] Handling call
0709 12:26:04.156204 (+627237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:04.162010 (+  5806us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:26:04.243526 (+ 81516us) log.cc:844] Serialized 14 byte log entry
0709 12:26:04.295057 (+ 51531us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:04.295589 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 12:26:04.295728 (+   139us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:04.300825 (+  5097us) log.cc:844] Serialized 14 byte log entry
0709 12:26:04.301089 (+   264us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:04.301165 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:04.310981 (+  9816us) raft_consensus.cc:1685] finished
0709 12:26:04.310999 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:04.549092 (+238093us) spinlock_profiling.cc:243] Waited 2.13 ms on lock 0x7b18000f2440. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:26:04.608495 (+ 59403us) spinlock_profiling.cc:243] Waited 627 ms on lock 0x7b5400164750. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:04.608598 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4841,"prepare.queue_time_us":391985,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":1671,"raft.run_cpu_time_us":390,"raft.run_wall_time_us":15456,"spinlock_wait_cycles":1446665728,"thread_start_us":79820,"threads_started":2,"wal-append.queue_time_us":55543}
I20260709 12:26:04.554339  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 2328) took 1450 ms. Trace:
W20260709 12:26:04.557111 11017 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.320s	user 0.000s	sys 0.002s
I20260709 12:26:04.558645 10919 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:04.563241 10927 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:04.586942 10850 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:04.547163 11011 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:04.574067  5966 rpcz_store.cc:276] 0709 12:26:03.305700 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:03.306619 (+   919us) service_pool.cc:224] Handling call
0709 12:26:03.306947 (+   328us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:03.319106 (+ 12159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:03.319141 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:03.319660 (+   519us) log.cc:844] Serialized 26 byte log entry
0709 12:26:03.899441 (+579781us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:03.899482 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:03.899572 (+    90us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:04.571205 (+671633us) spinlock_profiling.cc:243] Waited 2.74 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:04.573471 (+  2266us) raft_consensus.cc:1685] finished
0709 12:26:04.573490 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:04.573676 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11740,"raft.queue_time_us":14743,"raft.run_cpu_time_us":88,"raft.run_wall_time_us":90,"spinlock_wait_cycles":6296832,"thread_start_us":547033,"threads_started":1,"wal-append.queue_time_us":758230}
I20260709 12:26:04.593724  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:04.641932  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:04.642630  6114 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:04.570205 10781 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:04.593802  6044 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:04.597751  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:04.591531 11026 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:04.520359 10814 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:26:04.614020  6037 rpcz_store.cc:276] 0709 12:26:03.103513 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:03.103624 (+   111us) service_pool.cc:224] Handling call
0709 12:26:04.554144 (+1450520us) spinlock_profiling.cc:243] Waited 740 ms on lock 0x7b54000d7d54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:04.554282 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1700864384}
I20260709 12:26:04.570195  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:04.617467 10019 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:04.617568  6649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 945) took 1223 ms. Trace:
I20260709 12:26:04.654520  6649 rpcz_store.cc:276] 0709 12:26:03.394045 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:03.617686 (+223641us) service_pool.cc:224] Handling call
0709 12:26:03.783224 (+165538us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:03.783419 (+   195us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:26:04.116681 (+333262us) log.cc:844] Serialized 14 byte log entry
0709 12:26:04.596491 (+479810us) spinlock_profiling.cc:243] Waited 6.03 ms on lock 0x7b180031ee80. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f4820bfc4bc 00007f481df4a48b 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf423a
0709 12:26:04.617177 (+ 20686us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:04.617228 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:04.617274 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:04.617365 (+    91us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:04.617501 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":28084,"prepare.queue_time_us":390362,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":53,"raft.queue_time_us":23612,"raft.run_cpu_time_us":112,"raft.run_wall_time_us":112,"spinlock_wait_cycles":13869952,"thread_start_us":411493,"threads_started":2,"wal-append.queue_time_us":144274}
W20260709 12:26:04.657480  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 87340.1us
I20260709 12:26:04.606920  6117 rpcz_store.cc:276] 0709 12:26:01.953382 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.130435 (+177053us) service_pool.cc:224] Handling call
0709 12:26:03.486797 (+1356362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:03.487531 (+   734us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:04.606228 (+1118697us) spinlock_profiling.cc:243] Waited 1.36 s on lock 0x7b5400101dd0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:04.606372 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3118635264}
I20260709 12:26:04.582653 10884 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:04.621186  6647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 946) took 1226 ms. Trace:
W20260709 12:26:04.622421 10996 consensus_meta.cc:287] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.530s	user 0.007s	sys 0.004s
I20260709 12:26:04.623435 10916 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:04.615675 10711 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.644434  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:04.687263  5966 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:04.632743 10927 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:04.647329  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:04.651556  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:04.667092  6643 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:26:04.681548  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:04.681438  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:04.632656 10865 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:04.697278  6642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1297) took 1217 ms. Trace:
I20260709 12:26:04.697717  6642 rpcz_store.cc:276] 0709 12:26:03.480173 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:03.648561 (+168388us) service_pool.cc:224] Handling call
0709 12:26:03.648991 (+   430us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:03.784357 (+135366us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:03.784386 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:03.784851 (+   465us) log.cc:844] Serialized 26 byte log entry
0709 12:26:04.134740 (+349889us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:04.134781 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:04.134850 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:04.556572 (+421722us) spinlock_profiling.cc:243] Waited 6.09 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:04.693019 (+136447us) raft_consensus.cc:1685] finished
0709 12:26:04.693040 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:04.697212 (+  4172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":134960,"raft.queue_time_us":136006,"raft.run_cpu_time_us":79,"raft.run_wall_time_us":79,"spinlock_wait_cycles":14017920,"thread_start_us":349572,"threads_started":1,"wal-append.queue_time_us":419858}
I20260709 12:26:04.693240  6643 pending_rounds.cc:85] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 9
I20260709 12:26:04.704372  6643 pending_rounds.cc:107] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:26:04.704676  6643 raft_consensus.cc:2889] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:04.705758  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:04.620597 11002 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:04.665905  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:04.694849  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:04.683214 10286 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:04.693424  5965 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:04.712939  6650 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:04.714282  6650 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:04.708748  6647 rpcz_store.cc:276] 0709 12:26:03.394776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:03.626057 (+231281us) service_pool.cc:224] Handling call
0709 12:26:03.626383 (+   326us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:03.626617 (+   234us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:26:04.060605 (+433988us) log.cc:844] Serialized 14 byte log entry
0709 12:26:04.596073 (+535468us) spinlock_profiling.cc:243] Waited 8.68 ms on lock 0x7b180021a2a0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f4820bfc4bc 00007f481df4a48b 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf423a
0709 12:26:04.620854 (+ 24781us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:04.620905 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:04.620950 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:04.621022 (+    72us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:04.621130 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":39841,"prepare.queue_time_us":509799,"prepare.run_cpu_time_us":47,"prepare.run_wall_time_us":49,"raft.queue_time_us":33507,"raft.run_cpu_time_us":129,"raft.run_wall_time_us":18160,"spinlock_wait_cycles":19962752,"thread_start_us":549043,"threads_started":2,"wal-append.queue_time_us":176604}
I20260709 12:26:04.716969  5960 raft_consensus.cc:2368] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17.
I20260709 12:26:04.692737 10996 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:04.633656 11039 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:26:04.706516  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:04.690210 11026 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:04.717809  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:04.659799 11027 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 15.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.054s
I20260709 12:26:04.718770  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:04.729465  6009 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:04.645290  5934 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:04.720039  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 151920us
I20260709 12:26:04.695279 10865 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:04.639621 10867 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:26:04.723031  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:04.730870  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:04.731969  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 86789.5us
W20260709 12:26:04.732738  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 214890us
I20260709 12:26:04.738581  5934 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:04.733454  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:04.701229 10814 consensus_queue.cc:1243] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer f1bb8e63c2b448cdafd51f05d277c741 log is divergent from this leader: its last log entry 14.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:26:04.685324 10966 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.737402  6647 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:04.744843  5934 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:04.745988  5965 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:04.694989 10711 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.737365 10746 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:04.737080 10774 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:04.755388  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:04.725700 10286 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:04.737581 11011 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:04.747117 11030 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:26:04.762045  5934 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:04.743752 10926 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:04.783059  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:04.784852  6648 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:04.786187  5963 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:26:04.783635  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 50269.5us
I20260709 12:26:04.788254  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:04.783994 10883 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:04.793498 10907 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:04.763306 11011 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:04.794749 11011 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:04.737829 11026 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:04.721740 11002 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:04.749624 10821 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:26:04.778963 10814 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:04.780658 11027 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:04.816582 10774 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:04.820617  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:04.827553  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:04.833146  6042 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:04.833557  6042 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:04.834321  6042 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.835438  6042 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:04.841851  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:04.846907  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.849298  6651 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:04.851295  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:04.810304 10795 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:04.853252  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:04.853899  5966 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:04.851140  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:04.809957 10892 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:04.855050  6037 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:04.828665 11027 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.852176  6006 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:04.862634  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 107334us
I20260709 12:26:04.831185 10883 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:04.838555 10996 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:04.782377 10865 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.834064 10532 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:04.876564  6081 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:04.833879 11031 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:26:04.856426 10795 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:04.895740  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:04.896047  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:04.995203 10966 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:04.859236 10774 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:04.996707 10774 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:04.997189 10774 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:04.907212  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:04.998705  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.002943  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:04.894860  5966 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
W20260709 12:26:04.967623  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:04.871845 11027 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:05.003482  6042 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:05.008474  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:05.010782  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:05.011921  6006 leader_election.cc:400] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17.
I20260709 12:26:05.012223  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:05.012852  6644 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:05.012250  6006 leader_election.cc:403] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:05.013660  5964 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:05.013825 11008 raft_consensus.cc:3055] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:05.003664  6041 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:26:05.014271  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:05.014261 11008 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:05.015646  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:05.016713 11008 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.017719 11008 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:05.011942  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:05.019160 11002 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.022194 10958 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:05.022773 10958 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.024863 10958 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:04.982827 10700 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.026120 10700 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:05.026055 10781 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 14 current term: 14 is higher.
I20260709 12:26:05.028322 10700 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.028448  6041 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:04.977787  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:04.872145 11030 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:04.859833 11035 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:04.882175 11014 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.677s	user 0.004s	sys 0.000s
I20260709 12:26:04.877673 10814 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:04.877830 11049 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.157s
I20260709 12:26:04.883299 10883 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:04.991135 11051 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:26:04.910259 10532 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:04.994977  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:05.004215  6642 raft_consensus.cc:2410] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 12:26:04.838649 10562 consensus_queue.cc:1059] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.039s
I20260709 12:26:05.030545  6043 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
W20260709 12:26:05.036284  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 208817us
I20260709 12:26:04.904861 10996 raft_consensus.cc:697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:04.982242 10795 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:04.982072 10865 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:04.848857 10286 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:04.986732 10916 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:04.989549 11019 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:05.059218  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:26:05.033265  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:05.069347  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 314588us
I20260709 12:26:04.991173 10867 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:26:05.071480  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.066720 10814 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:05.025051 11027 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.072633 10705 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:05.081348  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 86564.8us
I20260709 12:26:05.081570 10905 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:05.082144 10932 raft_consensus.cc:3055] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:05.114311 10019 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.052196 11035 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.092057 10532 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.093681 10774 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.096307  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2339) took 1937 ms. Trace:
I20260709 12:26:05.056571 11030 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:05.036273 11002 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17.
W20260709 12:26:05.108875 11050 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.111s	user 0.000s	sys 0.001s
I20260709 12:26:05.109735  6082 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:05.110005  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:05.103096 10867 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:05.110818  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:05.110893  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:05.111271  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:05.108451  6084 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:05.114948 10019 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.135632 10901 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:05.130566  6035 rpcz_store.cc:276] 0709 12:26:03.158895 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:03.159025 (+   130us) service_pool.cc:224] Handling call
0709 12:26:03.159591 (+   566us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:03.159971 (+   380us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:03.159995 (+    24us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:03.604229 (+444234us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b4c00223500. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f320a20 00007f481f331a29 00007f481f2f7644 00007f481f31ef2d 00007f481f31eb93 00007f482104f18b 00007f482104fcb5 00007f4821051004 00007f4821050729 00007f4821055d96 00007f482104aadb
0709 12:26:03.605111 (+   882us) log.cc:844] Serialized 556 byte log entry
0709 12:26:04.065696 (+460585us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:04.065732 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:04.065813 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:04.752639 (+686826us) spinlock_profiling.cc:243] Waited 1.85 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:05.096021 (+343382us) raft_consensus.cc:1685] finished
0709 12:26:05.096047 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:05.096232 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":41417728,"thread_start_us":460163,"threads_started":1,"wal-append.queue_time_us":557987}
I20260709 12:26:05.139740  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.139810  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.107910  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:05.159075  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 48255.6us
I20260709 12:26:05.163866  6037 raft_consensus.cc:2393] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:26:05.158963  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 47766.3us
I20260709 12:26:05.164361  5932 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:05.163913  5965 raft_consensus.cc:2393] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 12: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:05.107836 10564 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.053s
I20260709 12:26:05.166677 10901 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.168140 10821 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:05.169381 10883 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.163165  6043 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
W20260709 12:26:05.171032 11052 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:26:05.172158 10019 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.168695 10821 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.173399 10821 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:05.175117  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 104077us
W20260709 12:26:05.176782  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 49711.6us
I20260709 12:26:05.113780 10932 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:05.128328 11026 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:05.185551  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 77187.6us
I20260709 12:26:05.104162 11031 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.070s
I20260709 12:26:05.113250 10922 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.065s
I20260709 12:26:05.170337 10883 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:26:05.209367  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.210664  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.164340 10867 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:05.175935 11030 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:05.126247 10705 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.211475  6037 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:05.162602 11056 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:26:05.213541 11041 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:05.224370 11062 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:26:05.224164 11041 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.224820 10774 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.225508 10774 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.226823 11030 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:05.226975 11027 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.225935 10774 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.213289 11057 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:05.213595 10883 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.190018 11039 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:26:05.218636 11058 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.236745 10863 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:05.216137 10905 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:26:05.227880 11030 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.234877 11059 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
W20260709 12:26:05.250238 10944 consensus_meta.cc:287] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.712s	user 0.008s	sys 0.003s
I20260709 12:26:05.247588 10883 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:05.241248 11046 consensus_queue.cc:1059] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.016s
I20260709 12:26:05.251716 11058 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.209115 10996 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:05.268584 11055 log.cc:927] Time spent T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:26:05.272449 11011 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.258994 11059 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:05.274727 11059 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:05.264194 10944 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.245280 10932 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.280674 10932 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:05.281206 10944 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.285439 11011 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.285866 11058 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:05.284381 11035 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.100000  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:05.095192  5862 catalog_manager.cc:5697] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 5 to 7. New cstate: current_term: 7 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
W20260709 12:26:05.316696  5864 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 319) took 18318 ms (client timeout 15000 ms). Trace:
W20260709 12:26:05.317090  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 143251us
I20260709 12:26:05.176396  5934 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:05.320158  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:05.332476  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 146003us
I20260709 12:26:05.318290  5862 catalog_manager.cc:5697] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:05.336308  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 226547us
W20260709 12:26:05.341953  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 163645us
I20260709 12:26:05.337709  5862 catalog_manager.cc:5697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:05.414853  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.415330  5862 catalog_manager.cc:5697] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:05.417234 10711 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.215739 10532 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:26:05.417827  5862 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 9 to 12, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 12 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:26:05.357851  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.360889 10774 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.228664 10814 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.379492  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:05.385393  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:05.388274  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:05.387108 11086 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:05.409118 10700 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.405768 10019 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:26:05.317471  5864 rpcz_store.cc:269] 0709 12:25:46.997615 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:47.030659 (+ 33044us) service_pool.cc:224] Handling call
0709 12:26:05.316324 (+18285665us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:00.530991 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:00.606693 (+ 75702us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:00.606732 (+    39us) write_op.cc:435] Acquired schema lock
0709 12:26:00.606749 (+    17us) tablet.cc:662] Decoding operations
0709 12:26:00.607714 (+   965us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:00.607775 (+    61us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:00.607800 (+    25us) tablet.cc:685] Acquiring locks for 9 operations
0709 12:26:00.608471 (+   671us) tablet.cc:701] Row locks acquired
0709 12:26:00.608488 (+    17us) write_op.cc:260] PREPARE: finished
0709 12:26:00.608631 (+   143us) write_op.cc:270] Start()
0709 12:26:00.608740 (+   109us) write_op.cc:276] Timestamp: P: 1783599960608582 usec, L: 0
0709 12:26:00.608758 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:26:00.609406 (+   648us) log.cc:844] Serialized 3594 byte log entry
0709 12:26:01.392931 (+783525us) op_driver.cc:464] REPLICATION: finished
0709 12:26:01.502902 (+109971us) write_op.cc:301] APPLY: starting
0709 12:26:01.502987 (+    85us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:01.671607 (+168620us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:01.671697 (+    90us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:01.741528 (+ 69831us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:01.741760 (+   232us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=18,key_file_lookups=18,delta_file_lookups=18,mrs_lookups=0
0709 12:26:01.741805 (+    45us) write_op.cc:312] APPLY: finished
0709 12:26:01.742248 (+   443us) log.cc:844] Serialized 89 byte log entry
0709 12:26:01.792226 (+ 49978us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:01.799182 (+  6956us) write_op.cc:454] Released schema lock
0709 12:26:01.802021 (+  2839us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:01.839465 (+ 37444us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:01.869281 (+ 29816us) write_op.cc:454] Released schema lock
0709 12:26:02.724795 (+855514us) spinlock_profiling.cc:243] Waited 963 us on lock 0x7b1800412ae0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df67522 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
Metrics: {"mutex_wait_us":1913704,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":109624,"apply.run_cpu_time_us":13860,"apply.run_wall_time_us":324091,"cfile_cache_hit":38,"cfile_cache_hit_bytes":41765,"num_ops":9,"prepare.queue_time_us":617905,"prepare.run_cpu_time_us":4805,"prepare.run_wall_time_us":142725,"raft.queue_time_us":168380,"raft.run_cpu_time_us":9245,"raft.run_wall_time_us":150108,"replication_time_us":784012,"spinlock_wait_cycles":2215808,"thread_start_us":628491,"threads_started":4,"wal-append.queue_time_us":521589,"wal-append.run_cpu_time_us":9736,"wal-append.run_wall_time_us":1610326}]]}
I20260709 12:26:05.427217 10850 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:05.430740 10922 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:26:05.432017 10927 consensus_meta.cc:287] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.728s	user 0.011s	sys 0.000s
I20260709 12:26:05.423063 10711 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:05.434638 10944 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.439906 10932 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:05.440110 11026 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:05.441716 11046 consensus_queue.cc:1243] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer 24012af7747d4c4ea89c3da2ff950099 log is divergent from this leader: its last log entry 8.9 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:26:05.443029 11060 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.357968 10705 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:05.434224 10884 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:05.440315 10916 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:05.291155 11059 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.446566 11011 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:05.456429 11034 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:05.480870  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.510454 10863 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.479815 10883 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.474001 11041 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:05.543063  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 162576us
W20260709 12:26:05.543596  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 156543us
W20260709 12:26:05.547542  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 158193us
I20260709 12:26:05.477061 11043 raft_consensus.cc:2955] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Committing config change with OpId 8.8: config changed from index 6 to 8, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:05.565320  6645 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:26:05.563223 10944 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.566869 10867 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.567957 11060 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.569602 11028 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:05.571553 10927 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.600361 10927 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.573184 11049 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:05.573974 10901 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.603384 10867 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:05.605759 11060 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.606060  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:05.596952 11028 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:05.607822 11028 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.601486 11049 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:05.610016 11049 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.610939  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.612890 10996 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:05.566882 11034 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.613828 11059 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.613659 10996 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.614823 11049 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:05.616731 11034 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.617308 10996 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.576092 10883 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.584251 10711 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.617901 11019 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:05.618595 10711 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.619999  6044 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:26:05.621198 10711 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.576499 10850 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.621598 11028 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:05.587072 10727 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:05.586767 10700 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.587968 11011 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.589677 10884 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.623468 10727 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:05.594624 11095 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.001s
I20260709 12:26:05.624634 10727 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.625692  6044 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:05.625520 11086 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.575125 10863 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.612761 11030 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.626224 10727 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:05.627424 11030 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.627250 10700 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:05.628335  6649 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:05.627591 10850 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.629592 11030 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.625372 10884 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.567054 10564 consensus_queue.cc:1059] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:26:05.608635  6043 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:05.595115 11047 raft_consensus.cc:3055] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:05.632344 11011 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.632925 11047 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:05.634148 11047 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.634509 11011 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.563506 11026 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.636768  5862 catalog_manager.cc:5697] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 4 to 7, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 7 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.635484 11011 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.638424  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:05.637771  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:05.639096 10821 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.639846 10700 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:05.640070  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.640427 10996 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:05.628091 10863 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.640774 10700 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.618564 11019 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:05.643695 11086 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:05.644455  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 468001us
I20260709 12:26:05.645610  5934 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:05.635934  6035 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:05.639750  6649 raft_consensus.cc:2393] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 13: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:05.670768 11047 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:05.641083  5862 catalog_manager.cc:5697] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 6 to 8, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:05.641561 10996 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.600216 10944 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.677109 10996 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:05.682929 10700 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:05.683372  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.684278  6044 raft_consensus.cc:2410] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 12 because replica has last-logged OpId of term: 10 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 11.
I20260709 12:26:05.685338  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.686100  6041 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:05.687093  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:05.687429  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 89272.2us
W20260709 12:26:05.683584  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.709246  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:05.710233 11030 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:05.710670 11030 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.711212 11030 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:05.700348  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 54931.4us
I20260709 12:26:05.700655 10019 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:05.701463 10863 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:05.715185 10863 raft_consensus.cc:3055] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:05.715632 10863 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:05.716696 10863 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.718117 10863 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:05.687776 10825 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:05.704049  6041 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:05.704840  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.720866  6044 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:05.704159  5862 catalog_manager.cc:5697] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:05.721375 11030 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.705339  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:05.705993  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:05.706718 11011 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.702627 10884 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:05.722520  5862 catalog_manager.cc:5697] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 8 to 9, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 9 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:05.686600 10711 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.677991  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:05.710702  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:05.733210  6042 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:05.736753  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:05.736665  6609 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:05.680720 10821 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.736112  6645 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:05.739216  6043 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
W20260709 12:26:05.756412  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:05.743398 10865 consensus_meta.cc:287] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.646s	user 0.008s	sys 0.007s
I20260709 12:26:05.764662  6039 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:05.755335 11019 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.752233 11030 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.749482 11026 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.755405  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:05.761425  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:05.754231  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:05.747574 10884 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:05.760385  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:05.756654  5968 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:05.772809  6041 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:05.773912 10019 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.739559 10825 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:05.747625  5862 catalog_manager.cc:5697] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:05.783471  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:05.781306 10996 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:05.788141  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:05.788312  5964 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:05.789986  6648 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:05.791676 10019 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.793207 10996 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.791716  5963 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:05.800576  6037 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:05.794821  6036 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:05.805182 10564 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:05.805972 10564 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.794126  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:05.781629 10700 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:05.807051 10700 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.807541 10700 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:05.806366  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:05.810992  6041 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:05.786378 10825 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.817425 10825 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:05.823130 11098 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.085s	user 0.000s	sys 0.001s
I20260709 12:26:05.829813  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.830811  6040 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:05.832762  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:05.833087  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:05.833271  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:05.834082  6116 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:26:05.834285  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:05.835057  6113 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:05.835031  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:05.781852 10884 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:05.793892 10019 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:05.812484  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:05.771860 10711 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.814036  5862 catalog_manager.cc:5697] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:05.815541 10727 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.816612  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:05.816830 10564 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:05.837128  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:05.846361 10711 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.846931  6113 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:05.847036  6036 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:05.791831  5960 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:05.849828 11030 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:05.837231  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:05.850896  6112 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:05.851214 11091 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:05.842267 10996 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:05.845911 10727 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.851763 11091 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.853648 10727 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:05.851218  5862 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:05.856352  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:05.856264  5862 catalog_manager.cc:5697] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:05.857002  5966 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:26:05.858359  5862 catalog_manager.cc:5697] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
W20260709 12:26:05.863348  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 92135.9us
I20260709 12:26:05.871219  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:05.872251  6042 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:05.872265 11030 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:05.873306 11030 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:05.864863  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.842542 10884 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:05.873715  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:05.875098  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.875931 10996 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.877755  5964 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:05.878988  6042 raft_consensus.cc:2410] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 13 because replica has last-logged OpId of term: 11 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
I20260709 12:26:05.869683 10823 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:05.878289 10996 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.867035  6113 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:05.879544  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.891428  6036 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:05.895309  6041 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:05.901093 11026 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:05.902040 11026 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.902812 10823 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:05.905056 11026 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:05.911166  6036 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:26:05.906364  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.873719 11030 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:05.928684 11026 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:05.928970  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.937556 10884 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:05.929838  6039 raft_consensus.cc:2410] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 11 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 5.
I20260709 12:26:05.929534  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:05.938371  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 45945.1us
I20260709 12:26:05.943876  6042 raft_consensus.cc:2393] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:05.945436  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:05.908818 11019 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:05.905857 10823 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:05.926608  5862 catalog_manager.cc:5697] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index -1 to 6, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 7 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.959151  5862 catalog_manager.cc:5697] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 10 to 13, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 13 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:05.969218  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.944563 11056 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:05.980365  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 109310us
I20260709 12:26:05.991255  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:05.991905  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:05.992550  6037 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:05.993872 10823 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:26:05.997524 10823 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:05.997611 10884 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:05.997946 10823 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:26:06.000168  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.002369 10019 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:05.970996 10711 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:06.006219  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:05.955000 11086 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.041s
I20260709 12:26:06.012082  6645 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.000599  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:05.966003 11026 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.009771  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:06.014019 10019 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.015668  5862 catalog_manager.cc:5697] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 9 to 10, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 10 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:06.029624  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:06.030676  6113 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.043593  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.045009 11091 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.046633  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:06.047256  5966 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:05.999186 10823 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.047362  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:06.048264 10823 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:06.050262 10867 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:06.050683 10867 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:06.051494  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.052536  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.053257  5968 raft_consensus.cc:2393] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:06.051640 10867 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.053925  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.055241  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.058872 10821 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:26:06.048230  6042 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 14: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:06.062306  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:06.062501  6038 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:06.062753  5960 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:06.063529  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:06.064303  6042 raft_consensus.cc:2393] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 14: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:06.064992  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:06.065480  6042 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:06.066799  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 52446.2us
I20260709 12:26:05.974308  6643 raft_consensus.cc:2955] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 6 to 8, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:06.068066 11031 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:06.068661 11031 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.070525 10884 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:06.015028 10996 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.079056  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:06.079568  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.079806  6647 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:26:06.011755 10711 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.081522  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:06.023319 11056 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.082298  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.078251  5962 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:06.067607  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:06.084225  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:06.084911  6644 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.086131 10867 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:06.087507 10019 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:26:06.088227 11083 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:06.089344  6114 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 8 index: 9. (index mismatch)
I20260709 12:26:06.071846 10884 raft_consensus.cc:3055] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:06.029069  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.090427 10884 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:06.094374 10884 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.095201  6644 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:06.096020  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:06.096259  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.096592  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.097225  6117 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:06.097914  6115 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 7 index: 5. (index mismatch)
I20260709 12:26:06.098523  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.099136  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.099705  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:06.101257  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.101984  6114 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:26:06.071830 10996 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.103609 11058 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:06.116696 11058 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.119699 11030 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.108709  6084 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:06.194871  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 86227.4us
I20260709 12:26:06.122428 10821 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:06.122619  6111 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:06.110927  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.123327  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.123993 11058 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.098987  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.124275  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:06.111712 10996 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:06.204114  6115 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:06.094177 10711 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:06.090301  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:06.113499 11056 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.090975  6650 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
W20260709 12:26:06.113996 10795 consensus_meta.cc:287] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 1.013s	user 0.020s	sys 0.005s
I20260709 12:26:06.128829  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:06.109640  5967 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:26:06.110492 10814 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.129853  5968 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:06.102967 10884 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:06.219434  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.114261  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.130756  5965 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:26:06.132272  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.200098 11047 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:06.079069 11026 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.131976  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:06.136930  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.226037  6114 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:06.140288  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.140730 11083 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:06.140970  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:06.111147  6009 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:06.227314  6646 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:06.142602  5966 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:06.215102 11058 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:06.155222  6645 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:06.161006  5934 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:06.165457  6037 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:06.198523  6109 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:06.207299  5862 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:06.220665  5963 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
W20260709 12:26:06.232443  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.112653 11031 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:06.228844  6116 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:06.145169 10700 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:06.227815  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 116757us
I20260709 12:26:06.232088  6644 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: [11.10-11.10]
I20260709 12:26:06.237251  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:06.233214  6117 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 14: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:26:06.234714  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.242342  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:06.244331  5961 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 12. Current term is 13. Ops: [12.11-12.11]
I20260709 12:26:06.228996 10711 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:06.225971 10825 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.248066  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:06.249310  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 6 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.224543 11047 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.251036 11047 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:06.200556 10821 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.253082 10825 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:06.253803 11058 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.257186 11058 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.257655  6042 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:06.258625  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.259289  5968 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:26:06.259933  6111 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:06.261533  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:06.262125  6114 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.234474 10814 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.262755 10996 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:06.263770 10996 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.264124 10996 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.264807 10814 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:06.226346 10795 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.267464  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:06.268278  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.268599  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.268774  6611 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:06.269649 10823 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:06.269800  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.270577  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.270977  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.271693  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.271847  6645 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:06.271066  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:06.272794 11026 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.273057  6084 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:06.273348 11026 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.274420 10865 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:06.274854 10865 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:06.275254 10865 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:06.275604 11026 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.280483 11031 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.281044 11091 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:06.282814  5962 raft_consensus.cc:2368] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12.
I20260709 12:26:06.283679  6647 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:26:06.285086  6110 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:06.285473  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.286283  6650 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:06.286700  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:06.286965  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.289760  6115 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:06.235740  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.292870  6113 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:06.262672  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:06.270416 10823 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:06.302637  6646 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:06.303083  6649 raft_consensus.cc:2368] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15.
I20260709 12:26:06.302192  6114 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:06.306897  5862 catalog_manager.cc:5697] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 12 to 14, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 14 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:06.309049  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:06.293812  6006 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:06.287949  6118 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:26:06.312157  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:06.317149  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:06.320956  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.322346  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:06.322995  6039 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:06.325711  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.287808 11083 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.281204 11031 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.320415 10727 raft_consensus.cc:2764] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:26:06.328886 10865 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.326412  6651 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:26:06.333496 10711 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:06.303839 10823 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.267464 10795 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.338817  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:06.342677 11056 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:06.344393 11031 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:06.345017 11031 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:06.345531 11031 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.345901  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:06.326848  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.302793 11091 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:06.334897  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:06.350832  6109 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:06.347594  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.348609 11030 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.349563  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.356526  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:06.350416  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.282852 10700 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:06.328917  5862 catalog_manager.cc:5697] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 6 to 7, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 7 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:06.361486  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 200576us
I20260709 12:26:06.361773  6006 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:06.363713  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.363839  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.334976 10823 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.365324  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:06.367728  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:06.324420 11026 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:06.323525 10814 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:06.354758 11011 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:06.373638  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:06.371330  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:06.370971  5862 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:06.373660  6111 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:06.328047 11083 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.378846  5963 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:26:06.382995  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:06.382402  5862 catalog_manager.cc:5697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:06.389437  6112 raft_consensus.cc:2410] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:26:06.377496 11011 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:06.390116 11011 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:06.378188 10711 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:06.370864 11026 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:06.378582 10564 consensus_queue.cc:1059] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 8.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:26:06.398367 10564 raft_consensus.cc:3055] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:06.398802 10564 raft_consensus.cc:740] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:06.399847 10564 consensus_queue.cc:260] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.400950  6084 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:06.402694  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:06.381008 11056 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:06.406932  6642 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:06.407227  6611 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:06.408376 10019 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:06.409022  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.372833 10727 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
I20260709 12:26:06.409650  5963 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:26:06.410089  6116 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:06.408488  5862 catalog_manager.cc:5697] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 10 to 12, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 12 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:06.384061  6081 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:06.411756  6111 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:06.391944 10700 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:06.379274 11086 consensus_queue.cc:1059] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:26:06.407815 10867 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:06.403323 10711 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.403684 11026 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:06.378636 10814 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.401091 10564 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:06.422395 10851 consensus_queue.cc:1059] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:26:06.424541 11086 raft_consensus.cc:3055] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:06.435321 11086 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:06.425338  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 48149.2us
I20260709 12:26:06.415980 10700 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.404248 11031 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:06.429385  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.408440 11056 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:06.412393 10825 raft_consensus.cc:2764] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:26:06.454128 10700 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:06.419164 10867 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:06.457909  5963 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:26:06.436260 10019 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:26:06.455395 11056 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:06.459436 10867 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:06.442418  5862 catalog_manager.cc:5697] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 5 to 7, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 7 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:06.430936 10711 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:06.500353  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.456669 10996 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.498693  5862 catalog_manager.cc:5697] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 3 to 4, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 4 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:06.434631 10865 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.504045 10814 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:06.509672 10727 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:06.510258 10727 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:06.456395 11091 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.511282 10727 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.515089 11043 consensus_queue.cc:1059] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.002s
I20260709 12:26:06.508472  5862 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 13 to 14, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 14 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:06.520428  6039 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:06.522140  6609 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:06.524720  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:06.568005  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.531401  5862 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 10 to 12, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 12 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:06.571681  6109 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:06.572569  5862 catalog_manager.cc:5697] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 5 to 6, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 6 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:06.573882  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:06.623664  5964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.020s	sys 0.061s
I20260709 12:26:06.527135 10825 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:06.627759  5862 catalog_manager.cc:5697] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 9 to 12. New cstate: current_term: 12 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:26:06.670964  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.679387  5862 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:06.649259 10825 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:26:06.691568  5964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.575s	user 0.021s	sys 0.062s
I20260709 12:26:06.676519 11028 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:06.571786 11086 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:06.704398  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 467176us
W20260709 12:26:06.706928  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 339003us
I20260709 12:26:06.708879 11086 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:06.709921  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.710631  5960 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:06.711473  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:06.712491  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.713246  5960 raft_consensus.cc:2393] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:06.713615  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.714288  5963 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:06.714373  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.715133  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:06.715476  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.716966  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.717705  5959 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:06.718101  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.718892  6115 raft_consensus.cc:2410] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
I20260709 12:26:06.719723  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.720425  6114 raft_consensus.cc:2393] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:06.713981  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:06.722236  5960 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:26:06.726830 10825 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.729586  5960 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:06.706497  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.734941 10865 raft_consensus.cc:3055] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:06.735450 10865 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:06.736364 10865 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.740468 11083 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.741057 11083 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.747757 11011 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.734988 11047 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:06.755570 10884 consensus_meta.cc:287] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.530s	user 0.008s	sys 0.002s
I20260709 12:26:06.756942 10823 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.757599 10821 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.758481 10996 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.762943  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:06.768247  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 402982us
I20260709 12:26:06.771894  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.772754  6114 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:26:06.773700  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.774909  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:06.778774  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:06.782285  6113 raft_consensus.cc:2368] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
W20260709 12:26:06.781139  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 359402us
I20260709 12:26:06.783991  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:06.787389  6112 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:26:06.772401 10821 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:06.787886  6112 pending_rounds.cc:85] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 9
I20260709 12:26:06.795096  5932 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:06.792326  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:06.742338 10867 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:06.803300  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 367093us
I20260709 12:26:06.793948  6112 pending_rounds.cc:107] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:26:06.805874  6110 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:06.806332  6112 raft_consensus.cc:2889] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:06.806253  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:06.790493 10814 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:06.808878  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:06.801591 10878 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.519s	user 0.024s	sys 0.058s
I20260709 12:26:06.817168  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:06.821430 10867 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.822664  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:06.790580 10944 consensus_queue.cc:1059] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 12:26:06.815888 10878 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.740s	user 0.024s	sys 0.058s
I20260709 12:26:06.830870  6081 leader_election.cc:400] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12.
I20260709 12:26:06.831686  6081 leader_election.cc:403] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:26:06.810838 11121 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.811124 10821 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:06.823453 10850 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:06.825268 11083 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:06.816004 10564 consensus_queue.cc:1059] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:26:06.857260 11121 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.811827 10711 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.831818 10884 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:06.841492  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.840849 11123 consensus_queue.cc:1059] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.008s
W20260709 12:26:06.870837  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 91473.5us
I20260709 12:26:06.872678  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:06.874080  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.876039  6643 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
W20260709 12:26:06.884617  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.884967  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:06.885123  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:06.886372  5961 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:06.863243 11120 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:06.861352 10996 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.865113 11030 raft_consensus.cc:3055] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:06.898694 10286 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.027s
I20260709 12:26:06.902114 11030 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:06.865919 11091 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:06.873090 10867 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12.
I20260709 12:26:06.890312 10944 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.912266  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:06.906564 10851 raft_consensus.cc:3055] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:06.915174  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:06.906253 11047 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.887784 11056 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.909317 11120 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:06.889312 11026 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.910804 11119 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:06.910056 10795 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:06.907999 10884 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:06.898953 10700 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.920460  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.872380 11124 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:26:06.922401  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.905824 10996 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.923409 10564 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:06.930024 10884 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.932070 10996 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:06.917649 10823 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:06.917958 10727 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:06.918027 10851 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:06.922006  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:06.933120  5966 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
W20260709 12:26:06.933830  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 144605us
I20260709 12:26:06.920454 11011 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:06.939334  5968 raft_consensus.cc:2393] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 17: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:06.936805  6082 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:06.942799 10996 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:06.927086 11119 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.942824 11135 raft_consensus.cc:3055] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:06.971278 11135 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:06.972218 11135 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.972801  5962 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:06.973302 11135 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.975890  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:06.976689  6647 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:06.978854 11026 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:06.980114  5960 raft_consensus.cc:2393] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:06.981107 11119 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:06.982955 11121 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:06.983753 10286 consensus_queue.cc:1059] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:06.984251  5966 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:06.984670 10286 raft_consensus.cc:3055] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:06.985008 10286 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:06.944818 11056 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:06.925161 10795 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:06.941366  5934 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:06.988168  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 46912.3us
I20260709 12:26:06.989380  5934 leader_election.cc:400] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15.
I20260709 12:26:06.989660  5934 leader_election.cc:403] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:06.990629 10711 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:06.925107 11030 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.974236  5962 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:06.918016 11091 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:26:06.919936 10821 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.991815 11030 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:06.954865 11058 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:06.995960 11058 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:06.996155 10863 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:06.996682 10863 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.996934 11058 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.998179 11058 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:06.959745 10700 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:06.960800  6112 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:26:07.007069  6112 pending_rounds.cc:85] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 11
I20260709 12:26:07.007385  6112 pending_rounds.cc:107] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:26:07.007665  6112 raft_consensus.cc:2889] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:06.961472  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:06.962852 10867 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:07.008656  5934 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:06.964514  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:06.966312  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:07.010840  6116 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:07.011180  5934 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:06.967983 11120 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.946185 11129 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:06.943842 11125 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:26:06.955394 11117 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.080s	user 0.000s	sys 0.001s
I20260709 12:26:06.999490 11091 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:07.000010 10996 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:06.988196 10795 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:06.920821 10944 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.005414 11026 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:06.963053 10851 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:06.985821 10286 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:06.981422 11128 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.109s	user 0.001s	sys 0.002s
I20260709 12:26:07.031159 11091 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:07.041179  5963 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:07.040525 11056 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.043185 10996 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.051972  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.053313  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:07.030361 11083 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15.
I20260709 12:26:07.059372  6112 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 10: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:07.054708  6042 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:07.059841  6041 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 15: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:07.061363  6040 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
W20260709 12:26:07.058643  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 172893us
I20260709 12:26:07.039636 11031 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:07.069253  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.066746  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:07.063488  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:07.040342 11028 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:07.071828  6044 raft_consensus.cc:2393] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:07.073621  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:07.030185 11119 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:26:07.070094  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 9 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:07.042482 10944 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.075613  5966 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:26:07.077236  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:07.050649 10711 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:07.068169 10795 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:07.083880  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:07.080657  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:07.086589  6043 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:07.085510  5968 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:26:07.088483  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.089093 10286 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:07.092947  6112 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:07.099000 10865 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:07.069514 11143 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.104224  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:07.104461 11091 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.105358  6650 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:07.083432 10851 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:07.109287  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:07.112851  5965 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:07.078804 11028 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:07.090102 10863 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.085934 11056 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.132737 11056 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:07.134431 11056 consensus_queue.cc:1059] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 11.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:07.030997 11129 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.080255 11026 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:07.114259 11140 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:07.090932 11144 consensus_queue.cc:1059] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.028s
I20260709 12:26:07.078352 10700 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.034s
I20260709 12:26:07.120677 10823 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:07.072765  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:07.106243 10711 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.138104  6116 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:07.113335 11083 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:07.135751 11127 raft_consensus.cc:3055] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:07.141796 11026 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:26:07.162778  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 90077.4us
I20260709 12:26:07.149930  6611 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:07.151556  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 266654us
W20260709 12:26:07.158538  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:07.148875  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:07.139108 11091 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:07.162433  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 8 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:07.164783  5963 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:26:07.166832  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.169415  6043 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 7.
I20260709 12:26:07.141736 11125 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:07.183914  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:07.187160  5962 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:26:07.148609 10823 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:07.155697 11083 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:07.169509 11026 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:07.111840 11143 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:07.191797  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 190115us
I20260709 12:26:07.163218 11127 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:07.181559 11121 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:07.180532 10878 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:07.202160 11139 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.202872 11139 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.193104 10823 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:07.207070 10878 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:07.208407  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:07.208199 10878 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 9.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.209034  6647 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:07.210081  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:07.210740  6650 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:07.211767  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:07.190995 11123 consensus_queue.cc:1059] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:26:07.216614 10814 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:07.217187 10814 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:07.218328  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:07.220829  5963 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:07.222788  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.170689  6006 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:07.224264  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.227625  6117 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:26:07.225159  6115 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:07.223529  6112 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:26:07.197141  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:07.204329  6009 connection.cc:256] RPC call timeout handler was delayed by -1.0753500679998069s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16690000000000002s for a response
I20260709 12:26:07.231299  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:07.229096  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 58506.7us
I20260709 12:26:07.234237  6041 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:07.235725  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:07.236523  6111 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 12: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:07.236830  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:07.237795  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:07.238361  6115 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:07.239302 11125 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 12.13, Last appended by leader: 13, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.243870  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.245692 11140 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:07.246167 11140 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.246562 11140 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:07.247944 11039 raft_consensus.cc:3055] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:07.248406 11039 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:07.249343 11039 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:07.251377 11113 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.379s	user 0.005s	sys 0.000s
I20260709 12:26:07.253156  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2474) took 1190 ms. Trace:
I20260709 12:26:07.253919 11028 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.253151 10850 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:07.255066 10850 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:07.255954 10850 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.257409 10850 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:07.261526  6115 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:07.238243  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:07.262744 10286 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:07.253657  5964 rpcz_store.cc:276] 0709 12:26:06.062312 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:06.062428 (+   116us) service_pool.cc:224] Handling call
0709 12:26:06.062764 (+   336us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:06.072550 (+  9786us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:06.072579 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:06.073074 (+   495us) log.cc:844] Serialized 26 byte log entry
0709 12:26:06.700017 (+626943us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:06.779443 (+ 79426us) log.cc:844] Serialized 14 byte log entry
0709 12:26:06.779671 (+   228us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:06.779739 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:06.973113 (+193374us) spinlock_profiling.cc:243] Waited 3.21 ms on lock 0x7b18002a5f20. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:26:07.250707 (+277594us) spinlock_profiling.cc:243] Waited 2.2 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:07.252724 (+  2017us) raft_consensus.cc:1685] finished
0709 12:26:07.252754 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:07.253045 (+   291us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9317,"prepare.queue_time_us":77892,"prepare.run_cpu_time_us":65,"prepare.run_wall_time_us":2189,"raft.queue_time_us":13310,"raft.run_cpu_time_us":432,"raft.run_wall_time_us":433,"spinlock_wait_cycles":12432640,"thread_start_us":625725,"threads_started":1,"wal-append.queue_time_us":743351}
I20260709 12:26:07.266084  6608 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:07.266948 10286 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:07.267328 10286 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.267688 10286 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:07.270511  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:07.271976  6081 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:07.274657 11056 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:07.275266 11056 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:07.276230 11056 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:07.236285  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 225165us
I20260709 12:26:07.272249 10795 consensus_queue.cc:1059] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:26:07.279989 10795 raft_consensus.cc:3055] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:07.280237  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:07.281497  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:07.282235 11119 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.282739 11119 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.283689  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:07.284679 11119 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:07.285184 11119 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:07.285547  6084 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:07.285696 11119 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.286350 11043 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:07.286738  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:07.287496 11043 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:07.288021 11043 raft_consensus.cc:697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:07.288897  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:07.289536  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52791.8us
I20260709 12:26:07.198210 11121 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.232223 10821 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:07.291338 10821 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.291113 11043 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.291698 10821 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:07.291034  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.288528 10795 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:07.293870  6009 connection.cc:256] RPC call timeout handler was delayed by -1.0483500679997633s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16990000000000002s for a response
I20260709 12:26:07.295310  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.292577  6110 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:26:07.296015  5965 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:07.301151  6043 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:07.274335 11144 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:26:07.302977  6114 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:07.306496  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:07.311163  6041 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:07.289767 10700 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:07.308197 11123 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.013s
I20260709 12:26:07.313691  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:07.291076 11121 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:07.327525 11110 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.638s	user 0.000s	sys 0.006s
I20260709 12:26:07.330833  6611 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:07.331791 10700 raft_consensus.cc:2764] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:26:07.332391 10795 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.333768 10795 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:07.243791 10823 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.287997 11119 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:07.311812 11030 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:07.314141  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.314810  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.309037 11031 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:07.316262 11127 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.317806 10711 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.337807  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.346132  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.339546  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:07.311043  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:07.297106 11124 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:07.337800  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:07.351346  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.357251  6037 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:07.339954 11039 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:07.361486  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.362157  6039 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
W20260709 12:26:07.363731  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52771.6us
I20260709 12:26:07.311921 11047 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.048s
I20260709 12:26:07.368383  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:07.370687  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:07.372561  5965 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 15: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:07.349346 11011 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:07.377318  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:07.382923  5964 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:07.382263  5962 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:07.389353  6112 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:26:07.389343  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.393721  6039 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:07.373581 11031 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:07.367487 11030 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:07.396726  6009 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:07.392621 11049 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.404268  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.354310 11124 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.352502 11083 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.433970 11138 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.434595 11049 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.435900 11124 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:07.440014 10814 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.399641 10711 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:07.449005  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 78005.8us
I20260709 12:26:07.399529 11031 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:07.388309 11011 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.405725 11139 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:07.464744  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:07.465444  5964 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:07.444339 10996 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:07.397670 11120 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.049s
I20260709 12:26:07.468317  5959 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:07.405495 11123 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:26:07.416901 10700 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:26:07.416927 10286 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.476987 11141 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:07.477394 11136 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:07.477751 11132 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 12:26:07.478292 11011 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.479275 11031 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:07.482175  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:07.482751  6608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.569s (SENT) [suppressed 3 similar messages]
I20260709 12:26:07.455739 11026 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.512219  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:07.513437  5962 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:07.487772 11139 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:07.463831 10711 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.503952 11030 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.475330 11028 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.490665 10996 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:07.500341 11136 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.527827  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:07.523774 10286 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:07.501499 11143 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:07.525192 11139 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.527136  5960 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: []
W20260709 12:26:07.530856  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:07.456739 11138 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.551880  6040 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:26:07.553871 10823 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.553690 11140 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:07.554893  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 168925us
W20260709 12:26:07.568073  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 94857.9us
I20260709 12:26:07.556044 11136 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:07.566164  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 83439us
I20260709 12:26:07.564551  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:07.567729  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:07.571146  5962 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:07.571058  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:07.571979  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:07.577222  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:07.585539  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:07.587400  6113 raft_consensus.cc:2368] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9.
I20260709 12:26:07.573941 11028 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:07.601022  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:07.599411  5934 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:07.602862 11031 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:07.603286 11031 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.603622 11031 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:07.606803 11161 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:07.610526 11142 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:07.602758 11120 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:26:07.591954 11043 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:26:07.611133 11142 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.612191 10823 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.612718 10823 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.613348 11142 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.616815  6112 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:07.532729 10996 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.620994  5934 leader_election.cc:400] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:26:07.621356  5934 leader_election.cc:403] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:07.592418 11119 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:07.624290  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.595912 11141 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:07.596423 11058 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:07.627257 11028 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.627686 11125 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:26:07.628540  5961 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:07.657181  6117 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:07.657838  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:07.630206 11127 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:07.636945 11140 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:07.658529  5966 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:07.639592 11138 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.641059 11049 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:07.646914  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:07.655807  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.654601 11058 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:07.666937 11058 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:07.667469  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:07.668109 10700 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:07.668689 10700 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.669788 11028 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:07.611137 11031 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.640558 10821 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.670946 10700 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.671468  6038 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 15: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:07.672343  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:07.662177  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.673695  6114 raft_consensus.cc:2393] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:07.662406  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.662952  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.662205  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.621322 10814 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:07.678931  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.683480  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:07.685735  6117 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:26:07.686053  6647 raft_consensus.cc:2393] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 12: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:07.686446  5966 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:26:07.675421  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.674314  6110 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:26:07.668257  6044 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 9
I20260709 12:26:07.681159  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:07.689420  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:07.663540  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 62524.6us
I20260709 12:26:07.692008  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:07.688966  6649 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:26:07.693429  6035 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:26:07.695428  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 100768us
I20260709 12:26:07.696286  6009 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:07.690086  6650 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
W20260709 12:26:07.699282  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52454.9us
I20260709 12:26:07.699496 10019 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:07.700093 10019 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:07.700896 10019 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.702654 11125 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.703174 11125 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.704272  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:07.705201 11125 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.705988  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:07.706768  5961 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 10: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:07.707505  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:07.708070  5961 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:07.709271  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:07.710021  5963 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:07.705848 11058 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.710739 11161 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:07.710844 11141 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.6, Last appended by leader: 6, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.713131 11058 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:07.672222 10878 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:07.715428 10878 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.717538 10878 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.655159 11136 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:07.723150 11058 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:07.724227 11058 raft_consensus.cc:3055] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:07.724562 11058 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:07.725888  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:07.713043  5968 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:07.727849  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:07.728552  5960 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:07.725767  6081 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:07.734038  6040 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
W20260709 12:26:07.696988 11091 consensus_meta.cc:287] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.515s	user 0.010s	sys 0.000s
I20260709 12:26:07.744544 11170 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:07.735647 11161 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:07.744753 11058 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:07.745913  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 67381.1us
I20260709 12:26:07.747738 10711 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.748193 10700 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:07.748684  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:07.751281 11049 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:07.751857 11049 raft_consensus.cc:697] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:07.753034 10869 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.752741 11049 consensus_queue.cc:237] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.754035 11058 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:07.756340  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.756492  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.757120  6115 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:07.757222  6118 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:26:07.758211  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.758005 10869 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.764917  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:07.769009  6043 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:07.773578  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:07.773649  6112 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:07.774477  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:07.775197  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:07.696751 10823 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.777580  6111 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:07.781036  5960 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:07.778381  5968 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:07.781036  6109 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:26:07.766805  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:07.721748 11129 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:07.791512  5959 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:07.788893  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:07.676335 11169 consensus_queue.cc:1059] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 4, Time since last communication: 0.123s
I20260709 12:26:07.777953 10878 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
W20260709 12:26:07.794788 11131 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:07.788072 11142 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:07.820590 11142 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.821045 11142 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:07.821883 11135 consensus_meta.cc:287] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.848s	user 0.012s	sys 0.000s
I20260709 12:26:07.782147 11161 consensus_queue.cc:1059] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.021s
I20260709 12:26:07.825798  6084 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:07.831338  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:07.778048 10286 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.024s
W20260709 12:26:07.834601  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 138393us
I20260709 12:26:07.798749 10821 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.841480 10851 raft_consensus.cc:3055] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:07.841944 10851 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:07.842571 10944 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:07.843019 10944 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.843349 10944 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:07.845296  5962 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:26:07.847221  5966 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9. Ops: [8.8-8.8]
I20260709 12:26:07.848052  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:07.848732  6035 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:07.850625  6650 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:26:07.803119 10823 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:26:07.863562  6044 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:26:07.832413 11043 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:26:07.866025  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 92521.6us
I20260709 12:26:07.835625 10878 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:07.821056 11139 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.866698  6609 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:07.824671 11121 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.885692 11139 consensus_queue.cc:1059] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:07.886759 11139 raft_consensus.cc:3055] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:07.887537 11139 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:07.888711 11139 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.867794 11043 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.889961 11043 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:07.897046 11139 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:07.867926 11125 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:26:07.901525 10821 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:07.902161 10821 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:07.904484 10821 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.906250  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:07.907176 11142 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.874270  5934 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:07.912578 10884 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:07.912705  5934 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:07.913100 10884 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.913514 10884 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:07.913972 11125 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:07.914911 11125 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:07.916746 11043 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.901177 10286 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:26:07.924817  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 143685us
I20260709 12:26:07.925985  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:07.929404  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.935451  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:07.870069 10878 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:07.937791  6041 raft_consensus.cc:2368] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11.
I20260709 12:26:07.939579  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:07.939910  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 72055.1us
I20260709 12:26:07.940347  6115 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:07.942411  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:07.946233  6109 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:07.930171 11039 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:07.950273  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.950898  6114 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:07.937587 10821 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:07.941469 10878 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:07.954581  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 85517.9us
I20260709 12:26:07.946861 11138 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:07.962827  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:07.963527  6114 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:26:07.953117 10286 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:07.971160  6114 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 13. Preceding OpId from leader: term: 13 index: 14. (index mismatch)
I20260709 12:26:07.969560 11177 raft_consensus.cc:3055] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:07.972862 11177 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:07.974066 11026 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.976130 10825 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:26:07.977335 11174 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
I20260709 12:26:07.979241 11031 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:07.979022 10286 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:07.987452  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:07.954223 11180 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:26:07.956171 11039 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.003115 10821 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.005120 10821 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:08.005733 11168 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.374s	user 0.000s	sys 0.004s
W20260709 12:26:08.004417 11175 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.177s	user 0.001s	sys 0.000s
I20260709 12:26:08.006556 11043 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:08.011097  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 46823.2us
I20260709 12:26:08.011734  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:08.012014  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:08.012439  6115 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:08.012848 11011 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:07.997493 10944 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.016191 10851 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:08.016811 10944 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:08.017305 10851 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:07.982967 11125 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:08.019764 10869 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:08.021378 10996 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:08.027040 11083 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:08.034722  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:08.039923  6115 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:26:08.063717  6115 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:08.016242 11129 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:08.083971  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:08.085286  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:08.088474 10884 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:08.091715 11039 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:08.092093  6113 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:08.092629 11169 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:08.093225 11169 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:08.094151 11169 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.096402 11142 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:08.086414  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:08.099779  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:08.059535 11170 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:08.106377  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 165686us
W20260709 12:26:08.104899  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 158177us
I20260709 12:26:08.112210  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:08.113005  6650 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:08.114825  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:08.118506  6649 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:08.118840  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:08.119685  6113 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:08.122100 10019 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:08.123291  6009 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:08.125483  6036 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 10 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 12:26:08.125909  6036 pending_rounds.cc:85] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 11
I20260709 12:26:08.126266  6036 pending_rounds.cc:107] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 10.12
I20260709 12:26:08.126538  6036 raft_consensus.cc:2889] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:08.127029  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:08.127532 10019 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.128443  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:08.107118 11141 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:08.105845 11135 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:08.132964  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:08.109737 11136 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:08.137004  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:08.138989  6009 leader_election.cc:400] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9.
I20260709 12:26:08.139254  6009 leader_election.cc:403] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:08.109506 11124 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:26:08.130385 10884 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:08.149472  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:08.134150 10996 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:26:08.155937 11183 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.054s	user 0.006s	sys 0.000s
I20260709 12:26:08.136211 10814 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:08.136276 11136 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.183832  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:08.164980  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:08.168133 11177 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:08.170761  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:08.190861  6114 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:08.172031 10019 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:08.173107  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:08.191351 11195 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9.
I20260709 12:26:08.191959  6112 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:08.196259  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 78643.7us
I20260709 12:26:08.176446  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:08.197573  5960 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:08.198443  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 46895.5us
I20260709 12:26:08.198626  5967 raft_consensus.cc:2368] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11.
I20260709 12:26:08.177002  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:08.131462 10711 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.019s
I20260709 12:26:08.179097  6116 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 9. (term mismatch)
I20260709 12:26:08.175179  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:08.178917  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:08.173890 11047 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:08.211112  5961 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:08.211617  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:08.212330  5961 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:26:08.183629 10869 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.184666  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:08.165759  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:08.217501  5962 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:08.185256  5959 raft_consensus.cc:2376] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15. Re-sending same reply.
I20260709 12:26:08.219837  5960 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:08.188125  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:08.191267  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52400us
I20260709 12:26:08.188685 11136 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:08.175083  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:08.202749  5966 raft_consensus.cc:2376] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13. Re-sending same reply.
I20260709 12:26:08.208266  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:08.179553  6117 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:08.203729  6116 pending_rounds.cc:85] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 8
I20260709 12:26:08.225414  6116 pending_rounds.cc:107] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:26:08.225687  6116 raft_consensus.cc:2889] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:08.180192  6113 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:08.204200  5934 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:08.215292  5967 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:08.190074 11120 raft_consensus.cc:3055] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:08.224419  6109 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:08.231987  5962 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:26:08.207410  6112 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:26:08.232123  5960 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:08.228411  5934 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:08.236246  5934 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:08.239590  6109 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:08.238322  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:08.222504 11177 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:08.241793  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:08.209280 10286 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:26:08.245090 11011 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:08.240927 11031 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:26:08.231613 11120 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:08.222312 11047 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:08.234618 11125 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:08.232575 11043 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.240906 10944 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:08.253610  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:08.254088  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:08.392331  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 138306us
I20260709 12:26:08.226831 10869 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.255059 10996 raft_consensus.cc:2764] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:26:08.356896 10019 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.255585 11161 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:08.259313  5934 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:08.396203 10019 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.257891 11028 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.136s
I20260709 12:26:08.257685 11138 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.139s
I20260709 12:26:08.391187 10944 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.384908 11125 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.393795 11124 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:08.412170  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:08.413583  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:08.420578  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:08.414867  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:08.419468 10019 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:08.419744  6040 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:08.385226 11150 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.060s
I20260709 12:26:08.424038  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:08.424690  6039 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:08.392829 11043 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:08.427886 11188 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.267s	user 0.001s	sys 0.000s
I20260709 12:26:08.397461 10814 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:26:08.415804 10944 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:08.419124 11125 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:08.464798 11189 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:08.465401 11189 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.465862  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:08.466531  6647 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:08.421026 11153 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:08.444854 10821 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:08.448292 11190 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:08.468199 11190 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:08.468917 11189 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:08.450053  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 2542) took 1111 ms. Trace:
I20260709 12:26:08.454720 11047 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.415238 10878 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.469059 11190 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.469544  6041 rpcz_store.cc:276] 0709 12:26:07.339087 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:07.339254 (+   167us) service_pool.cc:224] Handling call
0709 12:26:08.449811 (+1110557us) spinlock_profiling.cc:243] Waited 588 ms on lock 0x7b540030e3d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:08.449952 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1353163136}
I20260709 12:26:08.470489 11190 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:08.471275  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:08.456851 10869 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:08.424695 11120 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.474017 11120 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:08.426935 11031 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:08.474651 11031 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.475049 11031 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:08.475416  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:08.476150  6651 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 15: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:08.477253  6648 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:08.479167 11039 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:08.480674  5964 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:08.466362  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:08.425043  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:08.482879  6035 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:08.483695  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:08.484289  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:08.485034  6037 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:08.482378  6646 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:26:08.425830 10996 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.494808 10996 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:08.471290 10878 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:08.496997 10996 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:08.499812  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:08.511251  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:08.518515  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:08.552312  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:08.553417  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:08.554028  6649 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:08.522220  6036 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:08.554728  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:08.554917  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:08.522120 10814 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.555933 11049 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.522843  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:08.555599 10814 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:08.557843  6611 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:08.558534 10700 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:08.559098 10814 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:08.555598  6109 raft_consensus.cc:2368] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12.
I20260709 12:26:08.560508  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:08.561084  6112 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:08.559188 10700 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:08.561702 10700 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:08.562101 10700 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:08.562749  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:08.563431  6109 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:08.523628  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:08.564221  6041 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:08.527799  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:08.516316  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:08.510154 11121 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:08.533872  6038 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
W20260709 12:26:08.567726  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:08.568385  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:08.571697  6112 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:08.574023  6109 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 7. Current term is 8. Ops: [7.5-7.5]
I20260709 12:26:08.575729  6109 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:26:08.576788  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:08.578698  6042 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:26:08.580210  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:08.580793  6648 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:08.583069  6648 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:26:08.587739  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:08.588348  6118 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:08.588646 10851 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.589259 10851 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.561318  6649 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:08.590520  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:08.591077  6118 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:08.592170 10851 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:08.593744 10700 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.594805  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:08.596184  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:08.597899 11130 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:08.598308 11130 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.598703 11130 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:08.602741 11163 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:08.587502 11136 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:08.607510 11136 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:08.607904 11130 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.539125 11164 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:08.624693  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:08.625058 11164 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.625388  6109 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:08.625480 11164 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:08.626056 11130 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:08.626689  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:08.627382  6109 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:08.542784  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:08.542915 11043 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:08.554126  6116 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:08.556491 11049 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.631085  6109 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:08.608521 11125 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:08.609706  6111 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 5. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:26:08.656427  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:08.610634  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:08.657819  6113 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:08.611610  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:08.658819  6117 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:08.615293  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:08.597409  6118 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:08.537889 11031 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:08.536325  6646 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
W20260709 12:26:08.628777  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 369524us
I20260709 12:26:08.635352  6611 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:08.657138  6035 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
W20260709 12:26:08.664218  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 48983.8us
I20260709 12:26:08.665053  6009 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:08.666813  6042 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:26:08.667719  6009 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:08.668545  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:08.669273  6039 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:08.661885  5934 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:08.670620  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:08.670353  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:08.678550 10823 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:08.679181  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:08.679881  6035 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:08.673000 11136 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:08.672879 10814 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:08.683926 10700 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:08.684691  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:08.685387 11049 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:08.709220  6036 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 15: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:08.686913  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:08.708760  6643 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:08.671672  6611 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:08.703649  6009 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:08.712107  6009 leader_election.cc:400] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12.
I20260709 12:26:08.712409  6009 leader_election.cc:403] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:08.713550  6082 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:08.714506  6651 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:08.715508 10865 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:26:08.706626  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 44848.2us
I20260709 12:26:08.709882  6646 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:08.718663 10884 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:08.719226 10884 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:26:08.716555  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 462986us
I20260709 12:26:08.720144 10884 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:08.718606 11170 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:08.723209 11170 raft_consensus.cc:697] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:08.720113  5932 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:08.685434 11031 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:08.726280 11120 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:08.590090 10944 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:08.730669  6082 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:08.732594  6009 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:08.731182  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:08.737385  5932 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:08.745903  6009 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:08.706552 11189 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.709148 11177 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:08.706840 11136 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.757359 10814 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:08.762790  6009 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:08.765350  6084 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:08.730348 10823 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.732193 10865 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:08.731398 11190 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:08.769614  5932 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:08.764365  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:08.755322 11135 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:26:08.772627 11124 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:08.757771 11031 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:08.709371 11141 consensus_queue.cc:1059] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:26:08.687450 11121 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.079s
I20260709 12:26:08.757041 10996 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:08.771817 10823 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:08.777335  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:08.773056 10865 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:08.786918  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:08.709005 11129 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:26:08.767087 11120 raft_consensus.cc:2764] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election decision vote started in defunct term 8: won
I20260709 12:26:08.770171 11136 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:08.768347 11056 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:08.757227 10700 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:26:08.784622  6643 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:08.770488 10814 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:08.773214 11190 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:08.771490 11043 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:08.779861  5932 leader_election.cc:400] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11.
I20260709 12:26:08.755564 11163 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:26:08.760646 11177 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.756775 11189 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.789096  6118 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:26:08.789901  6009 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:08.776088 11161 raft_consensus.cc:697] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:08.791839  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:08.788264  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:08.790416  6611 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:08.776268 11124 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.794611 10821 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:26:08.781168 10869 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:08.793234 10825 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.044s
I20260709 12:26:08.800289 11043 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.793468 11127 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:08.781349 11049 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.019s
I20260709 12:26:08.771661 11083 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:26:08.823848 11177 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:08.836177  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48004.1us
I20260709 12:26:08.819562 11130 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.800248 10814 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:08.781879 11199 raft_consensus.cc:2764] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:26:08.837623 10869 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:08.862181  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 93638us
I20260709 12:26:08.863369  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:08.838572 11139 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:08.792976 11164 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.779803 11170 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:08.819517 11190 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:08.798106 11200 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:26:08.837138 11124 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:08.839432 11043 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:08.839475 11127 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:08.833448  6009 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:08.823752  5932 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:08.839973 11120 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:08.843948 10825 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:08.859161 11125 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:08.963835  6111 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:08.962158  5934 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:08.867484 10869 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:08.973649 11203 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:26:08.876538 11139 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:08.978919  6109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:08.983922 11161 consensus_queue.cc:237] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 8.5, Last appended by leader: 5, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:08.962726 11091 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:26:08.973829 11175 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.109s	user 0.000s	sys 0.005s
I20260709 12:26:08.990695 10944 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:08.939940 11189 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:08.960999 11138 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:08.993361 10865 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:08.860158 11130 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.011086  6109 raft_consensus.cc:606] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:09.012917  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:09.004710 11200 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election won for term 8
I20260709 12:26:09.004873 10825 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:09.010833 11139 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:09.011654 11203 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:09.008677 10821 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:09.001444  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:09.020071  6109 raft_consensus.cc:614] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:09.004208  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 180518us
I20260709 12:26:09.046360  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:09.047889  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:09.011732  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 49678.3us
I20260709 12:26:09.007045 11164 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:09.052109  5959 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:09.013794 11091 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:09.004549 11120 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:09.055382  6611 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:09.049059  5960 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:09.049654  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:08.999540 11204 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.060s	user 0.004s	sys 0.000s
I20260709 12:26:09.019521 10865 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:09.080358  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:09.081005  5959 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:09.081684  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:09.082268  6118 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:09.064419  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:09.002988 11127 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:09.079659  5960 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 14 index: 7. (index mismatch)
I20260709 12:26:09.086627  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:09.087215  5964 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:09.083781  6117 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:09.079701  5967 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:09.079901  6113 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:09.082505  6608 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:09.091223  6608 leader_election.cc:400] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11.
I20260709 12:26:09.092221  6608 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:09.094961  6006 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:09.096367  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:09.085552  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:09.104274  6118 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:09.104830  5961 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:26:09.106526  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:09.107183  6036 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:09.037668 11121 consensus_queue.cc:1243] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer 24012af7747d4c4ea89c3da2ff950099 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:26:09.109066  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:09.114696  6110 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:09.118492  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:09.115840  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:09.125551  5964 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:09.121235  5934 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:09.114529  5963 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:09.135854 10944 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:09.079078 11203 raft_consensus.cc:697] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:09.136515 10944 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:09.137198 11203 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:09.139720 11130 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:09.141804  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:09.141577 11091 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.148962 11043 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.080056 11200 raft_consensus.cc:697] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:09.151223 11200 consensus_queue.cc:237] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 7.5, Last appended by leader: 5, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:09.147145 11199 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:09.153132 11199 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:09.153549 11199 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:09.154853 11041 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:09.155803 11041 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:09.161429  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:09.162714 11129 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:09.163316 11129 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:09.163950 11129 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:09.133370 10825 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.092710 10869 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.167271 10869 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:09.168001 10996 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:09.109522 11164 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:09.168781 11164 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:09.169163 11164 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:09.170589 11120 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.111725 11202 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.172231 11202 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.014946 11138 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.085871 11011 consensus_queue.cc:1059] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.097s
I20260709 12:26:09.168424 10996 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:09.177989 10996 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.183759  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:09.184417  6040 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:09.198091  6114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:09.198855  6114 raft_consensus.cc:606] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:09.199232  6114 raft_consensus.cc:614] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:09.198570  6118 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:26:09.189805  6611 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:09.137840 10944 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:09.163683  6109 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:09.115084 11180 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:09.240216  5959 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:26:09.161895 11177 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.244015  5965 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 9 index: 6. (index mismatch)
I20260709 12:26:09.242569 11083 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.010s
I20260709 12:26:09.253274 11083 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:09.253674 11083 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:09.254540 11083 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:09.255761 11083 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:09.258018  6113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b70d6df693140769deef828413df1ba"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:09.258955  6113 raft_consensus.cc:606] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:09.260129  6117 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:09.261965  5934 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:09.250437  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:09.263480  5959 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:09.244345  5964 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:09.213778 10286 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:09.212709 10996 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:09.154199 11136 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.295212 10884 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.278920 10869 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.154448 11199 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:09.310151  5964 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:09.264905 11180 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:09.311836  6036 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
W20260709 12:26:09.313045  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 479665us
I20260709 12:26:09.283025 10286 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:09.320696  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:09.284339 11028 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:09.320853  6009 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:09.284119 11030 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:09.323838 10286 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:09.328684  6082 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:09.324137  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:09.331205  6041 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:26:09.332453  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:09.291697 10878 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:09.321816 10823 consensus_meta.cc:287] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.525s	user 0.005s	sys 0.008s
I20260709 12:26:09.310341 11043 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:09.322970 11215 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:09.337086 11047 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:09.321036 10884 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:09.329063 11121 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
W20260709 12:26:09.389783  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 334544us
I20260709 12:26:09.312806 11124 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:09.381306  6040 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:09.348251 11199 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:09.321878 10869 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:09.338313 11170 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:26:09.335497 11030 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:09.351202 11011 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:09.340956 10878 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:09.413563 11211 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 12:26:09.415262 10825 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:09.419221 11208 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.291s	user 0.001s	sys 0.001s
I20260709 12:26:09.342263 11214 consensus_queue.cc:1059] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.070s
I20260709 12:26:09.395166 11201 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:09.431079 11201 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:09.435388  6646 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:09.395864 11169 raft_consensus.cc:3055] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:09.439215  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:09.345136 10823 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.448136  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:09.401425 11047 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:09.451756  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:09.459200  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:09.463616  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:09.441396 11121 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:09.439190 11169 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:09.411180 11130 consensus_queue.cc:1059] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.058s
I20260709 12:26:09.435032 11049 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:26:09.450268 11202 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:09.470178 11135 consensus_meta.cc:287] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.694s	user 0.008s	sys 0.006s
I20260709 12:26:09.459740 11138 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:09.498207  5962 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: []
W20260709 12:26:09.493463  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:09.496484  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 404310us
I20260709 12:26:09.447809 11141 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.042s
I20260709 12:26:09.502354  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:09.406906 11180 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.476374 11011 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:09.460443 11218 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.053s
I20260709 12:26:09.504894 11202 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.506891 11222 raft_consensus.cc:3055] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:09.504176 11056 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:09.505182 11135 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 11. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12.
I20260709 12:26:09.508848 11041 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:09.492370 11177 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:09.527063  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:09.551945  6608 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:09.537111  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:09.553588  6608 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:09.530089 11136 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:09.544034 11222 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:09.584786  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 245056us
I20260709 12:26:09.540779 11220 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:09.600404  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 154600us
I20260709 12:26:09.601163  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:09.601831  6118 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:09.612236  6114 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:09.521675 11091 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.064s
I20260709 12:26:09.579243 11189 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:09.618422  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:09.619527  6043 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:26:09.624238  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:09.625459  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:09.626003  6043 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:09.618114  6044 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:09.640654  6118 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:26:09.545925 11202 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.630672  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:09.611694 11232 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:09.600553 11028 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:09.539526 11047 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:09.643703  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:09.682246  6042 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:09.683383  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:09.684100  6042 raft_consensus.cc:2393] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 14: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:09.687589 11202 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:09.712711  6037 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: [17.10-17.10]
I20260709 12:26:09.552729 11169 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:09.639570 10814 consensus_meta.cc:287] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.774s	user 0.001s	sys 0.014s
I20260709 12:26:09.613674 11224 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.589109 11227 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.089s
W20260709 12:26:09.688326 11209 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:26:09.641209 11189 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:26:09.734140  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 191893us
I20260709 12:26:09.665905 10825 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:09.659410 11124 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:09.688309 10869 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:09.670085 10884 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:09.719677 11221 log.cc:927] Time spent T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
W20260709 12:26:09.755394  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 201852us
I20260709 12:26:09.668992 10823 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:09.744151 11224 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.589047 11011 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:09.796617 11224 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:09.742838  6036 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:09.719410 11202 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:09.787019 11239 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
W20260709 12:26:09.787801 11238 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.063s	user 0.000s	sys 0.001s
W20260709 12:26:09.788193  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 49142.6us
I20260709 12:26:09.738343 11161 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:09.743574 11120 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:09.800189  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:09.791437 11246 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:09.792305 11028 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:09.738171 10814 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:09.793761 11189 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:09.778762 11203 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.635s	user 0.022s	sys 0.005s
I20260709 12:26:09.766983 10878 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:09.836572  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:09.838132  6647 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: [10.10-12.11]
I20260709 12:26:09.839854  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:09.837291  6648 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:09.843940  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:09.845760  6642 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16. Ops: []
W20260709 12:26:09.807870 11190 consensus_meta.cc:287] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.792s	user 0.014s	sys 0.000s
I20260709 12:26:09.806298 10825 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:09.878772  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:09.879434  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:09.881366  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:09.885465  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:09.831701 11203 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.023s	sys 0.005s
I20260709 12:26:09.910863  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:09.911772  6036 raft_consensus.cc:2410] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 9 because replica has last-logged OpId of term: 7 index: 5, which is greater than that of the candidate, which has last-logged OpId of term: 5 index: 4.
I20260709 12:26:09.921510  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:09.926111  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 98682us
I20260709 12:26:09.927337 11224 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:09.886801 10851 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:09.812569 11161 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.812467 11120 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.963435  6648 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:26:09.882936 11190 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.874701 11202 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:09.968770  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:09.972937  6043 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:09.908222 11136 consensus_queue.cc:1059] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.060s
I20260709 12:26:09.906806 11135 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.053s
I20260709 12:26:09.958550 11251 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:10.046502 10286 consensus_meta.cc:287] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.717s	user 0.007s	sys 0.003s
I20260709 12:26:10.060972  6644 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:09.959520 10851 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.064359  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:09.959156 11224 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.047399 11124 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:10.072552  6644 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:10.050058 11200 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.053912 11246 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.076675 11136 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:10.081457 11215 raft_consensus.cc:3055] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:10.083603 11124 raft_consensus.cc:697] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:10.119004  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 299451us
I20260709 12:26:10.070611 10286 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.125062 11215 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:10.145052 11226 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.302s	user 0.001s	sys 0.000s
I20260709 12:26:10.145732 11253 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.145983 11215 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.146337 11253 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.122373 11170 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:26:10.146440  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2413) took 1123 ms. Trace:
I20260709 12:26:10.152827  6646 raft_consensus.cc:2393] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 12: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:26:10.154448 11228 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.329s	user 0.000s	sys 0.001s
I20260709 12:26:10.155684 11120 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:10.158160 10996 consensus_meta.cc:287] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.868s	user 0.009s	sys 0.001s
W20260709 12:26:10.150349 11083 consensus_meta.cc:287] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.894s	user 0.007s	sys 0.006s
I20260709 12:26:10.150880 11170 consensus_queue.cc:1243] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer 0069e2ba1f02412e8e1d6c20a1fb510f log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
W20260709 12:26:10.152036  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.148708 11253 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:10.152122 11129 consensus_meta.cc:287] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.988s	user 0.008s	sys 0.004s
I20260709 12:26:10.163369 11129 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.166070 11129 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:10.147639 11247 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.190s	user 0.000s	sys 0.001s
I20260709 12:26:10.149590 10286 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.152563  6038 rpcz_store.cc:276] 0709 12:26:09.023420 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.023517 (+    97us) service_pool.cc:224] Handling call
0709 12:26:09.023786 (+   269us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:09.027601 (+  3815us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:09.027632 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:09.028106 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:26:09.549824 (+521718us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:09.549868 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:09.549939 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:10.146204 (+596265us) raft_consensus.cc:1685] finished
0709 12:26:10.146224 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:10.146362 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3436,"raft.queue_time_us":89908,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":5044,"thread_start_us":463492,"threads_started":1,"wal-append.queue_time_us":625252}
I20260709 12:26:10.147419 11215 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:10.085042 11200 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.125358 11136 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:10.150442 10821 consensus_meta.cc:287] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 1.096s	user 0.010s	sys 0.005s
W20260709 12:26:10.205241  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 62663.8us
I20260709 12:26:10.173983 11056 raft_consensus.cc:3055] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:10.064440 11251 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.159703 11124 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.226543  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:10.214395  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 293105us
I20260709 12:26:10.214993  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:10.228972  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:10.229737  6040 raft_consensus.cc:2368] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13.
I20260709 12:26:10.180255 10814 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.221930  6114 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:26:10.217303 11228 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.062s	user 0.005s	sys 0.005s
I20260709 12:26:10.259456  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:10.278172  5961 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:10.122406 11246 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.289132  6113 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:26:10.289258  6609 leader_election.cc:400] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13.
I20260709 12:26:10.290587  6609 leader_election.cc:403] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
I20260709 12:26:10.276718 10286 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:10.214275 11120 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:10.217064 10821 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:10.076128 10825 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.218255 11056 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:10.216789 11234 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.095s
I20260709 12:26:10.374899  6042 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:26:10.374855  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:10.294479  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:10.383250  5965 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:10.386036  5961 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
W20260709 12:26:10.307493 11245 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.170s	user 0.000s	sys 0.000s
W20260709 12:26:10.294633 11261 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 12:26:10.308310 11250 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.192s	user 0.000s	sys 0.000s
W20260709 12:26:10.431792  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 187079us
I20260709 12:26:10.443114  6608 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:10.292773 11247 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:26:10.382058  6109 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:10.310384 11249 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.295603 11200 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.296680 11136 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:10.294169 11236 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.222s	user 0.000s	sys 0.001s
I20260709 12:26:10.309466 11271 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:10.431150 10996 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.466086 10996 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.468179 10996 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.468763 11268 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:10.469348 11268 raft_consensus.cc:697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:10.470275 11268 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.431288 11028 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.476929 11028 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.478185 11246 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.480918  6644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 1382) took 1034 ms. Trace:
I20260709 12:26:10.481455  6644 rpcz_store.cc:276] 0709 12:26:09.446427 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.447871 (+  1444us) service_pool.cc:224] Handling call
0709 12:26:10.480702 (+1032831us) spinlock_profiling.cc:243] Waited 612 ms on lock 0x7b54000e01d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:10.480846 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1407909120}
I20260709 12:26:10.458091 11056 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.488032 11056 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:10.434191 11190 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.473723 11224 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:10.492115  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:10.492702 11139 consensus_meta.cc:287] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 1.413s	user 0.006s	sys 0.011s
I20260709 12:26:10.493148 11139 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.493574  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:10.494179  6113 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:26:10.496995  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:10.494230  6649 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:10.458591  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.444809 10944 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.501288 10944 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.476068 11262 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.503185 11262 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.505607 11262 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:10.433454 10286 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:10.445050 11026 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.380996 11120 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.446607 11161 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.441610 11220 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13.
W20260709 12:26:10.475482 11217 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 1.134s	user 0.000s	sys 0.004s
I20260709 12:26:10.475919 11271 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:10.492161 11127 consensus_meta.cc:287] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 1.379s	user 0.007s	sys 0.008s
I20260709 12:26:10.500325  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:10.500471 11203 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:10.508872  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:10.514070  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.463227 10869 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.528676  6109 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 15 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
W20260709 12:26:10.507671 11164 consensus_meta.cc:287] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 1.338s	user 0.012s	sys 0.005s
I20260709 12:26:10.495666 11202 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.641048 11202 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:10.640875 11164 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.641551 11202 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:10.642647 11255 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.175s	user 0.007s	sys 0.012s
I20260709 12:26:10.643043 11164 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.643539 11202 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.643740  6044 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:10.634174  6113 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 5 index: 4. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:26:10.645615  6044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2561) took 1018 ms. Trace:
W20260709 12:26:10.646473 11244 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.490s	user 0.000s	sys 0.001s
I20260709 12:26:10.645959  6044 rpcz_store.cc:276] 0709 12:26:09.626993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.639285 (+ 12292us) service_pool.cc:224] Handling call
0709 12:26:09.639587 (+   302us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:10.644099 (+1004512us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:10.645383 (+  1284us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54000d8254. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:10.645558 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2308939520}
W20260709 12:26:10.648904 11257 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.501s	user 0.002s	sys 0.001s
I20260709 12:26:10.651031  6116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2834) took 1566 ms. Trace:
I20260709 12:26:10.651393  6116 rpcz_store.cc:276] 0709 12:26:09.084353 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.084773 (+   420us) service_pool.cc:224] Handling call
0709 12:26:09.085103 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:09.401813 (+316710us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:26:09.660921 (+259108us) log.cc:844] Serialized 14 byte log entry
0709 12:26:09.873630 (+212709us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:09.874104 (+   474us) log.cc:844] Serialized 26 byte log entry
0709 12:26:09.874230 (+   126us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:09.874262 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:09.874325 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:10.648295 (+773970us) spinlock_profiling.cc:243] Waited 48.4 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:10.650690 (+  2395us) raft_consensus.cc:1685] finished
0709 12:26:10.650797 (+   107us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:10.650947 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":43019,"prepare.queue_time_us":391054,"prepare.run_cpu_time_us":31,"prepare.run_wall_time_us":32,"raft.queue_time_us":256687,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":12136,"spinlock_wait_cycles":111428480,"thread_start_us":573739,"threads_started":3,"wal-append.queue_time_us":409355}
W20260709 12:26:10.585000 11223 log.cc:927] Time spent T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.169s	user 0.001s	sys 0.004s
I20260709 12:26:10.652727  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2830) took 1592 ms. Trace:
I20260709 12:26:10.663133 11251 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.662562  6111 rpcz_store.cc:276] 0709 12:26:09.060806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.061034 (+   228us) service_pool.cc:224] Handling call
0709 12:26:09.061372 (+   338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:09.439403 (+378031us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:09.439434 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:09.448402 (+  8968us) log.cc:844] Serialized 26 byte log entry
0709 12:26:09.617921 (+169519us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:09.618213 (+   292us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:09.618533 (+   320us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:10.645882 (+1027349us) spinlock_profiling.cc:243] Waited 23.5 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:10.652439 (+  6557us) raft_consensus.cc:1685] finished
0709 12:26:10.652459 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:10.652673 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":73399,"raft.run_cpu_time_us":93,"raft.run_wall_time_us":93,"spinlock_wait_cycles":54117760,"thread_start_us":546383,"threads_started":2,"wal-append.queue_time_us":660556}
I20260709 12:26:10.583192 11224 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:10.583611 11242 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.304s	user 0.003s	sys 0.002s
I20260709 12:26:10.453205 11249 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:10.666879  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.630632 11161 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:26:10.668632  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 171722us
W20260709 12:26:10.525939 11250 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:26:10.541254 11135 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:10.511765 11138 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.155s
I20260709 12:26:10.673877  6649 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:10.583139 11141 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:10.666118 11047 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.006s	sys 0.032s
I20260709 12:26:10.680192  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 1707) took 1384 ms. Trace:
I20260709 12:26:10.668138 11177 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.685497  6114 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:26:10.681902 11135 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.680560 11220 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:10.678779 11251 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:10.674945  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:10.707485 11280 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:10.707948 11280 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.708289 11280 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:10.678323 11161 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:10.708770 11161 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:10.708145 11138 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 4, Time since last communication: 0.001s
I20260709 12:26:10.672034 11274 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:10.710739 11274 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:10.705400 11047 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.589s	user 0.014s	sys 0.034s
I20260709 12:26:10.708448 11125 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:10.719023 11274 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:10.706633 11177 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.722359 11177 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.707178 11220 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.725852 11220 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.670250 10814 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.529454 11026 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.671315 11224 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.671485 10821 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.675956 11124 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.680732 10286 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.731820 10814 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.730926 11141 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.734741 11249 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:10.681157  6035 rpcz_store.cc:276] 0709 12:26:09.296142 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.300693 (+  4551us) service_pool.cc:224] Handling call
0709 12:26:09.301149 (+   456us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:09.301527 (+   378us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:09.301557 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:09.302120 (+   563us) log.cc:844] Serialized 26 byte log entry
0709 12:26:09.546240 (+244120us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:09.546286 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:09.546358 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:10.679994 (+1133636us) raft_consensus.cc:1685] finished
0709 12:26:10.680014 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:10.680134 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1249,"raft.run_cpu_time_us":115,"raft.run_wall_time_us":116,"thread_start_us":243717,"threads_started":1,"wal-append.queue_time_us":632326}
I20260709 12:26:10.735688  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2829) took 1675 ms. Trace:
I20260709 12:26:10.633494 11127 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.768600  6115 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:26:10.768216 11124 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.769958 11127 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:10.777045  6112 rpcz_store.cc:276] 0709 12:26:09.060415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.060954 (+   539us) service_pool.cc:224] Handling call
0709 12:26:09.081167 (+ 20213us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:09.500858 (+419691us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:09.500887 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:09.506781 (+  5894us) log.cc:844] Serialized 26 byte log entry
0709 12:26:09.642629 (+135848us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:09.821791 (+179162us) log.cc:844] Serialized 14 byte log entry
0709 12:26:09.873405 (+ 51614us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:09.873543 (+   138us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:10.735341 (+861798us) raft_consensus.cc:1685] finished
0709 12:26:10.735361 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:10.735600 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":50635,"prepare.queue_time_us":152079,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":186138,"raft.run_cpu_time_us":213,"raft.run_wall_time_us":89226,"thread_start_us":600862,"threads_started":3,"wal-append.queue_time_us":534150}
I20260709 12:26:10.780884 11141 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.786538 11177 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:10.792752 11177 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.795032 11177 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.783109 10814 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.773275 11124 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.667330 10869 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.734604 11253 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:10.806970  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 189652us
I20260709 12:26:10.707170 11251 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.739116 11135 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.739913 11028 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:10.811461 11199 consensus_meta.cc:287] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 1.409s	user 0.012s	sys 0.000s
I20260709 12:26:10.737757 11271 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:10.806423 11215 consensus_meta.cc:287] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.592s	user 0.007s	sys 0.002s
I20260709 12:26:10.805866 11139 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.819272 11249 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:10.811614 11026 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.801950 10821 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.833500  5964 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
W20260709 12:26:10.846308  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.822134 11252 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.818989 11135 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:10.820459 10944 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.809700 11253 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.840878 11127 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:10.838635 11047 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:10.828053 11201 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.825311 11249 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.852715 11241 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:10.828639 11275 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:26:10.853431 11180 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:10.829350 11120 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.828462 11215 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:10.829679 11030 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.835552 11139 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:10.844715 11274 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.866515  6084 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:10.851459 10286 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:10.853451 11164 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:10.860113 10825 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:10.881702  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.872947 11041 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.879555 11263 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:10.887640 11202 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:10.888281 11202 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.888700 11249 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.890247 11202 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.873117 11241 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.882248 11139 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.869542 11047 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.892087  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:10.892473 11241 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.892706  5959 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:10.882622 10286 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.893489 10821 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.894066  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:10.894799  5959 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:10.879994 11215 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.895359 10286 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.895974  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:10.896561  5959 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:26:10.897217 10869 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:10.900861  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:10.901404  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2836) took 1816 ms. Trace:
I20260709 12:26:10.854710 11252 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.901836  6115 rpcz_store.cc:276] 0709 12:26:09.084993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.085100 (+   107us) service_pool.cc:224] Handling call
0709 12:26:09.085408 (+   308us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:10.769105 (+1683697us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:10.901126 (+132021us) spinlock_profiling.cc:243] Waited 1.68 s on lock 0x7b540020bf54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:10.901334 (+   208us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3870336384}
I20260709 12:26:10.903724 11252 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:10.863336 11127 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.906139 11127 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.858136 11135 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.907498 11219 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:10.908023 11219 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:10.908763 11135 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.908915 11219 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.881394 11274 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.910072 11219 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:10.911547 11274 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:10.912791 11280 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.914651 11270 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.915210 11270 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.915683 11202 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.890167 11251 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.916193 11202 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.916859 11251 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:10.917563 11270 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.918293 11202 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.918776 11011 raft_consensus.cc:3055] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:10.919186 11011 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:10.896593 11215 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.917337 11251 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.920871  6044 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:10.922732 11202 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.923202 11280 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.920061 11011 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.923209 11202 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:10.924201 11011 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:10.925034 10851 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.925983  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2556) took 1309 ms. Trace:
I20260709 12:26:10.926366  6037 rpcz_store.cc:276] 0709 12:26:09.616243 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.618511 (+  2268us) service_pool.cc:224] Handling call
0709 12:26:09.618817 (+   306us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:09.718373 (+ 99556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:10.925743 (+1207370us) spinlock_profiling.cc:243] Waited 70.1 ms on lock 0x7b540028f0d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:10.925928 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":161238784}
W20260709 12:26:10.927280 11231 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 1.102s	user 0.007s	sys 0.012s
I20260709 12:26:10.882730 11164 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.932509 11164 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.901582  5965 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:26:10.934340  6115 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:26:10.945325  6109 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:26:10.947947  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.955538  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:10.956235  6114 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:10.922299 11251 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.959158  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:10.925432 11202 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.892648 11139 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:10.963105  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:10.964564  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:10.965139  6043 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 5. Preceding OpId from leader: term: 10 index: 6. (index mismatch)
I20260709 12:26:10.964078  6044 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 8 index: 6. (index mismatch)
I20260709 12:26:10.965302  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:10.964162 11271 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:10.926849 10878 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:26:10.970185  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:10.877272 11180 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:10.945133 11224 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:10.951243 11189 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.773s	user 0.007s	sys 0.001s
I20260709 12:26:10.974850  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:10.975864  6649 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 1383) took 1469 ms (client timeout 1707 ms). Trace:
I20260709 12:26:10.977633  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:10.972296  6038 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
W20260709 12:26:10.979143  6649 rpcz_store.cc:269] 0709 12:26:09.506242 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.506516 (+   274us) service_pool.cc:224] Handling call
0709 12:26:10.975678 (+1469162us) spinlock_profiling.cc:243] Waited 941 ms on lock 0x7b5400824bd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:10.975786 (+   108us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2164795264}
I20260709 12:26:10.979925  6043 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:10.885337 11161 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:10.935741 10825 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:10.986133  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:10.993121  6114 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:10.993640 11241 consensus_queue.cc:1059] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:10.994380  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:10.995280  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:10.995776  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:10.885403 11041 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:10.979266 11189 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.801s	user 0.008s	sys 0.001s
I20260709 12:26:10.970957 11253 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:10.996507  6114 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:26:11.006628  6038 raft_consensus.cc:2393] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 14: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:11.007601  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:10.979420 11271 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.010224 11289 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:11.011822 11289 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:11.013193  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:10.982637 11164 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.014942  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:11.022763  6111 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:11.019028  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.024012  6114 raft_consensus.cc:2410] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 11 because replica has last-logged OpId of term: 8 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 7.
I20260709 12:26:11.011986 11028 raft_consensus.cc:3055] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:26:11.033907  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.037909  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.036576  5934 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:11.015166 11263 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:11.043810  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:11.029666 11229 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.031414 11202 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:11.046519  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:11.032928 11241 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:11.030750 11028 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:11.069584  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:11.042419  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:11.071947  6649 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 15: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:11.051863  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.035600 11280 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.091051  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:11.058139  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.051797  6111 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:26:11.074644  6642 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:11.083344  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.091741  6648 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:26:11.052835 11251 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:11.077411 10825 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.052578 11139 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:11.078989  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.082762  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.103001  6646 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:11.083014  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.083756 11296 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:11.083994 11291 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:26:11.090196  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:11.012485 11289 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:11.087123  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 50636.9us
I20260709 12:26:11.127946  6608 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:11.082213  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.057107 11229 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.130621  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.131965  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.132835  6042 raft_consensus.cc:2410] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 18 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:26:11.132612 11200 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:11.129226  5934 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:11.134440 11284 consensus_queue.cc:1059] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.039s
I20260709 12:26:11.043125 11189 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.031654 11164 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.088182 11041 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:11.084102 11234 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:11.117851 11283 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:11.122751 11263 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.125211 11180 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:11.117344  5993 heartbeater.cc:646] Failed to heartbeat to 127.4.181.126:41341 (0 consecutive failures): Timed out: Failed to send heartbeat to master: TSHeartbeat RPC to 127.4.181.126:41341 timed out after 15.000s (SENT)
I20260709 12:26:11.087469 11083 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:11.136768  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.136973  6040 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 17 index: 9. (term mismatch)
I20260709 12:26:11.138806  6042 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:11.097760  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:11.044625 11120 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.059s
I20260709 12:26:11.087248 11218 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:11.240589 11218 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.241977 11271 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.132050 11289 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:11.103297 11030 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.134s
I20260709 12:26:11.188613 10825 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:11.141178  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.142680  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:11.149261  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.236296  6040 pending_rounds.cc:85] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 8
I20260709 12:26:11.191309  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.192072  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:11.253786  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 46629us
W20260709 12:26:11.254282  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 156605us
I20260709 12:26:11.255260 11041 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.255817 11041 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.257829 11041 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.258814 11030 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:11.252933  5966 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:11.194536  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.253845  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.260675  5965 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:11.085376 11138 consensus_queue.cc:1059] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.103s
I20260709 12:26:11.202754  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.190412  5963 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:11.238451  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.262042  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:11.206879  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.236196  5961 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:11.187916 11219 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:11.110478 11139 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:11.099223 11280 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.270406  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.085199 11028 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.260823  5960 raft_consensus.cc:2410] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:26:11.198612  6644 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:26:11.084507 11241 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.136327 11296 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.285223 11241 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:11.285807 11296 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:11.047813 11203 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.062s
I20260709 12:26:11.271636 11283 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:26:11.187312 11026 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:11.264730  6040 pending_rounds.cc:107] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 16.9
I20260709 12:26:11.189845 11234 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.101295 11251 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.287611  6040 raft_consensus.cc:2889] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:11.288369  6651 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:26:11.189183 11189 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.288897 11026 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.269444  6042 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 12 index: 7. (index mismatch)
I20260709 12:26:11.194226 10878 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:11.094173 11202 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.140391 11270 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.236590 11083 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:11.283437 10944 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.325405 11280 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.325577 10944 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:11.327320  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.328534 11083 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:11.289521  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.330884  6642 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:26:11.252795 10825 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:11.330847  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:11.287335 11283 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:11.332007  6611 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:11.327876 10944 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:11.335839  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 63351.9us
I20260709 12:26:11.366536  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:26:11.348351  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.369189  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1198) took 2265 ms. Trace:
I20260709 12:26:11.271778 11139 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:11.279662 11214 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.368948 10821 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:11.369577  5962 rpcz_store.cc:276] 0709 12:26:09.103603 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.103854 (+   251us) service_pool.cc:224] Handling call
0709 12:26:09.104123 (+   269us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:09.498751 (+394628us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:11.368717 (+1869966us) spinlock_profiling.cc:243] Waited 394 ms on lock 0x7b540008b454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:11.369090 (+   373us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":905887104}
I20260709 12:26:11.378404  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:11.378825  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.380988  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:11.381340  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:11.381541  5962 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:11.382408  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:11.371601  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.289354 11026 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:11.383538  6042 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:11.384011  5966 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:26:11.384533  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.385097  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:11.383167  5960 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 15: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:11.330176 11169 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:11.400915  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.401857  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:11.402613  6118 raft_consensus.cc:2368] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14.
I20260709 12:26:11.273053 11295 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:11.391603  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:11.403291 11295 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:11.403398  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:11.403759 11295 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:11.392129  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.392985  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:11.365955 11028 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:11.359701 11135 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:11.337401 10825 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:11.334323 11232 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:11.289335 11234 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:11.448261  6042 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: [10.10-10.10]
I20260709 12:26:11.336838 11164 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:11.399647  5966 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:11.450229  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.450160  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.408064  6116 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:11.451570  6646 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:11.289124 11251 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.333997 10878 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.355855 11218 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:11.272538 11219 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.411221  5965 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: [14.7-14.7]
W20260709 12:26:11.332998 11289 consensus_queue.cc:1175] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0557a7246c8945b99e5215c99d4ddf9c" responder_term: 15 status { last_received { term: 15 index: 9 } last_committed_idx: 8 last_received_current_leader { term: 15 index: 9 } }
I20260709 12:26:11.365733 11283 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:11.412593  6115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:11.356069 11202 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.442199  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.470150  6115 raft_consensus.cc:606] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:11.281232 11200 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.120s
I20260709 12:26:11.290980 11120 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.118s
I20260709 12:26:11.376490 11190 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:11.442203  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 7 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.447408  5962 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:11.401669 11030 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:11.443055 11232 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.456190 11026 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.373603 11280 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.070s
I20260709 12:26:11.458983  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.460489 11229 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.371548 11270 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.461858  6112 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:26:11.462118  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.401765 11056 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:11.468367  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:11.471344  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.471328  6113 raft_consensus.cc:2368] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11.
I20260709 12:26:11.473260  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.400470 10821 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.400460 11214 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:11.486850  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.494741  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.845484  6115 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:11.846143 11218 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:11.846618  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.846812 11218 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.848141  6115 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:26:11.464804 10944 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:11.482196 11189 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.850039 11218 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.532938 11283 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.851400  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.603545 11083 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.853291  5960 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
W20260709 12:26:11.614821  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.855170 11083 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:11.855633  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.854401 11056 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:11.871132  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 125978us
I20260709 12:26:11.868255  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.865778  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.476511  6116 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:11.856833  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.629096  5967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1195) took 2535 ms. Trace:
I20260709 12:26:11.852562  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:11.873781  5962 raft_consensus.cc:2410] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:26:11.873914  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.874895  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.875656  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.496676  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:11.474893  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.851159 11283 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:11.472290 11263 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.881335 11295 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.881494 11263 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.883528 11295 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.883670 11263 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:11.794216 11047 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:11.487092  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.865157 11270 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:11.515373 11011 consensus_meta.cc:287] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.591s	user 0.010s	sys 0.000s
I20260709 12:26:11.852770 11214 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.867646  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.867744  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.854067 11030 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:11.869313  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.512182  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:11.606982  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 1717) took 1161 ms. Trace:
I20260709 12:26:11.464570 10878 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:11.858244  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.576565 11121 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:11.901167  6035 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:11.878572  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.870741 10823 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.901225  6039 rpcz_store.cc:276] 0709 12:26:10.445986 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:10.446155 (+   169us) service_pool.cc:224] Handling call
0709 12:26:10.446443 (+   288us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:10.667598 (+221155us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:10.667627 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:10.667666 (+    39us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:10.667694 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:11.606718 (+939024us) spinlock_profiling.cc:243] Waited 221 ms on lock 0x7b54001ba654. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:11.606765 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:11.606918 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":508039424}
I20260709 12:26:11.902323 10823 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.902951  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.902818 11121 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.903553  6039 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:11.903646 11222 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.880776  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.661171 11125 raft_consensus.cc:3055] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:11.904670 11222 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:11.904758 11125 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:11.905087 11121 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.628629 11219 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.856927 10821 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:11.887626  6115 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:11.888628  6082 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:11.872335  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:11.896173  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:11.896294  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.896211  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.909592  6648 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 13: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:11.909579  6643 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:11.897446  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:11.868314  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.898487 11295 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:11.913362 11295 raft_consensus.cc:3055] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:11.913748  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.914673  6117 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:11.915174  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.915208  6117 raft_consensus.cc:606] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:11.915360  6647 raft_consensus.cc:2410] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 11 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:26:11.915805  6117 raft_consensus.cc:614] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:11.899652 11232 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.924881  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:11.925480  5962 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:11.926952  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.928095  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.906806 11030 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:11.510404 11234 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.880060  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.886848  6110 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:26:11.931834  6118 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:11.904357  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.910883  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.932890  6649 raft_consensus.cc:2410] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 12 because replica has last-logged OpId of term: 10 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 9.
I20260709 12:26:11.911478  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.912177  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.912719 11047 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:11.880635 11139 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.919474  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.920704 10996 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:11.922477 11056 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:11.922742 10944 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.923214 11026 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.913710 11295 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:11.942423 10944 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:11.942746 11295 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.943948 11295 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:11.940963  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 53842.4us
I20260709 12:26:11.873292  5967 rpcz_store.cc:276] 0709 12:26:09.094172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.101756 (+  7584us) service_pool.cc:224] Handling call
0709 12:26:09.102268 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:09.242752 (+140484us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:26:09.309869 (+ 67117us) log.cc:844] Serialized 14 byte log entry
0709 12:26:09.583635 (+273766us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:10.977259 (+1393624us) spinlock_profiling.cc:243] Waited 3.85 ms on lock 0x7b2c0001d508. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f94da11 00007f481f95d372 00007f482108fa01 00007f482105443a 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2
0709 12:26:10.977721 (+   462us) log.cc:844] Serialized 26 byte log entry
0709 12:26:11.028170 (+ 50449us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:11.028208 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:11.628728 (+600520us) spinlock_profiling.cc:243] Waited 74 ms on lock 0x7b540008a554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:11.628793 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:11.628853 (+    60us) raft_consensus.cc:1685] finished
0709 12:26:11.628867 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:11.629029 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26762,"prepare.queue_time_us":75429,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":34031,"raft.run_cpu_time_us":206,"raft.run_wall_time_us":23629,"spinlock_wait_cycles":179099136,"thread_start_us":300695,"threads_started":2,"wal-append.queue_time_us":509566,"wal-append.run_cpu_time_us":1809,"wal-append.run_wall_time_us":1116809}
I20260709 12:26:11.925560  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:11.949467  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:11.950194  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:11.932647  6039 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:11.908139 11121 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.951413  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.938112  5965 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:11.905596 11125 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.955065 11125 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:11.957748 11294 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.699s	user 0.001s	sys 0.001s
I20260709 12:26:11.958072 11234 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.958971  6647 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:26:11.936700 11047 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.959889 11047 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:11.962792  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:11.964540  6608 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:11.966040  6650 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:26:11.940308  5962 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:11.934974  6113 raft_consensus.cc:2410] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 16 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:26:11.918859 10821 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:11.937640  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.953660  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:11.970757  5967 raft_consensus.cc:2410] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 14 because replica has last-logged OpId of term: 13 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 8.
I20260709 12:26:11.966214  6611 leader_election.cc:400] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14.
I20260709 12:26:11.971457  6648 raft_consensus.cc:2376] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14. Re-sending same reply.
I20260709 12:26:11.971784  6081 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:11.972570  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.937373  6082 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:11.969635  6035 raft_consensus.cc:2410] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 16 because replica has last-logged OpId of term: 15 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
I20260709 12:26:11.971200  6611 leader_election.cc:403] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:26:11.951920 11056 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:11.976397  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.977044  6035 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:11.977106  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.977276  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.977789  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.978571  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.977999  5960 raft_consensus.cc:2393] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 12: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:11.979255  6043 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:26:11.979662  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.976729  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:11.980367  6609 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:11.980675  6035 raft_consensus.cc:2410] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 10 because replica has last-logged OpId of term: 9 index: 6, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 5.
I20260709 12:26:11.980741  6645 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:11.975585  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:11.981477  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:11.982329  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.982311  6611 leader_election.cc:400] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11.
I20260709 12:26:11.977785  6039 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:11.976596  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:11.985189  5965 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:11.985622  6006 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:11.986343  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.985847  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.989794  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:11.959923 11139 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:11.970629 10821 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.992086  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.993484  6609 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:11.987773 11218 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:11.997457  5964 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 2525) took 2684 ms (client timeout 1566 ms). Trace:
W20260709 12:26:11.997844  5964 rpcz_store.cc:269] 0709 12:26:09.313201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.313320 (+   119us) service_pool.cc:224] Handling call
0709 12:26:11.997244 (+2683924us) spinlock_profiling.cc:243] Waited 1.49 s on lock 0x7b54000f6c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:11.997342 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3424518400}
I20260709 12:26:11.998750 11246 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:11.999176 11246 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:11.999511 11246 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:11.999944  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:12.001047  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.001573  6044 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:26:11.987521 11251 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:11.976563 11056 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.002833 11251 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:12.003289 11251 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:11.987468 11270 consensus_queue.cc:1059] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 12.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.017s
I20260709 12:26:12.004570 11270 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:12.004959 11270 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:11.949437 10878 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.005699 11270 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:11.983186 11219 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.006750 11219 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:12.008392 10944 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.984890 11011 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:12.010528 11011 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:11.979669 11234 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:12.011849 11234 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:12.012255 11234 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:12.012328 10865 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.012929 10865 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:11.974604 11263 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:12.011883 11224 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.018733 11224 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:11.990149 11169 consensus_meta.cc:287] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.581s	user 0.008s	sys 0.001s
I20260709 12:26:11.983976 11258 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:12.023048 11215 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.023542 11215 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:12.026011 10825 consensus_meta.cc:287] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.576s	user 0.008s	sys 0.001s
I20260709 12:26:12.026551 10825 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.027465 10821 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:12.028020  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.026764 10944 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:12.033293  6081 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:11.984242 11214 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.045s
I20260709 12:26:12.028908  6646 raft_consensus.cc:2393] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:11.991575  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.029381  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:11.970894 11254 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:12.002342  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.043848  6084 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.036713  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:12.035816  6609 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:12.038934  6035 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:12.044751  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:12.049959  6084 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:12.047061  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:12.028779 10825 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:12.059319  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.065990  6041 raft_consensus.cc:2410] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:26:12.066282  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.057299  6084 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:12.066704  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:11.985460 11232 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14.
I20260709 12:26:12.070133  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:12.068935  6082 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:12.004452 11056 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:12.077837  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.081866  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.008967 11219 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:12.084748  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.087852  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.098181  6043 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:11.971632 11121 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.101426  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.065714 11139 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:12.046718 11169 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:12.066349 11253 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.066525 10996 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:12.068087 11225 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:12.069972 11271 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.068269 11263 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:12.065475 11229 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:12.070611 11130 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:12.099159 11270 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:12.142391  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.143450  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:12.070312 11227 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.083091 11218 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.146315  6039 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:12.101140 10851 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:12.011541 11011 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.145737 11169 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.160981 11246 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:12.065749 11254 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.144348 10996 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:12.112771 11127 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:12.145733 11258 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:12.206946  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:12.164975 10851 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:12.151175 11229 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:12.117890 11056 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:12.205765 10996 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:12.220970  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 11 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.221761  5960 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 15: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:26:12.230963  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.216173 11227 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:12.233011 11227 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:12.233451 11227 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:12.233656  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:12.218777  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:12.117328 11139 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:12.165529  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:12.251772  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:12.244879  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.251441  6112 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 16: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:12.235246  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:12.255080  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:26:12.255792  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.256405  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:12.152046 11271 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:12.208525 11127 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:12.218098 11229 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:12.208112 11215 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:12.263397  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.222551 10851 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:12.208343 11258 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:12.265115  6037 raft_consensus.cc:2410] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:26:12.254359 11139 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:12.266800  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.181197 11218 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.251291 11214 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.266263  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:12.263146 11170 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:12.256961 11219 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:12.264349 11127 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:12.303138  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.257145 11047 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:12.261279 11222 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.039s
I20260709 12:26:12.312947  6044 raft_consensus.cc:2410] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 17 because replica has last-logged OpId of term: 15 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 11.
I20260709 12:26:12.306547  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.269632 11215 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:12.295588 11219 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:12.295378 11170 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:12.309154  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:12.305375 11083 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.317965  5960 raft_consensus.cc:2376] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14. Re-sending same reply.
I20260709 12:26:12.316112  6043 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:12.320693 11083 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:12.321798 11047 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:12.322800  6651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50454 (request call id 1246) took 1269 ms. Trace:
I20260709 12:26:12.323171  6651 rpcz_store.cc:276] 0709 12:26:11.053195 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.053712 (+   517us) service_pool.cc:224] Handling call
0709 12:26:12.322640 (+1268928us) spinlock_profiling.cc:243] Waited 196 ms on lock 0x7b54006aead4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:12.322744 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":451147648}
I20260709 12:26:12.322997 11083 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:12.327320 11169 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:12.327944 11169 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:12.328441 11169 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:12.336704  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 193334us
I20260709 12:26:12.339337 11246 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:12.343199 11199 raft_consensus.cc:3055] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:12.343632 11199 raft_consensus.cc:740] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:26:12.392343  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.320013 11170 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:12.319911 11219 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:12.419057  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.419852  6043 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 7.
I20260709 12:26:12.319169 11263 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:12.337930 11169 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:12.298498 11214 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:12.431085  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.344305 11189 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:12.514398  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.541307  6643 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 12. Current term is 13. Ops: []
W20260709 12:26:12.543247 11317 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.122s	user 0.000s	sys 0.000s
I20260709 12:26:12.544834  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.545934  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:12.546895  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.546597 11199 consensus_queue.cc:260] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:12.547875 11199 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:12.547973  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:12.549098  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:12.549677  6117 raft_consensus.cc:2368] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15.
W20260709 12:26:12.549959 11030 consensus_meta.cc:287] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.610s	user 0.008s	sys 0.007s
I20260709 12:26:12.423609 10865 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:12.550347  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.553922  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.554988  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.555538  6117 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:12.556315  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.556574  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.556746 11127 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:12.557739  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:12.559152 10996 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:12.560806 10821 consensus_meta.cc:287] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.533s	user 0.012s	sys 0.003s
I20260709 12:26:12.561239 10821 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:12.562356  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:12.562724  6037 raft_consensus.cc:2368] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15.
I20260709 12:26:12.563078 11218 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:12.559383 11263 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.564663  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.565852  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:12.518306 11295 consensus_meta.cc:287] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.574s	user 0.012s	sys 0.007s
I20260709 12:26:12.546701 11254 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:12.482410 11222 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:12.570098  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.571666  6110 raft_consensus.cc:2368] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11.
I20260709 12:26:12.596364  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.596364  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.597647  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.600490  5962 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
W20260709 12:26:12.597779  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 341448us
I20260709 12:26:12.603056  6038 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:12.604467  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.604673  6117 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:12.605232  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.606950  6009 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:12.607054  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:12.421934 11121 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:12.607900  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:12.610150  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 2429) took 1208 ms. Trace:
I20260709 12:26:12.624963  6038 rpcz_store.cc:276] 0709 12:26:11.401673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.813847 (+412174us) service_pool.cc:224] Handling call
0709 12:26:12.597504 (+783657us) spinlock_profiling.cc:243] Waited 8.65 ms on lock 0x7b5800124298. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482601a0a0 00007f4826019984 00007f481f5946d4 00007f481f594662
0709 12:26:12.610095 (+ 12591us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":19889024}
I20260709 12:26:12.608361  6643 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:12.605679  6043 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:12.609337  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.550377 11030 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:12.611274 11214 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:12.623296 10821 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:12.622602 11218 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.630146  5966 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 15: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:12.620966  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 5 index: 4 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.627317  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.625792  5934 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.626893  5965 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 4.
I20260709 12:26:12.632467  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2969) took 1223 ms. Trace:
I20260709 12:26:12.634511  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.635309  6039 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:12.636445  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.637256  6043 raft_consensus.cc:2410] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 12 because replica has last-logged OpId of term: 10 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:26:12.637832  6037 raft_consensus.cc:2393] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 15: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:12.632774  5965 rpcz_store.cc:276] 0709 12:26:11.409157 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.595962 (+1186805us) service_pool.cc:224] Handling call
0709 12:26:12.632375 (+ 36413us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.639320  6645 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:12.641427  5934 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.643051  6611 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:12.644222  6611 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:12.648433  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.650514  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2424) took 1280 ms. Trace:
W20260709 12:26:12.652269  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 45403.6us
I20260709 12:26:12.653818  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.421497 11234 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.650857  6043 rpcz_store.cc:276] 0709 12:26:11.370104 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.649782 (+1279678us) service_pool.cc:224] Handling call
0709 12:26:12.650038 (+   256us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.650197 (+   159us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.650220 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:12.650259 (+    39us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:12.650287 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.650337 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:12.650439 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.623420 11295 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:12.656594  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:12.647877  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2423) took 1278 ms. Trace:
I20260709 12:26:12.659667 11190 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:12.658171  6611 leader_election.cc:400] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11.
I20260709 12:26:12.660472  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:12.670423  6611 leader_election.cc:403] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Cancelling election due to peer responding with higher term
I20260709 12:26:12.659003  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.660216 11127 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:12.660539  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.664728 11161 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:12.628603 11030 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:12.667433  6039 rpcz_store.cc:276] 0709 12:26:11.369841 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.646970 (+1277129us) service_pool.cc:224] Handling call
0709 12:26:12.647366 (+   396us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.647544 (+   178us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.647587 (+    43us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:12.647633 (+    46us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:12.647663 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.647715 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:12.647817 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.667984  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1215) took 1528 ms. Trace:
I20260709 12:26:12.668639  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.663439  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.688493  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2976) took 1190 ms. Trace:
I20260709 12:26:12.669342  6651 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:12.671098  6644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 1242) took 1618 ms. Trace:
I20260709 12:26:12.671572  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:12.689898  6643 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:12.672468  5962 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:12.674892 10944 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:12.688861  5961 rpcz_store.cc:276] 0709 12:26:11.497834 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.663217 (+1165383us) service_pool.cc:224] Handling call
0709 12:26:12.688433 (+ 25216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.679078  6642 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:12.646538 11125 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:12.672065  5965 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:26:12.607528 11222 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.706730  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.689716  6644 rpcz_store.cc:276] 0709 12:26:11.049228 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.049670 (+   442us) service_pool.cc:224] Handling call
0709 12:26:11.049983 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:11.280273 (+230290us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.666907 (+1386634us) spinlock_profiling.cc:243] Waited 148 ms on lock 0x7b54004e2fd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:12.667102 (+   195us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":341223808}
I20260709 12:26:12.705096  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 1733) took 1001 ms. Trace:
I20260709 12:26:12.687327  5959 rpcz_store.cc:276] 0709 12:26:11.139766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.139895 (+   129us) service_pool.cc:224] Handling call
0709 12:26:11.187614 (+ 47719us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:11.206714 (+ 19100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:11.206743 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:11.206782 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:11.206810 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.667786 (+1460976us) spinlock_profiling.cc:243] Waited 18.9 ms on lock 0x7b5400197154. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:12.667830 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:12.667933 (+   103us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":43422464}
I20260709 12:26:12.694443  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:12.697541 11234 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:12.707967  6039 rpcz_store.cc:276] 0709 12:26:11.703690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.704355 (+1000665us) service_pool.cc:224] Handling call
0709 12:26:12.704647 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.704812 (+   165us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.704835 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:12.704875 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:12.704904 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.704954 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:12.705044 (+    90us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.646415 11219 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.699208  6036 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:12.700126  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.717654  6114 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:12.701529 11271 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:12.691764 10944 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:12.702872  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.724280  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.724612  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 2543) took 1189 ms. Trace:
I20260709 12:26:12.703898 11190 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:12.677268 11270 consensus_meta.cc:287] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.524s	user 0.007s	sys 0.000s
I20260709 12:26:12.708854  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:12.693602 11169 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:12.767031  5965 raft_consensus.cc:2376] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14. Re-sending same reply.
I20260709 12:26:12.662750 10823 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:12.714301  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:12.670972 11218 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.767957  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.715454  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:12.768558  5965 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:12.769236  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:12.769935  6644 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:12.770843  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:12.771826  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:12.772540  6644 raft_consensus.cc:2410] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 14 because replica has last-logged OpId of term: 11 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 10.
I20260709 12:26:12.773221  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:12.716183  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.708267 11127 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:12.774828 11127 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:12.716333  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:12.775974  5961 raft_consensus.cc:2410] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:26:12.776762  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.776907 11127 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:12.777412  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2968) took 1375 ms. Trace:
I20260709 12:26:12.777712  5961 rpcz_store.cc:276] 0709 12:26:11.402000 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.776518 (+1374518us) service_pool.cc:224] Handling call
0709 12:26:12.777352 (+   834us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.722940  6643 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:12.778883 11170 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.779565  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:12.780548  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:12.780922 11170 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:12.781038  6643 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:12.781865  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:12.666661 11083 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:12.725039  5964 rpcz_store.cc:276] 0709 12:26:11.534755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.702641 (+1167886us) service_pool.cc:224] Handling call
0709 12:26:12.724548 (+ 21907us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:12.782543  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 122143us
I20260709 12:26:12.783591  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:12.717871  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.783977  5934 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.784490  5959 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:12.704027 11121 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:12.729966 10944 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:12.730219 11251 consensus_meta.cc:287] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.726s	user 0.018s	sys 0.000s
I20260709 12:26:12.730685 11263 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:12.732283 11323 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:12.735982  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.730629 11253 consensus_queue.cc:1059] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.008s
I20260709 12:26:12.802935  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.719741 11214 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:12.747500 11219 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:12.748070  6038 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
W20260709 12:26:12.751946  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.820132  6009 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:12.821709  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:12.822350 10996 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:12.822926 10996 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:12.823251 10996 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:12.823571 10996 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:12.824546  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.753489 11139 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:12.754791 11225 consensus_meta.cc:287] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.604s	user 0.008s	sys 0.001s
I20260709 12:26:12.825603 11225 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:12.756201  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.828091  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.828872  5963 raft_consensus.cc:2410] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 19 because replica has last-logged OpId of term: 17 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:26:12.830080  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 2959) took 1448 ms. Trace:
I20260709 12:26:12.794801 11315 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:12.758637 11258 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:12.760277 10851 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:12.762207 11227 consensus_meta.cc:287] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.528s	user 0.007s	sys 0.004s
I20260709 12:26:12.713500 11161 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:12.769694 11328 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:12.769359  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.666544 11220 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:26:12.785077  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 2539) took 1251 ms. Trace:
I20260709 12:26:12.786110  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.786995  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.788328  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:12.855122  5962 rpcz_store.cc:276] 0709 12:26:11.533655 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.692564 (+1158909us) service_pool.cc:224] Handling call
0709 12:26:12.785012 (+ 92448us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.789112  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:12.791167  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:12.856124  6648 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:12.856400  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2974) took 1359 ms. Trace:
I20260709 12:26:12.796037  5934 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:12.856992  6081 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 2.609s (SENT) [suppressed 13 similar messages]
W20260709 12:26:12.857501  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 61561.2us
I20260709 12:26:12.856735  5964 rpcz_store.cc:276] 0709 12:26:11.497215 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.786726 (+1289511us) service_pool.cc:224] Handling call
0709 12:26:12.856346 (+ 69620us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.858263  5934 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.794677  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:12.859603  5959 raft_consensus.cc:2410] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 12 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
W20260709 12:26:12.799690  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.745222 11229 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:12.863217  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.808939  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:12.809681 11189 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:12.810839  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2573) took 1844 ms. Trace:
W20260709 12:26:12.814277  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.830369  5963 rpcz_store.cc:276] 0709 12:26:11.381868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.829371 (+1447503us) service_pool.cc:224] Handling call
0709 12:26:12.829628 (+   257us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.829782 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.829804 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:12.829843 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:12.829884 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.829933 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:12.830030 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.836208 11190 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election lost for term 10. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11.
I20260709 12:26:12.831270 10996 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.831983 11121 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:12.875185  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:12.807273 11323 consensus_queue.cc:1243] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer 0557a7246c8945b99e5215c99d4ddf9c log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:26:12.837689  6113 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:12.842710 11219 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:12.843564 11222 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:12.807792 11214 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:12.844666 11139 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:12.842602  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:12.803999 11251 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.852077  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:12.883598 11251 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:12.884177  6647 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 12: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:12.858945  5965 raft_consensus.cc:2393] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 12: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:12.864012  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.884795  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 2526) took 1386 ms. Trace:
I20260709 12:26:12.885164  6647 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:12.885141  5965 rpcz_store.cc:276] 0709 12:26:11.498106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.769157 (+1271051us) service_pool.cc:224] Handling call
0709 12:26:12.884732 (+115575us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.886072  5934 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:12.869531 11125 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:12.887081  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2530) took 1356 ms. Trace:
I20260709 12:26:12.866878  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:12.888137 11125 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:12.888600 11125 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:12.888823  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.889915  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:12.869297  5959 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:12.891731  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 2965) took 1498 ms. Trace:
I20260709 12:26:12.892043  5959 rpcz_store.cc:276] 0709 12:26:11.393289 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.866187 (+1472898us) service_pool.cc:224] Handling call
0709 12:26:12.869138 (+  2951us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.891513 (+ 22375us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.891680 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.893564  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2531) took 1362 ms. Trace:
W20260709 12:26:12.854140 11336 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.062s	user 0.002s	sys 0.002s
I20260709 12:26:12.836756  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.893947  5959 rpcz_store.cc:276] 0709 12:26:11.531643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.892793 (+1361150us) service_pool.cc:224] Handling call
0709 12:26:12.893098 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.893260 (+   162us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.893284 (+    24us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:12.893323 (+    39us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:12.893351 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.893410 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:12.893512 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.871624  5964 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:26:12.896543  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.874135  5932 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.897207 11199 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:12.897670  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.866046  6040 rpcz_store.cc:276] 0709 12:26:10.965942 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:10.966066 (+   124us) service_pool.cc:224] Handling call
0709 12:26:10.966337 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:11.288123 (+321786us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.810609 (+1522486us) spinlock_profiling.cc:243] Waited 161 ms on lock 0x7b540025b554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:12.810782 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":370147200}
I20260709 12:26:12.898286 11083 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election lost for term 5. Reason: could not achieve majority
I20260709 12:26:12.874920  6115 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 12: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:12.877277  5961 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:12.900215  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 2975) took 1402 ms. Trace:
I20260709 12:26:12.900568  5961 rpcz_store.cc:276] 0709 12:26:11.497542 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.866888 (+1369346us) service_pool.cc:224] Handling call
0709 12:26:12.876973 (+ 10085us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.899947 (+ 22974us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.900147 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.879177  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:12.881626 11214 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:12.803359 11030 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:12.901393  6036 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:12.898527  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:12.903312 10851 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:12.903836  5932 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:12.895347  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.905099  6117 raft_consensus.cc:2410] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 18 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 8.
I20260709 12:26:12.905849  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:12.896620  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 2964) took 1503 ms. Trace:
I20260709 12:26:12.880648  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:12.906566  5964 rpcz_store.cc:276] 0709 12:26:11.393046 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.858571 (+1465525us) service_pool.cc:224] Handling call
0709 12:26:12.871400 (+ 12829us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:12.896361 (+ 24961us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.896568 (+   207us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.872542  5962 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: [16.9-16.9]
I20260709 12:26:12.900971  6040 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:26:12.907732  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 2961) took 1525 ms. Trace:
I20260709 12:26:12.867935 11120 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:12.908074  5962 rpcz_store.cc:276] 0709 12:26:11.382335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.855801 (+1473466us) service_pool.cc:224] Handling call
0709 12:26:12.872253 (+ 16452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:12.907483 (+ 35230us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.907686 (+   203us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:12.908915  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:12.886386  6647 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 10. (term mismatch)
I20260709 12:26:12.887437  5965 rpcz_store.cc:276] 0709 12:26:11.531306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.886344 (+1355038us) service_pool.cc:224] Handling call
0709 12:26:12.886618 (+   274us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.886760 (+   142us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.886783 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:12.886823 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:12.886879 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.886931 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:12.887027 (+    96us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.909606  6647 pending_rounds.cc:85] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 9
I20260709 12:26:12.909847  6647 pending_rounds.cc:107] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 10.10
I20260709 12:26:12.910065  6647 raft_consensus.cc:2889] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:12.910396  5965 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:12.911232  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2545) took 1304 ms. Trace:
I20260709 12:26:12.911592  5965 rpcz_store.cc:276] 0709 12:26:11.607199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.909822 (+1302623us) service_pool.cc:224] Handling call
0709 12:26:12.910102 (+   280us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.910999 (+   897us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.911185 (+   186us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.853746 11263 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
I20260709 12:26:12.869709 11189 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:12.857843 11161 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.913553  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.928642  6114 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
W20260709 12:26:12.912526  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 69979.1us
I20260709 12:26:12.929564  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:12.930097  6114 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:12.853927 11227 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:12.915684  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2535) took 1383 ms. Trace:
I20260709 12:26:12.935885  5964 rpcz_store.cc:276] 0709 12:26:11.532688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.907309 (+1374621us) service_pool.cc:224] Handling call
0709 12:26:12.915240 (+  7931us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.915394 (+   154us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.915417 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:12.915459 (+    42us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:12.915492 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.915540 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:12.915635 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.916149  6040 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:12.937516  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2552) took 1091 ms. Trace:
I20260709 12:26:12.937825  5964 rpcz_store.cc:276] 0709 12:26:11.854324 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.936825 (+1082501us) service_pool.cc:224] Handling call
0709 12:26:12.937098 (+   273us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.937243 (+   145us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.937265 (+    22us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:12.937301 (+    36us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:12.937341 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.937388 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:12.937470 (+    82us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:12.917539  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:12.941124  6643 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:12.913344  6117 raft_consensus.cc:2393] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 15: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:12.920017 11125 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.920945 10996 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:12.924633 10944 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.917147 11222 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:12.933645  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.934757 11214 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:12.916838  6647 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:12.939909  6044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60122 (request call id 1738) took 1235 ms. Trace:
I20260709 12:26:12.987447  6044 rpcz_store.cc:276] 0709 12:26:11.704921 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.081488 (+376567us) service_pool.cc:224] Handling call
0709 12:26:12.939721 (+858233us) spinlock_profiling.cc:243] Waited 212 ms on lock 0x7b5400271354. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:12.939857 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":488353536}
I20260709 12:26:12.942303  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2585) took 1021 ms. Trace:
I20260709 12:26:12.942619  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:12.946255  5962 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 12. Current term is 13. Ops: []
W20260709 12:26:12.948274  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48969.6us
I20260709 12:26:12.994971  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:12.951150 11030 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:12.914351 11251 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:12.972390  6114 raft_consensus.cc:2410] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 13 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
W20260709 12:26:12.984508  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51532.3us
I20260709 12:26:12.992420  6039 rpcz_store.cc:276] 0709 12:26:11.921003 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.710950 (+789947us) service_pool.cc:224] Handling call
0709 12:26:12.711273 (+   323us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:12.711593 (+   320us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.711618 (+    25us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:12.718084 (+  6466us) log.cc:844] Serialized 52 byte log entry
0709 12:26:12.792101 (+ 74017us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:12.834034 (+ 41933us) spinlock_profiling.cc:243] Waited 2.6 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:12.916522 (+ 82488us) log.cc:844] Serialized 14 byte log entry
0709 12:26:12.928790 (+ 12268us) log.cc:844] Serialized 14 byte log entry
0709 12:26:12.929115 (+   325us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.929186 (+    71us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:12.942121 (+ 12935us) raft_consensus.cc:1685] finished
0709 12:26:12.942140 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:12.942256 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":13325,"prepare.run_cpu_time_us":54,"prepare.run_wall_time_us":55,"raft.queue_time_us":6214,"raft.run_cpu_time_us":228,"raft.run_wall_time_us":25672,"spinlock_wait_cycles":12729088,"thread_start_us":160560,"threads_started":2,"wal-append.queue_time_us":37112}
I20260709 12:26:12.947139 11332 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:13.001919  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:13.002477  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:13.009042  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:13.002929  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:12.998620  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 141641us
W20260709 12:26:13.003566 11330 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.130s	user 0.001s	sys 0.000s
W20260709 12:26:13.013398  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:13.000682  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:12.935603 11271 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:13.005785  6039 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:12.897713 11199 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.005090  6609 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:13.021256  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:13.022432  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:13.024179  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:13.016644  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:12.946719 11253 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:12.955168 11222 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.035140  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:13.046269  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:13.048520 11342 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:13.039631  6643 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:13.045217  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 2941) took 1652 ms. Trace:
I20260709 12:26:12.999408 11328 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:13.051959  6111 rpcz_store.cc:276] 0709 12:26:11.392634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.403737 (+ 11103us) service_pool.cc:224] Handling call
0709 12:26:11.404053 (+   316us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:11.448917 (+ 44864us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:11.448948 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:12.340921 (+891973us) spinlock_profiling.cc:243] Waited 1.06 ms on lock 0x7b2c0003b2d8. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f94da11 00007f481f95d372 00007f482108fa01 00007f482105443a 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2
0709 12:26:12.394138 (+ 53217us) log.cc:844] Serialized 52 byte log entry
0709 12:26:12.723520 (+329382us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:12.794020 (+ 70500us) log.cc:844] Serialized 14 byte log entry
0709 12:26:12.794236 (+   216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.794306 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:13.015126 (+220820us) raft_consensus.cc:1685] finished
0709 12:26:13.044988 (+ 29862us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.045153 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":45110,"prepare.queue_time_us":73261,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":46369,"raft.run_cpu_time_us":134,"raft.run_wall_time_us":13838,"spinlock_wait_cycles":17064704,"thread_start_us":188160,"threads_started":1,"wal-append.queue_time_us":354640}
W20260709 12:26:13.054759  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 58019.2us
I20260709 12:26:13.064661  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:13.029006 10996 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:13.028008 11139 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:13.045679 11336 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:26:13.069280  6647 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: [9.9-9.9]
W20260709 12:26:13.073077  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 169308us
I20260709 12:26:13.031982 11253 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:13.049695 11222 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:13.032656 11263 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:13.045960 11225 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:13.046154 11325 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:13.003305 11251 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.061305 11030 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:13.068586 10996 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.083541  5932 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:13.063378 11342 raft_consensus.cc:697] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:13.088254  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2422) took 1718 ms. Trace:
I20260709 12:26:13.067927 10865 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:13.165419  6042 rpcz_store.cc:276] 0709 12:26:11.369552 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.385529 (+ 15977us) service_pool.cc:224] Handling call
0709 12:26:11.385856 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:11.448730 (+ 62874us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.087935 (+1639205us) spinlock_profiling.cc:243] Waited 57.5 ms on lock 0x7b540025bf54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:13.088181 (+   246us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":132300544}
I20260709 12:26:13.115396 11325 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:13.182293  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 117699us
I20260709 12:26:13.164005 10851 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:13.185237  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 113882us
I20260709 12:26:13.186342  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:13.187847  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:13.169436 10996 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:13.087703 11225 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:13.180636 11121 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:13.195919 11353 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:13.196496 11346 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:13.196955 11342 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.087831 11263 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:13.201323  5934 leader_election.cc:400] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15.
I20260709 12:26:13.185091 11229 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:13.204618  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:13.209856  5934 leader_election.cc:403] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:26:13.210951  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:13.213900  5934 connection.cc:256] RPC call timeout handler was delayed by -1.1500567610000871s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1799s for a response
I20260709 12:26:13.222546  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:13.227577 11345 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:13.227820 11199 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:13.230290  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2529) took 1731 ms. Trace:
I20260709 12:26:13.229841  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2591) took 1289 ms. Trace:
I20260709 12:26:13.261430  5963 rpcz_store.cc:276] 0709 12:26:11.498918 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.867170 (+1368252us) service_pool.cc:224] Handling call
0709 12:26:12.867486 (+   316us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:12.876646 (+  9160us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.876677 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:12.877149 (+   472us) log.cc:844] Serialized 26 byte log entry
0709 12:26:12.946729 (+ 69580us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:12.946768 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.946833 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:13.230095 (+283262us) raft_consensus.cc:1685] finished
0709 12:26:13.230114 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.230236 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5970,"raft.queue_time_us":8679,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":3616,"thread_start_us":67398,"threads_started":1,"wal-append.queue_time_us":205954}
I20260709 12:26:13.265620 11357 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:13.273729  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1218) took 2133 ms. Trace:
W20260709 12:26:13.275336  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 191888us
I20260709 12:26:13.219187 11161 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:13.262535  6036 rpcz_store.cc:276] 0709 12:26:11.940890 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.902071 (+961181us) service_pool.cc:224] Handling call
0709 12:26:12.902402 (+   331us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:12.912864 (+ 10462us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.912896 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:12.913382 (+   486us) log.cc:844] Serialized 26 byte log entry
0709 12:26:12.990707 (+ 77325us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:12.990753 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.990827 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:13.229620 (+238793us) raft_consensus.cc:1685] finished
0709 12:26:13.229639 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.229778 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10052,"raft.queue_time_us":11078,"raft.run_cpu_time_us":119,"raft.run_wall_time_us":13884,"thread_start_us":76986,"threads_started":1,"wal-append.queue_time_us":157080}
I20260709 12:26:13.274224  5968 rpcz_store.cc:276] 0709 12:26:11.140669 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.141399 (+   730us) service_pool.cc:224] Handling call
0709 12:26:11.141683 (+   284us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:11.292148 (+150465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:11.292179 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:11.292219 (+    40us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:11.292251 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.273461 (+1981210us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b54002db9d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:13.273514 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.273662 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345608576}
I20260709 12:26:13.262188 11220 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:13.204911 11121 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.268172 11346 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:13.290495  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:13.290274  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 75898.6us
I20260709 12:26:13.194938 11253 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:13.284910 11347 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:26:13.309705  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:13.310267  6118 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
W20260709 12:26:13.298823 11352 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:26:13.287390 11214 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:13.313643  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:13.294674 11227 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:13.299203 11139 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.315747  6118 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:13.320626 11139 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.323119 11139 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:13.324013 11263 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:13.326064 11121 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:13.326946 10865 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:13.319345 11225 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:13.316342 11325 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:13.330017 11222 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.330722 11251 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:13.332497 11253 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:13.335242 11346 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15.
I20260709 12:26:13.342644 11368 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.335856  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:13.343196 11368 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:13.343808 11254 raft_consensus.cc:3055] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:13.344198 11254 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:13.344981 11254 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.345417 11368 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:13.345898 11254 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:13.348038 11224 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:13.350092  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:13.350921  6648 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:13.350958  6037 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:13.351826  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:13.352670  6109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2875) took 1342 ms. Trace:
I20260709 12:26:13.354445  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2534) took 1822 ms. Trace:
I20260709 12:26:13.353279  6109 rpcz_store.cc:276] 0709 12:26:12.010187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.011335 (+  1148us) service_pool.cc:224] Handling call
0709 12:26:12.011662 (+   327us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:12.023404 (+ 11742us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.023434 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:12.023941 (+   507us) log.cc:844] Serialized 26 byte log entry
0709 12:26:12.144724 (+120783us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:12.144765 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.352319 (+1207554us) spinlock_profiling.cc:243] Waited 11.3 ms on lock 0x7b54000e29d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:13.352380 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:13.352422 (+    42us) raft_consensus.cc:1685] finished
0709 12:26:13.352433 (+    11us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.352620 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3737,"raft.run_cpu_time_us":96,"raft.run_wall_time_us":97,"spinlock_wait_cycles":26093952,"thread_start_us":120413,"threads_started":1,"wal-append.queue_time_us":198062,"wal-append.run_cpu_time_us":1797,"wal-append.run_wall_time_us":1001829}
I20260709 12:26:13.355742  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 2880) took 1312 ms. Trace:
I20260709 12:26:13.356119  6112 rpcz_store.cc:276] 0709 12:26:12.043248 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.053221 (+  9973us) service_pool.cc:224] Handling call
0709 12:26:13.355542 (+1302321us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b54001031d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:13.355664 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":357836032}
I20260709 12:26:13.354984  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:13.354900  5961 rpcz_store.cc:276] 0709 12:26:11.532428 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.904913 (+1372485us) service_pool.cc:224] Handling call
0709 12:26:12.914421 (+  9508us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:13.040228 (+125807us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:13.040259 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:13.040796 (+   537us) log.cc:844] Serialized 26 byte log entry
0709 12:26:13.041987 (+  1191us) raft_consensus.cc:1645] Marking committed up to 5
0709 12:26:13.042019 (+    32us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.042083 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:13.354219 (+312136us) raft_consensus.cc:1685] finished
0709 12:26:13.354243 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.354375 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":133405,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":111,"thread_start_us":108991,"threads_started":2,"wal-append.queue_time_us":39222}
I20260709 12:26:13.358508  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:13.359470  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:13.361259  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:13.352991  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:13.358997  5961 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:13.363025  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:13.363901 11219 consensus_queue.cc:1059] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:13.363951 11328 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:13.363984 11370 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:13.364909 11219 raft_consensus.cc:3055] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:13.365264 11219 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:13.365362 10865 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:13.365651 11370 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:13.364202 11121 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:13.364032 11214 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:13.366065  6112 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:13.367473  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:13.369124  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:13.366516 11325 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:13.370532  6084 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:13.372113  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 78404.1us
I20260709 12:26:13.372818  5932 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:13.369663  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:13.374929  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:13.376109  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:13.366091 11219 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.367822 11370 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:13.377564 11138 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:13.378928 11138 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:13.370807 11325 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:13.377974  5967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2967) took 1984 ms (client timeout 1941 ms). Trace:
I20260709 12:26:13.379743  6110 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:13.378005  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:13.382331  5960 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:13.379494  6651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1393) took 1485 ms. Trace:
I20260709 12:26:13.379328 11138 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:13.369400 11222 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:13.379880  5967 rpcz_store.cc:269] 0709 12:26:11.393807 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.949223 (+555416us) service_pool.cc:224] Handling call
0709 12:26:13.377758 (+1428535us) spinlock_profiling.cc:243] Waited 19.8 ms on lock 0x7b54002dc8d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:13.377892 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":45603712}
I20260709 12:26:13.383172  6651 rpcz_store.cc:276] 0709 12:26:11.893693 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.324212 (+430519us) service_pool.cc:224] Handling call
0709 12:26:12.667068 (+342856us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.689382 (+ 22314us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.379295 (+689913us) spinlock_profiling.cc:243] Waited 342 ms on lock 0x7b54004e2fd0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:13.379436 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":787695872}
I20260709 12:26:13.385142  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:13.385968  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:13.387535  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:13.388654  5932 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:13.378109  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:13.389920  6648 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:13.391500  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:13.392894  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:13.393283  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:13.395210  5932 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:13.397631  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:13.391953 11189 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.395107  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1224) took 1426 ms. Trace:
I20260709 12:26:13.404667  5961 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:13.405860  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1226) took 1436 ms. Trace:
I20260709 12:26:13.406123  5961 rpcz_store.cc:276] 0709 12:26:11.969237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:13.405300 (+1436063us) service_pool.cc:224] Handling call
0709 12:26:13.405544 (+   244us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:13.405662 (+   118us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:13.405678 (+    16us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:13.405704 (+    26us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:13.405721 (+    17us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.405752 (+    31us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.405819 (+    67us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:13.407136  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:13.356775 10996 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.407270  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:13.408454  6651 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
W20260709 12:26:13.377377 11356 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.098s	user 0.000s	sys 0.006s
I20260709 12:26:13.379534 11224 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:13.378072 11363 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:13.419073 11360 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:13.433058  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:13.415645  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:13.434958  6651 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:13.380713 11219 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:13.406960 11130 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.021s
I20260709 12:26:13.436057  5932 leader_election.cc:400] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15.
I20260709 12:26:13.436460  6651 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:13.436887  5932 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:13.423110  5961 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10. Ops: [8.8-9.9]
I20260709 12:26:13.437346  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:13.437975  6109 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:26:13.438448  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:13.419777  6648 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:13.440685  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:13.441212  5960 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:13.438004  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 2986) took 1279 ms. Trace:
I20260709 12:26:13.442118  5961 rpcz_store.cc:276] 0709 12:26:12.158376 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:13.408170 (+1249794us) service_pool.cc:224] Handling call
0709 12:26:13.422933 (+ 14763us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:13.437735 (+ 14802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.437949 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:13.437842 11222 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:13.433913 11125 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:13.445940 11125 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.446295 11125 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:13.450544 11334 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.665s	user 0.004s	sys 0.000s
I20260709 12:26:13.452109  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1115) took 1345 ms. Trace:
I20260709 12:26:13.452543  6115 rpcz_store.cc:276] 0709 12:26:12.106435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.565638 (+459203us) service_pool.cc:224] Handling call
0709 12:26:13.451903 (+886265us) spinlock_profiling.cc:243] Waited 303 ms on lock 0x7b540023aad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:13.452047 (+   144us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":696766336}
I20260709 12:26:13.455806 11120 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:13.456327 11120 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:13.456792 11120 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:13.458012  6044 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:26:13.456931  6035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 2444) took 1517 ms (client timeout 1544 ms). Trace:
I20260709 12:26:13.456224  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1223) took 1487 ms. Trace:
I20260709 12:26:13.432150 10996 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:13.377377 11368 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:26:13.460196  5963 rpcz_store.cc:276] 0709 12:26:11.968688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:13.263488 (+1294800us) service_pool.cc:224] Handling call
0709 12:26:13.263837 (+   349us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:13.264056 (+   219us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:13.264079 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:13.264579 (+   500us) log.cc:844] Serialized 26 byte log entry
0709 12:26:13.383963 (+119384us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:13.383999 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.384183 (+   184us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:13.455957 (+ 71774us) raft_consensus.cc:1685] finished
0709 12:26:13.455978 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.456150 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":119065,"threads_started":1,"wal-append.queue_time_us":183280}
W20260709 12:26:13.459127  6035 rpcz_store.cc:269] 0709 12:26:11.939537 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.982177 (+ 42640us) service_pool.cc:224] Handling call
0709 12:26:13.456757 (+1474580us) spinlock_profiling.cc:243] Waited 48.6 ms on lock 0x7b540030edd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:13.456874 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":111798016}
I20260709 12:26:13.415377 11349 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:13.466691  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:13.464433  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:13.458285  6651 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:13.460671  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:13.452790  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 1731) took 1749 ms. Trace:
I20260709 12:26:13.468169  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:13.433529 11189 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:13.471546 11323 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:13.471681 11189 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:13.438681 11353 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:13.426869 11229 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:13.473368 11229 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.469614 11363 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:13.474913 11363 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:13.475260 11363 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:13.475539 11229 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:13.471428 11234 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:13.431908 11325 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.477032 11325 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:13.478255 10878 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:13.482132  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:13.483390  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:13.483547  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:13.484076  6039 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:13.485040  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:13.469789 11253 consensus_queue.cc:1059] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:26:13.486788  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:13.427163 11350 consensus_queue.cc:1059] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 10.6, Next index: 7, Last known committed idx: 5, Time since last communication: 0.060s
I20260709 12:26:13.487504  6039 raft_consensus.cc:1217] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Deduplicated request from leader. Original: 10.10->[12.11-17.14]   Dedup: 13.12->[15.13-17.14]
I20260709 12:26:13.488022 11350 raft_consensus.cc:3055] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:13.488133  6039 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: [12.11-17.14]
I20260709 12:26:13.488395 11350 raft_consensus.cc:740] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:13.489202 11350 consensus_queue.cc:260] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 10.6, Last appended by leader: 6, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:13.458285 11214 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:13.491077  6035 raft_consensus.cc:2410] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 8 index: 8.
I20260709 12:26:13.432075 11370 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.492327 11370 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:13.484144  6042 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:13.470152  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:13.475951 11326 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.012s
I20260709 12:26:13.475358 11296 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:13.428081 11315 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:13.468006  6043 rpcz_store.cc:276] 0709 12:26:11.703113 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.658777 (+955664us) service_pool.cc:224] Handling call
0709 12:26:12.659086 (+   309us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:12.659418 (+   332us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.659446 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:12.680479 (+ 21033us) log.cc:844] Serialized 52 byte log entry
0709 12:26:12.786112 (+105633us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:12.932894 (+146782us) log.cc:844] Serialized 14 byte log entry
0709 12:26:12.933127 (+   233us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:12.933201 (+    74us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:13.449952 (+516751us) spinlock_profiling.cc:243] Waited 12.2 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:13.452477 (+  2525us) raft_consensus.cc:1685] finished
0709 12:26:13.452585 (+   108us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.452730 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":19149,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":31,"raft.queue_time_us":7763,"raft.run_cpu_time_us":207,"raft.run_wall_time_us":4764,"spinlock_wait_cycles":28147968,"thread_start_us":212981,"threads_started":2,"wal-append.queue_time_us":79282}
I20260709 12:26:13.519532  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:13.520263  5963 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:13.523478  6109 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:13.503651  6651 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:26:13.490913 11214 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:13.505477 11030 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:13.459524 11224 raft_consensus.cc:697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:13.507129  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:13.506170 11353 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:13.557874  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:13.501693  5932 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:13.558970  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 57357us
I20260709 12:26:13.561707 11353 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:13.562201 11353 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.562587 11353 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:13.516620  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:13.563719  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 47148.6us
I20260709 12:26:13.565294 11360 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:13.566913  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:13.490326 11350 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:13.487102 11253 raft_consensus.cc:3055] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:13.494370 11342 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.036s
I20260709 12:26:13.531955 11224 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.570768 11253 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:13.571755 11253 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.573093 11253 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:13.528205 11199 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.008s
I20260709 12:26:13.528530 11130 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Stepping down as leader of term 10
W20260709 12:26:13.539978  6650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50470 (request call id 995) took 2091 ms (client timeout 1793 ms). Trace:
I20260709 12:26:13.539691 11214 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.544137  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:26:13.576406  6650 rpcz_store.cc:269] 0709 12:26:11.448521 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.448656 (+   135us) service_pool.cc:224] Handling call
0709 12:26:13.539756 (+2091100us) spinlock_profiling.cc:243] Waited 107 ms on lock 0x7b5400468cd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:13.539891 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":246097152}
I20260709 12:26:13.579639  6109 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: []
W20260709 12:26:13.579738  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 111637us
I20260709 12:26:13.581673  6608 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:13.583024  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:13.582998  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:13.584550  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:13.585557  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:13.588225  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:13.588811  6608 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:13.586264  6042 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:13.545047 11363 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.547101  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2551) took 1700 ms. Trace:
I20260709 12:26:13.547902  6642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1391) took 1685 ms. Trace:
I20260709 12:26:13.548595  6116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2877) took 1518 ms. Trace:
I20260709 12:26:13.526314 11315 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:13.495191  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:13.515846  6609 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:13.603609  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 87843.5us
I20260709 12:26:13.597848  6608 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:13.595007  6642 rpcz_store.cc:276] 0709 12:26:11.862373 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.996306 (+133933us) service_pool.cc:224] Handling call
0709 12:26:11.996582 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.705412 (+708830us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.547659 (+842247us) spinlock_profiling.cc:243] Waited 682 ms on lock 0x7b5400555d54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:13.547841 (+   182us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1569164544}
I20260709 12:26:13.594936  5965 rpcz_store.cc:276] 0709 12:26:11.846265 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.913909 (+1067644us) service_pool.cc:224] Handling call
0709 12:26:12.915864 (+  1955us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:13.050931 (+135067us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:26:13.182555 (+131624us) log.cc:844] Serialized 14 byte log entry
0709 12:26:13.387536 (+204981us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:13.393993 (+  6457us) log.cc:844] Serialized 52 byte log entry
0709 12:26:13.394151 (+   158us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:13.394188 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.394251 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:13.546850 (+152599us) raft_consensus.cc:1685] finished
0709 12:26:13.546872 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.547036 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9602,"prepare.queue_time_us":114064,"prepare.run_cpu_time_us":390,"prepare.run_wall_time_us":6451,"raft.queue_time_us":139950,"raft.run_cpu_time_us":209,"raft.run_wall_time_us":13975,"thread_start_us":433172,"threads_started":3,"wal-append.queue_time_us":202013}
I20260709 12:26:13.595260  6116 rpcz_store.cc:276] 0709 12:26:12.030585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.030703 (+   118us) service_pool.cc:224] Handling call
0709 12:26:12.030986 (+   283us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.235097 (+204111us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:12.235130 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:12.235172 (+    42us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:12.235202 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.548377 (+1313175us) spinlock_profiling.cc:243] Waited 204 ms on lock 0x7b540021cad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:13.548433 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.548543 (+   110us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":468977408}
I20260709 12:26:13.604712  6609 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:13.576952 11130 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:13.608340  6118 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:13.590689 11271 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:13.590559 11229 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:13.590394 11220 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:13.592345 11139 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:26:13.592037 11189 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:13.627403 11380 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:13.628371 11380 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:13.630511 10944 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:13.631596  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:13.634620 11368 raft_consensus.cc:3055] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:13.635111 11368 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:13.635942 11368 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:13.636919 11368 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:13.650946 10823 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:13.651456 10823 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:13.652302 10823 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.653296 10823 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:13.594185 11342 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.607812 11323 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:13.618376 11229 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:13.679569  6082 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:13.732056  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52580.8us
I20260709 12:26:13.678714  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1222) took 1710 ms. Trace:
I20260709 12:26:13.737221  5964 rpcz_store.cc:276] 0709 12:26:11.968506 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.947228 (+978722us) service_pool.cc:224] Handling call
0709 12:26:12.947532 (+   304us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:13.062698 (+115166us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:13.062729 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:13.062769 (+    40us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:13.062804 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.678416 (+615612us) spinlock_profiling.cc:243] Waited 115 ms on lock 0x7b54000f8054. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:13.678500 (+    84us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.678647 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2461,"raft.queue_time_us":118757,"raft.run_cpu_time_us":155,"raft.run_wall_time_us":6019,"spinlock_wait_cycles":264086784}
W20260709 12:26:13.696274  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:13.684679  6041 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 2560) took 3996 ms (client timeout 1700 ms). Trace:
W20260709 12:26:13.739531  6041 rpcz_store.cc:269] 0709 12:26:09.617288 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:09.617723 (+   435us) service_pool.cc:224] Handling call
0709 12:26:13.613412 (+3995689us) spinlock_profiling.cc:243] Waited 2.39 s on lock 0x7b54000622d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:13.613593 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":5493220224}
I20260709 12:26:13.733256  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:13.578573 11125 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:13.767845  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:13.772048  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:13.660110 11363 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:13.670639 11161 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.671244 11271 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:13.671133 11189 raft_consensus.cc:697] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:26:13.797024  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:13.817010  6645 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 1403) took 1793 ms (client timeout 1920 ms). Trace:
W20260709 12:26:13.817253  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:13.804381 11224 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:13.808457 11361 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:13.742267 11254 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:13.684166 11229 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:13.820113  6649 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
W20260709 12:26:13.817625  6645 rpcz_store.cc:269] 0709 12:26:12.023572 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.069877 (+ 46305us) service_pool.cc:224] Handling call
0709 12:26:13.816784 (+1746907us) spinlock_profiling.cc:243] Waited 567 ms on lock 0x7b540080b954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:13.816945 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1304977280}
I20260709 12:26:13.642356 11120 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:13.813019  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 215231us
I20260709 12:26:13.776328 11326 raft_consensus.cc:2764] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:26:13.658385 11138 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:13.824666  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 231300us
I20260709 12:26:13.658761 11342 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:13.780040 11296 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:26:13.824596  6646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50470 (request call id 996) took 2358 ms (client timeout 1799 ms). Trace:
W20260709 12:26:13.829734  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 124471us
I20260709 12:26:13.830996  6608 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:13.831243  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:13.832221  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:13.829978  6646 rpcz_store.cc:269] 0709 12:26:11.460752 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.461523 (+   771us) service_pool.cc:224] Handling call
0709 12:26:13.819311 (+2357788us) spinlock_profiling.cc:243] Waited 170 ms on lock 0x7b54005569d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:13.819452 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":391607168}
I20260709 12:26:13.833818  6006 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:13.660660 11130 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.840899  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:13.841598 11214 raft_consensus.cc:2764] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:26:13.821142 11359 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.844115  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:13.843950  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 239279us
I20260709 12:26:13.846136  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:13.846872  6609 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:13.845335  5967 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:13.843339  6006 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:13.850582  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:13.851372  6006 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:13.851524  5967 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:13.847949  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:13.853271  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:13.829509 11296 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:13.866581  6006 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:13.867504  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:13.839005 11139 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:13.815888 11161 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:13.869514  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:13.868417  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:13.870664  5965 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 16: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:26:13.872051  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:13.871809  5966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 2973) took 2401 ms (client timeout 1628 ms). Trace:
I20260709 12:26:13.872259  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:13.875584  5959 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:13.845257 11380 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:13.880314  6006 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:13.847764 11219 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Leader pre-election won for term 5
W20260709 12:26:13.882844  5966 rpcz_store.cc:269] 0709 12:26:11.469998 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.880518 (+410520us) service_pool.cc:224] Handling call
0709 12:26:13.871588 (+1991070us) spinlock_profiling.cc:243] Waited 725 ms on lock 0x7b540008c354. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:13.871733 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1668085120}
I20260709 12:26:13.886562  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:13.892534  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:13.893201  5966 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:13.896090  5964 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:13.866380 11296 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:13.865290 10996 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:13.870297 11130 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:13.912076  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:13.912895 11380 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.913434 11380 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:13.914108  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:13.915462 11355 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.629s	user 0.001s	sys 0.000s
I20260709 12:26:13.916024 11380 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:13.916855  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 2970) took 1174 ms. Trace:
I20260709 12:26:13.917233  6114 rpcz_store.cc:276] 0709 12:26:12.742302 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:13.025343 (+283041us) service_pool.cc:224] Handling call
0709 12:26:13.025650 (+   307us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:13.033053 (+  7403us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:13.033108 (+    55us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:13.050225 (+ 17117us) log.cc:844] Serialized 26 byte log entry
0709 12:26:13.187288 (+137063us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:13.187329 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.187395 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:13.914874 (+727479us) spinlock_profiling.cc:243] Waited 1.67 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:13.916582 (+  1708us) raft_consensus.cc:1685] finished
0709 12:26:13.916601 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.916798 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4813,"raft.queue_time_us":7909,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":5941,"spinlock_wait_cycles":3842944,"thread_start_us":136691,"threads_started":1,"wal-append.queue_time_us":179803}
I20260709 12:26:13.897782  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:13.921538 11028 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:13.922006 11028 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.825444 11224 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.922364 11028 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:13.875138 11139 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:13.923039 11139 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:13.900753 11342 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:13.890810 11219 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:13.927217 11219 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 4 FOLLOWER]: Advancing to term 5
W20260709 12:26:13.928072  6081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.739s	user 0.008s	sys 0.011s
W20260709 12:26:13.928421  6081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.008s	sys 0.011s
W20260709 12:26:13.928925  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 741084us
I20260709 12:26:13.930868  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 15 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:13.932989  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2533) took 2400 ms. Trace:
I20260709 12:26:13.933418  5959 rpcz_store.cc:276] 0709 12:26:11.532172 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.898979 (+1366807us) service_pool.cc:224] Handling call
0709 12:26:13.872309 (+973330us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:13.887297 (+ 14988us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.932763 (+ 45466us) spinlock_profiling.cc:243] Waited 973 ms on lock 0x7b540008c350. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:13.932918 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2237853568}
I20260709 12:26:13.934849  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:13.935659  6114 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:26:13.913084 11367 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.623s	user 0.003s	sys 0.000s
W20260709 12:26:13.939999 11383 log.cc:927] Time spent T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:26:13.940526 11224 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:13.941994 11120 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:13.951409  5967 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:26:13.951041  5960 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:13.871906 11328 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:13.879292 11011 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:13.894045  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:14.004101  6081 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:13.941928 11376 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:26:13.893416 11385 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:14.088696  5965 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:13.849964 11359 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.887036 11222 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
W20260709 12:26:13.947098 11382 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
W20260709 12:26:14.119493  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 189054us
I20260709 12:26:14.131141  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:13.951507 11346 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:14.124130 11325 consensus_meta.cc:287] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.639s	user 0.010s	sys 0.000s
I20260709 12:26:14.088205 11127 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.094095 11387 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.128334 11370 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:14.202123  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:14.145455 11224 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:13.876070 11189 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:13.873189 11271 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:14.200487 11253 consensus_meta.cc:287] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.627s	user 0.011s	sys 0.000s
I20260709 12:26:14.189749 11222 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:14.124532 11011 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:14.217252  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 381585us
W20260709 12:26:14.226168  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:14.228741  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:14.202961 11127 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:14.231837  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 348749us
I20260709 12:26:13.957168 11328 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:14.235610  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 361857us
I20260709 12:26:14.235859 11328 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:14.220434 11222 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:14.241441  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:14.243377  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:14.244879  6118 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:14.248505  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:14.203850 11387 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.255370  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:14.256459  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 117616us
I20260709 12:26:14.258239  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:14.239743 11138 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:14.252737 11368 consensus_meta.cc:287] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.615s	user 0.007s	sys 0.004s
I20260709 12:26:14.266484  6111 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12. Ops: [11.7-11.7]
I20260709 12:26:14.263119  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:14.264958  6081 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:14.239935 11346 consensus_queue.cc:1059] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 12.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:26:14.270058  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:14.274927  6113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 2884) took 2198 ms (client timeout 1521 ms). Trace:
W20260709 12:26:14.275355  6113 rpcz_store.cc:269] 0709 12:26:12.067612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.163127 (+ 95515us) service_pool.cc:224] Handling call
0709 12:26:14.266050 (+2102923us) spinlock_profiling.cc:243] Waited 618 ms on lock 0x7b5400206a54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:14.266163 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1420833536}
I20260709 12:26:14.262452 11011 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:14.283878  6081 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:14.290306  5963 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:14.306736  5967 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:26:14.308229 11384 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.104s	user 0.001s	sys 0.000s
I20260709 12:26:14.309717 11359 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:14.272281 11254 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:14.312142  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:14.314057  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:14.281324 11161 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:14.315557  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:14.316238 11315 consensus_meta.cc:287] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.707s	user 0.008s	sys 0.000s
I20260709 12:26:14.262790 11253 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.019s
I20260709 12:26:14.316637  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:14.319180 11394 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.073s	user 0.000s	sys 0.000s
I20260709 12:26:14.285140 11130 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:14.320837 11390 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.089s	user 0.000s	sys 0.001s
I20260709 12:26:14.323894 11258 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:14.324661 11028 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.325042 11139 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.326551 11254 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:14.326771 11368 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:26:14.328235 11402 log.cc:927] Time spent T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:26:14.328567  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:14.328858  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:14.311081 11403 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.019s
I20260709 12:26:14.327061 11254 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:14.312548 11404 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:14.330863 11127 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:14.331547 11359 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:14.332115 11359 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.333907  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2537) took 2800 ms. Trace:
I20260709 12:26:14.334303  5962 rpcz_store.cc:276] 0709 12:26:11.533159 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.908763 (+1375604us) service_pool.cc:224] Handling call
0709 12:26:12.917997 (+  9234us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.994329 (+ 76332us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:14.333667 (+1339338us) spinlock_profiling.cc:243] Waited 28.1 ms on lock 0x7b54000b8454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:14.333846 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":64584576}
I20260709 12:26:14.311053 11387 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:14.313002  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:14.336632  5964 raft_consensus.cc:2368] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15.
I20260709 12:26:14.337026  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 2983) took 1310 ms. Trace:
I20260709 12:26:14.331061 11404 raft_consensus.cc:697] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:14.316663 11315 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.335717  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:14.338006 11219 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.337450  6111 rpcz_store.cc:276] 0709 12:26:13.027037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:13.062930 (+ 35893us) service_pool.cc:224] Handling call
0709 12:26:14.266240 (+1203310us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:14.267466 (+  1226us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:14.336846 (+ 69380us) spinlock_profiling.cc:243] Waited 1.2 s on lock 0x7b5400206a50. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:14.336969 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2766539520}
I20260709 12:26:14.335927  6118 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
W20260709 12:26:14.338032 11353 consensus_meta.cc:287] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.775s	user 0.008s	sys 0.000s
I20260709 12:26:14.341547 11353 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.341922 11342 raft_consensus.cc:3055] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:14.311493 11222 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.342934  5961 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13. Ops: [12.9-12.9]
I20260709 12:26:14.328261  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:14.344725  6110 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
W20260709 12:26:14.345196 11229 consensus_meta.cc:287] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.515s	user 0.008s	sys 0.000s
I20260709 12:26:14.345746 11229 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.346487  6609 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:14.349649 11386 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:14.340108 11219 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:14.355432  5959 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:14.363281  5934 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:14.373981  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:13.399652  5968 rpcz_store.cc:276] 0709 12:26:11.968843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:13.295583 (+1326740us) service_pool.cc:224] Handling call
0709 12:26:13.295931 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:13.296148 (+   217us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:26:13.296430 (+   282us) log.cc:844] Serialized 14 byte log entry
0709 12:26:13.394769 (+ 98339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:13.394826 (+    57us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:13.394867 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.394937 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:13.395049 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10853,"prepare.queue_time_us":2648,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":16147,"thread_start_us":82523,"threads_started":1}
I20260709 12:26:14.382875  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:14.383550  6035 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:26:14.384984  5934 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:14.386705  6035 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:14.387104  6035 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:14.387319  5934 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:14.388754  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.330935 11403 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:14.390081  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:14.393172  6118 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:14.349668 11229 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:14.391070  6111 raft_consensus.cc:3055] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:14.394060  6111 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:14.393533  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:14.342356 11342 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:14.387876  6035 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.397742  6009 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:14.401587  6035 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:14.392859 11403 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:14.383208 11368 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:14.407392  6608 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.390369 11349 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:14.395594  6111 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.413141  6111 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:14.411111  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2428) took 3024 ms. Trace:
I20260709 12:26:14.414338  6038 rpcz_store.cc:276] 0709 12:26:11.386673 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.649303 (+1262630us) service_pool.cc:224] Handling call
0709 12:26:12.649565 (+   262us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:12.819068 (+169503us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:14.410890 (+1591822us) spinlock_profiling.cc:243] Waited 98.3 ms on lock 0x7b540028fad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:14.411053 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226006400}
I20260709 12:26:14.415658  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:14.416148  5963 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:14.417074  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:14.417668  5966 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:14.393404 11387 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:14.422176  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:14.429088  6118 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:26:14.338392 11404 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.431880 11139 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:14.433153  6044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2594) took 2381 ms. Trace:
I20260709 12:26:14.410542 11399 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:14.434836 11399 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.437054 11399 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:14.419596 11295 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:14.438158 11125 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:14.433606  6044 rpcz_store.cc:276] 0709 12:26:12.055905 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.988410 (+932505us) service_pool.cc:224] Handling call
0709 12:26:13.457663 (+469253us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:13.459752 (+  2089us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:14.432851 (+973099us) spinlock_profiling.cc:243] Waited 469 ms on lock 0x7b540030edd0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:14.433067 (+   216us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1078330752}
I20260709 12:26:14.392678 11219 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.032s
I20260709 12:26:14.441035 11268 consensus_queue.cc:1059] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 10.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:14.441735 11219 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:14.442085 11219 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:14.442853 11219 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.443384 11268 raft_consensus.cc:3055] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:14.443825 11370 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:14.444111 11219 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:14.445142  5966 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:14.453594  6608 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:14.461476  6035 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:26:14.461790  6035 pending_rounds.cc:85] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 11
I20260709 12:26:14.462013  6035 pending_rounds.cc:107] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:26:14.462237  6035 raft_consensus.cc:2889] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:14.408433 11170 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:14.445011 11296 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.428140  6649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1388) took 2550 ms. Trace:
W20260709 12:26:14.440969 10823 consensus_meta.cc:287] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.787s	user 0.010s	sys 0.001s
I20260709 12:26:14.446249 11387 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.443835 11268 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:14.470543 11170 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.502790 11170 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:14.470388 11295 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:14.510509  6115 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:14.511898 11359 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:14.515442  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:14.489301 11387 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:14.424180  5963 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:14.467958  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:14.469591  6111 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:14.421236 11349 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:14.425115  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:14.420445 11028 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:14.477918  6006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.594s	user 0.014s	sys 0.021s
W20260709 12:26:14.537431  6006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.653s	user 0.014s	sys 0.021s
I20260709 12:26:14.478443  6649 rpcz_store.cc:276] 0709 12:26:11.861623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:11.934382 (+ 72759us) service_pool.cc:224] Handling call
0709 12:26:13.819947 (+1885565us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:13.820491 (+   544us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:14.411701 (+591210us) spinlock_profiling.cc:243] Waited 1.85 s on lock 0x7b54005569d0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:14.411817 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4265339136}
I20260709 12:26:14.479805  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:14.538089  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 657800us
I20260709 12:26:14.538717  6113 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 16: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:14.530550  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2595) took 2394 ms. Trace:
I20260709 12:26:14.433666 11403 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.539059  6006 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:14.537444 11349 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:14.540400  6006 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.540155  6040 rpcz_store.cc:276] 0709 12:26:12.136099 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:13.013195 (+877096us) service_pool.cc:224] Handling call
0709 12:26:13.013527 (+   332us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:13.014274 (+   747us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:13.014303 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:13.014831 (+   528us) log.cc:844] Serialized 26 byte log entry
0709 12:26:13.067564 (+ 52733us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:13.078945 (+ 11381us) log.cc:844] Serialized 14 byte log entry
0709 12:26:13.084301 (+  5356us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:13.084382 (+    81us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:14.445302 (+1360920us) spinlock_profiling.cc:243] Waited 5.38 ms on lock 0x7b180048e8c0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:26:14.530224 (+ 84922us) raft_consensus.cc:1685] finished
0709 12:26:14.530317 (+    93us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:14.530488 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":11904,"prepare.queue_time_us":11134,"prepare.run_cpu_time_us":5484,"prepare.run_wall_time_us":25173,"raft.queue_time_us":5491,"raft.run_cpu_time_us":255,"raft.run_wall_time_us":27268,"spinlock_wait_cycles":12373248,"thread_start_us":52358,"threads_started":1,"wal-append.queue_time_us":153306}
I20260709 12:26:14.478763  6118 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:14.543222 11271 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:14.544422 11222 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:14.544082  6006 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.544544 11271 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:14.488873 11342 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.7, Last appended by leader: 7, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.551362  6006 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.527514 11295 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:14.547298 11271 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:14.554843  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.556169  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:14.559271  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 212877us
I20260709 12:26:14.563539  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.565059  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.565778  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.566350  6039 raft_consensus.cc:2393] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:14.560415 11222 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:14.560196 11410 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:14.313086  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:14.572937  6609 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:14.548127 11170 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.574782  6081 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:14.575392 11189 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:14.576376 11189 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:14.576472 11405 raft_consensus.cc:2764] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:26:14.576900 11295 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.576988 11189 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.579355 11405 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:14.558818 11028 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:14.580613  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.581234  6039 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:14.581061 11028 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.581176  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:14.581420 11189 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:14.582684 11408 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:14.583262  6038 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 4. Current term is 5. Ops: []
I20260709 12:26:14.583117  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.584093  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:14.585215  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:14.585902  6044 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:26:14.563164 11254 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.587263  6036 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:14.551605 11403 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:14.591475  6081 leader_election.cc:400] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15.
I20260709 12:26:14.591746  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.590967  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:14.596613  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.554354 11315 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:14.602137  6044 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:14.601567  6081 leader_election.cc:403] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:14.603116  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.603729  6109 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:14.555065 11399 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:14.555871 11386 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:14.604849  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:14.617816 11359 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:14.610337  6609 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:14.618288  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:14.594800 11410 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:14.595705 11342 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:14.610347 11407 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:14.604070 11408 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.013s
I20260709 12:26:14.616317 11254 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:14.624630 11385 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:14.639374 11385 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:14.639770 11170 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:14.616910 11399 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:14.639672  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 8 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:14.640869  6646 raft_consensus.cc:2393] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 8: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:14.641920  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:14.549970 11268 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.643127  6646 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:14.611537  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.644408  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:14.644795  6041 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:14.617712 11386 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.623471  6039 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:14.613905  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.618276 11359 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.647109  6081 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:14.624362  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:14.627252  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:14.630383  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:14.650393  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:14.651146  6651 raft_consensus.cc:2368] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:14.632177  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:14.635459  6644 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:14.652068  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:14.652146  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:14.647955  6081 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:14.653610  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 181121us
I20260709 12:26:14.654534  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:14.610512 11246 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15.
I20260709 12:26:14.655673  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:14.656131  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:14.656929  5934 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:14.671489  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:14.669624  6084 leader_election.cc:400] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:14.657779 11419 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:26:14.658031  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 54995us
I20260709 12:26:14.662971 11353 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:14.663908 11254 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:14.604839 11370 consensus_queue.cc:1059] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.052s
I20260709 12:26:14.620715 11346 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election lost for term 8. Reason: could not achieve majority
I20260709 12:26:14.639792 11385 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:14.656823 11401 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:14.689539 11028 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:14.668398  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:14.690955  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:14.620108 11234 consensus_queue.cc:1059] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.055s
I20260709 12:26:14.668673  6648 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:14.643175 11268 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:14.628726 11332 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.029s
I20260709 12:26:14.694844  6647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1408) took 1854 ms. Trace:
W20260709 12:26:14.695001 11412 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:26:14.695291  6647 rpcz_store.cc:276] 0709 12:26:12.840640 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:13.075197 (+234557us) service_pool.cc:224] Handling call
0709 12:26:13.075582 (+   385us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:13.075964 (+   382us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:13.075995 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:13.082655 (+  6660us) log.cc:844] Serialized 26 byte log entry
0709 12:26:14.419081 (+1336426us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b18000bb240. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:26:14.559402 (+140321us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:14.559442 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:14.559491 (+    49us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:14.694557 (+135066us) raft_consensus.cc:1685] finished
0709 12:26:14.694578 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:14.694782 (+   204us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2278,"raft.queue_time_us":519,"raft.run_cpu_time_us":104,"raft.run_wall_time_us":5018,"spinlock_wait_cycles":3973504,"thread_start_us":139251,"threads_started":1,"wal-append.queue_time_us":1587926}
I20260709 12:26:14.697252  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:14.674610 11419 consensus_queue.cc:1243] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer 0069e2ba1f02412e8e1d6c20a1fb510f log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:26:14.654444 11359 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:14.670359 11325 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:14.709172 11189 raft_consensus.cc:3055] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:26:14.709642 11189 raft_consensus.cc:740] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:14.710541 11189 consensus_queue.cc:260] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.628985 11030 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
I20260709 12:26:14.713304 11189 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:14.719026  6041 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:14.675343 11127 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:14.670215  6646 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:14.674991  6643 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:14.674273  6649 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:14.723057  6084 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.624823 11258 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.726228 11258 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.727341 11361 consensus_queue.cc:1059] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:14.728749 11258 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:14.729473  6114 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:14.603528 11405 consensus_queue.cc:1059] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.052s
I20260709 12:26:14.731119 11405 raft_consensus.cc:3055] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:14.731405  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:14.701299 11028 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:14.682946  5960 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:14.732157  5962 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:14.680872  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:14.733616 11246 raft_consensus.cc:3055] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:14.734021 11246 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:14.673354  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:14.703776  5959 raft_consensus.cc:1240] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:14.679903 11125 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:14.682765 11360 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:26:14.673556  6006 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.674098 11130 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.724485 11296 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:14.669618 11386 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.693055  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:14.736548  6116 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:14.752902 11130 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.754750  6644 raft_consensus.cc:2410] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 10.
I20260709 12:26:14.754895 11386 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:14.755312 11130 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:14.718757 10823 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.038s
I20260709 12:26:14.757158  6651 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 17: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:14.748044 11127 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:14.758761  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:14.759394  5959 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:14.732398 11028 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.762566  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2427) took 3376 ms. Trace:
I20260709 12:26:14.739359 11199 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:26:14.764164  6038 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:14.766000 11421 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.106s	user 0.000s	sys 0.003s
I20260709 12:26:14.738031  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:14.731500 11405 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:14.758816 11127 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.769706  6116 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:14.726862 11328 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.771878 11328 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:14.772372 11246 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.773579 11246 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:14.769810  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:14.748270  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 74830.1us
I20260709 12:26:14.753315  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:14.779541  6643 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:14.779619  6006 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:14.780839  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.781900  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:14.784193  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.785699  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:14.762962  6037 rpcz_store.cc:276] 0709 12:26:11.386328 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:12.647908 (+1261580us) service_pool.cc:224] Handling call
0709 12:26:12.940316 (+292408us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:13.351388 (+411072us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:14.413588 (+1062200us) spinlock_profiling.cc:243] Waited 410 ms on lock 0x7b5400271354. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:14.762330 (+348742us) spinlock_profiling.cc:243] Waited 292 ms on lock 0x7b5400271350. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:14.762485 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1615830784}
I20260709 12:26:14.787729  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:14.789054  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:14.790349  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:14.794750  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:14.795572  6643 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:14.798311  6643 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:14.800498  6084 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:14.749239  6113 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:14.778688  6081 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.812309  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:14.771733 11386 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:14.815850 11258 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:14.825024 11353 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:14.825630 11353 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:14.826545 11353 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:14.832043  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 47885.9us
I20260709 12:26:14.834829  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.835016  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:14.835460  6044 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:14.835594  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.835943  6036 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:14.836361  6037 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 16: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:14.836896  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.838629  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.841068  6040 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:14.842012  6043 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:26:14.843463  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 46442.4us
I20260709 12:26:14.843647  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:14.844724  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:14.838368  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:14.848466  6037 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:14.848594  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:14.854976  6043 raft_consensus.cc:2368] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15.
I20260709 12:26:14.855888  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.848614  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:14.859794  6042 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:14.861491  6042 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 9. (term mismatch)
I20260709 12:26:14.861904  6042 pending_rounds.cc:85] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 8
I20260709 12:26:14.862181  6042 pending_rounds.cc:107] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 10.9
I20260709 12:26:14.862504  6042 raft_consensus.cc:2889] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:14.851480  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:14.876515  5959 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 15: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:14.877377  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:14.851850  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:14.817708 11408 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:14.852892  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:14.882543  5962 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:14.880322  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:14.853235  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:14.853897  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:14.885298  5968 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 8: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:14.864415  5967 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 12:26:14.822145 10996 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:14.811223 11219 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:14.734436 11387 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.871351  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:14.818033 11328 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:14.874248 11254 raft_consensus.cc:697] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:14.875209  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:14.850284  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.822573 11296 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:14.822886 11332 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:14.854030  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:14.763151 11028 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:14.887437  6611 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:14.831068 11386 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:14.830899 11370 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:14.840750 11343 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:14.890537  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.890125  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.915050  6037 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 16: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:26:14.915369  5862 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 326) took 18889 ms (client timeout 15000 ms). Trace:
I20260709 12:26:14.891278  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.846966 11407 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:14.847389 11214 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:14.884959 11222 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.033s
I20260709 12:26:14.904605  5961 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:14.905074  6044 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:14.823127 11130 consensus_queue.cc:1059] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 7.5, Next index: 6, Last known committed idx: 5, Time since last communication: 0.067s
I20260709 12:26:14.906068  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:14.905617  5934 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:14.916606  6082 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:14.920003  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 106005us
I20260709 12:26:14.904630 11326 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:14.924829  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:14.871757 11170 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:26:14.907436 11328 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.941170  6646 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:14.911849 11370 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.906563 11296 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:14.872825 11410 consensus_queue.cc:1059] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.052s
I20260709 12:26:14.944398  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:14.879868 11349 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.934650 10865 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:14.906672 11161 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:14.903986 11403 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.039s
I20260709 12:26:14.921470 11323 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:14.943781  5865 catalog_manager.cc:5697] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 11 to 14, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 14 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:14.947773 11328 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:14.950343 11258 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:14.951076 11401 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:14.948236 11028 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:14.951615 11254 consensus_queue.cc:237] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 10.6, Last appended by leader: 6, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.940241 11407 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:14.940001 11343 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:14.901687 11359 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:14.953848  5961 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:14.954639 11370 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:14.958365 11296 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:14.958904 11130 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:15.015673  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 124646us
I20260709 12:26:14.963074  5960 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:14.945075  6040 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:14.963992  5965 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:14.964425 11360 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:14.962047  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:14.971982  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:15.018929  6118 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:15.019645  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 70260.7us
I20260709 12:26:15.020421  6082 leader_election.cc:400] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15.
I20260709 12:26:15.020694 11222 consensus_queue.cc:1243] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer 24012af7747d4c4ea89c3da2ff950099 log is divergent from this leader: its last log entry 15.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:26:15.021862  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:14.889159 11271 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.024326 11271 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:15.025226  6035 raft_consensus.cc:2393] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:14.975427 11161 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:14.996608  6038 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:14.951339 11387 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:14.915802  5862 rpcz_store.cc:269] 0709 12:25:56.025806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:25:56.026125 (+   319us) service_pool.cc:224] Handling call
0709 12:26:14.915290 (+18889165us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:07.328543 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:07.329204 (+   661us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:07.329251 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:26:07.329270 (+    19us) tablet.cc:662] Decoding operations
0709 12:26:07.437076 (+107806us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:07.437184 (+   108us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:07.437213 (+    29us) tablet.cc:685] Acquiring locks for 30 operations
0709 12:26:07.439652 (+  2439us) tablet.cc:701] Row locks acquired
0709 12:26:07.439697 (+    45us) write_op.cc:260] PREPARE: finished
0709 12:26:07.439887 (+   190us) write_op.cc:270] Start()
0709 12:26:07.440041 (+   154us) write_op.cc:276] Timestamp: P: 1783599967439822 usec, L: 0
0709 12:26:07.440076 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:26:07.526580 (+ 86504us) log.cc:844] Serialized 11673 byte log entry
0709 12:26:08.160193 (+633613us) op_driver.cc:464] REPLICATION: finished
0709 12:26:08.675008 (+514815us) write_op.cc:301] APPLY: starting
0709 12:26:08.675148 (+   140us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:09.254290 (+579142us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:09.254433 (+   143us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:10.488398 (+1233965us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:10.488867 (+   469us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=60,key_file_lookups=60,delta_file_lookups=60,mrs_lookups=0
0709 12:26:10.488934 (+    67us) write_op.cc:312] APPLY: finished
0709 12:26:10.489564 (+   630us) log.cc:844] Serialized 260 byte log entry
0709 12:26:10.690539 (+200975us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:10.690783 (+   244us) write_op.cc:454] Released schema lock
0709 12:26:10.690876 (+    93us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:10.692807 (+  1931us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:10.692843 (+    36us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1730,"reported_tablets":42,"child_traces":[["op",{"apply.queue_time_us":451964,"apply.run_cpu_time_us":157895,"apply.run_wall_time_us":2030328,"cfile_cache_hit":122,"cfile_cache_hit_bytes":129587,"num_ops":30,"prepare.queue_time_us":323069,"prepare.run_cpu_time_us":25181,"prepare.run_wall_time_us":370104,"raft.queue_time_us":240383,"raft.run_cpu_time_us":120016,"raft.run_wall_time_us":292140,"replication_time_us":698156,"thread_start_us":793671,"threads_started":5,"wal-append.queue_time_us":418205,"wal-append.run_cpu_time_us":25769,"wal-append.run_wall_time_us":2335679}]]}
I20260709 12:26:14.812394 11011 raft_consensus.cc:2955] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Committing config change with OpId 8.8: config changed from index 6 to 8, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:15.037933 11441 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:15.038591  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:15.041769 11441 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:15.042603 11127 consensus_queue.cc:1059] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
I20260709 12:26:15.044271 11127 raft_consensus.cc:3055] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:15.044660 11127 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:15.045516 11127 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.012423 10996 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:15.047216 10996 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.048995 11439 raft_consensus.cc:3055] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:15.049439 11439 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:15.010097  5865 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 11 to 13, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 13 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:14.959442 11423 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:14.898823 11385 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:14.992401  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 110279us
I20260709 12:26:14.990242 11399 consensus_queue.cc:1059] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:26:14.990851 11138 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:15.017791  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:14.996906 11214 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:15.051003  5966 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:26:15.035555 11161 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:15.053417  6116 pending_rounds.cc:85] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 11
I20260709 12:26:15.056337  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:15.057257  5865 catalog_manager.cc:5697] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 8 to 12, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 12 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:15.008932 11323 raft_consensus.cc:697] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:15.077934 11323 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:15.082341 11429 log.cc:927] Time spent T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:26:15.081698  5865 catalog_manager.cc:5697] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 8 to 9, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 9 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:15.083320  5865 catalog_manager.cc:5697] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 11 to 12, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 12 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:15.084818 11432 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:15.086431 11386 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.087899 11386 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:15.085391 11432 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.032706  6118 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:15.065128  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:15.052228  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:15.092140 11385 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:15.092646  6113 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:15.093022 11428 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.129s	user 0.002s	sys 0.000s
I20260709 12:26:15.094028  6648 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:15.068862  6044 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 10 index: 9. (term mismatch)
I20260709 12:26:15.097220  6044 pending_rounds.cc:85] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 8
I20260709 12:26:15.097496  6044 pending_rounds.cc:107] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 9.9
I20260709 12:26:15.097708  6044 raft_consensus.cc:2889] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:15.027665 11028 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:15.071033  6645 raft_consensus.cc:2410] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 13 because replica has last-logged OpId of term: 12 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:26:15.072160  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:15.072845  6116 pending_rounds.cc:107] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 16.12
I20260709 12:26:15.100508  6644 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:15.074985 11435 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.075555 11234 consensus_queue.cc:1059] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:15.076313 11359 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:15.065200 11420 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.117s	user 0.000s	sys 0.001s
I20260709 12:26:15.100700  6040 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:15.100701  6116 raft_consensus.cc:2889] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:15.122408  6118 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:15.105901  6113 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:15.106037  5965 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:15.107803  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:15.110890  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 93147.2us
I20260709 12:26:15.115317 11028 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.131572  6611 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:15.136096  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 5 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:15.128237  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:15.128693  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:15.128238  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:15.035673 11130 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.140477 11130 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.142025  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:15.142728  6644 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:26:15.143198  6009 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:15.143924  6084 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:15.070125 11436 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.111088 11127 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:15.117211  5865 catalog_manager.cc:5697] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 6 to 9. New cstate: current_term: 9 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:15.147233  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:15.125066 11222 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:15.067315 11295 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.068s
I20260709 12:26:15.161181  6040 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:15.071484 11138 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.122913 10865 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:26:15.150813 11130 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:15.164155  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:15.171090  6040 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:15.172823  5865 catalog_manager.cc:5697] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 10 to 12, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 12 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:15.127274 11408 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.036s
I20260709 12:26:15.157816 11380 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:15.181005  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 104057us
I20260709 12:26:15.143787 11229 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.027s
I20260709 12:26:15.050340 11439 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.186776  5865 catalog_manager.cc:5697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 8 to 12, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 12 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:15.188086  5965 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:15.193322 11138 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.197003 11189 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:15.171149 11222 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:15.174541 11130 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.162932 11431 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:15.204789  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:15.162300 11437 consensus_queue.cc:1059] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 8.7, Next index: 8, Last known committed idx: 6, Time since last communication: 0.057s
I20260709 12:26:15.211817  6113 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:26:15.175227 11441 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:15.184402  6040 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:15.164997 11440 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader election lost for term 5. Reason: could not achieve majority
I20260709 12:26:15.124583 11435 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.209445  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:15.216212  6043 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:15.213930  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 66794.6us
I20260709 12:26:15.218731  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:15.219291  5865 catalog_manager.cc:5697] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 4 to 7, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 7 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:15.223712  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:15.228466 11161 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.134184 11343 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.232146 11407 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.186316 11271 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:26:15.234617 11435 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.221781 11439 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:15.210224 11258 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:26:15.241432 11441 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:15.242950 11361 raft_consensus.cc:3055] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:15.243412 11361 raft_consensus.cc:740] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:15.244086 11342 consensus_meta.cc:287] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.600s	user 0.004s	sys 0.004s
I20260709 12:26:15.157382 11436 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.244261 11361 consensus_queue.cc:260] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.245476 11361 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:15.246318 11436 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.248746 11296 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.223009  5865 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:15.258584  5963 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:15.259315  6111 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:26:15.263437  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:15.264279  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:15.264971  6113 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:15.267756  5865 catalog_manager.cc:5697] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:15.265844  6043 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:15.214480 11130 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:15.273012 11431 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:15.215633 11349 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:15.253964 11328 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.349797 11125 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.350139 11435 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.350571 11125 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.353546  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:15.354187  6043 raft_consensus.cc:2376] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14. Re-sending same reply.
W20260709 12:26:15.353847  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 130197us
I20260709 12:26:15.355825  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:15.356364  6040 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:26:15.358305  6043 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14. Ops: [11.11-13.12]
I20260709 12:26:15.352425 11222 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:15.360447  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:15.370414  6113 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:15.376029  5865 catalog_manager.cc:5697] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 7 to 11, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 11 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:15.351001 11435 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.380862 11435 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.382143 11296 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.382820 11296 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.383309 11296 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:15.368260 11450 log.cc:927] Time spent T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.154s	user 0.000s	sys 0.001s
W20260709 12:26:15.374761 11246 consensus_meta.cc:287] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.594s	user 0.009s	sys 0.007s
I20260709 12:26:15.359566 11325 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:15.365543 11403 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.375875 11125 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:15.398315  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:15.400568  5865 catalog_manager.cc:5697] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 10 to 11, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 11 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:15.402263  5865 catalog_manager.cc:5697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 7 to 10. New cstate: current_term: 10 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:15.376709 11440 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.423542  5865 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:15.373304 11370 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.440603 11370 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.424602 11214 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:15.455708 11296 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.456892 11431 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.7, Last appended by leader: 7, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.406025 11246 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:15.477782  6109 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:26:15.486864  5865 catalog_manager.cc:5697] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 7 to 8, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:26:15.405648 11403 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.463609 11130 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.495819 11328 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:15.444555 11452 consensus_queue.cc:1059] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:26:15.482242 11296 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:15.512732  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 139625us
I20260709 12:26:15.514405 11214 raft_consensus.cc:3055] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:15.525190 11214 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:15.526119 11214 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.431645 11440 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.557723  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:15.558564  6044 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
W20260709 12:26:15.560035 11455 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:26:15.561793 11440 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.562095 11403 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:15.570914  6041 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:15.575482 11161 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.588407  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:15.589490  6041 raft_consensus.cc:2410] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 13 because replica has last-logged OpId of term: 11 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:26:15.586489  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:15.590952 11403 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.591506 11403 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.583105 11161 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:15.592655 11161 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.594995 11403 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.596796 11458 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:15.597240 11458 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:15.597579 11458 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:15.599195 11454 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.155s	user 0.002s	sys 0.000s
I20260709 12:26:15.606851  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:15.608444 11439 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:15.609040 11439 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.615653  6040 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:15.507326 11296 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.626747 11161 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:15.613423 11457 consensus_queue.cc:1059] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:26:15.672041 11326 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:15.687695 11439 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:15.685222 11326 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:15.691713 11458 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.694950 11432 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:15.698148 11458 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.706208 11434 raft_consensus.cc:3055] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:15.705904 11405 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.706750 11434 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:15.707146 11405 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:15.747202  5934 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:15.749785  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:15.754066  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:15.755607  5963 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:15.773532  6081 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:15.782599  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:15.783496  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 2616) took 1192 ms. Trace:
I20260709 12:26:15.784124  6116 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 13: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:15.785579  6036 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:15.776104  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 2619) took 1007 ms. Trace:
I20260709 12:26:15.780306  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:15.793140 11296 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.707881 11434 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.796883 11434 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:15.801558 11130 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.803536 11353 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:15.803910 11199 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:15.804489 11199 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:15.804996 11199 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:15.805546 11342 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:15.784024  6038 rpcz_store.cc:276] 0709 12:26:14.590887 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.591505 (+   618us) service_pool.cc:224] Handling call
0709 12:26:15.783059 (+1191554us) spinlock_profiling.cc:243] Waited 162 ms on lock 0x7b54001f2f54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:15.783278 (+   219us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":373247744}
I20260709 12:26:15.788990  6035 rpcz_store.cc:276] 0709 12:26:14.768314 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.769511 (+  1197us) service_pool.cc:224] Handling call
0709 12:26:15.775533 (+1006022us) spinlock_profiling.cc:243] Waited 250 ms on lock 0x7b540030e8d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:15.775867 (+   334us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":575716096}
I20260709 12:26:15.818393  5963 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:15.821156  5964 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:15.824841 11441 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:15.825960 11459 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:15.827046 11353 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:15.827641  6039 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:15.828493  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:15.829524  6044 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:15.827102  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:15.812322  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 60561.2us
I20260709 12:26:15.827598  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:15.841002  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:15.861899  5934 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:15.863113 11161 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:15.863945  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:15.865128  5965 raft_consensus.cc:2410] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 13 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:26:15.870718  6038 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:15.874800 11246 raft_consensus.cc:3055] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:15.875389 11246 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:15.836427 11441 raft_consensus.cc:697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:15.863705 11161 raft_consensus.cc:697] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:15.903378  5963 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:15.906076  5965 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:26:15.907781 11459 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:15.908094  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:15.908542  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:15.908325  6043 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:15.907977  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:15.915429  6039 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 6. Preceding OpId from leader: term: 11 index: 7. (index mismatch)
I20260709 12:26:15.917549 11219 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:15.918906  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:15.918560 11219 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.920189 11353 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.921396 11219 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:15.926578  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:15.903223 11214 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:15.932948  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:15.893358 11246 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:15.933025 11161 consensus_queue.cc:237] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.936115 11246 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:15.938433  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:15.941646  6113 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:15.934233  6643 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:15.943970  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:15.945775  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:15.947154  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:15.938493  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:15.948225  6642 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:15.948493  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:15.948912  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:15.950845  5959 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: [8.8-10.9]
I20260709 12:26:15.951802  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:15.951442  5963 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:15.938990  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:15.954921  6116 raft_consensus.cc:2368] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18.
I20260709 12:26:15.956427  6650 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:15.959192 11441 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 12.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.908552 11459 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:15.948182  5967 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 13: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:15.926807  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:15.970245  5964 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
W20260709 12:26:15.977849  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 70794.3us
I20260709 12:26:15.980852  6646 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:15.982488  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:15.983368  6647 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:15.994626  6044 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:16.000337  6647 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:16.001931  6006 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:16.003212 11408 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:16.004011 11170 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.003950 11408 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.004953 11170 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.006773 11470 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:16.007354 11470 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.007627 11328 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:16.007766 11470 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:16.009353  6648 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:16.026221  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:16.014488 11125 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.031855 11125 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.018740 11408 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:16.026122  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:16.040270 11343 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:16.063220 11343 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.063633 11343 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:16.065999  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:16.067036 11120 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:16.068809 11370 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:16.069394 11370 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:16.071120  5963 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:16.043825 11459 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:16.039826  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 47295.6us
I20260709 12:26:16.072429 11138 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:16.063673  6645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50470 (request call id 1026) took 1427 ms. Trace:
I20260709 12:26:16.073107 11138 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.073885  5934 leader_election.cc:400] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18.
I20260709 12:26:16.074242  5934 leader_election.cc:403] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:26:16.075733 11138 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:16.076606 11471 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18.
I20260709 12:26:16.076687  6645 rpcz_store.cc:276] 0709 12:26:14.636450 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:14.651830 (+ 15380us) service_pool.cc:224] Handling call
0709 12:26:16.063223 (+1411393us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54003dbb54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:16.063452 (+   229us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":961632000}
I20260709 12:26:16.078366 11370 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.044481 11170 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.061623 11268 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:16.103511 11476 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:26:16.043125 11199 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.106524 11199 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:16.107457 11268 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.108428 11474 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.109081 11474 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.109881 11268 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:16.071153  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:16.111209  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:16.111622  6081 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:16.111825  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:16.112567  6116 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:16.081266  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:16.081128 11404 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:16.113626 11296 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:16.082124  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:16.114704 10865 consensus_queue.cc:1059] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 11.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.017s
I20260709 12:26:16.100477  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:16.072177  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 696735us
I20260709 12:26:16.112746 11254 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:16.117038 11254 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:16.118409  5934 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:16.118775  6040 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:16.116328  6647 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:16.121382  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:16.123685  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:16.125061  6118 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:26:16.102905 11370 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:16.119444 11459 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.007s
I20260709 12:26:16.126633 11461 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
W20260709 12:26:16.104230 11458 consensus_queue.cc:1175] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0557a7246c8945b99e5215c99d4ddf9c" responder_term: 18 status { last_received { term: 18 index: 11 } last_committed_idx: 11 last_received_current_leader { term: 18 index: 11 } }
I20260709 12:26:16.127836  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:16.128505  6646 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:16.080891  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:16.129462  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:16.130393  6650 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:16.130432  6109 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:16.115123  6111 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:16.115836 11404 raft_consensus.cc:3055] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:16.130908  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:16.135612 11472 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:16.136209 11472 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.136698 11472 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:16.138618 10865 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:16.136145 11325 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.008s
I20260709 12:26:16.116238 11474 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:16.034297 11125 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.144156 10865 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:16.149784 10865 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.092235  6648 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:16.148285  6642 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:16.154667  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:16.134354 11404 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:16.155432  5963 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:26:16.115026 11470 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.156236 11404 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.158030 11404 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:16.158762 11470 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:16.158983  6651 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:16.159207 11434 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:16.160317 11325 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.161085 11325 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.164954  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:16.165933  6041 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 5.
I20260709 12:26:16.118358 11254 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.147703  6116 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:26:16.180231  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:16.133497  6043 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:16.145731  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:16.147431  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:16.189318  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:16.190739  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:16.190582  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:16.191371  5963 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 4.
I20260709 12:26:16.189829  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:16.196946  6651 raft_consensus.cc:2368] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18.
I20260709 12:26:16.194113  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:16.164980 11325 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:16.209862  6646 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:16.198805  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:16.212146  6040 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:16.213343  5962 raft_consensus.cc:2393] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:16.208565  5959 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 6. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:26:16.212313  6082 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:16.201419 11138 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:16.226013  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:16.226737  5963 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:16.227595  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:16.228742 11138 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:16.231506 11326 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.232265 11138 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.234768  5964 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:16.238938  6006 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:16.239243 11475 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.239885 11475 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.240581 11445 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:16.240953  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 93698.8us
I20260709 12:26:16.243115 11461 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:16.243700 11461 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:16.244794 11461 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.232332  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:16.246687 11325 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:16.247249  6609 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:16.247427 11325 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.249085 10823 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:16.249485 10823 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.249831 10823 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:16.250504  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52804.7us
I20260709 12:26:16.250942 11413 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:16.251701 11413 consensus_queue.cc:1243] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer 0557a7246c8945b99e5215c99d4ddf9c log is divergent from this leader: its last log entry 14.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:26:16.254258 11325 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:16.246744  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 58772.1us
I20260709 12:26:16.260258  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:16.251183 11296 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:16.272728 11296 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:16.259500  6647 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:16.262832  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:16.263974  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:16.274000 11296 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.274794  6651 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 5.
I20260709 12:26:16.272069 11459 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.250267 11386 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:16.262173  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:16.270256  6084 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:16.270560 11475 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:16.271260  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:16.272138  6114 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:16.261181  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:16.280480  6043 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 14: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:16.265425  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:16.266445  6040 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:16.254853  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:16.277912  6109 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
W20260709 12:26:16.282487  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 62127.3us
I20260709 12:26:16.195874 11343 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.286693  6115 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 13: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:16.286952  6113 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:16.288682  6611 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:16.289353  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:16.292346  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:16.294106  6643 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:16.289608 11475 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Leader pre-election won for term 6
I20260709 12:26:16.289839 11386 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:16.286513  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:16.277482 10823 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.293010  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:16.275349 11125 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:16.282070 11445 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.303819  5965 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:16.301767  6643 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:16.295552  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:16.288599 11448 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.315668  6651 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:16.262243 11472 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.312613 11475 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.360852 11475 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:16.295751 11315 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:16.364817 11315 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.286523 11268 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:16.369379  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 57464.9us
I20260709 12:26:16.275636 11459 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.291530 11214 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election won for term 14
W20260709 12:26:16.299615 11483 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.058s	user 0.003s	sys 0.000s
I20260709 12:26:16.328446 11441 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:16.384778  6649 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:16.376027  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:16.359372 11161 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.365262 11315 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:16.356529 11170 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:16.399343  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:16.404299 11408 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:16.405114 11408 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.406066 11326 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:16.408103  6035 pending_rounds.cc:85] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 11
I20260709 12:26:16.408529  6035 pending_rounds.cc:107] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:26:16.408851  6035 raft_consensus.cc:2889] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:16.389266 11219 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:16.414863  6036 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
W20260709 12:26:16.415422 11484 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:26:16.417955  5934 leader_election.cc:400] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18.
I20260709 12:26:16.370309 11448 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.418848 11405 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:16.419286 11405 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.419587 11405 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:16.420380 11448 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:16.423556 11479 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.135s	user 0.000s	sys 0.000s
I20260709 12:26:16.426146 11445 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.426879  6642 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:16.428310 11214 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:16.429418 11214 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.430625 11343 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:16.432665 11408 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:16.434988  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:16.395941 11268 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.396445 11441 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:16.442454  6114 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:16.451892  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:16.453032  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:16.463654  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 190937us
I20260709 12:26:16.399642 11161 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.414963 11219 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.460829 11120 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Leader pre-election won for term 5
I20260709 12:26:16.482139  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:16.482581  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:16.441756 11445 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:26:16.439903 11170 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.480077  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:16.499199  6116 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:16.491408  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:16.477442 11448 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.492595  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:16.499023  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 259216us
I20260709 12:26:16.500649  6110 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:16.505663  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:16.504408  5966 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:16.518774  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:16.519791 11219 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.520304  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:16.507778 11386 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.521764 11170 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.521940  6037 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:26:16.487507 11120 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:16.522574  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:16.522827 11120 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:26:16.523913  6041 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:16.522838 11448 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.520958  6648 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:16.485153 11472 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.530452  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:16.531116  6648 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:26:16.530742 11315 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.531482 11268 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.531996  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:16.532119 10823 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:16.532614  6648 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:16.533123 11315 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.530481  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:16.523098  6118 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:16.550760  6643 raft_consensus.cc:2368] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:16.552208  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:16.515204  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:16.529696 11448 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.511646 11325 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.052s
I20260709 12:26:16.564131  6041 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:16.565200  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:16.567830  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:16.569350  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 54264.9us
I20260709 12:26:16.567023  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:16.571187  6651 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:16.535811 11408 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:16.578352  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:16.513996 11471 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:16.519855 11459 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:16.579784  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:16.581012 11408 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.586252 11408 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:16.588496 11471 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.590754 11471 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.591295 11471 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.591738 11471 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.593525 11471 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.594547 11474 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:16.595258 11474 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.597538 11474 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.602049  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:16.608507  6038 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:16.615716  6648 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:16.618624  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:16.619410  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:16.620129  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:16.620530  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:16.621116  6650 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:16.577526 11448 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:16.622812 11448 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.623178 11448 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:16.625519  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:16.626351  6109 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 16: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:16.626719  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:16.602717  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:16.628736  6041 raft_consensus.cc:2393] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 5: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:16.628894  6110 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:26:16.618683  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:16.605454 11488 log.cc:927] Time spent T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.083s	user 0.000s	sys 0.001s
I20260709 12:26:16.607848  6040 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:16.603513  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:16.629423  6038 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:16.631191  6116 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:16.630607  6117 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:26:16.583242  6042 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:16.637945  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:16.530637 11432 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 5, Time since last communication: 0.072s
W20260709 12:26:16.619695 11493 log.cc:927] Time spent T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:26:16.578610 11472 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.641438  6113 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:16.642619  6648 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:16.650786  6084 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:16.641413  6111 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 14 index: 7. Preceding OpId from leader: term: 16 index: 8. (index mismatch)
I20260709 12:26:16.641889  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:16.644605  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:16.639035  6651 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:16.650837  6114 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:16.662319  6611 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:16.673058  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:16.654484 11295 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.567756 11441 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.684891 11326 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.667577 11432 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.687237 11448 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.688755  6038 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:16.691715 11161 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.698923  6084 leader_election.cc:400] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:16.700024  6084 leader_election.cc:403] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:16.659994 11459 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:16.711835  6118 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:16.700982  6609 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:16.697445 11268 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:16.665445 11472 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.702657 11459 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.762045  6649 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:16.654171 11408 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.745378  6042 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:16.667409 11120 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.748764 11268 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:16.763674 11459 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:16.735809 11326 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.701133 11295 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:16.703164 11432 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.780200 11477 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:16.778296 11268 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:16.777711 11315 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:16.770813 11475 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:16.786772 11138 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.511s	user 0.016s	sys 0.041s
W20260709 12:26:16.819473  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:16.799114 11448 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.791164 11315 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:16.810912 11138 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.016s	sys 0.042s
I20260709 12:26:16.863777  6009 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:16.868938  6038 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:26:16.841933 11315 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:16.871249  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:16.827925 11404 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:26:16.827088 11477 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:16.923138  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 178620us
I20260709 12:26:16.906821 11170 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:16.909641 10823 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:16.963478  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:16.978699 11028 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.979465 11028 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:16.981735 11028 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:16.951830 11343 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:16.944108 11472 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:16.989490  6110 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:16.997459 11120 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:17.006656 11295 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:17.010257 11501 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.482s	user 0.004s	sys 0.000s
I20260709 12:26:17.016582 11461 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.019398 11477 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:17.022354  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 76770.9us
I20260709 12:26:17.035661 11458 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:17.036455  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:17.036828  5966 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:17.039108  6009 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:17.047380  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:17.047791  5961 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 16: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:17.050086  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:17.052641  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:17.053241  5963 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:17.051843  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 350923us
I20260709 12:26:16.988605 11408 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:17.032117 11214 raft_consensus.cc:2764] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:26:17.039917 11170 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.061225  6009 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:17.057739  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 285826us
I20260709 12:26:17.051442 11475 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:17.091702  5962 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:26:17.056288 11219 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:17.056469 11326 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:17.051589 11432 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:17.104379  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.114674  6038 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:17.116394  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:17.087598 11405 consensus_meta.cc:287] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.668s	user 0.010s	sys 0.002s
I20260709 12:26:17.119547  6645 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:17.112485  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:17.113709  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:17.040174 11343 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.122109  6043 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:17.124119  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:17.129627  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 56386us
I20260709 12:26:17.130409  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:17.132429  5959 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 14: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:17.133203  5961 raft_consensus.cc:2393] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:17.116673 11214 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:17.176632  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:17.181044  5965 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:26:17.186367  5962 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:26:17.058269 11461 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.107821 11170 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.125658 11326 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:26:17.162778 11219 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.197103  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.197522  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:17.201495  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 141337us
I20260709 12:26:17.203639  6117 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:17.203842  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:17.204670 11432 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:17.205063 11432 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:17.205406 11432 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:17.205466 11271 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:17.205510  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:17.206489 11271 consensus_queue.cc:1243] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer 24012af7747d4c4ea89c3da2ff950099 log is divergent from this leader: its last log entry 17.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:26:17.206981 11271 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:17.207283 11271 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:17.207659  6009 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:17.208120 11271 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.208853  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:17.209120 11408 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:17.210592 11408 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:17.211130 11408 raft_consensus.cc:697] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:17.211406  6117 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:17.212078 11408 consensus_queue.cc:237] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 9.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.213313  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:17.176930 11214 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:17.187718 11501 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:26:17.216351  5965 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:26:17.254359 11494 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:26:17.231032 11509 consensus_queue.cc:1059] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:17.268805  5963 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:17.255766 11528 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.100s
I20260709 12:26:17.182001 11441 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:17.216459 11504 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.103s	user 0.001s	sys 0.000s
W20260709 12:26:17.235675  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:17.231441 11214 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:17.231956  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:17.130101 11405 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.218057  5934 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:17.216120 11505 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.074s	user 0.001s	sys 0.000s
I20260709 12:26:17.317442  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:17.347846  6117 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 12: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:17.300475  6043 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
W20260709 12:26:17.233371 11503 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
I20260709 12:26:17.348450  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 14 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:17.254716  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:17.329033  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:17.322963 11531 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.137s	user 0.000s	sys 0.000s
I20260709 12:26:17.349717  6109 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
W20260709 12:26:17.322224 11268 consensus_meta.cc:287] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.512s	user 0.009s	sys 0.009s
I20260709 12:26:17.364795  6115 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:26:17.368551  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:17.338426 11271 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:17.236896 11219 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:17.346951  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 128953us
I20260709 12:26:17.355419 11028 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:26:17.352725  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 139483us
I20260709 12:26:17.377276  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:17.379102  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:17.379522  6118 raft_consensus.cc:2393] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:17.381353  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:17.381346  5963 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:26:17.372079 11325 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.378692 11535 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.434206  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:17.435951  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:17.436492  5963 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:17.374390 11472 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.362227 11268 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.433655  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:17.349318 11441 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.434954  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:17.441942  5968 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:17.379387 11509 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:17.375907 11512 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:17.453788  5959 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:17.458344 11537 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:17.469640 11537 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:17.471095 11522 log.cc:927] Time spent T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:26:17.471989 11535 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.401134 11343 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:17.395958 11028 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:17.440054 11325 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.486014 11546 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:17.487293 11541 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:17.447681 11516 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.291s	user 0.000s	sys 0.001s
W20260709 12:26:17.447328 11517 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.130s	user 0.000s	sys 0.001s
I20260709 12:26:17.437686 11138 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:17.501715  6042 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:17.503909  5963 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:17.487844 11541 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:17.512089  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 130776us
I20260709 12:26:17.512575  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.516460  6044 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:26:17.468111 11353 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:17.516867  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.519515 10865 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:17.524538 11527 log.cc:927] Time spent T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.151s	user 0.001s	sys 0.001s
I20260709 12:26:17.474442 11535 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:17.475749 11268 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:17.532505  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:17.539734  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:17.540510 10865 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.542819 10865 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:17.544965  6117 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:17.545614  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:17.545768  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.546200  6113 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:17.546432  6039 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
W20260709 12:26:17.514542 11484 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:26:17.547528  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.548614  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:17.549160 11532 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:26:17.549680  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:17.550395  6039 raft_consensus.cc:2368] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6.
I20260709 12:26:17.551460  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.551579  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.462257 11509 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.553490  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.553985  6039 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:17.554668 11461 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:17.555277  6650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 1287) took 1155 ms. Trace:
I20260709 12:26:17.555665  6650 rpcz_store.cc:276] 0709 12:26:16.399444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:16.621674 (+222230us) service_pool.cc:224] Handling call
0709 12:26:16.622014 (+   340us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:26:16.627243 (+  5229us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:16.627270 (+    27us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:26:16.665653 (+ 38383us) log.cc:844] Serialized 78 byte log entry
0709 12:26:16.961406 (+295753us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:16.961454 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:16.961522 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:17.555060 (+593538us) raft_consensus.cc:1685] finished
0709 12:26:17.555079 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:17.555225 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":523,"raft.queue_time_us":4735,"raft.run_cpu_time_us":123,"raft.run_wall_time_us":4025,"thread_start_us":229618,"threads_started":1,"wal-append.queue_time_us":464827}
I20260709 12:26:17.546764  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.552057  6040 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:26:17.499416 11512 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:17.560942 11512 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.515359 11138 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.447992 11432 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.519979 11546 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.554317 11530 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:17.575388 11530 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.577986 11473 raft_consensus.cc:3055] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:17.578398 11473 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:17.582531  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:17.583287 11405 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:17.583884 11405 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.584332 11405 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.554119  6044 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:17.530364 11541 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:17.590217 11533 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.195s	user 0.000s	sys 0.001s
I20260709 12:26:17.591185 11138 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:17.592108 11520 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.263s	user 0.000s	sys 0.001s
I20260709 12:26:17.595643 11546 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:17.596824 11432 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:17.597409 11432 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:17.600626  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:17.601341  6109 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 16: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:17.603498  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:17.604025  6044 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:17.604739  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.605334  6037 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:17.606637  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.608582 11170 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:17.609176 11170 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:17.609959 11170 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:17.611452 11509 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:17.614832 11530 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:17.618271  6042 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:17.620281  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:17.621291 11459 consensus_meta.cc:287] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.839s	user 0.004s	sys 0.004s
I20260709 12:26:17.621197  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 6 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:17.579206 11473 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.625787  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:17.626072 11524 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:17.453332 11472 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.627096  6042 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
W20260709 12:26:17.627238 11315 consensus_meta.cc:287] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.710s	user 0.010s	sys 0.000s
I20260709 12:26:17.598060 11432 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:17.635788  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:17.668045  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 270724us
I20260709 12:26:17.638283  5968 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:26:17.648105  6110 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
W20260709 12:26:17.588249 11513 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.199s	user 0.001s	sys 0.000s
W20260709 12:26:17.650508  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:17.626446  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3007) took 1002 ms. Trace:
I20260709 12:26:17.670945  6115 rpcz_store.cc:276] 0709 12:26:16.624201 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:16.637717 (+ 13516us) service_pool.cc:224] Handling call
0709 12:26:16.643474 (+  5757us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:17.365202 (+721728us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:17.626199 (+260997us) spinlock_profiling.cc:243] Waited 721 ms on lock 0x7b5400101dd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:17.626391 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1658341760}
I20260709 12:26:17.673023  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:17.674711  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:17.675052  6645 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:17.658915  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:17.660825  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 78390.7us
I20260709 12:26:17.664528  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.586349 11405 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:17.676146  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:17.663933  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 6 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:17.678197  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:17.686188  5964 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:17.685717  5961 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 5 FOLLOWER]: Advancing to term 6
I20260709 12:26:17.653550 11524 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:17.682087  6648 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:17.672947  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:17.683521  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:17.684015  6113 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:17.665814  6650 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:17.693374  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:17.679880  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:17.690472  6111 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 16 index: 9. (index mismatch)
I20260709 12:26:17.659708 11474 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Leader election won for term 6
I20260709 12:26:17.660110 11530 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:17.608768 11214 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.697961  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:17.699311  6113 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:17.701886  6116 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:17.703972  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:17.695242 11405 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.706776 11405 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.709057 11405 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:17.696979 11524 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:17.711688  6112 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:17.712836 11545 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.029s
I20260709 12:26:17.713585 11138 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.714095 11138 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:17.715122 11510 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.205s	user 0.000s	sys 0.000s
I20260709 12:26:17.716203 11138 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:17.716491  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 1794) took 1402 ms. Trace:
I20260709 12:26:17.716889  6035 rpcz_store.cc:276] 0709 12:26:16.314569 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:16.314708 (+   139us) service_pool.cc:224] Handling call
0709 12:26:16.398060 (+ 83352us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:16.446389 (+ 48329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:16.446420 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:16.459674 (+ 13254us) log.cc:844] Serialized 52 byte log entry
0709 12:26:16.934616 (+474942us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:16.934659 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:16.934720 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:17.716249 (+781529us) raft_consensus.cc:1685] finished
0709 12:26:17.716271 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:17.716408 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":26752,"raft.queue_time_us":33433,"raft.run_cpu_time_us":166,"raft.run_wall_time_us":13493,"thread_start_us":435201,"threads_started":1,"wal-append.queue_time_us":922924}
I20260709 12:26:17.717809  6082 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:17.719173 11246 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:17.719246  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:17.684578 10823 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:17.719611 11246 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:17.719952 10823 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.720319  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:17.721880  6009 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:17.722074 10823 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:17.722668 11546 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:17.681434 11315 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.723055 11546 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:17.723479 11546 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:17.723862 11539 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:17.724242 11539 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:17.724568 11539 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:17.724848 11541 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:17.725373 11296 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:17.725747 11296 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:17.726075 11296 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:17.726612 11541 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:17.726739 11550 consensus_queue.cc:1059] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:17.673198 11526 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:17.736925 11530 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.737519 11472 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:17.680069 11473 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:17.739359 11246 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:17.675642 11404 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.071s
I20260709 12:26:17.744498 11539 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.745916  6081 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:17.746723 11509 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:17.747655  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 59784.6us
I20260709 12:26:17.722997  6009 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:17.750411 11511 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:17.750754 11509 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:17.726177  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.725225 11315 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:17.727504 11254 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:17.757946 11254 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:17.758306 11254 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:17.739359 11530 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:17.728418 11541 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:17.761485 11541 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:17.766590 11219 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:17.767166 11513 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:26:17.770321 11214 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:17.765442 11548 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:17.775202 11529 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.074s
I20260709 12:26:17.779202  5961 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 6.
I20260709 12:26:17.780351  5932 leader_election.cc:400] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6.
I20260709 12:26:17.780756 11511 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:17.781785  5960 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:17.782378  6081 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:17.789129  6081 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:17.790314 11548 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:17.791342 11296 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.791977 11548 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:17.792644 11548 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.793398 11296 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:17.795058 11548 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:17.796325 11524 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.798349 11254 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.790586  5932 leader_election.cc:403] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 5 election: Cancelling election due to peer responding with higher term
I20260709 12:26:17.685823 11325 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:17.657205 11459 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:17.828688  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 143110us
I20260709 12:26:17.808296  5964 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
W20260709 12:26:17.828686  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 105738us
I20260709 12:26:17.835351  6009 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:17.835882  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.835990  6112 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:17.831254  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:17.836964  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 56761.6us
I20260709 12:26:17.835774  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:17.839188  6037 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:17.832237  6611 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:17.839993  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:17.836501 11477 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:17.841542 11477 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.866006  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:17.861860  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.850924  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:17.869346  6114 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:17.869468  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:17.802230 11541 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.869880 11441 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:17.877519  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:17.871409  6642 raft_consensus.cc:2368] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17.
I20260709 12:26:17.874282  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.879058  6039 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:17.875308  6118 raft_consensus.cc:2393] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:17.879518  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.876093  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:17.880513  5963 raft_consensus.cc:2393] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:17.876700  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:17.877270  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 11 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:17.881055  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.883788  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:17.883949  5934 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:17.870219 11509 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:17.830847 11548 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:17.842221 11473 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader election lost for term 5. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 5. Current term is 6.
I20260709 12:26:17.891144  5964 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:17.836736 11219 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:17.870337 11254 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:17.882926 11370 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.503s	user 0.022s	sys 0.043s
I20260709 12:26:17.886667  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:17.857801 11353 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:17.757629 11246 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:17.892635  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 137916us
I20260709 12:26:17.885479  5934 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:17.882820 11551 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:17.870685 11138 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:17.881520 11408 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:17.902510  6041 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:26:17.902981  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 69880.9us
I20260709 12:26:17.903780  6084 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:17.695600 11028 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.887444 11343 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:17.935295  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 49890.3us
I20260709 12:26:17.945392  5934 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:17.864423 11511 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:26:17.935981  6111 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: []
W20260709 12:26:17.938748  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 106594us
I20260709 12:26:17.874215 11530 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.028s
W20260709 12:26:17.900817 11370 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.529s	user 0.023s	sys 0.043s
I20260709 12:26:17.904573 11219 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:17.937443 11138 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:17.895236 11509 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:17.958173  6651 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:17.893842 11458 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.055s
I20260709 12:26:17.963707  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:17.931988 10823 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:18.006685  6649 raft_consensus.cc:2393] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:17.952369 11540 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:17.992236  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:17.948340 11254 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.015928 11254 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:18.018085 11254 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:18.015167 11518 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.004s
I20260709 12:26:17.896585 11548 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:17.945410 11526 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:18.020023 11526 raft_consensus.cc:697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:18.020941 11526 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.022310 11509 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:18.023830 11459 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:18.002175  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:17.967862  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:18.025077  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 57315.3us
I20260709 12:26:17.954046 11296 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.071s
I20260709 12:26:18.025745 11380 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:17.949731 11473 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
W20260709 12:26:18.001742  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 58566.6us
I20260709 12:26:18.003652  6039 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:17.951886 11353 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:17.960556  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:17.955328 11551 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.014726 11387 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.015046  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:18.030752  6041 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:18.032742  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:17.994982 11138 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:17.961203 11315 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:18.001421  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:17.901819 11546 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:18.029151  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:18.015208  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:18.026801 11524 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:18.015341 11477 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:18.033509  6114 raft_consensus.cc:2393] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:18.036016 11551 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:18.036751 11387 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:18.028266 10823 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.020795 11246 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:18.043031 11539 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:18.043579 11170 raft_consensus.cc:3055] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:18.020848 11548 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:17.957211 11528 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.076s
I20260709 12:26:18.026289 11380 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:18.015874 11472 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.035s
I20260709 12:26:17.956779 11404 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
W20260709 12:26:18.060634  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:18.079146  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:18.046823  6037 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:18.051398 11219 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:18.083041  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:18.085093  6110 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:18.067451  6114 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:18.047708  6650 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:18.056797  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:18.072551  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:18.093326  6113 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:18.072620  6041 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:18.057585  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:18.057518  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:18.096347  6644 raft_consensus.cc:2393] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:18.124312  6009 leader_election.cc:400] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17.
I20260709 12:26:18.124802  6009 leader_election.cc:403] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:26:18.128787  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:18.136521  6114 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:26:18.136970 11474 raft_consensus.cc:697] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:18.141486  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:18.145524  6009 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:18.146422  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 138981us
I20260709 12:26:18.061739 11546 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:18.153309  6113 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:18.146512  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:18.068535 11170 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:18.162762  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:18.168015  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:18.168804  5962 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:26:18.170569 11549 consensus_queue.cc:1059] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:18.172648  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:18.173729 11413 consensus_queue.cc:1059] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:18.170276  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:18.164309  6611 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:18.176450  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:18.176537  6111 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:18.179435  6113 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:18.174429  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:18.184468  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:18.140988 11246 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:18.186484  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:18.187075 11246 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:18.144802 11539 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:18.188083 11246 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:18.188894 11549 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:18.189152  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:18.164284 11271 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:18.162744 11161 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.028s
I20260709 12:26:18.190747 11271 raft_consensus.cc:697] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:18.192188 10823 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:26:18.191847 11271 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.183121  6110 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:18.194037 10823 raft_consensus.cc:3055] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:18.195775 11170 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.196471 10823 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:18.197077 11571 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:18.197371  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:18.197270 10823 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.198410  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:18.198580 10823 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:18.200964 11120 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:18.203080 11509 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:18.203469 11509 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:18.204380 11509 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.205675 11509 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:18.197104 11170 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:18.188030 11539 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:18.215389 11445 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:18.216065 11445 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:18.217012 11445 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.218003  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:18.127190 11432 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:18.219516 11432 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.221783 11432 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:18.222666 11380 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.226342  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:18.226557  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:18.255975  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:18.235260  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:18.284852 10823 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:26:18.285071  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 49896.9us
I20260709 12:26:18.285441 10823 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:18.287088  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:18.284219  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:18.289038  6113 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 20: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:18.285585  6110 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:26:18.058975 11315 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.160056 11470 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:18.308261  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:18.310528  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:18.159834 11405 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:18.160622 11214 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:18.227990 11541 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:18.323629  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:18.332886  6039 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:18.334396 11556 log.cc:927] Time spent T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:26:18.258553 11537 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:18.325839 10823 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:18.354446  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 67420.3us
I20260709 12:26:18.355342  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:18.216189 11539 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:18.298125 11138 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:18.373311  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:18.379925  5968 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:18.356423 11434 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:18.388540 11542 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:18.365512 11518 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:18.405392  5960 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 9: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:18.406148  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:18.412123  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 100467us
I20260709 12:26:18.381211 11380 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.362907 11537 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.384207 11524 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:18.390108 11413 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader election won for term 9
W20260709 12:26:18.427683 11558 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.142s	user 0.001s	sys 0.000s
I20260709 12:26:18.447110  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:18.428848 11568 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
W20260709 12:26:18.434305 11563 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.001s
I20260709 12:26:18.449268  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:18.450934  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2506) took 1066 ms. Trace:
I20260709 12:26:18.371317 11474 consensus_queue.cc:237] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 4.6, Last appended by leader: 6, Current term: 6, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.451357  6036 rpcz_store.cc:276] 0709 12:26:17.384755 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.384947 (+   192us) service_pool.cc:224] Handling call
0709 12:26:17.401172 (+ 16225us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:17.531248 (+130076us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:17.531278 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:17.663142 (+131864us) log.cc:844] Serialized 26 byte log entry
0709 12:26:18.104311 (+441169us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:18.104352 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:18.104424 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:18.450726 (+346302us) raft_consensus.cc:1685] finished
0709 12:26:18.450747 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:18.450872 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":68775,"raft.run_cpu_time_us":73,"raft.run_wall_time_us":74,"thread_start_us":550429,"threads_started":2,"wal-append.queue_time_us":730632}
I20260709 12:26:18.453155  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:18.453801  6036 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:18.449337  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:18.455521  5964 raft_consensus.cc:2393] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 9: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:18.439220 11530 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:18.456624 11530 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:18.461227  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:18.463353  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:18.468181  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:18.468832  6651 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:18.459084 11530 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:18.469399  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:18.469975  6044 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:26:18.470307  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:18.470952  5965 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:18.471251  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:18.472626  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:18.473997  6651 raft_consensus.cc:2410] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 15 because replica has last-logged OpId of term: 14 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 12.
I20260709 12:26:18.473220  6036 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:26:18.477775  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:18.478425  6036 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:18.398624 11434 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.436275 11524 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:18.508919  6651 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:18.499989  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:18.484835 11413 raft_consensus.cc:697] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:18.485189 11551 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:18.539870  6044 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:26:18.541175  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:18.510154 11524 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:18.583282  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:18.437702 11380 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:18.647961  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 106935us
I20260709 12:26:18.647622  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:18.649569  6609 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:18.649046  5934 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:18.650628  6609 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:18.640816  5965 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:18.657512  6039 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:18.659780  6039 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15. Ops: [11.11-14.13]
W20260709 12:26:18.589047 11473 consensus_meta.cc:287] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.557s	user 0.006s	sys 0.002s
I20260709 12:26:18.693521  6036 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:18.696976  6037 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: [10.7-12.8]
I20260709 12:26:18.589082 11138 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:18.584579 11537 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:18.588312 11271 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:18.611354 11551 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:18.544402 11343 consensus_queue.cc:1059] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.127s
I20260709 12:26:18.698053 11570 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:18.672011 11445 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
I20260709 12:26:18.671819 11581 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:18.700799 11518 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:18.716735 11271 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.719116 11434 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:18.685075 11413 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 7.8, Last appended by leader: 8, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.694321 11473 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:18.767122  6117 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 12:26:18.767349  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 118401us
I20260709 12:26:18.737768 11445 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:18.740497 11518 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:18.768177 11575 raft_consensus.cc:3055] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:18.776183 11575 raft_consensus.cc:740] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:18.765921 11581 raft_consensus.cc:697] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:18.783771  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:18.784409  5965 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:18.787323  6081 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:18.774924 11445 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:18.788633  6081 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:18.790729 11470 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:18.792484 11581 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.790282  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:18.795567 11271 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:18.796293 11246 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:18.796664 11445 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.798049  6081 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:18.800282 11246 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:18.883903  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:18.887101  5965 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:26:18.777381 11518 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:18.742779 11551 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:18.893747  6081 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:18.906877  5932 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:18.966851 11477 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:18.966737  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:18.925778 11458 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:18.772722 11343 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.155s
I20260709 12:26:18.892617 11570 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:18.986634 11550 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:18.989012 11585 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.250s	user 0.000s	sys 0.000s
I20260709 12:26:18.989236 11594 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:18.988883  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 82085.2us
I20260709 12:26:18.998605  6109 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:26:18.986120  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 92445.2us
I20260709 12:26:18.974139 11474 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:18.999795 11380 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:19.000578 11590 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:26:18.999492  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:19.008070  5932 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:19.015746  5932 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:19.001523 11214 consensus_meta.cc:287] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.665s	user 0.004s	sys 0.007s
I20260709 12:26:18.995196 11470 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:19.017144  6111 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:26:18.993582 11509 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:19.016799  5965 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 9: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:19.022192  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:19.024493 11214 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17.
I20260709 12:26:19.029196  5966 raft_consensus.cc:3055] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:19.022898 11470 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:19.075811 11470 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:19.026701 11509 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.011557 11570 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.027657 11551 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.030711  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1278) took 1589 ms. Trace:
I20260709 12:26:19.030296  5966 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:19.024637 11458 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:18.983285 11575 consensus_queue.cc:260] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:19.010003 11477 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.025449 11594 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:19.132054 11509 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.093978  5959 rpcz_store.cc:276] 0709 12:26:17.438948 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.490505 (+ 51557us) service_pool.cc:224] Handling call
0709 12:26:17.526716 (+ 36211us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:17.645941 (+119225us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:26:17.671214 (+ 25273us) log.cc:844] Serialized 14 byte log entry
0709 12:26:18.007297 (+336083us) log.cc:844] Serialized 14 byte log entry
0709 12:26:18.028010 (+ 20713us) spinlock_profiling.cc:243] Waited 2.23 ms on lock 0x7b1800158c80. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df64455 00007f482104c060 00007f482105e716 00007f482106f287 00007f482106f208
0709 12:26:18.050412 (+ 22402us) spinlock_profiling.cc:243] Waited 3.58 ms on lock 0x7b1800158c80. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:26:18.166323 (+115911us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:18.166384 (+    61us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:18.166441 (+    57us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:19.027811 (+861370us) spinlock_profiling.cc:243] Waited 119 ms on lock 0x7b54002f2454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:19.027869 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:19.027992 (+   123us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":6436,"prepare.queue_time_us":26734,"prepare.run_cpu_time_us":81,"prepare.run_wall_time_us":83,"raft.queue_time_us":48055,"raft.run_cpu_time_us":180,"raft.run_wall_time_us":20562,"spinlock_wait_cycles":286870656,"thread_start_us":433046,"threads_started":2,"wal-append.queue_time_us":454241}
I20260709 12:26:19.020560 11593 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:19.128185 11575 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:19.128660 11214 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:19.130491 11551 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:19.016625 11474 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.139163  6041 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:19.029059 11541 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:19.016237 11550 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.139329  5966 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:19.126631 11588 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:19.152647  5966 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:19.158777 11385 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:19.133184 11524 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.154232 11548 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:19.175323 11570 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.149048 11551 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:19.180311 11551 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:19.181654 11595 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:19.159581 11385 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.183365  6044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2652) took 1296 ms. Trace:
I20260709 12:26:19.184046  6044 rpcz_store.cc:276] 0709 12:26:17.886451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:18.577255 (+690804us) service_pool.cc:224] Handling call
0709 12:26:18.625626 (+ 48371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:18.626027 (+   401us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:26:18.626054 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:18.649943 (+ 23889us) log.cc:844] Serialized 26 byte log entry
0709 12:26:18.779837 (+129894us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:18.779922 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:18.780061 (+   139us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:19.183125 (+403064us) raft_consensus.cc:1685] finished
0709 12:26:19.183144 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:19.183304 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":98589,"threads_started":1,"wal-append.queue_time_us":402317}
I20260709 12:26:19.157955 11541 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:19.182739  5967 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:19.147359 11214 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.140377 11458 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:19.162150 11588 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.191479 11380 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:19.209430 11576 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.631s	user 0.000s	sys 0.003s
W20260709 12:26:19.211525 11573 log.cc:927] Time spent T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.521s	user 0.000s	sys 0.001s
W20260709 12:26:19.213685 11561 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.627s	user 0.000s	sys 0.002s
I20260709 12:26:19.217355 11214 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:19.218706 11591 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.217s	user 0.001s	sys 0.001s
I20260709 12:26:19.219044 11524 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.220811 11385 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.228093  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:60122 (request call id 1822) took 1066 ms. Trace:
I20260709 12:26:19.247910 11404 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:19.237535 11296 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.166896 11518 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.217427  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2650) took 1333 ms. Trace:
I20260709 12:26:19.263041  6041 rpcz_store.cc:276] 0709 12:26:18.161766 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:18.258961 (+ 97195us) service_pool.cc:224] Handling call
0709 12:26:19.227883 (+968922us) spinlock_profiling.cc:243] Waited 810 ms on lock 0x7b5400171454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:19.228018 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1863958912}
I20260709 12:26:19.245558 11246 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.228088 11588 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:19.264777 11526 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.733s	user 0.022s	sys 0.027s
I20260709 12:26:19.248114 11325 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:19.278065 11526 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.762s	user 0.023s	sys 0.027s
I20260709 12:26:19.277424 11246 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.276410  6042 rpcz_store.cc:276] 0709 12:26:17.884245 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.892367 (+  8122us) service_pool.cc:224] Handling call
0709 12:26:18.310836 (+418469us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:18.319072 (+  8236us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:18.319105 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:18.334252 (+ 15147us) log.cc:844] Serialized 26 byte log entry
0709 12:26:18.381736 (+ 47484us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:18.381779 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:18.381847 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:19.123025 (+741178us) raft_consensus.cc:1685] finished
0709 12:26:19.123044 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:19.217098 (+ 94054us) spinlock_profiling.cc:243] Waited 418 ms on lock 0x7b54000d8750. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:19.217354 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":8257,"raft.queue_time_us":7987,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":32556,"spinlock_wait_cycles":961732480,"thread_start_us":46994,"threads_started":1,"wal-append.queue_time_us":310269}
I20260709 12:26:19.296875  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2651) took 1411 ms. Trace:
I20260709 12:26:19.300182  6038 rpcz_store.cc:276] 0709 12:26:17.885330 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.931284 (+ 45954us) service_pool.cc:224] Handling call
0709 12:26:17.944817 (+ 13533us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:17.957924 (+ 13107us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:17.957955 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:18.002281 (+ 44326us) log.cc:844] Serialized 52 byte log entry
0709 12:26:18.315837 (+313556us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:18.364873 (+ 49036us) log.cc:844] Serialized 14 byte log entry
0709 12:26:18.366161 (+  1288us) log.cc:844] Serialized 14 byte log entry
0709 12:26:18.366308 (+   147us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:18.366363 (+    55us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:19.208853 (+842490us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:19.296645 (+ 87792us) raft_consensus.cc:1685] finished
0709 12:26:19.296668 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:19.296809 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1046,"prepare.queue_time_us":76753,"prepare.run_cpu_time_us":72,"prepare.run_wall_time_us":78,"raft.queue_time_us":69609,"raft.run_cpu_time_us":322,"raft.run_wall_time_us":10173,"spinlock_wait_cycles":369086720,"thread_start_us":279376,"threads_started":1,"wal-append.queue_time_us":541553}
I20260709 12:26:19.252758 11542 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:19.266932 11537 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:19.313757  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:19.296692 11473 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.296694 11246 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.251556 11380 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.274684 11404 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.278991 11296 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.328182  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2520) took 1596 ms. Trace:
I20260709 12:26:19.328537 11470 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:19.329051  6112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:19.329391  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.329636 11441 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.323598 11473 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:19.330507  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.333894  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:19.339790  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.318109 11477 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.368770  6041 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 20: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:19.369248 11473 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.371311 11380 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.273780 11541 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:19.343663  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.374032  6110 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:19.345957  6042 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:19.358065  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.374836  6114 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:26:19.359203  5963 pending_rounds.cc:85] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 8
I20260709 12:26:19.375553  5963 pending_rounds.cc:107] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 14.9
I20260709 12:26:19.375911  5963 raft_consensus.cc:2889] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:19.339423  6040 rpcz_store.cc:276] 0709 12:26:17.732204 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.732339 (+   135us) service_pool.cc:224] Handling call
0709 12:26:17.732653 (+   314us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:17.732992 (+   339us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:17.733021 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:17.751201 (+ 18180us) log.cc:844] Serialized 26 byte log entry
0709 12:26:18.097287 (+346086us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:18.097329 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:18.097395 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:19.213044 (+1115649us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:19.324966 (+111922us) raft_consensus.cc:1685] finished
0709 12:26:19.324993 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:19.328112 (+  3119us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13955,"raft.queue_time_us":1167,"raft.run_cpu_time_us":165,"raft.run_wall_time_us":30118,"spinlock_wait_cycles":344903936,"thread_start_us":345659,"threads_started":1,"wal-append.queue_time_us":746037}
I20260709 12:26:19.359608  6109 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:26:19.360478  6035 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15. Ops: [12.8-14.9]
I20260709 12:26:19.364228  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:19.366596 11441 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.324046 11537 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.294798 11325 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.342080  6112 raft_consensus.cc:606] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:19.382982  6112 raft_consensus.cc:614] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:19.345278  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:19.377785  6115 raft_consensus.cc:2393] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 13: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:19.383783  6036 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:19.358592 11474 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.314648 11542 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.400241  6113 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:19.373605 11550 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.400950  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.414000  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:19.415279 11616 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:19.416563  6084 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:19.417389 11616 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:19.433701 11441 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:19.438055 11598 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.447s	user 0.001s	sys 0.001s
I20260709 12:26:19.438980 11518 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.424002 11458 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:19.442262 11518 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.442804 11518 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.450802  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:19.451617  6118 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 12: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:19.440716  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:19.454828  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.440096 11537 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.462709  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.460392  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.463553  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:19.461014  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:19.467507  6109 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:19.458932 11526 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:19.481673  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.482373  6118 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:19.468295 11551 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:19.487663 11551 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:19.482632 11271 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:19.486562 11386 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:19.470772 11380 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.489426  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:19.489625  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.470350 11458 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:19.471752 11618 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.022s
I20260709 12:26:19.477612 11524 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:19.491914  6109 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:19.483939  6082 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:19.492676 11380 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.500352 11380 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.488103 11551 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:19.500635  6118 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:26:19.486263 11550 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:19.505879  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:19.480557 11518 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.521517  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:19.524582  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:19.505290 11580 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.917s	user 0.000s	sys 0.003s
I20260709 12:26:19.528277 11616 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:19.530198 11608 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:19.513924 11441 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:19.519930 11246 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:19.520316 11268 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:19.539762 11386 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:19.556036 11572 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.969s	user 0.006s	sys 0.022s
I20260709 12:26:19.558892  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2507) took 2108 ms. Trace:
I20260709 12:26:19.559281  6043 rpcz_store.cc:276] 0709 12:26:17.450525 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.450710 (+   185us) service_pool.cc:224] Handling call
0709 12:26:17.451064 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:17.699055 (+247991us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:17.699091 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:17.699667 (+   576us) log.cc:844] Serialized 26 byte log entry
0709 12:26:18.284460 (+584793us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:18.284531 (+    71us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:18.284641 (+   110us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:19.550770 (+1266129us) spinlock_profiling.cc:243] Waited 154 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:19.558540 (+  7770us) raft_consensus.cc:1685] finished
0709 12:26:19.558564 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:19.558800 (+   236us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":16888,"raft.queue_time_us":19061,"raft.run_cpu_time_us":50,"raft.run_wall_time_us":50,"spinlock_wait_cycles":353753984,"thread_start_us":707223,"threads_started":2,"wal-append.queue_time_us":800178}
I20260709 12:26:19.561533  6043 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:19.562546 11325 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.563920  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:19.532163 11404 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.568145  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:19.518138 11271 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:19.575969  6041 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
I20260709 12:26:19.520215 11458 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.521204 11550 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:19.576959  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.579249  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:19.547537 11246 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:19.547169 11268 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:19.586154  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:19.597858 11268 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:19.588045  6643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1457) took 1519 ms. Trace:
I20260709 12:26:19.589697 11474 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.598474  6643 rpcz_store.cc:276] 0709 12:26:18.057306 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:18.063405 (+  6099us) service_pool.cc:224] Handling call
0709 12:26:18.070761 (+  7356us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:18.135448 (+ 64687us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:18.135478 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:18.168085 (+ 32607us) log.cc:844] Serialized 26 byte log entry
0709 12:26:18.361271 (+193186us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:18.361446 (+   175us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:18.361521 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:19.487724 (+1126203us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:19.566509 (+ 78785us) raft_consensus.cc:1685] finished
0709 12:26:19.566548 (+    39us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:19.576286 (+  9738us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13711,"raft.queue_time_us":53925,"raft.run_cpu_time_us":121,"raft.run_wall_time_us":12430,"spinlock_wait_cycles":345920768,"thread_start_us":192807,"threads_started":1,"wal-append.queue_time_us":371758}
I20260709 12:26:19.593639  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:19.568145 11386 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.595139 11246 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:19.590828 11618 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.600028 11387 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.573967 11170 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.598790 11474 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.606194 10823 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:19.612350 10823 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.575217 11537 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:19.613781 11537 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:19.614560 11616 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:19.616466 11616 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.618070 10823 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.619956 11623 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:19.620669 11623 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.605621 11386 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.590574 11271 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.645359 11524 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:26:19.648238  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 122531us
I20260709 12:26:19.647576 11524 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.649370  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:19.638890 11542 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.657068 10823 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:19.650440 11608 raft_consensus.cc:697] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:19.666728  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.692830  6609 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:19.644420 11271 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:19.626302 11170 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.692301 11529 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.024s
I20260709 12:26:19.714351 11526 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:19.692718 11386 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:19.610440 11618 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:19.717707  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 124163us
I20260709 12:26:19.786679 11569 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.787431 11569 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.789740 11569 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.759369 11636 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:19.798197 11636 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.801836  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.761801 11268 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.806576  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 1823) took 1642 ms. Trace:
I20260709 12:26:19.807018 11268 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.807411 11548 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.808004 11548 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:19.809587 11596 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.814s	user 0.000s	sys 0.001s
I20260709 12:26:19.810281 11548 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.858384 11161 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.851958  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:19.807461  6081 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 2.112s (SENT) [suppressed 12 similar messages]
I20260709 12:26:19.738996 11386 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:19.777251 11608 consensus_queue.cc:237] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:19.900604 11548 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.903874 11315 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.861702 11470 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:19.911398 11548 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:19.905251  6114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:19.912689  6114 raft_consensus.cc:606] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:19.913069  6114 raft_consensus.cc:614] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:19.902365 11602 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.702s	user 0.000s	sys 0.008s
I20260709 12:26:19.913905 11548 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:19.870940  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 88736.5us
I20260709 12:26:19.916587  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:19.897634 11386 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:19.869874  6648 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50470 (request call id 1048) took 1917 ms (client timeout 1963 ms). Trace:
W20260709 12:26:19.920307  6648 rpcz_store.cc:269] 0709 12:26:17.952001 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:17.956634 (+  4633us) service_pool.cc:224] Handling call
0709 12:26:19.869665 (+1913031us) spinlock_profiling.cc:243] Waited 711 ms on lock 0x7b540060b154. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:19.869807 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1636209408}
I20260709 12:26:19.923408 11634 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:19.864563 11542 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:19.926936 11642 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:19.926179 11542 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.815240 11474 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.866967 11623 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:19.899426 11637 log.cc:927] Time spent T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.127s	user 0.000s	sys 0.000s
I20260709 12:26:19.921372 11618 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.772390 11633 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:19.739319 11271 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.806975  6039 rpcz_store.cc:276] 0709 12:26:18.163990 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:18.706241 (+542251us) service_pool.cc:224] Handling call
0709 12:26:18.738314 (+ 32073us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:18.991598 (+253284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:18.991630 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:18.991674 (+    44us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:18.991713 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:19.806345 (+814632us) spinlock_profiling.cc:243] Waited 253 ms on lock 0x7b54001aefd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:19.806387 (+    42us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:19.806518 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":581979008}
W20260709 12:26:19.947090  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:19.958688  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:19.811529 11524 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.810567 11550 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.871374  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.954126 11542 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.954432 11386 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.900445 11170 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.975490  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.976184  6113 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:19.863976 11161 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:19.905498 11551 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:20.007592  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:20.005393 11458 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.977034 11616 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.034s
I20260709 12:26:20.019889  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:20.023510  6035 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:20.024734  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.980506 11636 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:19.981375 11386 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:19.981998  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2621) took 1462 ms. Trace:
I20260709 12:26:19.982267 11246 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:20.044955  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:19.996083 11579 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 1.265s	user 0.004s	sys 0.000s
I20260709 12:26:20.046267  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:19.969626 11472 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:20.015340 11518 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:20.039197 11271 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:20.040980 11161 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:20.042552 11551 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:20.027299  5964 rpcz_store.cc:276] 0709 12:26:18.519663 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:18.648627 (+128964us) service_pool.cc:224] Handling call
0709 12:26:18.661996 (+ 13369us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:18.765345 (+103349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:18.765377 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:18.772074 (+  6697us) log.cc:844] Serialized 26 byte log entry
0709 12:26:19.015106 (+243032us) raft_consensus.cc:1645] Marking committed up to 6
0709 12:26:19.015149 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:19.015213 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:19.901673 (+886460us) spinlock_profiling.cc:243] Waited 1.73 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:19.978344 (+ 76671us) raft_consensus.cc:1685] finished
0709 12:26:19.978365 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:19.981938 (+  3573us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":38495,"raft.queue_time_us":57648,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":3972480,"thread_start_us":92377,"threads_started":2,"wal-append.queue_time_us":279650}
I20260709 12:26:20.047027  6642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1452) took 2016 ms. Trace:
I20260709 12:26:20.047394  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:20.057135  6642 rpcz_store.cc:276] 0709 12:26:18.032763 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:18.032878 (+   115us) service_pool.cc:224] Handling call
0709 12:26:18.047178 (+ 14300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:18.068943 (+ 21765us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:18.068980 (+    37us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:18.069500 (+   520us) log.cc:844] Serialized 26 byte log entry
0709 12:26:18.356003 (+286503us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:18.356090 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:18.356184 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:19.935467 (+1579283us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:20.046729 (+111262us) raft_consensus.cc:1685] finished
0709 12:26:20.046750 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:20.046967 (+   217us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":46038,"raft.queue_time_us":22836,"raft.run_cpu_time_us":249,"raft.run_wall_time_us":10271,"spinlock_wait_cycles":110869760,"thread_start_us":204509,"threads_started":1,"wal-append.queue_time_us":603932}
I20260709 12:26:20.055433  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:20.065037  6113 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:20.065783  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:20.066987  6115 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
W20260709 12:26:20.067981  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:20.047087 11472 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:20.047173 11518 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:20.100023 11413 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.112087  5963 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 10 index: 8. Preceding OpId from leader: term: 12 index: 9. (index mismatch)
I20260709 12:26:20.112869  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.100419 11161 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:20.116350  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.116030  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:20.121203  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 313749us
I20260709 12:26:20.120088  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.107970 11353 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:20.218691  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.219928  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:20.221026  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:20.221303  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:20.222344  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:20.217038  6117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2980) took 1986 ms. Trace:
I20260709 12:26:20.223495  6113 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:20.129851  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:20.228145  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.228328  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.229475  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:20.149710  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.222935  6117 rpcz_store.cc:276] 0709 12:26:18.230678 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:18.230801 (+   123us) service_pool.cc:224] Handling call
0709 12:26:18.231190 (+   389us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:18.769186 (+537996us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:20.216735 (+1447549us) spinlock_profiling.cc:243] Waited 536 ms on lock 0x7b5400372654. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:20.216945 (+   210us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1231862016}
I20260709 12:26:20.221801  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:20.226143  5966 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 7. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:20.233629  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:20.234242  6117 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:20.235201  6114 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 15: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:20.237349  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.238101  6643 raft_consensus.cc:2393] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 15: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:26:20.183429 11643 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:26:20.242221  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.122615  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.246337  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.247184  6648 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 12: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:20.130156 11161 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:20.213572 11246 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:20.153947 11640 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:20.250689  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:20.252116  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:20.252310  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:20.252669  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:20.256567  5963 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 6 index: 7. (index mismatch)
I20260709 12:26:20.212584 11518 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:20.254356  6117 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:20.257154  6041 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:26:20.264140  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:20.253806  5965 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 10. (term mismatch)
I20260709 12:26:20.258088  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.265610  5965 pending_rounds.cc:85] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 9
I20260709 12:26:20.266112  5965 pending_rounds.cc:107] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 11.10
I20260709 12:26:20.266425  5965 raft_consensus.cc:2889] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:20.265369  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:20.270641  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.271368  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.271446  6651 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
W20260709 12:26:20.280896  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:20.121727 11413 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:20.304939  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45219.7us
I20260709 12:26:20.310361  5964 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:20.316694  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.312657  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.318044  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:20.321363  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.326807  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.265631 11640 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:20.333374  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.334053  6036 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 6.
I20260709 12:26:20.321105  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.336125 11161 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:20.336611 11640 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:20.325114  6113 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:20.278425 11353 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:20.340610 11353 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:20.344624 11524 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:20.325470  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.333254 11472 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:20.352676  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:20.356261  6039 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:20.345866  6644 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:20.358947  6643 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
W20260709 12:26:20.354947  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 176912us
I20260709 12:26:20.360914  5934 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:20.308730 11474 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:20.374884  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.379024  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:20.376039  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.380193  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.376974  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:20.381263  6043 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:20.377225  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.380399  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:20.382987  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:20.360117 11509 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:20.389555  6115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:20.390654  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:20.380983 11648 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:20.394800  6039 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:20.397548  6115 raft_consensus.cc:606] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:20.400202  6082 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:20.402598  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:20.403842 11640 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:20.404433 11640 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:20.406131 11616 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:20.406620 11616 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:20.406993 11616 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:20.395668 11570 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:20.412068  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:20.387250 11578 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:20.422248  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.410887 11570 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:20.430979 11570 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:20.432018  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.433210  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:20.419917 11404 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:20.383193 11474 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:20.434453  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.434648 11404 raft_consensus.cc:697] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:20.434846  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.435550  5965 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:20.435634  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.436574  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.436698  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.437641  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.438045  6649 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:26:20.435570 11404 consensus_queue.cc:237] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 11.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:20.434237  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.443782  6644 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: []
I20260709 12:26:20.444893  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.446080  6038 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:20.449345  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.448024 11343 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:20.419286  5959 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:20.377835 11512 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:26:20.457062  5964 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:26:20.459969  5959 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:20.466109  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.443101 11581 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:20.442649 11640 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:20.467643  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.471233  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.476300  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.478888  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.450837 11578 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:20.480882  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.449290 11658 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:26:20.485731  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 106782us
I20260709 12:26:20.487898  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.490422  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.452157 11343 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:20.492547  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2653) took 2602 ms. Trace:
I20260709 12:26:20.495014  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.465750 11626 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 10, Time since last communication: 0.022s
W20260709 12:26:20.496762 11656 log.cc:927] Time spent T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.086s	user 0.001s	sys 0.000s
I20260709 12:26:20.496934 11581 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:20.494221  6037 rpcz_store.cc:276] 0709 12:26:17.890342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:18.658666 (+768324us) service_pool.cc:224] Handling call
0709 12:26:18.696722 (+ 38056us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:18.697361 (+   639us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:20.492362 (+1795001us) spinlock_profiling.cc:243] Waited 37.7 ms on lock 0x7b5400271850. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:20.492481 (+   119us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":86677888}
I20260709 12:26:20.486917 11658 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:20.505859 11658 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:20.507911 11578 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:20.510447  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.511111  5965 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:26:20.545527  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:20.549862  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:20.550299  5968 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:20.550544  6647 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:20.551084  6608 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:20.551079  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.552724  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.475433 11616 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:20.556249  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:20.556855  5967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 2608) took 2362 ms (client timeout 2112 ms). Trace:
I20260709 12:26:20.556911  5962 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
W20260709 12:26:20.557284  5967 rpcz_store.cc:269] 0709 12:26:18.149471 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:18.149609 (+   138us) service_pool.cc:224] Handling call
0709 12:26:20.512014 (+2362405us) spinlock_profiling.cc:243] Waited 984 ms on lock 0x7b5400197654. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:20.512134 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2264346368}
I20260709 12:26:20.563818  6084 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:20.569424  6084 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:20.548069 11546 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:20.560693 11474 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:20.583436  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:20.593385  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.595098  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.595697  5964 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 6.
I20260709 12:26:20.597705  6084 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:20.599859  6084 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:20.566975 11413 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:20.565557 11325 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:20.605958  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 190990us
I20260709 12:26:20.610565  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:20.582235 11528 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:20.611034 11370 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:20.615458  6006 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:20.594762 11470 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:20.605312 11474 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:20.594321 11546 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:20.602658 11246 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:20.675181 11548 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:20.668059  5934 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:20.668010  6081 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:20.671862  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 56504.1us
I20260709 12:26:20.644529 11370 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:20.640094  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:20.675508 11639 raft_consensus.cc:2764] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election decision vote started in defunct term 12: won
I20260709 12:26:20.696982  5964 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:20.695231  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:20.673543  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 290676us
I20260709 12:26:20.702402  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:20.699949  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:20.703927 11640 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:20.705271  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:20.696254 11548 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:20.698144 11370 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:20.670596 11325 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:20.697906 11470 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:20.701196 11271 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:20.711838  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 157796us
I20260709 12:26:20.714576  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:20.715477  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 115691us
W20260709 12:26:20.716336  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 48346.9us
I20260709 12:26:20.711112 11610 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:20.740566  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:20.741027  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:20.718118 11509 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:20.709995 11548 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:20.717717  5964 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:20.738082 11413 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:20.706163 11570 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:20.760694  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 46217.9us
W20260709 12:26:20.806770  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:20.740571 11616 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:20.831969  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:20.809782 11161 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:20.826320 11662 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.218s	user 0.001s	sys 0.000s
I20260709 12:26:20.812863 11610 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:20.811055 11138 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:20.885515  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:20.886196  6042 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:20.752815 11353 consensus_queue.cc:1059] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 7.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.078s
I20260709 12:26:20.756278 11028 consensus_queue.cc:1059] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.090s
I20260709 12:26:20.825989 11271 consensus_queue.cc:1059] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
W20260709 12:26:20.984697  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 160730us
I20260709 12:26:20.884027 11610 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:20.896971 11551 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Leader pre-election won for term 7
W20260709 12:26:21.015597 11670 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.261s	user 0.000s	sys 0.001s
W20260709 12:26:21.017108 11671 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.189s	user 0.000s	sys 0.000s
W20260709 12:26:21.019338 11672 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.266s	user 0.000s	sys 0.000s
W20260709 12:26:21.020848 11667 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.276s	user 0.000s	sys 0.000s
I20260709 12:26:21.038234  6042 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:20.841370 11161 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:21.133394  6081 outbound_call.cc:321] RPC callback for RPC call kudu.master.MasterService.TSHeartbeat -> {remote=127.4.181.126:41341, user_credentials={real_user=slave}} blocked reactor thread for 94894.4us
I20260709 12:26:21.013852 11610 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:21.156533 11546 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:20.707288 11639 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.335s
I20260709 12:26:20.845793 11674 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.207s
I20260709 12:26:21.013300 11551 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:20.899847 11138 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:21.045828 11663 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.354s	user 0.000s	sys 0.001s
I20260709 12:26:21.195765 11639 consensus_queue.cc:1243] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer f1bb8e63c2b448cdafd51f05d277c741 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:26:21.286391 11370 consensus_meta.cc:287] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.568s	user 0.007s	sys 0.000s
I20260709 12:26:21.287056 11570 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:21.286864 11370 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:21.287885 11325 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:21.184234 11665 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.461s	user 0.000s	sys 0.001s
W20260709 12:26:21.194275 11677 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.207s	user 0.000s	sys 0.000s
I20260709 12:26:21.290189 11138 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:21.139053 11679 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:21.298126 11161 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:20.983836 11676 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.232s
I20260709 12:26:21.312153 11676 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:21.319271  6608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.565s	user 0.067s	sys 0.139s
W20260709 12:26:21.323078  6608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.569s	user 0.067s	sys 0.140s
W20260709 12:26:21.329236  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 587994us
I20260709 12:26:21.332873  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:21.279223 11551 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:26:21.350800  6082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.520s	user 0.008s	sys 0.000s
W20260709 12:26:21.353224  6082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.523s	user 0.008s	sys 0.000s
W20260709 12:26:21.331250  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 199548us
W20260709 12:26:21.385046  6611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.633s	user 0.061s	sys 0.069s
W20260709 12:26:21.385526  6611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.633s	user 0.061s	sys 0.070s
W20260709 12:26:21.385869  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 634390us
I20260709 12:26:21.330969 11413 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:21.293483 11679 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:21.468147  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 91943.5us
W20260709 12:26:21.495636  6083 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.627s	user 0.009s	sys 0.007s
W20260709 12:26:21.496043  6083 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.666s	user 0.009s	sys 0.007s
I20260709 12:26:21.392056 11445 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:21.464118 11524 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.003s	sys 0.007s
W20260709 12:26:21.499197 11666 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.545s	user 0.002s	sys 0.028s
W20260709 12:26:21.520048 11666 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.611s	user 0.002s	sys 0.029s
W20260709 12:26:21.538776  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 205972us
I20260709 12:26:21.531710 11296 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:21.543175 11445 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:21.532385 11685 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.158s
I20260709 12:26:21.663028 11691 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:21.662665 11694 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 12, Time since last communication: 0.176s
I20260709 12:26:21.713738 11524 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:21.728660 11683 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
W20260709 12:26:21.769610  6610 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.012s	sys 0.020s
W20260709 12:26:21.782378  6610 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.642s	user 0.012s	sys 0.020s
I20260709 12:26:21.715550 11445 raft_consensus.cc:697] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:26:21.789937 11548 consensus_meta.cc:287] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.962s	user 0.006s	sys 0.001s
I20260709 12:26:21.802634  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1310) took 1657 ms. Trace:
I20260709 12:26:21.663517 11413 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:21.803613  5966 rpcz_store.cc:276] 0709 12:26:20.144902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.234034 (+ 89132us) service_pool.cc:224] Handling call
0709 12:26:20.234299 (+   265us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:20.339129 (+104830us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:20.339163 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:20.339206 (+    43us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:20.339239 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:21.802357 (+1463118us) spinlock_profiling.cc:243] Waited 105 ms on lock 0x7b54002779d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:21.802403 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:21.802569 (+   166us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":240602880}
I20260709 12:26:21.722110 11370 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:21.875114 11445 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:21.899722 11594 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:21.900398 11594 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:21.903959 11353 raft_consensus.cc:3055] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Stepping down as leader of term 7
I20260709 12:26:21.904453 11353 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:21.905297 11353 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 7, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:21.906800 11028 raft_consensus.cc:3055] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:21.907251 11028 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:21.739881 11691 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:21.908097 11028 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:21.909204 11028 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:21.910643  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 924364us
W20260709 12:26:21.914907  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:21.918332  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:21.919286  5966 raft_consensus.cc:2393] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:21.935555  5964 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:26:21.910553 11691 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:21.945439  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 5 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:21.800290 11524 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:21.889590 11370 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:21.944161  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:21.952255  6647 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:26:21.941701  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:21.951675  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1199) took 1238 ms. Trace:
I20260709 12:26:21.957418  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:21.931349 11353 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:21.959148  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:21.960567  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:21.804358 11548 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:21.953272  6111 rpcz_store.cc:276] 0709 12:26:20.713332 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.713499 (+   167us) service_pool.cc:224] Handling call
0709 12:26:20.713860 (+   361us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:20.714232 (+   372us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:20.714262 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:20.715001 (+   739us) log.cc:844] Serialized 26 byte log entry
0709 12:26:20.848126 (+133125us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:20.848168 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:20.848235 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:21.951426 (+1103191us) raft_consensus.cc:1685] finished
0709 12:26:21.951451 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:21.951609 (+   158us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":412,"raft.run_cpu_time_us":87,"raft.run_wall_time_us":88,"thread_start_us":132711,"threads_started":1,"wal-append.queue_time_us":661607}
W20260709 12:26:21.970554  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51876.6us
W20260709 12:26:21.944444 11627 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.002s	sys 0.019s
I20260709 12:26:21.989475  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:21.942680 11679 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:21.991931  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:21.945363 11700 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:21.992944  6111 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:21.993777  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:21.994426  6118 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:21.965334 11594 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.003652  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:22.004101  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:22.004513  6117 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: []
W20260709 12:26:21.990029 11627 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.834s	user 0.002s	sys 0.019s
I20260709 12:26:21.970916 11687 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:21.986299 11570 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.008246  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:22.005988  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:22.007658  6111 raft_consensus.cc:2410] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
I20260709 12:26:21.992465 11546 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:21.992741 11509 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.050733  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:21.964416 11370 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.055569  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:22.054661  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:21.994035 11691 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:21.994051 11472 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:22.050143 11570 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.001614 11325 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:22.000262 11701 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:22.062570  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 92463.5us
I20260709 12:26:22.067559  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:22.063822  6110 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:22.005596 11702 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:22.057590  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 140509us
I20260709 12:26:22.070794  6113 raft_consensus.cc:2410] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 14 because replica has last-logged OpId of term: 13 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 7.
W20260709 12:26:22.062187 11578 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.231s	user 0.008s	sys 0.023s
W20260709 12:26:22.070616 11610 consensus_meta.cc:287] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.909s	user 0.007s	sys 0.003s
I20260709 12:26:22.090476  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:22.006655 11700 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.075215 11537 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.056825 11546 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:22.127019  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 142420us
I20260709 12:26:22.134518  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:22.060685 11509 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.064095 11691 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.066119 11472 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.134333 11594 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:26:22.103889 11578 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.277s	user 0.008s	sys 0.023s
I20260709 12:26:22.163172 11578 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:22.163705 11578 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.164393 11546 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:22.165942 11578 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.166761  6651 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:22.049382 11687 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.156814  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:50992 (request call id 49) took 1757 ms. Trace:
I20260709 12:26:22.076460 11325 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.162048 11571 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:22.162320 11716 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:22.168522  6115 rpcz_store.cc:276] 0709 12:26:20.389253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.389422 (+   169us) service_pool.cc:224] Handling call
0709 12:26:22.146474 (+1757052us) spinlock_profiling.cc:243] Waited 7.31 ms on lock 0x7b5400372654. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482104e853 00007f482601c60a 00007f481f5a27d4 00007f481f5a2762 00007f481f5a2691 00007f481f5a260c 00007f481f5a18c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:22.146571 (+    97us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16806656}
I20260709 12:26:22.082321 11702 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.174398  6117 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
W20260709 12:26:22.180532  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:22.186872  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 96464.3us
I20260709 12:26:22.188198  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:22.157342 11711 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:22.199245  6118 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:22.160032 11594 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:22.205529 11695 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:22.169248 11697 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:22.209630 11697 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.215667 11570 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:22.221873 11702 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:22.180605 11700 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.195577 11692 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.223886 11692 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.228791 11509 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.230767 11325 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:22.233610 11680 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 1.211s	user 0.005s	sys 0.026s
I20260709 12:26:22.236451 11687 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.237408 11587 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.238070 11587 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.240741 11715 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:22.243660 11691 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:22.244460 11594 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:22.203581 11524 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.254837 11711 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.257722 11711 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:22.269196  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 1828) took 2711 ms. Trace:
W20260709 12:26:22.269595 11551 consensus_meta.cc:287] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.885s	user 0.008s	sys 0.000s
I20260709 12:26:22.269663  6035 rpcz_store.cc:276] 0709 12:26:19.557589 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:19.561896 (+  4307us) service_pool.cc:224] Handling call
0709 12:26:19.562188 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:20.026116 (+463928us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:22.268913 (+2242797us) spinlock_profiling.cc:243] Waited 461 ms on lock 0x7b5400270454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:22.269122 (+   209us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1059630464}
I20260709 12:26:22.275297 11370 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:22.276440 11548 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:22.279246 11472 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.182029 11571 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.282449 11571 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:22.285353  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.286096  6651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 1073) took 1852 ms. Trace:
I20260709 12:26:22.286792  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.287889  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.286505  6651 rpcz_store.cc:276] 0709 12:26:20.433875 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.443550 (+  9675us) service_pool.cc:224] Handling call
0709 12:26:20.458971 (+ 15421us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:22.168157 (+1709186us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:22.285848 (+117691us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54004b8cd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:22.286032 (+   184us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3927057664}
I20260709 12:26:22.290311  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.291488  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.292093  5967 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:22.131752 11610 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.226203 11692 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:22.296054  6036 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 2669) took 2045 ms (client timeout 1634 ms). Trace:
W20260709 12:26:22.297051  6036 rpcz_store.cc:269] 0709 12:26:20.250930 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.251859 (+   929us) service_pool.cc:224] Handling call
0709 12:26:22.295876 (+2044017us) spinlock_profiling.cc:243] Waited 77.4 ms on lock 0x7b54001ba654. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:22.295981 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178092800}
I20260709 12:26:22.299410  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.309487  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1309) took 2164 ms. Trace:
I20260709 12:26:22.309927  5961 rpcz_store.cc:276] 0709 12:26:20.144612 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.232264 (+ 87652us) service_pool.cc:224] Handling call
0709 12:26:20.232490 (+   226us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:20.253528 (+ 21038us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:20.253557 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:20.253597 (+    40us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:20.253635 (+    38us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:22.309253 (+2055618us) spinlock_profiling.cc:243] Waited 20.8 ms on lock 0x7b5400035554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:22.309303 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:22.309427 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":47938816}
I20260709 12:26:22.311282  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:22.312402  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:22.313382  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.320058  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.320762  5965 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:22.321614  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:22.325349  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:22.270071 11551 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.327018  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:22.327615  5960 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:22.328225 11551 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:22.330602  6643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 1298) took 2061 ms. Trace:
I20260709 12:26:22.331024  6643 rpcz_store.cc:276] 0709 12:26:20.268902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.269043 (+   141us) service_pool.cc:224] Handling call
0709 12:26:20.309832 (+ 40789us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:20.359358 (+ 49526us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:22.330345 (+1970987us) spinlock_profiling.cc:243] Waited 46.6 ms on lock 0x7b5400515ed4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:22.330541 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":107116800}
I20260709 12:26:22.300397  5967 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:22.332533  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.332949 11404 raft_consensus.cc:993] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:26:22.333931  6648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 1067) took 1901 ms. Trace:
I20260709 12:26:22.334318  6648 rpcz_store.cc:276] 0709 12:26:20.432184 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.445776 (+ 13592us) service_pool.cc:224] Handling call
0709 12:26:20.446084 (+   308us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:20.484409 (+ 38325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:20.484442 (+    33us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:20.484481 (+    39us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:20.484511 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:22.333703 (+1849192us) spinlock_profiling.cc:243] Waited 38.1 ms on lock 0x7b5400535554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:22.333750 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:22.333876 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":87693696}
I20260709 12:26:22.337687  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.339334  5961 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:22.082073 11701 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.212109 11697 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:22.344689  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 143491us
I20260709 12:26:22.347877 11404 raft_consensus.cc:1081] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:26:22.351768 11353 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:22.300866 11587 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.352505 11343 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.354396 11120 consensus_queue.cc:1059] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 13.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 12:26:22.367013 11610 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:22.368158 11353 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:22.368582 11353 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:22.369407 11353 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.390900  5963 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 8. (term mismatch)
I20260709 12:26:22.391343  5963 pending_rounds.cc:85] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 7
I20260709 12:26:22.391578  5963 pending_rounds.cc:107] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 12.8
I20260709 12:26:22.391813  5963 raft_consensus.cc:2889] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:22.395129 11727 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:22.395658 11727 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:22.396818 11727 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.400722  5963 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:26:22.403391  5960 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:22.387316 11353 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:22.405753  5934 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:22.402709 11727 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:22.370440 11594 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.425323  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:22.425035  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:22.407634 11120 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:26:22.425544  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:22.426774  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:22.430152  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:22.430860  6115 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:26:22.430825  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:22.432919  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:22.413815 11343 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 16.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.010s
I20260709 12:26:22.424412  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:22.436664  6651 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 15 index: 13. (term mismatch)
I20260709 12:26:22.438066  6651 pending_rounds.cc:85] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 12
I20260709 12:26:22.438325  6651 pending_rounds.cc:107] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 14.13
I20260709 12:26:22.438580  6651 raft_consensus.cc:2889] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:22.437048  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:22.440135  5963 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:22.444089 11701 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:22.435519 11664 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:22.446637  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:22.452981  6118 raft_consensus.cc:2410] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 15 because replica has last-logged OpId of term: 14 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 10 index: 8.
W20260709 12:26:22.455935 11698 log.cc:927] Time spent T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.399s	user 0.000s	sys 0.003s
I20260709 12:26:22.417801 11721 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:22.467353 11721 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:22.467829 11721 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:22.471927 11594 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:22.476897 11587 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:22.477360 11587 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:22.447252  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:22.448060  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:22.448633  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:22.448877  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:22.449512 11714 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:26:22.482093  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:22.491439  5964 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:26:22.488287  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:22.494427  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.496229  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:22.497267  6111 raft_consensus.cc:2410] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 11 because replica has last-logged OpId of term: 10 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 9 index: 6.
I20260709 12:26:22.497517  6646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1466) took 2267 ms. Trace:
I20260709 12:26:22.497885  6646 rpcz_store.cc:276] 0709 12:26:20.230014 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.230130 (+   116us) service_pool.cc:224] Handling call
0709 12:26:20.241828 (+ 11698us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:20.245177 (+  3349us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:20.245207 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:20.245755 (+   548us) log.cc:844] Serialized 26 byte log entry
0709 12:26:22.335881 (+2090126us) spinlock_profiling.cc:243] Waited 5.12 ms on lock 0x7b18001cc840. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:26:22.435222 (+ 99341us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:22.435290 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:22.435424 (+   134us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:22.480346 (+ 44922us) raft_consensus.cc:1685] finished
0709 12:26:22.480365 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:22.497450 (+ 17085us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":702,"raft.run_cpu_time_us":114,"raft.run_wall_time_us":5562,"spinlock_wait_cycles":11785088,"thread_start_us":99044,"threads_started":1,"wal-append.queue_time_us":2227116}
I20260709 12:26:22.498134  5961 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:22.504139  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.504592  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.507283  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.509792  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:22.491005 11623 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:22.512951  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.514365 11642 raft_consensus.cc:3055] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:22.514798 11642 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:22.515319 11623 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.515578 11642 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.516789 11642 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:22.517441 11623 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:22.518939 11623 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:22.512662 11629 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:22.520219 11551 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.520450 11610 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:22.521030 11610 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.523224 11610 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:22.523716 11610 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.524119 11610 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.493930 11528 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.520723  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3028) took 3615 ms. Trace:
I20260709 12:26:22.540427  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:22.521082 11551 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.529568 11623 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.562721  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:22.565146  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:22.530203 11721 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.478247 11587 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.512207  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:22.542416  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:22.542670  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:22.578294  6036 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:22.546026 11537 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:22.548518 11610 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.553042  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:22.536278  5968 rpcz_store.cc:276] 0709 12:26:18.905690 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:18.905844 (+   154us) service_pool.cc:224] Handling call
0709 12:26:20.512140 (+1606296us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:20.552100 (+ 39960us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:22.520501 (+1968401us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b5400197650. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:22.520643 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3563298176}
I20260709 12:26:22.567716  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.592042  5960 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:22.554531 11271 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:22.548439 11705 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.489s	user 0.002s	sys 0.008s
I20260709 12:26:22.570158  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:22.569586  5962 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:22.572036  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:22.574196  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.574625  6115 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:22.579175  6042 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:22.580020  6110 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 9 index: 9. (index mismatch)
I20260709 12:26:22.588377  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:22.554684 11640 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:22.592638  6038 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:26:22.597368 11541 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:22.597972 11541 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:22.598286  6036 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:22.599396 11541 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.596537  5967 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:26:22.591917  5964 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:22.599611 11640 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.604547  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:22.605134  6036 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:22.607697  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:22.592782  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 82030.2us
I20260709 12:26:22.609122  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:22.561334 11528 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.602780  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:22.610550  5966 raft_consensus.cc:2955] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Committing config change with OpId 8.8: config changed from index 6 to 8, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:22.612991  6081 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:22.614514  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:22.616108  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:22.567133 11707 consensus_queue.cc:1059] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:26:22.620321  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:22.620713  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:22.622179  6038 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:22.591334 11743 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:22.594702 11746 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:22.606611 11681 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:22.628432  6044 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:22.614426  6081 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:22.610105 11610 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:22.587467 11537 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.644078  6081 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:22.618010 11704 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:22.617389 11687 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:22.649271 11697 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:22.602748 11271 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.654985  6611 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:22.655140  6648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:26:22.656219  6648 raft_consensus.cc:606] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:22.656549  6648 raft_consensus.cc:614] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:22.649356  6081 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:22.658922  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2544) took 2306 ms. Trace:
I20260709 12:26:22.652248 11697 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:22.643777 11743 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.651429 11610 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.653275 11704 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:22.664017 11537 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:22.664342 11704 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:22.662165 11697 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:22.659348  6041 rpcz_store.cc:276] 0709 12:26:20.352550 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.352658 (+   108us) service_pool.cc:224] Handling call
0709 12:26:20.352929 (+   271us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:20.353121 (+   192us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:26:20.700800 (+347679us) log.cc:844] Serialized 14 byte log entry
0709 12:26:22.658614 (+1957814us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:22.658665 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:22.658713 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:22.658771 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:22.658870 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1665282,"prepare.queue_time_us":49423,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":1670659,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":76,"thread_start_us":627271,"threads_started":3,"wal-append.queue_time_us":464391,"wal-append.run_cpu_time_us":1158,"wal-append.run_wall_time_us":1129553}
I20260709 12:26:22.645596 11629 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:22.671943 11528 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:22.652745 11687 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:22.672662 11687 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:22.673211 11434 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:22.674530 11706 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:22.674794 11445 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:22.652249 11746 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.678210 11746 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.679858 11271 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.678223  6035 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:22.683048  6109 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:22.689069  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:22.688055  6609 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:22.689698  6038 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:22.668699 11681 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:22.730113  6609 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:22.664047 11610 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.736228 11610 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:22.736898 11610 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.753082  6109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1e2d6430774a629131a0953161507b"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:22.731999 11681 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:22.756533 11681 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:22.756891 11743 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.757553  6609 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:22.759809 11610 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.761113 11581 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:22.761783 11581 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:22.762166 11581 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:22.762570 11733 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.205s	user 0.000s	sys 0.001s
I20260709 12:26:22.763402 11623 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.707528 11745 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:22.735195 11739 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.100s	user 0.001s	sys 0.000s
I20260709 12:26:22.763821 11689 consensus_queue.cc:1059] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 4.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.007s
I20260709 12:26:22.762547 11581 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:22.722885 11271 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:22.695377 11537 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:22.730592 11694 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:22.776681 11721 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:22.778142  6609 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:22.779397  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:22.708763 11746 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:22.715277 11674 consensus_queue.cc:1059] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:26:22.780596  6609 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:22.780522  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:22.792002  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:22.792762  6041 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:22.771118 11551 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:22.806499  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:22.807173  6038 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
I20260709 12:26:22.809182  5965 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13. Ops: []
W20260709 12:26:22.792449  6009 connection.cc:256] RPC call timeout handler was delayed by -1.319405093000114s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1928s for a response
W20260709 12:26:22.810719  6009 connection.cc:256] RPC call timeout handler was delayed by -1.2357050929999787s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.2021s for a response
W20260709 12:26:22.811017  6009 connection.cc:256] RPC call timeout handler was delayed by -1.0998050930002137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
W20260709 12:26:22.811281  6009 connection.cc:256] RPC call timeout handler was delayed by -1.0998050930002137s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21720000000000003s for a response
W20260709 12:26:22.811559  6009 connection.cc:256] RPC call timeout handler was delayed by -1.0881050930001948s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21850000000000003s for a response
W20260709 12:26:22.811842  6009 connection.cc:256] RPC call timeout handler was delayed by -1.0253931930001272s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.21030000000000004s for a response
I20260709 12:26:22.812412  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:22.812542  5965 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 12. (term mismatch)
I20260709 12:26:22.814661  5965 pending_rounds.cc:85] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 11
I20260709 12:26:22.814996  5965 pending_rounds.cc:107] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 14.12
I20260709 12:26:22.815275  5965 raft_consensus.cc:2889] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:22.816527  6081 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:22.818580  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:22.820933  6009 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:22.801883 11690 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:22.803493 11528 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:22.806319 11315 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:22.845373  6035 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:26:22.774158 11745 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.852074  6609 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:22.850690  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:22.858129  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:22.858791  6038 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:22.821082 11685 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:22.821908 11386 raft_consensus.cc:3055] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:22.834700 11742 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:22.861685  6609 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:22.839644  6044 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:26:22.782516 11537 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:22.863412  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:22.939988  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 76658.3us
I20260709 12:26:22.940784  6009 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:22.941957  6009 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:22.797111 11271 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.803067 11746 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:22.818440 11679 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.042s
I20260709 12:26:22.847833 11315 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:22.820580 11701 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.046s
I20260709 12:26:22.871289 11386 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:22.868053 11753 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:22.872227 11528 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:26:22.867486 11676 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:22.835114 11541 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:23.019073 11541 raft_consensus.cc:697] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:23.020335 11541 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.024780 11676 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:23.025321 11676 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:23.027076 11684 raft_consensus.cc:3055] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Stepping down as leader of term 6
I20260709 12:26:23.027508 11684 raft_consensus.cc:740] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 6 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:23.028419 11684 consensus_queue.cc:260] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 6, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.029361 11684 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 6 FOLLOWER]: Advancing to term 7
I20260709 12:26:23.032021 11271 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:23.036608 11642 consensus_meta.cc:287] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.519s	user 0.003s	sys 0.005s
I20260709 12:26:22.858361 11706 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 10, Time since last communication: 0.053s
I20260709 12:26:22.867146 11640 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:22.927148  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 73439.5us
I20260709 12:26:22.844628 11690 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:22.943286  6009 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:23.076716  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 133503us
W20260709 12:26:22.942351  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 80763.6us
W20260709 12:26:22.964766  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.077399  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:22.989473  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:22.979429  6041 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 13 index: 8. (index mismatch)
I20260709 12:26:22.945175 11551 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:22.946605 11742 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:22.954289 11315 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:22.949334 11694 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:23.006006  6040 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 9. Preceding OpId from leader: term: 13 index: 10. (index mismatch)
I20260709 12:26:23.083523  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:23.038636 11746 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:23.040417 11537 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:22.948223 11751 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:22.833182 11703 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.039s
I20260709 12:26:23.059274  6036 raft_consensus.cc:2410] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:26:23.059978  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2550) took 2547 ms. Trace:
I20260709 12:26:23.057758 11271 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.094230  6043 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 6. Current term is 7. Ops: [6.7-6.7]
I20260709 12:26:23.055066 11639 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:23.098006  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.098763  6040 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:23.099893  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.087015  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:23.100816  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.061383 11706 consensus_queue.cc:1243] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer 0557a7246c8945b99e5215c99d4ddf9c log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:26:23.079478 11690 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:23.108639 11692 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:23.109127 11692 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:23.109608 11692 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:23.105760  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.086735 11753 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:23.088701  6037 rpcz_store.cc:276] 0709 12:26:20.512533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:20.512709 (+   176us) service_pool.cc:224] Handling call
0709 12:26:20.513064 (+   355us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:26:20.555967 (+ 42903us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:20.556015 (+    48us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:26:20.559895 (+  3880us) log.cc:844] Serialized 78 byte log entry
0709 12:26:20.800640 (+240745us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:20.821467 (+ 20827us) log.cc:844] Serialized 14 byte log entry
0709 12:26:22.478996 (+1657529us) spinlock_profiling.cc:243] Waited 4.33 ms on lock 0x7b1800385840. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481dee1c0a 00007f4827621219 00007f481df69a40 00007f481df644e4 00007f481df64455 00007f482104c060 00007f482105e716 00007f482106f287 00007f482106f208
0709 12:26:22.857776 (+378780us) log.cc:844] Serialized 14 byte log entry
0709 12:26:23.054898 (+197122us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.055270 (+   372us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:23.059759 (+  4489us) raft_consensus.cc:1685] finished
0709 12:26:23.059780 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.059921 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":79593,"prepare.queue_time_us":141939,"prepare.run_cpu_time_us":110,"prepare.run_wall_time_us":2371,"raft.queue_time_us":1711382,"raft.run_cpu_time_us":403,"raft.run_wall_time_us":22537,"spinlock_wait_cycles":9961344,"thread_start_us":803270,"threads_started":4,"wal-append.queue_time_us":480393,"wal-append.run_cpu_time_us":2734,"wal-append.run_wall_time_us":1107958}
I20260709 12:26:23.082916 11386 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.082342 11640 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:23.113487 11753 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.121114 11753 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:23.129851 11386 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:23.130932 11690 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.133215 11690 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:23.115031  6040 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: [16.10-16.10]
I20260709 12:26:23.150157  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.084725 11694 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:23.157982  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.106293 11537 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:23.173578 11747 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.183s	user 0.000s	sys 0.001s
I20260709 12:26:23.166886 11694 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:23.171772 11721 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.106563 11271 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:23.208621 11697 consensus_meta.cc:287] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.510s	user 0.000s	sys 0.007s
I20260709 12:26:23.202883 11721 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.210603 11512 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.211095 11512 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:23.213066 11512 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:23.214627 11721 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:23.184798 11745 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:23.191392  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 10 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.118247 11639 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.182235  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.200196  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:23.221791  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.222680  6650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50470 (request call id 1079) took 1279 ms. Trace:
I20260709 12:26:23.223289  6035 raft_consensus.cc:2393] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 7: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:23.223212  6650 rpcz_store.cc:276] 0709 12:26:21.943435 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.943549 (+   114us) service_pool.cc:224] Handling call
0709 12:26:23.200052 (+1256503us) spinlock_profiling.cc:243] Waited 1.14 ms on lock 0x7b5800085b98. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2feee 000000000036eb39 00007f4825fa31e0 00007f482606c0c4 00007f482606c131 00007f482601a0a0 00007f4826019984 00007f481f5946d4 00007f481f594662
0709 12:26:23.222622 (+ 22570us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2635520}
I20260709 12:26:23.224318  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.224900  6035 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:26:23.226397 11629 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.226446 11679 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.226964 11629 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.227077 11679 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.229596 11629 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:23.224893  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:23.230826 11629 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:23.230952  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:23.231231 11629 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:23.231669 11629 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:23.231874  6642 raft_consensus.cc:2410] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
I20260709 12:26:23.232527  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:23.234370 11758 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:23.234843 11758 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:23.235211 11758 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:23.234226 11470 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:23.236738  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:23.240581  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:23.243541 11756 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:26:23.248405 11758 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:23.253199  6082 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:23.209096 11697 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.259362  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.260778  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.258682 11528 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:23.262933  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.263787  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.246052 11315 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.265035 11528 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:23.267462 11528 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:23.267642  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.268929  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.270915  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2655) took 1091 ms. Trace:
I20260709 12:26:23.271297  5963 rpcz_store.cc:276] 0709 12:26:22.179268 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.406661 (+227393us) service_pool.cc:224] Handling call
0709 12:26:22.406936 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:22.443340 (+ 36404us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.270694 (+827354us) spinlock_profiling.cc:243] Waited 30.5 ms on lock 0x7b54002dbed4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:23.270843 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":70196480}
I20260709 12:26:23.272220 11753 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.273418  6037 raft_consensus.cc:2368] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16.
I20260709 12:26:23.273587  6038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36260
I20260709 12:26:23.274184  6038 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:23.274541  6038 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:23.278057  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.242270 11679 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:23.283869  6043 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:23.285869  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.281440  6038 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:23.287429  6109 raft_consensus.cc:606] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:23.287918  6109 raft_consensus.cc:614] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:23.255955 11763 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:23.289656  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.289363  6038 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:23.257577 11470 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.030s
I20260709 12:26:23.287477 11679 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:23.300302 11697 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:23.291003 11681 consensus_meta.cc:287] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.534s	user 0.009s	sys 0.001s
I20260709 12:26:23.302368  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:23.308440 11629 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:23.309002 11753 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:23.309607 11681 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:23.310271 11758 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:23.316538  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.319599  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.322031 11681 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:23.322221 11687 consensus_meta.cc:287] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.649s	user 0.008s	sys 0.000s
I20260709 12:26:23.322635  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 2998) took 1319 ms. Trace:
I20260709 12:26:23.345144  6114 rpcz_store.cc:276] 0709 12:26:22.003446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.004829 (+  1383us) service_pool.cc:224] Handling call
0709 12:26:22.005080 (+   251us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:22.355346 (+350266us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:22.355380 (+    34us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:22.355425 (+    45us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:22.355465 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.322367 (+966902us) spinlock_profiling.cc:243] Waited 350 ms on lock 0x7b54002cea54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:23.322420 (+    53us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.322571 (+   151us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":804983040}
I20260709 12:26:23.323184 11717 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:23.346624 11717 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:23.347613 11717 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:23.348577 11717 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:23.324749  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.298863 11676 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.357339 11676 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:23.357815  5965 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:23.358590 11753 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:23.359015 11753 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:23.359392 11753 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:23.361068  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:23.361676  6116 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:23.363411 11765 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:23.365851  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:23.366695  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.367219  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:23.330152 11704 consensus_meta.cc:287] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.661s	user 0.006s	sys 0.001s
I20260709 12:26:23.368337 11704 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:23.346385 11692 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:23.332635 11315 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:23.333000 11581 consensus_meta.cc:287] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.551s	user 0.006s	sys 0.002s
I20260709 12:26:23.372947  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.373661  6112 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:26:23.333185 11696 raft_consensus.cc:3055] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:23.331259 11271 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:23.312690 11679 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.342258  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.344331  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:23.346179  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:23.393831  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:23.394225  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:23.394620  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.354336  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.331351 11639 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:23.353974  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.370828 11687 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:23.389686  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 129844us
I20260709 12:26:23.406077  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:23.406752  6650 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:26:23.386505  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:23.400552  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.402101  6114 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:23.409545  6009 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:23.410169  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.412557  6651 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:23.413340  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:23.413509  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.416375  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.400287 11528 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:23.418068  6117 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:23.405071 11716 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.420773 11716 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:23.421660 11271 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:23.423069 11716 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:23.424203  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.424579 11639 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:23.425447  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.342303 11694 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.373606 11692 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:23.426397  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.449033  6039 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 7. Current term is 8. Ops: []
W20260709 12:26:23.449833  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 47784.9us
I20260709 12:26:23.443791  5961 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 9. Current term is 10. Ops: [9.9-9.9]
I20260709 12:26:23.453909  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.442834 11679 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:23.460788  6116 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:23.444723 11687 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:23.445858 11629 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:23.465030  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.392699 11696 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:23.468109  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.420022 11528 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:23.468603  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.467166 11639 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:23.469515  6009 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:23.470029 11537 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:23.473730  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.477020  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:23.473695  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 100351us
I20260709 12:26:23.435936 11704 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:23.445971 11694 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:23.493294  6116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:23.499826  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.482913  5934 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:23.373018 11581 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.509814  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:23.505457  6116 raft_consensus.cc:606] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:23.515311  6650 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
W20260709 12:26:23.510785  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.515475  5934 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:23.511732 11120 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:23.488878  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.464016 11752 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:23.470242 11271 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:23.524350  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.497289 11587 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:23.481027 11745 raft_consensus.cc:2764] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election decision vote started in defunct term 16: won
I20260709 12:26:23.549631  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.531783  6647 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:23.546433  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.489001 11343 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:23.495384 11751 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:23.496152 11686 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:23.531316  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:26:23.518963 11120 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.488864 11315 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.070s
I20260709 12:26:23.525671 11687 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:23.557422  5934 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:23.531136 11722 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:23.569548 11689 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:23.496884 11696 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.559621 11751 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:23.566365 11120 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:23.497980 11753 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.568311 11028 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:23.590807  6111 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:23.591564  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.591918  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.590828  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.594231  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:23.565148 11686 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.600725  6036 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:23.602233  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:23.577668 11751 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:23.590750 11028 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:23.576151 11721 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:26:23.613276  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.579460 11676 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:26:23.609885  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.609841 11028 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:23.631690 11740 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.986s	user 0.000s	sys 0.003s
I20260709 12:26:23.605536 11694 consensus_queue.cc:1059] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 7.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:26:23.635389  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:23.635353  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.638659  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.637671  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.640134  6113 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 17: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:23.640604  5963 raft_consensus.cc:2393] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:23.623436 11687 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:23.643540  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:23.648738  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.650067  6081 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:23.650084  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.617116 11594 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.020s
I20260709 12:26:23.653239  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.654313  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.655265  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.628172 11686 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:26:23.655833  6042 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:26:23.657073  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.653800  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.656355 11692 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:23.660513  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.660539  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.662909  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:23.663497  6044 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:26:23.665299  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:23.652753 11676 raft_consensus.cc:3055] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:23.669683  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.658950 11528 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:23.673353 11697 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.002s
I20260709 12:26:23.678825  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:23.680418  6109 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:23.656075 11537 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.020s
I20260709 12:26:23.680985  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.685016  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:23.678912  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.664269 11762 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:23.687945  6118 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:26:23.690125  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:23.670818 11753 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:23.693575 11688 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:23.698232  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 2662) took 1208 ms. Trace:
I20260709 12:26:23.698738 11629 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:23.699538 11689 raft_consensus.cc:3055] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:23.699928 11689 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:23.700726 11689 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.701872 11689 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:23.681715 11528 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:23.702745 11528 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:23.706553  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:23.707617  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1320) took 1794 ms. Trace:
I20260709 12:26:23.708014  5966 rpcz_store.cc:276] 0709 12:26:21.913199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:21.928070 (+ 14871us) service_pool.cc:224] Handling call
0709 12:26:21.928631 (+   561us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:26:22.069902 (+141271us) raft_consensus.cc:1534] Early marking committed up to index 7
0709 12:26:22.432155 (+362253us) log.cc:844] Serialized 14 byte log entry
0709 12:26:22.570602 (+138447us) raft_consensus.cc:1539] Triggering prepare for 3 ops
0709 12:26:22.574004 (+  3402us) log.cc:844] Serialized 608 byte log entry
0709 12:26:22.574180 (+   176us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:22.659544 (+ 85364us) log.cc:844] Serialized 14 byte log entry
0709 12:26:22.682494 (+ 22950us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:22.682567 (+    73us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:23.631429 (+948862us) spinlock_profiling.cc:243] Waited 8.16 ms on lock 0x7b240011ac38. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481dded9c4 00007f481ddebacb 00007f481dfa6dc9 00007f481dfa6a55 00007f481dfa609d 00007f4820bd810e 00007f4820bef88c 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221
0709 12:26:23.707365 (+ 75936us) raft_consensus.cc:1685] finished
0709 12:26:23.707389 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.707558 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":55138,"prepare.queue_time_us":297312,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":35,"raft.queue_time_us":101657,"raft.run_cpu_time_us":366,"raft.run_wall_time_us":55146,"spinlock_wait_cycles":18784768,"thread_start_us":552339,"threads_started":3,"wal-append.queue_time_us":113366}
I20260709 12:26:23.707633  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:23.711104 11692 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:23.711529 11692 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:23.712344 11692 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.713750 11692 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:23.672910 11676 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:23.714197 11120 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:23.698664  5964 rpcz_store.cc:276] 0709 12:26:22.489706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.502235 (+ 12529us) service_pool.cc:224] Handling call
0709 12:26:23.698014 (+1195779us) spinlock_profiling.cc:243] Waited 77.6 ms on lock 0x7b54001cacd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:23.698142 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":178429184}
I20260709 12:26:23.687383 11684 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:23.733764 11684 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:23.721890  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:23.734808  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.734728 11684 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.735973 11684 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:23.690299 11679 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:23.742930 11679 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:23.743928 11679 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 13.14, Last appended by leader: 14, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.690987 11762 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:23.745611 11762 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:23.751106  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:23.751672  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.725405 11687 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:23.744779 11751 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.730288 11766 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
W20260709 12:26:23.755616  5865 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 206) took 20868 ms (client timeout 15000 ms). Trace:
I20260709 12:26:23.733047 11570 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:23.756597 11570 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:23.757969  6037 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:23.758689 11570 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:23.752794 11697 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:23.759630 11697 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:23.760023 11697 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:23.762076  6037 raft_consensus.cc:1217] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Deduplicated request from leader. Original: 10.10->[12.11-19.15]   Dedup: 13.12->[15.13-19.15]
I20260709 12:26:23.700121  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1327) took 1095 ms. Trace:
I20260709 12:26:23.806960 11581 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:23.751151 11676 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.771674  6647 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:23.808772  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:23.806118  5968 rpcz_store.cc:276] 0709 12:26:22.604728 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:22.650228 (+ 45500us) service_pool.cc:224] Handling call
0709 12:26:22.661465 (+ 11237us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:23.699246 (+1037781us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:23.699278 (+    32us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:23.699329 (+    51us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:23.699371 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:23.699890 (+   519us) spinlock_profiling.cc:243] Waited 1.04 s on lock 0x7b540008b454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:23.699931 (+    41us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:23.700043 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":485,"raft.run_cpu_time_us":83,"raft.run_wall_time_us":83,"spinlock_wait_cycles":2385858432}
I20260709 12:26:23.810042  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:23.806156  6037 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20. Ops: [12.11-19.15]
W20260709 12:26:23.756007  5865 rpcz_store.cc:269] 0709 12:26:02.887541 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:02.890609 (+  3068us) service_pool.cc:224] Handling call
0709 12:26:23.755339 (+20864730us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:15.692525 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:15.693101 (+   576us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:15.693139 (+    38us) write_op.cc:435] Acquired schema lock
0709 12:26:15.693156 (+    17us) tablet.cc:662] Decoding operations
0709 12:26:15.694639 (+  1483us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:15.694697 (+    58us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:15.694723 (+    26us) tablet.cc:685] Acquiring locks for 16 operations
0709 12:26:15.843259 (+148536us) tablet.cc:701] Row locks acquired
0709 12:26:15.843330 (+    71us) write_op.cc:260] PREPARE: finished
0709 12:26:15.843652 (+   322us) write_op.cc:270] Start()
0709 12:26:15.843834 (+   182us) write_op.cc:276] Timestamp: P: 1783599975843562 usec, L: 0
0709 12:26:15.843895 (+    61us) op_driver.cc:348] REPLICATION: starting
0709 12:26:15.845191 (+  1296us) log.cc:844] Serialized 6296 byte log entry
0709 12:26:16.596788 (+751597us) op_driver.cc:464] REPLICATION: finished
0709 12:26:17.382970 (+786182us) write_op.cc:301] APPLY: starting
0709 12:26:17.405372 (+ 22402us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:17.744966 (+339594us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:17.745129 (+   163us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:17.800884 (+ 55755us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:17.801283 (+   399us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=32,key_file_lookups=32,delta_file_lookups=32,mrs_lookups=0
0709 12:26:17.801335 (+    52us) write_op.cc:312] APPLY: finished
0709 12:26:17.802113 (+   778us) log.cc:844] Serialized 148 byte log entry
0709 12:26:18.153415 (+351302us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:18.296827 (+143412us) write_op.cc:454] Released schema lock
0709 12:26:18.318754 (+ 21927us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:18.426622 (+107868us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:18.426654 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":2124927,"reported_tablets":31,"spinlock_wait_cycles":94848,"child_traces":[["op",{"apply.queue_time_us":750291,"apply.run_cpu_time_us":50012,"apply.run_wall_time_us":1041090,"cfile_cache_hit":66,"cfile_cache_hit_bytes":71039,"num_ops":16,"prepare.queue_time_us":99510,"prepare.run_cpu_time_us":25376,"prepare.run_wall_time_us":221080,"raft.queue_time_us":444190,"raft.run_cpu_time_us":19275,"raft.run_wall_time_us":343974,"replication_time_us":752736,"thread_start_us":1068095,"threads_started":5,"wal-append.queue_time_us":805014,"wal-append.run_cpu_time_us":39017,"wal-append.run_wall_time_us":2511238}]]}
W20260709 12:26:23.769598 11783 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.076s	user 0.001s	sys 0.000s
I20260709 12:26:23.766037  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.772804  6648 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 12. (term mismatch)
I20260709 12:26:23.781213  6609 leader_election.cc:400] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16.
I20260709 12:26:23.762828  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:23.774904  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:23.772639  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:23.718101 11528 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:23.790385  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:23.791765  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:23.792503  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:23.754276  6109 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
W20260709 12:26:23.799400  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50011.4us
I20260709 12:26:23.788691 11766 consensus_queue.cc:1059] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.014s
I20260709 12:26:23.802819  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:23.792868 11697 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.868093  6645 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 12: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:23.870079  6648 pending_rounds.cc:85] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 11
I20260709 12:26:23.871349  6648 pending_rounds.cc:107] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 12.12
W20260709 12:26:23.871470  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 225497us
I20260709 12:26:23.871821  6644 raft_consensus.cc:2393] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 8: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:23.871960  6648 raft_consensus.cc:2889] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:23.872320  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:23.871748  6609 leader_election.cc:403] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:26:23.803458 11751 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:23.800078  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:23.773389  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:23.870697  6043 raft_consensus.cc:2376] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8. Re-sending same reply.
I20260709 12:26:23.875583  6649 raft_consensus.cc:2410] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:26:23.763593  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:23.865655  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 55704.2us
I20260709 12:26:23.811314  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:23.877336  6035 raft_consensus.cc:2410] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 14 because replica has last-logged OpId of term: 13 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 11.
W20260709 12:26:23.873577  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 92497.3us
I20260709 12:26:23.867946 11581 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:23.879072  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:23.879698  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:23.880825  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:23.881307  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.882965  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.888273  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.888863  5932 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:23.867779 11704 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:23.876910 11689 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:23.806140 11570 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 17.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.079s
I20260709 12:26:23.884263 11742 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:23.887293 11753 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:23.888774 11781 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:23.877213 11541 consensus_queue.cc:1059] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:26:23.894098 11751 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:23.887526 11681 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:26:23.906430 11781 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:23.916621  6650 raft_consensus.cc:2410] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:26:23.923249  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:23.926043  5932 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 7 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.927811  6647 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:23.929703  6647 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:23.930097  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:23.906216 11587 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:23.935153  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.937281  5932 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.942793  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:23.940688 11594 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 6 FOLLOWER]: Advancing to term 7
W20260709 12:26:23.952656  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 59015.7us
W20260709 12:26:23.973809 11768 log.cc:927] Time spent T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.477s	user 0.002s	sys 0.000s
I20260709 12:26:23.974262 11594 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election lost for term 7. Reason: could not achieve majority
I20260709 12:26:23.975888 11528 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:23.947625 11745 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:23.952425 11587 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:23.985543 11751 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.000947 11751 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.001765 11688 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.002175 11688 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:24.003207 11751 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:24.005282 11120 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:23.986652 11763 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:24.006800  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:24.007503  6649 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:23.978606 11781 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:24.007809 11138 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:24.008231 11138 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:24.009021 11138 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.009682 11762 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:23.967833 11786 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:24.011791 11762 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:24.014902 11753 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:23.967147 11689 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16.
I20260709 12:26:24.019379  6609 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:24.021847 11413 consensus_queue.cc:1059] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:24.024892 11413 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:26:24.025167  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:24.030289  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.046216  6609 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:23.990579 11594 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:23.994617 11697 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:24.043072  6009 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:24.074309  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 43634.4us
I20260709 12:26:23.998782 11528 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:23.984400 11028 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.038101  6646 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
W20260709 12:26:24.031427 11782 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.323s	user 0.002s	sys 0.000s
I20260709 12:26:24.007365 11766 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:24.010128 11138 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:24.026401 11676 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:24.035094 11629 raft_consensus.cc:3055] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:26:24.118283  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.033509 11786 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:24.043208 11413 raft_consensus.cc:697] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:24.051496 11581 raft_consensus.cc:3055] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Stepping down as leader of term 12
W20260709 12:26:24.111476  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 65306.9us
I20260709 12:26:24.097046 11639 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:24.145920 11791 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:24.146545 11541 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:24.183472  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 214310us
I20260709 12:26:24.158665 11509 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.168738 11028 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:24.184475  6009 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:24.191567  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:24.106400 11766 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:24.197021  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52917.2us
I20260709 12:26:24.118280 11315 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:24.199676  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.200992  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:24.201637  6036 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:24.202440  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:24.205809  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:24.121062 11629 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:24.211115  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 262656us
I20260709 12:26:24.214147  6117 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:24.180625 11639 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.209127 11690 consensus_queue.cc:1059] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:26:24.175292 11786 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.223129  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:24.225054  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:24.225710  6113 raft_consensus.cc:3055] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:24.226114  6113 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:24.226559  5932 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:24.198320 11782 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:26:24.179780 11581 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:24.221197  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:24.222508  6109 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:24.207055 11745 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:24.228237  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:24.209676 11751 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:24.206352 11753 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:24.197106 11697 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:24.229481  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 137675us
I20260709 12:26:24.228785  6117 raft_consensus.cc:2368] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16.
I20260709 12:26:24.231200  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:24.226902  6113 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:24.213713 11551 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:24.242800  5932 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:24.224716 11639 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:24.197712 11791 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.225945 11028 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:24.248795  5932 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:24.312077  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 63337.1us
I20260709 12:26:24.296828  6113 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:24.233536  6112 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:24.205086 11509 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:24.203634 11541 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.230595 11745 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.306655  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:24.339540  5932 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:24.295113 11570 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:24.295282 11721 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:24.303197 11551 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:24.364462  6036 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:24.367496  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:24.340484 11687 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:24.344867 11745 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:24.373392  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:24.375869  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:24.269186 11697 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:24.389729  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50294.2us
I20260709 12:26:24.397001  5932 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:24.398710  5932 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:24.399394  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.400200  6611 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:24.401845  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.409499  6611 leader_election.cc:400] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16.
I20260709 12:26:24.411273  6113 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:24.410586  6611 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:24.412313  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:24.412674  6113 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:24.416244  6110 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:24.417116 11687 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:24.297384 11413 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.417605  5932 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:24.312402 11629 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.415197 11120 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:24.418680  6110 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:24.426755  6113 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:24.401278 11721 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:24.443017  6111 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:24.443569  5932 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:24.444779  5932 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:24.406298 11445 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:24.395150 11685 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.045s
I20260709 12:26:24.405550 11789 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:24.451666 11703 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:24.517151  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 58683.2us
W20260709 12:26:24.517781  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 65628.8us
I20260709 12:26:24.520100  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:24.406548 11674 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:26:24.531358  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:24.452502 11512 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:24.455586 11716 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:24.544214  6037 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:24.457432 11120 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:24.559935  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.561877 11786 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:24.574929 11697 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:24.576676  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 56658.5us
I20260709 12:26:24.578394  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.579175  5965 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:24.544842 11721 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:24.581975  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:24.585618  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:24.586603  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:24.582445  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:24.587622  5959 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:24.582628  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:24.588389  5963 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:24.583550  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:24.589710  5962 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:24.594789  5966 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 10. (term mismatch)
I20260709 12:26:24.595333  5966 pending_rounds.cc:85] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 9
I20260709 12:26:24.595626  5966 pending_rounds.cc:107] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 16.10
I20260709 12:26:24.595906  5966 raft_consensus.cc:2889] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:24.599025 11791 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:24.599836  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:24.600282 11688 consensus_meta.cc:287] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.003s
I20260709 12:26:24.600718 11688 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:24.601154 11537 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:24.602625 11509 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:24.566083 11788 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.336s	user 0.001s	sys 0.000s
W20260709 12:26:24.611402  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.612134 11587 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.612685 11587 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.615427 11509 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.616124 11509 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.618389 11509 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:24.619982 11587 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:24.593235 11690 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.625855 11690 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.460168 11551 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.629377  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:24.623420  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.632906  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:24.628897  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:24.637187  5962 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:24.637331  6039 raft_consensus.cc:2393] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:24.640429  6041 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:24.641678 11541 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:24.647450 11806 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:26:24.648204 11690 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:24.651425  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:24.652246  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:24.652915  6043 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
I20260709 12:26:24.638165 11413 consensus_queue.cc:1059] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:26:24.654146  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:24.662024  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:24.663183  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 131912us
I20260709 12:26:24.664310  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:24.668530  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:24.663532  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:24.673569  5963 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:24.664086  6009 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:24.675443  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:24.675731  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:24.677959  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:24.618883 11804 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:24.707230  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:24.687577  5959 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:24.690339 11445 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Leader pre-election won for term 8
W20260709 12:26:24.671630 11676 consensus_meta.cc:287] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.532s	user 0.002s	sys 0.008s
I20260709 12:26:24.671532 11742 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:24.642571 11138 consensus_meta.cc:287] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.528s	user 0.000s	sys 0.010s
I20260709 12:26:24.702782  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:24.704530  5961 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:24.745813  6651 raft_consensus.cc:2410] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 10 because replica has last-logged OpId of term: 9 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 7 index: 8.
W20260709 12:26:24.735278  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 71277.7us
I20260709 12:26:24.740365  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.747663  5959 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:24.746306  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:24.703392 11791 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:24.755251  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:24.735100 11445 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:24.705308 11804 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:24.743746 11751 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:24.657572 11639 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.758332 11676 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:24.753423 11797 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:24.766166  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.755383 11688 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:24.775949 11804 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.777357 11804 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:24.779780 11766 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.781664 11766 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:24.762280 11445 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:24.787062  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.787722  5966 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:24.788528  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.789489  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.782537 11813 consensus_queue.cc:1059] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.015s
I20260709 12:26:24.790359  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.765090 11787 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:24.801522  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:24.802969  5966 raft_consensus.cc:2393] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:24.763753 11809 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:26:24.749750 11742 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.810703  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.811407  5966 raft_consensus.cc:2368] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 8. Current term is 9.
I20260709 12:26:24.812103  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:24.812577  5966 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:24.817792 11703 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:24.761440 11812 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 6, Time since last communication: 0.062s
I20260709 12:26:24.768086 11537 consensus_queue.cc:1059] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 16.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.055s
W20260709 12:26:24.825950  6006 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.619s (SENT) [suppressed 18 similar messages]
I20260709 12:26:24.841302 11809 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:24.841126 11824 consensus_queue.cc:1059] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:26:24.848559  6645 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
I20260709 12:26:24.854075  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.775104 11676 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.854279  5966 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
W20260709 12:26:24.861799  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 101358us
I20260709 12:26:24.874101  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.875375  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.875604  6116 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:24.876339  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:24.877254  5966 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:24.878933  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:24.880164  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 11 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:24.880295  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:24.856544 11812 raft_consensus.cc:3055] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:24.880884  6036 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:24.885381  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:24.879423  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:24.882121  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:24.895537  6035 raft_consensus.cc:3055] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:24.895990  6035 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:24.870572 11537 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:24.898496  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:24.899958  5960 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:24.896698  6035 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:24.907147  5966 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:24.886947 11813 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:24.878959 11692 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:24.886719 11812 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:24.930665  6116 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:24.932425  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:24.939538  6035 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:24.929257  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:24.953857  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 72598.1us
I20260709 12:26:24.954564  6111 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 10: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:24.955255  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.884791 11751 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:24.908519 11537 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:24.946072 11813 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:24.957441  5966 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:24.959636  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:24.961778  6036 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:26:24.962770  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.942114 11688 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:24.858078 11809 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:24.965835  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:24.979151 11787 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:24.979718 11537 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:24.981033 11537 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:24.959154 11639 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:24.983999  6646 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:24.984359 11676 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:24.986661  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.952502 11692 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:24.990063 11692 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:24.990528 11688 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:24.991181  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:24.991482  5960 raft_consensus.cc:2410] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 14.
I20260709 12:26:24.993070  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:24.991928  6037 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:24.994089  5960 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 7.
W20260709 12:26:24.995843  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:24.966384  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:24.966593  6116 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:24.909380 11138 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:24.967846  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:24.970176  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:24.953956 11823 raft_consensus.cc:3055] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:25.002534  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:25.002893  6651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50470 (request call id 1091) took 1232 ms. Trace:
I20260709 12:26:25.003772  6651 rpcz_store.cc:276] 0709 12:26:23.770703 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:23.772768 (+  2065us) service_pool.cc:224] Handling call
0709 12:26:25.002701 (+1229933us) spinlock_profiling.cc:243] Waited 879 ms on lock 0x7b54005569d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:25.002831 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2022655232}
W20260709 12:26:25.008494 11315 consensus_meta.cc:287] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.798s	user 0.007s	sys 0.007s
I20260709 12:26:25.008293 11138 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.008944 11315 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:24.986759 11751 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:25.011329 11688 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:25.003484 11823 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:25.013713 11823 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:24.979015 11825 consensus_queue.cc:1059] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:26:24.970315 11822 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:25.014990 11722 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:25.015429 11822 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:25.017696 11822 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:25.014182 11812 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.015779 11445 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:24.995180 11745 consensus_meta.cc:287] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.597s	user 0.013s	sys 0.000s
W20260709 12:26:25.018685 11827 consensus_queue.cc:1175] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "24012af7747d4c4ea89c3da2ff950099" responder_term: 17 status { last_received { term: 17 index: 13 } last_committed_idx: 13 last_received_current_leader { term: 17 index: 13 } }
I20260709 12:26:25.018785 11745 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:25.019543  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:25.021196 11809 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:25.022487  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:25.022874  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.014775 11823 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:25.024657  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:24.967123 11721 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:25.031503  6006 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.029542  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.032749  5966 raft_consensus.cc:2376] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16. Re-sending same reply.
I20260709 12:26:25.033234  6006 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.018235 11822 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:25.037603  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 7 candidate_status { last_received { term: 4 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:25.038405  5960 raft_consensus.cc:2410] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 7 because replica has last-logged OpId of term: 6 index: 7, which is greater than that of the candidate, which has last-logged OpId of term: 4 index: 6.
I20260709 12:26:25.039215  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 9 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.040192  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.040810  5960 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:25.042049  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.048591  5966 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14. Ops: [11.7-13.8]
I20260709 12:26:25.049989  5966 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:25.051296  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:25.029554 11809 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:25.055135  6043 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:24.998713 11790 consensus_queue.cc:1059] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.049s
I20260709 12:26:25.062826  5960 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
W20260709 12:26:25.064724  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.043529 11729 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:25.054901 11797 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.036367 11813 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:25.071398  5960 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:25.074530 11797 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.076975  5960 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:25.077244 11581 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.072511 11729 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.079922 11729 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:25.080408  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.081092  5963 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:25.082235  5963 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: [10.7-10.7]
I20260709 12:26:25.046036 11822 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:25.061658 11809 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.089731 11581 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:25.152680 11816 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.121s	user 0.001s	sys 0.001s
W20260709 12:26:25.236917  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:25.323683  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 290495us
I20260709 12:26:25.324833 11822 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:25.354730  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 397879us
I20260709 12:26:25.325956 11823 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:25.326664 11813 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:25.327495 11722 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.327525 11787 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:25.325995 11745 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:25.331254 11830 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:25.331704 11766 consensus_meta.cc:287] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.549s	user 0.014s	sys 0.004s
W20260709 12:26:25.331182  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.072044 11751 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:26:25.343259  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.353819  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.356141  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:25.356395  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:25.358207  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.374848  6643 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:25.374101  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.358405  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:25.359438  6116 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:25.360277  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:25.376410  6113 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:25.361152  6035 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:25.360956  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:25.377149  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:25.363042  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:25.379149  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:25.380035  6642 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 13: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:25.382725  6116 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:25.387409  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:25.387238  6006 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.390369  6006 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:25.374872 11722 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.393903 11830 raft_consensus.cc:2764] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Leader pre-election decision vote started in defunct term 15: won
I20260709 12:26:25.388937 11832 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:25.393425  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 7 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.373697 11751 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:25.395859  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.391405 11823 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:25.375810 11745 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:25.376750 11786 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader election won for term 9
I20260709 12:26:25.398284  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.411635 11836 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:25.389946 11781 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:25.416182  6118 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:25.395156 11822 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:25.374513 11787 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.420241 11696 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:25.422536 11829 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:26:25.418668  6643 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:25.398648 11823 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:25.426846 11823 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:25.429373 11787 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:25.418140 11786 raft_consensus.cc:697] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:25.400895 11830 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:25.423439 11797 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:25.430712 11786 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 7.9, Last appended by leader: 9, Current term: 9, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.434208  6650 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 9.
I20260709 12:26:25.435703 11804 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.436165 11804 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.399426 11751 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:25.398763 11832 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Leader election lost for term 7. Reason: could not achieve majority
I20260709 12:26:25.442185 11809 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:25.454838 11694 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:25.455399 11694 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:25.456259 11694 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.457630 11694 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:25.477641  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1232) took 1179 ms. Trace:
I20260709 12:26:25.478107  6115 rpcz_store.cc:276] 0709 12:26:24.300534 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.300733 (+   199us) service_pool.cc:224] Handling call
0709 12:26:24.344577 (+ 43844us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.416042 (+ 71465us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:24.416078 (+    36us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:24.416123 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:24.416163 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.477388 (+1061225us) spinlock_profiling.cc:243] Waited 71.2 ms on lock 0x7b5400091ad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:25.477434 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.477571 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":163811200}
I20260709 12:26:25.480490  6044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2602) took 1092 ms. Trace:
I20260709 12:26:25.480899  6044 rpcz_store.cc:276] 0709 12:26:24.388021 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.388153 (+   132us) service_pool.cc:224] Handling call
0709 12:26:24.388459 (+   306us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:24.388849 (+   390us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:24.388875 (+    26us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:24.409355 (+ 20480us) log.cc:844] Serialized 52 byte log entry
0709 12:26:24.458723 (+ 49368us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:24.526560 (+ 67837us) log.cc:844] Serialized 14 byte log entry
0709 12:26:24.635319 (+108759us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:24.635387 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:25.463717 (+828330us) spinlock_profiling.cc:243] Waited 3.38 ms on lock 0x7b18003c23e0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:26:25.480209 (+ 16492us) raft_consensus.cc:1685] finished
0709 12:26:25.480303 (+    94us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.480433 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1816,"prepare.queue_time_us":76784,"prepare.run_cpu_time_us":50,"prepare.run_wall_time_us":2387,"raft.queue_time_us":74729,"raft.run_cpu_time_us":227,"raft.run_wall_time_us":8066,"spinlock_wait_cycles":7782784,"thread_start_us":148443,"threads_started":2,"wal-append.queue_time_us":144747}
I20260709 12:26:25.498533 11629 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:25.504586  5961 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:25.504837 11812 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:25.508849  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:25.509527  6646 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:25.509826  6651 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:25.510347  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:25.513689 11793 raft_consensus.cc:3055] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:25.514135 11793 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:25.514988  6084 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:25.514950 11793 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.515980 11793 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:25.516714 11697 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:25.517123 11697 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.517446 11697 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:25.521227 11717 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:25.521661 11717 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:25.522416 11717 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:25.523666 11717 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:25.531102 11823 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:25.534250 11781 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.534993 11781 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.535336 11751 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.541602 11413 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.542261 11781 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:25.543140  6109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1230) took 1313 ms. Trace:
I20260709 12:26:25.543501  6109 rpcz_store.cc:276] 0709 12:26:24.229325 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.229961 (+   636us) service_pool.cc:224] Handling call
0709 12:26:24.295076 (+ 65115us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:24.350601 (+ 55525us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:24.350630 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:24.350669 (+    39us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:24.350699 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:25.542920 (+1192221us) spinlock_profiling.cc:243] Waited 55.3 ms on lock 0x7b5400091fd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:25.542966 (+    46us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:25.543084 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":127158016}
I20260709 12:26:25.552330  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:25.552893  6044 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:25.554903  6114 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:25.556257  6035 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9. Ops: []
W20260709 12:26:25.556847 11551 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 13 current term: 13 is higher.
I20260709 12:26:25.560840 11742 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:25.542280 11751 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:25.567809 11524 consensus_queue.cc:1059] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:25.568919 11690 raft_consensus.cc:3055] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:25.569276 11690 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:25.562755  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:25.570101 11690 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.10, Last appended by leader: 10, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.574234  6037 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:25.542171 11413 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.579592 11413 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:25.588472 11722 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:25.589615 11386 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:25.590624  6044 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:26:25.592120  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:25.592898 11413 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Leader election won for term 8
W20260709 12:26:25.593153  6081 connection.cc:256] RPC call timeout handler was delayed by -1.3734773929995754s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1968s for a response
I20260709 12:26:25.593379 11413 raft_consensus.cc:697] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:25.594230 11413 consensus_queue.cc:237] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 6.7, Last appended by leader: 7, Current term: 8, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.595479  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.596086  5961 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:25.596825 11804 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:25.597087  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.597750  5962 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 13 index: 14. Preceding OpId from leader: term: 14 index: 15. (index mismatch)
I20260709 12:26:25.598434  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.598443  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:25.599226  6044 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:26:25.600438  6609 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:25.601230  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.601797  5966 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:26:25.602710  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:25.603242 11804 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:25.603484  5967 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:25.603615 11804 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.603996 11804 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:25.604534 11823 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:25.605562  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:25.606236  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.606539  6081 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.607163  5965 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:25.607826  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 2673) took 1026 ms. Trace:
I20260709 12:26:25.607903 11794 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:25.609413  6081 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.610162 11679 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:25.610566  6081 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.616536  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.621531  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.623732  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.624034  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.624583  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.625921  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:25.626444  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.627082  5966 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:26:25.628886  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:25.630530  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:25.630671  6044 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:25.636864  6006 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.631436  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 8 candidate_status { last_received { term: 7 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.608215  5965 rpcz_store.cc:276] 0709 12:26:24.581209 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.581326 (+   117us) service_pool.cc:224] Handling call
0709 12:26:25.562573 (+981247us) spinlock_profiling.cc:243] Waited 1.55 ms on lock 0x7b5800010598. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482601a0a0 00007f4826019984 00007f481f5946d4 00007f481f594662
0709 12:26:25.607688 (+ 45115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3555200}
I20260709 12:26:25.631526 11823 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:25.646834  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.647794  5968 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 12: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:25.648741 11686 raft_consensus.cc:3055] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:25.649266 11686 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:25.649735  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:25.650302  5964 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:25.650170 11686 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.651258 11686 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:25.654778 11528 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:26:25.655145  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:25.654805  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:25.657246  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.657732  5961 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 10: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:25.658409  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:25.659422  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.659787 11681 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:25.660621  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:25.618700 11692 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:25.662568  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:25.659530  6081 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:25.663309  6116 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:25.664526  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:25.665040  5964 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:25.632011  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:25.666383  5967 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:25.637804  5962 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
W20260709 12:26:25.670598  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:25.711104  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:25.748322  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 88843.5us
I20260709 12:26:25.749200  6081 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:25.757295  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:25.758004  6037 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 20.
I20260709 12:26:25.628523 11679 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:26:25.778699  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.779260  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:25.780781  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.649384 11794 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:25.787783  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:25.788471  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:25.789377  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:25.790068  6646 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 17: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:25.785249  6009 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:25.792361  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:25.784118  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 147318us
I20260709 12:26:25.786131  6115 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 17: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:25.793706 11742 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:25.778060 11717 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.786330 11812 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:25.786309 11689 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:25.805860  6118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1228) took 1579 ms (client timeout 1503 ms). Trace:
W20260709 12:26:25.794771  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.795919  6644 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:25.797111 11729 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:25.798069  5962 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42702625c5a04990a24ae81a2dede920"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:26:25.806913  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 2608) took 1052 ms. Trace:
I20260709 12:26:25.778602 11541 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:25.808223  5962 raft_consensus.cc:606] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:25.807955  6043 rpcz_store.cc:276] 0709 12:26:24.754760 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.754966 (+   206us) service_pool.cc:224] Handling call
0709 12:26:25.806735 (+1051769us) spinlock_profiling.cc:243] Waited 294 ms on lock 0x7b540024d1d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:25.806856 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":676565888}
I20260709 12:26:25.808879  5962 raft_consensus.cc:614] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:25.799671  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:25.747499 11793 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:25.802980 11804 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.788422  6648 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
W20260709 12:26:25.806278  6118 rpcz_store.cc:269] 0709 12:26:24.226783 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.227044 (+   261us) service_pool.cc:224] Handling call
0709 12:26:25.805656 (+1578612us) spinlock_profiling.cc:243] Waited 1.14 s on lock 0x7b5400163d54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:25.805762 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2629713280}
I20260709 12:26:25.755228 11528 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:25.811010  5932 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:25.786980 11794 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:25.800500 11551 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:25.798811 11791 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:26:25.799047 11787 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:26:25.873668  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.780408 11722 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.034s
W20260709 12:26:25.858786  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 59187.7us
I20260709 12:26:25.881942  6006 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.810557 11692 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:25.813038 11742 raft_consensus.cc:697] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:25.860219 11587 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:25.860157 11793 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:25.813704 11138 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:25.811574 11717 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.890934  6006 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 8 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.892266 11696 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:25.877931 11751 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:25.876514 11541 raft_consensus.cc:697] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:25.806295 11689 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.861606 11794 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:25.912565  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.919574  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:25.932202  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:25.933261  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:25.814363 11729 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.925627 11696 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.944645 11729 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:25.945250 11639 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:25.946055 11830 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:25.946499 11830 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:25.946858 11830 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:25.948120 11813 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:25.948658 11823 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:25.949162 11823 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.951277 11823 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:25.905633 11587 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:25.861385 11528 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.895144 11812 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:26:25.915936 11796 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.902s	user 0.011s	sys 0.017s
I20260709 12:26:25.884301 11787 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:25.880848 11697 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:25.924695 11751 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:25.924270 11745 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 8. Reason: could not achieve majority
I20260709 12:26:25.957773 11587 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:25.956991 11832 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:25.986016  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:25.946868 11793 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.8, Last appended by leader: 8, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:25.984629 11742 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:25.986130  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 184986us
I20260709 12:26:25.989312  6081 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:25.991434 11717 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:25.992291 11688 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:25.992837 11688 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:25.993132 11528 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:25.993645 11688 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:25.984678 11751 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:25.996701 11445 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 8 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:26.000010  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:26.000187  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 204549us
W20260709 12:26:26.001349  6650 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 1509) took 1340 ms (client timeout 1661 ms). Trace:
W20260709 12:26:26.001781  6650 rpcz_store.cc:269] 0709 12:26:24.660716 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.665227 (+  4511us) service_pool.cc:224] Handling call
0709 12:26:26.001178 (+1335951us) spinlock_profiling.cc:243] Waited 726 ms on lock 0x7b54006167d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:26.001289 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1670187776}
I20260709 12:26:26.004729  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:26.007009  6115 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:26.000692  6037 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:26:26.008646  6081 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:26.009739  5962 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:26.011137  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:26.013635  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:26.014133  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:26.015563  6112 raft_consensus.cc:2368] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20.
I20260709 12:26:26.015941  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:25.964269 11813 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:25.982554 11796 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.969s	user 0.011s	sys 0.021s
I20260709 12:26:26.001363  6611 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:26.015208  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 211449us
I20260709 12:26:26.033270  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:26.035310  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:26.036077  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:26.037953  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:26.038631  6041 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:26.039844  6116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:26.040459  6116 raft_consensus.cc:606] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:26.041361  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:26.016829 11138 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:26.022655 11692 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:26.025754 11758 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:26.031546 11694 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:26.072638 11758 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.091898 11758 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:26.068662 11138 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.024185 11541 consensus_queue.cc:237] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.025900 11812 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.047s
I20260709 12:26:26.009245 11832 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.031214 11790 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
W20260709 12:26:26.153450 11841 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:26:26.154143 11856 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:26.154808 11856 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:26:26.155057 11838 log.cc:927] Time spent T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:26:26.155728 11856 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.160260 11551 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:26.161149 11758 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.073877 11804 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:26.163404 11758 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:26.154018 11690 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:26.169297 11832 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:26.172539 11686 consensus_meta.cc:287] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.521s	user 0.008s	sys 0.000s
I20260709 12:26:26.139647 11787 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.180428 11697 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:26.130553 11848 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:26.136390 11843 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:26:26.189157 11839 log.cc:927] Time spent T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.160s	user 0.001s	sys 0.000s
W20260709 12:26:26.198812 11842 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:26:26.201912 11843 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.258340  5864 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.267648  5864 catalog_manager.cc:5697] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 11 to 12, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 12 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.273357 11869 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:26.276084 11869 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.280977 11869 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:26.281800 11869 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:26.282687 11869 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.277134  5864 catalog_manager.cc:5697] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.289129 11869 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:26.296437 11869 consensus_queue.cc:1059] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 8.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.001s
W20260709 12:26:26.305724  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 261998us
W20260709 12:26:26.307310  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:26.312827 11825 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 1.297s	user 0.015s	sys 0.012s
W20260709 12:26:26.313437 11825 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.298s	user 0.015s	sys 0.012s
I20260709 12:26:26.315100 11587 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.318048 11587 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:26.141158 11679 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:26:26.325729 11853 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:26:26.328848  6043 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 7 index: 9. Preceding OpId from leader: term: 9 index: 10. (index mismatch)
I20260709 12:26:26.334203  6118 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:26.336351  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:26.337452  6037 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 20.
I20260709 12:26:26.338680 11867 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.339949  5864 catalog_manager.cc:5697] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:26.340251 11867 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.344148  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:26.343549  5864 catalog_manager.cc:5697] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 12 to 14, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 14 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:26.344946  6036 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:26.353986 11867 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:26.334245  6111 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:26.358179 11689 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:26.364369  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:26.365329  6041 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:26.366070 11836 consensus_queue.cc:1059] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:26.367080 11762 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:26.368060  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:26.370198 11742 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:26:26.371555 11854 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.153s	user 0.000s	sys 0.001s
I20260709 12:26:26.395758 11696 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:26.141515 11138 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:26.371771  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:26.396955  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 59706.8us
I20260709 12:26:26.373745 11866 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.160997 11813 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.398113 11860 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:26.398901  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:26.400707  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:26.374992 11859 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.318622 11717 raft_consensus.cc:3055] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:26.402871 11786 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:26.402644 11859 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.403179 11717 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:26.402874  6118 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:26.404574 11717 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.405460 11859 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:26.376490 11832 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.212783 11843 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:26.377960  6651 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:26.380698  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:26.403409 11786 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:26.397977 11866 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.382242  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:26.382918  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:26.406440 11832 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.383814 11846 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.387318  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:26.407157 11679 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:26.345767  5864 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:26.418936 11846 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.420068 11679 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.389549  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:26.421131  5864 catalog_manager.cc:5697] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 4 to 8, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:26.415373  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 44011us
W20260709 12:26:26.410645  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 301201us
I20260709 12:26:26.425967  6646 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:26.427048 11742 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:26.427495 11742 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:26.427950 11742 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:26.407243  6645 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:26:26.432137  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:26.433187  6111 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:26.433835  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:26.413442  6650 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 20.
I20260709 12:26:26.406181 11717 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:26.422147 11846 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:26.418195 11832 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:26.442716 11857 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:26.444283  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:26.445358  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:26.409806 11786 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:26.455655  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:26.455845  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:26.456359  5961 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:26.456729 11848 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.457281 11857 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.458298  6118 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:26:26.413017 11866 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:26.479584  6650 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:26.480723 11857 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:26.483093  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:26.483953  5963 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:26.485190 11848 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.488147 11848 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:26.489886  6112 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 14: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:26.461892 11867 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.031s
W20260709 12:26:26.491847  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 61924.5us
I20260709 12:26:26.494139  6036 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
W20260709 12:26:26.497660  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 63995.3us
W20260709 12:26:26.497566  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48832.4us
I20260709 12:26:26.503803  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:26.504498  6650 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
W20260709 12:26:26.506855  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:26.522182  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 71367.8us
I20260709 12:26:26.524530  5963 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:26:26.527518  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:26.528275 11832 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:26.529472 11551 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.529515 11813 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.531472  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:26.531292 11813 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.532279  6650 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:26.533350  5932 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:26.534065 11813 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:26.534372 11869 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:26.534986 11869 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 21 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:26.536055 11869 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.539981 11812 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:26.530089 11832 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.527588  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:26.539626  5934 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:26.530195 11551 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.545395 11812 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.569952  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:26.568305  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:26.568264  6611 leader_election.cc:400] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20.
I20260709 12:26:26.574813  6611 leader_election.cc:403] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:26.580505 11871 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:26.582259 11138 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.584636 11138 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:26.585963 11840 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.407s	user 0.002s	sys 0.001s
I20260709 12:26:26.592223  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:26.592832 11821 raft_consensus.cc:3055] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:26.593364 11821 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:26.594107  5964 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 17 index: 9. (index mismatch)
I20260709 12:26:26.594436 11821 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.596580  5864 catalog_manager.cc:5697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 6 to 8. New cstate: current_term: 8 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:26.598182  6110 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
W20260709 12:26:26.599057 11794 consensus_meta.cc:287] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.616s	user 0.008s	sys 0.007s
I20260709 12:26:26.599965  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:26.570251 11832 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:26.606009 11878 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:26:26.606348  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:26.607654  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:26.615688  6643 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:26.616115  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:26.616438 11551 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:26.572623 11812 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:26.625186  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 115054us
I20260709 12:26:26.610420  6109 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:26.632310  5961 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
W20260709 12:26:26.646696  6114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1233) took 2268 ms (client timeout 1685 ms). Trace:
I20260709 12:26:26.647430 11717 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:26.648584  6043 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:26.665858  6118 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:26.669332  6611 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:26.670850 11717 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.673338 11717 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:26.673659 11832 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:26.660161  6114 rpcz_store.cc:269] 0709 12:26:24.306132 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:24.306313 (+   181us) service_pool.cc:224] Handling call
0709 12:26:26.556093 (+2249780us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540023aad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:26.574672 (+ 18579us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2775143296}
W20260709 12:26:26.675041 11830 consensus_meta.cc:287] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.728s	user 0.014s	sys 0.008s
I20260709 12:26:26.675503 11830 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.677688 11830 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:26.667500 11794 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:26.679034  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 157221us
W20260709 12:26:26.679520 11751 consensus_meta.cc:287] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.684s	user 0.003s	sys 0.014s
I20260709 12:26:26.679960 11751 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.680728  5864 catalog_manager.cc:5697] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:26.682065 11751 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:26.683054  5864 catalog_manager.cc:5697] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:26.656097 11846 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:26.685992 11846 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.688208 11846 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:26.689812 11821 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:26.679965  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:26.696314  5934 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:26.697042 11587 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:26.697707 11587 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:26.700453  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:26.702630 11794 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:26.704305  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:26.704720 11865 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:26.705183 11865 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:26.705528 11865 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:26.706641 11587 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:26.709141 11843 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.711436  5961 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:26.712504  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:26.712991 11793 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:26.713627 11793 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.714159  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:26.664098  5962 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
W20260709 12:26:26.730942  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 71578.8us
I20260709 12:26:26.655761 11859 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:26:26.743980  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:26.744578  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:26.745813  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:26.742086  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:26.745204  6646 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:26.750684  5864 catalog_manager.cc:5697] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:26.754442  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:26.757756  5968 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:26.748682 11138 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:26.760035 11138 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.744846 11832 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:26:26.762035 11138 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:26.757946 11787 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.005s	sys 0.036s
W20260709 12:26:26.762775 11787 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.585s	user 0.005s	sys 0.036s
I20260709 12:26:26.763970  6116 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:26.769829  5961 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:26:26.759402  5964 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:26.766259 11865 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.625237 11786 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.782335  5962 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 10 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
W20260709 12:26:26.786060  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 108704us
I20260709 12:26:26.789471  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:26.795989  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 63366.7us
I20260709 12:26:26.797710  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:26.798566 11884 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:26.799057 11884 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.799403 11884 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:26.802155  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:26.802990  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 63664.4us
I20260709 12:26:26.804590  6006 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:26.805402  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:26.805509 11722 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:26.805797 11587 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:26.806602 11830 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:26.806391 11587 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.807042 11830 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.806196 11722 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.806555 11551 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:26.807443 11830 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:26.808637 11551 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.809008 11551 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:26.806272  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:26.807699 11832 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:26.822849  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:26.823156 11722 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:26.823647  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 45500.6us
I20260709 12:26:26.824137 11813 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:26.824528 11813 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.824990 11587 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:26.825660 11856 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:26.807156 11138 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:26.826611  6009 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:26.827560 11875 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:26.828370  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:26.829782  6040 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 4 index: 6. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:26:26.830528 11836 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:26.831071  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:26.831708  6040 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:26:26.832005  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:26.832271 11867 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:26.832861  6043 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 21: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:26.833827 11867 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:26.834483 11792 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:26.835083  6609 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:26.836947  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:26.837854  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:26.838825 11684 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:26.839183  5963 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:26.839586  6113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:26.842576  6113 raft_consensus.cc:606] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:26.843014  6113 raft_consensus.cc:614] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:26.826068 11856 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:26.831619  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:26.844724  6039 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:26.840399 11722 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:26.841089  6037 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:26.831101 11836 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:26.845695 11722 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.846522 11836 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.847909 11722 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:26.829641  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:26.834226 11138 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.850250 11823 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:26.850670  5960 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:26.851513 11138 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:26.843926 11856 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:26.852517 11832 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:26.853472 11832 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.825507 11849 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:26.824851 11813 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:26.838131  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:26.825731  6081 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:26.791726 11717 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:26.865129  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:26.882804  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:26.796099 11794 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:26.893371  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:26.904532  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:26.839367 11684 raft_consensus.cc:697] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:26.904289  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:26.930447  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:26.919235 11823 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:26.844099 11865 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:26.916414  6116 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:26:26.917608  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 91963.4us
I20260709 12:26:26.886475 11875 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:26.850060 11812 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.925649  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:26.924914 11792 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:26.929401 11587 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:26.930007  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:26.892616 11843 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:26.895287  6646 raft_consensus.cc:2393] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 17: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:26.933400  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:26.911981  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 91357.8us
I20260709 12:26:26.915707 11849 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:26.904271 11794 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.955868  6112 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:26.946915  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51190.8us
I20260709 12:26:26.975004  6040 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:26.957206  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:26.918272 11696 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.038s
I20260709 12:26:26.957129 11830 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:26.982642  6113 raft_consensus.cc:2376] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13. Re-sending same reply.
I20260709 12:26:26.983155 11792 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.984061 11587 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.976274  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:26.995496  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:26.993831 11856 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:26.996737  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:26.997809  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:26.998844  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:26.999838 11791 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:27.000460  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:27.001240  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:27.002477  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:26.951510 11875 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.005642 11138 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:27.017110  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:26.957579 11823 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:27.030042  5967 raft_consensus.cc:2368] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20.
I20260709 12:26:27.030478  5966 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:27.046937  6114 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:27.050324  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:27.051017  5960 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9. Ops: []
W20260709 12:26:27.032173 11742 consensus_meta.cc:287] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.600s	user 0.008s	sys 0.006s
I20260709 12:26:27.012416 11865 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.028193 11875 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:27.080369  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:27.081120  5966 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:27.078321 11742 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.072505 11791 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:27.096061 11742 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:27.095942 11791 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 16.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:27.099350  5962 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 7 FOLLOWER]: Advancing to term 8
I20260709 12:26:27.097198  6035 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:27.101747  5964 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:27.051028 11793 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:27.111364  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:27.105579  5932 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:27.115197  6112 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:27.089339 11138 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.143301 11138 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:27.106835 11865 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.146857  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:27.147224 11832 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:27.147406 11865 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:27.113075 11546 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:27.147948 11832 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:27.148097 11546 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:27.151540 11812 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:27.152031 11587 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:27.150207 11832 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:27.155001  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:27.155670  5967 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:27.156683  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 8 candidate_status { last_received { term: 6 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:27.157390  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:27.158077  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:27.166738 11849 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.169008 11704 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:27.175570 11792 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:27.176009  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.176313 11861 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:27.176754 11794 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:27.180609  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:27.217238  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:27.183562 11886 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:26:27.187650 11856 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:27.201701  5967 raft_consensus.cc:2368] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20.
I20260709 12:26:27.120215 11786 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:27.202865  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 306536us
I20260709 12:26:27.203828  6646 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:27.137017 11679 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 6, Time since last communication: 0.079s
W20260709 12:26:27.153855 11887 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.226s	user 0.001s	sys 0.000s
I20260709 12:26:27.182161  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:27.218075  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:27.243860  6645 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:27.114162 11551 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:27.243814  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 263719us
I20260709 12:26:27.222342  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:27.239316  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:27.243820  5963 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:27.246906  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:27.215102 11722 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:26:27.219197  6114 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:27.215984 11861 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.251766  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:27.253187  6037 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:27.174161 11884 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.264405  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:27.253051 11830 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:27.241756 11793 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.265620  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:27.281682  5960 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:27.114907 11823 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.276307  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:27.253261 11679 consensus_queue.cc:1243] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer f1bb8e63c2b448cdafd51f05d277c741 log is divergent from this leader: its last log entry 10.7 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
I20260709 12:26:27.293042  6116 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:27.303393  6113 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:27.287720  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:27.263566 11861 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:27.252440 11812 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:27.131692 11684 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.295307  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:27.290409  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 133132us
I20260709 12:26:27.306764  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:27.306910  6084 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:27.310153  6609 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:27.247763 11704 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.286098 11865 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.027s
W20260709 12:26:27.434765  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 170426us
I20260709 12:26:27.309031 11751 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:27.387095  5960 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
W20260709 12:26:27.374480  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 64353.1us
I20260709 12:26:27.338817  6109 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:27.387319  6645 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:27.343549  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:27.390743  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:27.314942  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 203982us
I20260709 12:26:27.365365  6116 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
W20260709 12:26:27.347059  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 44378.5us
I20260709 12:26:27.329739  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:27.454502  6112 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:27.461978  6646 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:26:27.456037  6109 raft_consensus.cc:606] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:27.339709 11859 consensus_meta.cc:287] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.599s	user 0.010s	sys 0.000s
I20260709 12:26:27.451138  6609 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:27.406105 11896 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.000s
I20260709 12:26:27.466620 11786 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:27.467588  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 124151us
W20260709 12:26:27.394778 11867 consensus_meta.cc:287] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.560s	user 0.012s	sys 0.000s
W20260709 12:26:27.467749  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 189780us
I20260709 12:26:27.313094 11696 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:26:27.337944 11853 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:26:27.348284 11906 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:27.469367  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:26:27.456946 11813 consensus_meta.cc:287] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.526s	user 0.000s	sys 0.010s
I20260709 12:26:27.471843  6084 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:27.410566 11846 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:27.398209 11898 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:27.286543 11793 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.341306 11551 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:27.449470 11751 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:27.474630 11907 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:26:27.475764  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:27.477387 11792 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.477770 11867 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:27.473966 11696 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.478758  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:27.479369 11704 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:27.318590 11812 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:27.473158  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:27.486976  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:27.483724 11875 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.518882  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:27.470933 11859 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20.
W20260709 12:26:27.504110  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:27.505498 11863 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:27.500255 11856 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:27.511421  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:27.513370  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:27.490517 11742 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:27.494822  5962 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 8.
I20260709 12:26:27.528460  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:27.529230 11907 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:27.529755 11907 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:27.507362 11751 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.530598 11914 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:27.531133 11812 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:27.511433 11792 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:27.532310  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:27.519284  6109 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:27.518704  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:27.520145  6114 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:27.520700  6646 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 10. Preceding OpId from leader: term: 9 index: 10. (term mismatch)
I20260709 12:26:27.499794 11846 raft_consensus.cc:697] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:27.521972  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:27.523286  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:27.523880  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:27.493021 11898 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:27.529266  6642 raft_consensus.cc:2368] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:27.521941  6115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:27.526845  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:27.534075  6646 pending_rounds.cc:85] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 9
I20260709 12:26:27.528366  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:27.534360  5964 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:27.536077  5967 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 6 index: 7. Preceding OpId from leader: term: 8 index: 8. (index mismatch)
I20260709 12:26:27.539500  6644 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:27.512260 11869 raft_consensus.cc:2764] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:26:27.542996  6650 raft_consensus.cc:2393] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:27.546452  6115 raft_consensus.cc:606] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:27.487556 11813 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:27.554733  6118 raft_consensus.cc:2368] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19.
I20260709 12:26:27.549710 11793 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:27.550980  6116 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:27.551968  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:27.553857  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:27.554982  5968 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 11 index: 8. (index mismatch)
I20260709 12:26:27.554828  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:27.533816 11856 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:27.547863  6646 pending_rounds.cc:107] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 8.10
I20260709 12:26:27.567054  6646 raft_consensus.cc:2889] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:27.556687 11875 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:27.531104 11914 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:27.515372 11696 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:27.512131 11830 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:26:27.558597 11898 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:27.579320  6643 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:26:27.582692  6109 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:27.583665  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:27.589846  5962 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:27.587013  6112 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:27.595162  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:27.595738  6646 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:27.586012  5963 pending_rounds.cc:85] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 6
I20260709 12:26:27.596555  5963 pending_rounds.cc:107] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 10.7
I20260709 12:26:27.596764  5963 raft_consensus.cc:2889] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:27.614276  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:27.614966  6646 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:27.616734  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:27.617352  5962 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:26:27.619228  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:27.619439 11900 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:27.620041 11900 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.579134 11856 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:27.619289  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:27.625551  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:27.625603 11910 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.228s	user 0.001s	sys 0.001s
I20260709 12:26:27.635823 11813 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:27.579914 11742 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:27.696324  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 96960us
I20260709 12:26:27.697382  6644 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
W20260709 12:26:27.699046  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 77267.9us
I20260709 12:26:27.587798 11832 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:27.707748  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 199853us
I20260709 12:26:27.710268  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:27.715132  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:27.715692  6084 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:27.530740 11907 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:27.716471  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:27.722276  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 116415us
I20260709 12:26:27.724042  5934 leader_election.cc:400] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:27.724371  5934 leader_election.cc:403] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:27.726275  5934 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:27.730253  5962 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:27.730873  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:27.731139  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:27.731870  6111 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:27.733383 11786 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:27.718995 11848 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.721725 11832 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.703503 11138 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
W20260709 12:26:27.734405  6006 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.831s	user 0.036s	sys 0.037s
W20260709 12:26:27.744328  6006 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.841s	user 0.036s	sys 0.039s
I20260709 12:26:27.746807  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:27.742789  6043 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:26:27.744992  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 879871us
I20260709 12:26:27.752810 11138 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:27.742920 11742 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.765939  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:27.768345 11546 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:27.771633  6643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 1527) took 1054 ms. Trace:
I20260709 12:26:27.773643  6044 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:27.777079 11792 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:27.731323 11758 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:27.780773  5934 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:27.768136 11863 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
W20260709 12:26:27.778158  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 78435.4us
I20260709 12:26:27.829394  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:27.784176  6643 rpcz_store.cc:276] 0709 12:26:26.717166 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.733654 (+ 16488us) service_pool.cc:224] Handling call
0709 12:26:27.771397 (+1037743us) spinlock_profiling.cc:243] Waited 797 ms on lock 0x7b540053edd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:27.771536 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1832309632}
I20260709 12:26:27.847018  6112 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
W20260709 12:26:27.849540  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 68824.4us
I20260709 12:26:27.850442  5934 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:27.740545 11900 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
W20260709 12:26:27.857118  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 83324.4us
I20260709 12:26:27.852123  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:27.860106  6039 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:27.802857 11722 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:27.865443  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:27.867295  6036 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:27.869180  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:27.870877  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 161645us
I20260709 12:26:27.871651  6084 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:27.873131  6044 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:27.865828  6611 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:27.876809  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:27.869500  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:27.739209 11848 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:27.848095 11751 raft_consensus.cc:476] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Not starting pre-election -- already a leader
I20260709 12:26:27.887032  6644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:26:27.888520  6644 raft_consensus.cc:606] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:27.889599  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:27.856671 11792 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:27.891546  6644 raft_consensus.cc:614] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:27.891929  6038 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:27.735178 11846 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 12.9, Last appended by leader: 9, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.896271  5934 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:27.783798 11861 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:27.897125  6611 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:27.863869 11929 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:27.883850 11821 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:27.887140 11869 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:27.892712 11863 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:27.905851  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:27.924146 11919 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:26:27.883306 11717 consensus_queue.cc:1059] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:26:27.943311 11689 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:27.943961 11689 raft_consensus.cc:697] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:27.944952 11689 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 9.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.887475 11704 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.033s
I20260709 12:26:27.951385 11832 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:27.952445 11751 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:27.952961 11751 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:27.911240 11900 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:27.953902 11900 raft_consensus.cc:697] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:27.954496  6042 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:27.954981 11900 consensus_queue.cc:237] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:27.863732 11758 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:27.963217  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 57447.1us
I20260709 12:26:27.973188  5966 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:28.005273  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:28.006008  6645 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:27.903092 11867 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.069s
W20260709 12:26:28.009337  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 290334us
I20260709 12:26:27.922159 11863 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:28.007920  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 89979.3us
I20260709 12:26:27.904768 11546 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 12:26:27.962383 11821 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:28.014449  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 118251us
I20260709 12:26:28.020481  5934 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:28.021665 11867 consensus_queue.cc:1243] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer 0069e2ba1f02412e8e1d6c20a1fb510f log is divergent from this leader: its last log entry 18.10 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 8
I20260709 12:26:28.009615 11869 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:28.031406  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:28.015327 11863 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:28.034781  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:28.037083  6644 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:28.037595 11931 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:28.040228  6611 leader_election.cc:400] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19.
I20260709 12:26:28.015895 11914 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:28.067574  6645 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:28.076071 11587 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:28.078454 11861 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:28.079041  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 1926) took 1188 ms. Trace:
I20260709 12:26:28.079298 11861 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:28.079581  6043 rpcz_store.cc:276] 0709 12:26:26.890138 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.890338 (+   200us) service_pool.cc:224] Handling call
0709 12:26:26.890671 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:27.753456 (+862785us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.078722 (+325266us) spinlock_profiling.cc:243] Waited 852 ms on lock 0x7b5400172354. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:28.078936 (+   214us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1958932736}
I20260709 12:26:28.080986 11696 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.083570 11758 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:28.084892 11751 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:28.032938 11869 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.088208 11869 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:28.091292 11848 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:28.091614  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:28.094049  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:28.094229  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:28.094671  6043 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:28.095160  6040 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:28.096596  6044 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:28.081601  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2714) took 1075 ms. Trace:
I20260709 12:26:28.097126  6044 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:28.108657  5963 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:28.108736  6647 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:28.105270  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:28.109360  6042 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:26:28.097848  5966 rpcz_store.cc:276] 0709 12:26:27.006342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.142386 (+136044us) service_pool.cc:224] Handling call
0709 12:26:27.142735 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:28.003934 (+861199us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.081318 (+ 77384us) spinlock_profiling.cc:243] Waited 820 ms on lock 0x7b54002dc3d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:28.081536 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1886330112}
I20260709 12:26:28.109599  5967 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:28.108968  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 81594.9us
I20260709 12:26:28.113303  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:28.022293 11856 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.065552 11938 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:28.130919  6038 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:28.129303  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:28.079787 11861 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:28.144376  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:28.117928 11907 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:28.155298  6651 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 13: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:28.118134 11900 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:28.117594 11751 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.145569  6044 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:28.157917  6044 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:28.113859 11931 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:28.159475  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:28.117439 11866 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.039s
I20260709 12:26:28.147364 11812 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:28.148754 11938 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:28.148540 11684 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:28.172614  5963 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:26:28.182536 11937 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:28.183156 11937 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:28.183568 11937 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:28.169745 11812 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:28.189309 11812 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:28.174417 11751 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:28.191039 11942 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:26:28.192391 11751 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:28.193574 11938 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.167198 11138 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:28.203965  6608 leader_election.cc:400] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20.
I20260709 12:26:28.182116  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:28.202096  6043 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:26:28.203298  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:28.173979 11696 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:28.173883 11899 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:28.226810 11899 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.228161  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:28.228783  6038 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:28.229223 11899 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:28.233839 11786 raft_consensus.cc:3055] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:28.234278 11786 raft_consensus.cc:740] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:28.205194 11861 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:28.235146 11786 consensus_queue.cc:260] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.236420 11786 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:28.237264  5968 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:28.238315  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:28.239056  5968 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 21: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:28.238907  6038 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:28.239744  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:28.238817  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:28.241737  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:28.242762  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:28.207702  5965 raft_consensus.cc:2368] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13.
I20260709 12:26:28.213325  5964 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:26:28.162559 11821 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.177928 11684 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.216140 11856 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:28.219660  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:28.246097 11751 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:28.247779  5968 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:28.248420  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:28.250384  6112 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:26:28.251431  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:28.251690  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:28.221892 11898 consensus_meta.cc:287] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.600s	user 0.003s	sys 0.004s
I20260709 12:26:28.222528 11812 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:28.268201  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:28.278854  6645 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
W20260709 12:26:28.279960  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 77949.4us
I20260709 12:26:28.273573  5967 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:28.275215 11629 raft_consensus.cc:993] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:26:28.276355 11684 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:28.277619 11869 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:28.280568  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:28.297770  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 276123us
I20260709 12:26:28.298825  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:28.166651 11931 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:28.301014  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:28.280833  6608 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:28.281814  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:28.317904  6116 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:28.272769  5932 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:28.297237  6006 leader_election.cc:400] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13.
I20260709 12:26:28.322981  6112 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:26:28.326282  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:28.326653  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:28.327347  6038 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:28.324563  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:28.329272  5962 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
W20260709 12:26:28.329320  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 56662.1us
I20260709 12:26:28.330857  6009 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:28.328750  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 48038us
I20260709 12:26:28.332542  6608 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:28.332978  6006 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:28.334772  5959 raft_consensus.cc:2368] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16.
I20260709 12:26:28.336735  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:28.283481 11914 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:26:28.340755  5934 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:28.297250 11867 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.045s
I20260709 12:26:28.319226 11684 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:28.351565 11751 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:28.351601 11684 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.352525 11751 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:28.353051 11751 raft_consensus.cc:697] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:28.354286 11684 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:28.328567 11742 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
W20260709 12:26:28.354561 11930 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.073s	user 0.001s	sys 0.000s
I20260709 12:26:28.355859 11871 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:28.356201 11742 raft_consensus.cc:3055] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:28.356565 11742 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:28.357384 11742 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.329011 11935 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:28.337980 11813 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:28.282028 11898 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.337882 11138 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:28.337738 11899 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:28.333384 11945 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:28.337543 11830 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:28.374478  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:28.298918 11812 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:28.343372 11717 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:28.388944  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 43944.4us
I20260709 12:26:28.361349 11832 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.026s
I20260709 12:26:28.394197  6649 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:28.353983 11751 consensus_queue.cc:237] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:28.387099 11899 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.405790  6043 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 8.
W20260709 12:26:28.407413  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 70720.3us
I20260709 12:26:28.408491  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:28.392498 11742 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:28.390525 11138 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:28.414054 11926 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:28.407660 11899 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:28.419924 11812 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:28.427709 11898 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:28.395279 11863 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.393843 11717 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:28.409721  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 76837.3us
I20260709 12:26:28.436883  6009 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:28.438337  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 89037.8us
I20260709 12:26:28.439378  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:28.440152  6044 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 10. (term mismatch)
I20260709 12:26:28.440531  6044 pending_rounds.cc:85] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 9
I20260709 12:26:28.440739  6044 pending_rounds.cc:107] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 17.10
I20260709 12:26:28.440953  6044 raft_consensus.cc:2889] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:28.430652 11863 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:28.439380  6649 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:26:28.441679 11825 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:28.444233 11821 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:28.439689 11812 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:28.445583  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:28.455981 11944 log.cc:927] Time spent T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.127s	user 0.001s	sys 0.000s
I20260709 12:26:28.447623 11953 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:28.463063 11953 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.465287 11953 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:28.445966 11138 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:28.449743 11812 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.467389 11812 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:28.445832 11823 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 18 current term: 18 is higher.
I20260709 12:26:28.444867 11914 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:26:28.479256  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:28.480739  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:28.481355  5960 raft_consensus.cc:2376] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11. Re-sending same reply.
I20260709 12:26:28.483842  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:28.487358  6643 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:28.488471 11959 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:28.489171  6110 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
I20260709 12:26:28.436350 11937 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.492882  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:28.493536  5960 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:28.466228 11821 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:28.496932  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:28.492918 11869 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:28.499342  5967 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:28.462153 11899 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.501953  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:28.503026  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:28.503679  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:28.514492  5960 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:26:28.512596 11722 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.005s
W20260709 12:26:28.543237 11950 log.cc:927] Time spent T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.080s	user 0.000s	sys 0.002s
I20260709 12:26:28.549182  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:28.550215 11696 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:28.552990 11696 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:28.560628  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:28.561065  6035 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:28.561329  6038 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:26:28.562709  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:28.563326  6041 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:28.564258  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:28.564890  5960 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:28.566561 11938 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:28.580844 11899 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:28.572729 11884 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:28.590312 11696 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.591280  5959 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 7 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:28.593307  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:28.599885 11901 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 1.209s	user 0.006s	sys 0.005s
I20260709 12:26:28.600728 11938 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:28.606003  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3100) took 1797 ms. Trace:
I20260709 12:26:28.606688  5965 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:28.609921 11931 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:28.612000 11861 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:28.603595 11937 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:28.615578  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:28.606429  5961 rpcz_store.cc:276] 0709 12:26:26.808776 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:26.810702 (+  1926us) service_pool.cc:224] Handling call
0709 12:26:26.833835 (+ 23133us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:26.886280 (+ 52445us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:26.886314 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:26.903940 (+ 17626us) log.cc:844] Serialized 52 byte log entry
0709 12:26:27.136540 (+232600us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:27.136585 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:27.136661 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:28.599265 (+1462604us) spinlock_profiling.cc:243] Waited 55.5 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:28.605672 (+  6407us) raft_consensus.cc:1685] finished
0709 12:26:28.605695 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.605921 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":61290,"raft.queue_time_us":52784,"raft.run_cpu_time_us":139,"raft.run_wall_time_us":16657,"spinlock_wait_cycles":127618432,"thread_start_us":159669,"threads_started":1,"wal-append.queue_time_us":439682}
W20260709 12:26:28.619793  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:28.619971  6109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3056) took 1089 ms. Trace:
I20260709 12:26:28.620801  6649 raft_consensus.cc:2368] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:28.627244  5965 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:28.628286  6041 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:28.620961  6109 rpcz_store.cc:276] 0709 12:26:27.530129 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.597680 (+ 67551us) service_pool.cc:224] Handling call
0709 12:26:27.618006 (+ 20326us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:27.715202 (+ 97196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:27.715234 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:27.732886 (+ 17652us) log.cc:844] Serialized 26 byte log entry
0709 12:26:27.856763 (+123877us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:27.896762 (+ 39999us) log.cc:844] Serialized 14 byte log entry
0709 12:26:28.278205 (+381443us) spinlock_profiling.cc:243] Waited 5.93 ms on lock 0x7b18002aab40. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:26:28.619486 (+341281us) spinlock_profiling.cc:243] Waited 872 us on lock 0x7b18002aab40. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481dee1c0a 00007f4827621219 00007f481df69a40 00007f481df644e4 00007f481df64455 00007f482104c060 00007f482105e716 00007f482106f287 00007f482106f208
0709 12:26:28.619659 (+   173us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:28.619728 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:28.619767 (+    39us) raft_consensus.cc:1685] finished
0709 12:26:28.619779 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:28.619914 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":135385,"prepare.queue_time_us":13594,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":33,"raft.queue_time_us":88158,"raft.run_cpu_time_us":131,"raft.run_wall_time_us":3320,"spinlock_wait_cycles":15655680,"thread_start_us":123485,"threads_started":1,"wal-append.queue_time_us":164776}
I20260709 12:26:28.623826 11812 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.636842 11812 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:28.641587  5934 leader_election.cc:400] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:28.641886  5934 leader_election.cc:403] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:26:28.638391 11587 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.638091 11791 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:28.649972 11812 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:28.651094 11823 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:28.651470 11823 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:28.652334 11823 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.653332 11823 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:28.655117 11587 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:28.656912  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:28.657207 11587 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:28.646889 11793 raft_consensus.cc:1081] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:26:28.664078 11791 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.664425  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:28.665230  6041 raft_consensus.cc:2410] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:26:28.663838 11823 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.665980 11823 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:28.668392  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:28.669337  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:28.669490  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:28.670113  6041 raft_consensus.cc:2410] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 13 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:26:28.675689  6116 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 13: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:28.678120  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:28.680835  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 3051) took 1164 ms. Trace:
I20260709 12:26:28.682538  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:28.683163  6116 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:26:28.685551  6645 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:26:28.686112  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:28.686685  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:28.681224  6110 rpcz_store.cc:276] 0709 12:26:27.512149 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:27.519050 (+  6901us) service_pool.cc:224] Handling call
0709 12:26:28.676067 (+1157017us) spinlock_profiling.cc:243] Waited 942 ms on lock 0x7b54002391d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:28.676167 (+   100us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2167028480}
I20260709 12:26:28.684216  5934 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:28.703466  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:28.703410  6040 raft_consensus.cc:2368] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19.
I20260709 12:26:28.718068  6036 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:28.719945  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:28.718441  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:28.684568 11931 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:28.731959 11790 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.732515 11790 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:28.730036 11956 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:28.734038 11956 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.735024 11546 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:28.735862 11546 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:28.736383 11546 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:28.736714 11546 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:28.737498 11546 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:28.739923  5932 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:28.741750  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:28.742331  6038 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:28.738513 11717 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:28.734362 11956 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:28.750252  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:28.756906  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:28.745639 11546 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:28.765144  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:28.746625 11792 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:28.747726 11959 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:28.769345  6038 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:28.746191 11790 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:28.774551  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:28.775167  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:28.775895  6643 raft_consensus.cc:2368] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:28.704991 11812 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.065s
I20260709 12:26:28.782721  6645 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:28.789569  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:28.765506 11907 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:28.791868  6038 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14. Ops: []
W20260709 12:26:28.790251  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 49303.7us
I20260709 12:26:28.793942  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:28.772632 11959 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.758351 11906 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:26:28.794934  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:28.766703 11931 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 10, Time since last communication: 0.027s
I20260709 12:26:28.787032 11823 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:28.802307  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:28.802554 11629 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:28.803526  5960 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:26:28.801911  6084 leader_election.cc:400] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:28.832134  6084 leader_election.cc:403] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:26:28.761165 11905 consensus_queue.cc:1059] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.031s
I20260709 12:26:28.774196 11679 consensus_queue.cc:1059] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.023s
I20260709 12:26:28.804095 11861 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:28.797750 11959 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:28.813082  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:28.814083  6006 leader_election.cc:400] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16.
I20260709 12:26:28.839635  6006 leader_election.cc:403] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:28.830749  6609 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:28.826550 11968 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:28.827705  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:28.794777 11758 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:28.853099  5963 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 14: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:28.803144 11787 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
W20260709 12:26:28.856496  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 56024.1us
I20260709 12:26:28.829665 11931 consensus_queue.cc:1243] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer 0557a7246c8945b99e5215c99d4ddf9c log is divergent from this leader: its last log entry 18.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:26:28.860311  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:26:28.887650  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 47770.4us
I20260709 12:26:28.887187 11867 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.003s
I20260709 12:26:28.857553 11848 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:28.857062 11787 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:28.899151  6609 leader_election.cc:400] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19.
I20260709 12:26:28.859262 11823 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16.
I20260709 12:26:28.860728 11684 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:28.888641 11861 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:26:28.916401  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 58638.8us
I20260709 12:26:28.906783  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:28.889462 11832 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:29.133801 11832 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.134253 11832 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:28.890415 11629 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:28.837178 11849 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.059s
I20260709 12:26:28.918768  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:29.140000  6044 raft_consensus.cc:2368] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
W20260709 12:26:28.899156 11966 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:26:28.919878  6609 leader_election.cc:403] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:26:28.939237  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:29.143093  6038 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 8.
I20260709 12:26:28.907627 11787 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:28.995457 11973 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.075s	user 0.000s	sys 0.000s
I20260709 12:26:28.858806 11968 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:28.867503 11956 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:28.950577 11970 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 12:26:28.892935 11846 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.037s
I20260709 12:26:29.131811  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:29.132733 11758 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:29.136807  6645 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:26:29.137194  6646 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 14: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:26:29.137781  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 246703us
I20260709 12:26:29.139595 11907 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:29.144634 11629 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.145911 11861 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.149243 11848 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
W20260709 12:26:29.147884  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 248858us
I20260709 12:26:29.180094  6609 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:29.130252 11792 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.152376 11859 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19.
I20260709 12:26:29.179445  5962 raft_consensus.cc:2368] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10.
W20260709 12:26:29.181891  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50193.8us
W20260709 12:26:29.181602  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:29.163137 11758 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.193054 11758 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.158602 11863 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:29.194664 11528 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:29.195130 11528 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:29.194850 11863 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.195858 11968 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:29.196053 11528 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.172209 11704 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:29.197114 11704 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.199468 11704 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.201622 11792 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.203841 11792 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.184692 11790 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:29.204564 11914 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:29.205121 11528 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:29.206966 11865 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:29.208300 11791 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.209941 11956 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.191501  6082 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:29.215116 11884 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.215700 11884 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.217872 11884 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.156015 11948 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.178495 11907 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.232787 11681 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:29.227320 11717 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.233536 11681 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.235441  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:29.235780  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:29.228251  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:29.239128  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 47696.5us
I20260709 12:26:29.240674  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:29.242587  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.243718  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.243892  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:29.244519  6109 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:29.245314 11679 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:29.246735 11717 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.227291 11900 consensus_queue.cc:1059] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.024s
I20260709 12:26:29.232981 11907 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.245275 11979 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:29.250649 11717 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.254118 11959 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.271289 11959 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.254318 11948 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.258924  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:29.268029 11979 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:29.275244 11979 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:29.261844 11900 raft_consensus.cc:3055] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:29.276266 11900 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:29.277195 11900 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.278365 11900 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:29.254774 11865 raft_consensus.cc:697] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:29.280155 11865 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.282159 11681 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.173833 11905 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.286424 11905 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.288836 11905 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.291287  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:29.213698 11832 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.230502  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:29.294283  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:29.297463  6647 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:29.298732 11976 raft_consensus.cc:3055] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:29.299163 11976 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:29.299988 11976 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.8, Last appended by leader: 8, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.301261 11976 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:29.301568  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.303826 11945 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.304476 11945 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.295400  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.307195 11945 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.309659  5932 leader_election.cc:400] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:29.310048 11792 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.296172 11948 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.314010  5961 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:29.295454  6116 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:26:29.318946  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.323956  6109 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:26:29.326107  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.331689  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.333935  6084 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:29.338747  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:29.197189 11863 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.342348  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.351308  6118 raft_consensus.cc:3055] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:29.351724  6118 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:29.352418  5965 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:29.355576  6006 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:29.310602 11956 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.372203  6006 leader_election.cc:400] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10.
I20260709 12:26:29.351966  5934 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:29.327801 11970 raft_consensus.cc:2764] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:26:29.372552  6006 leader_election.cc:403] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:29.373714  6118 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.375041  6118 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:29.347453 11931 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.376492 11931 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.350970 11859 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260709 12:26:29.379568 11546 consensus_meta.cc:287] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.614s	user 0.010s	sys 0.006s
I20260709 12:26:29.310602 11792 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.382306 11812 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.382102  6118 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 11. (term mismatch)
I20260709 12:26:29.382694  6116 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:29.383150  6118 pending_rounds.cc:85] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 10
I20260709 12:26:29.383397  6118 pending_rounds.cc:107] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 15.11
I20260709 12:26:29.383631  6118 raft_consensus.cc:2889] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:29.386178 11954 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 10
I20260709 12:26:29.389101  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:29.382387 11884 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:26:29.401038  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 49128.5us
I20260709 12:26:29.345266 11528 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:29.387420 11787 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:29.403647  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:29.403882 11138 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:29.405136 11956 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.407660 11832 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.409627 11979 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.426538 11528 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:29.448761 11528 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:29.415230  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:29.382023 11792 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.417026 11974 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.452965 11974 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.454066  5934 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:29.454969 11974 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.455106 11869 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:29.417624 11931 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.418753 11871 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.418785  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:29.419382  5961 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 9 index: 6. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:29.419723 11954 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 9. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10.
I20260709 12:26:29.415115  6042 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 13. (term mismatch)
I20260709 12:26:29.348224 11717 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.348472 11867 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:29.479883  6117 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:29.439386  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.439729  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.448272 11979 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.410384 11722 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.382908 11812 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.464099  6042 pending_rounds.cc:85] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 12
I20260709 12:26:29.490757  6042 pending_rounds.cc:107] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 17.13
I20260709 12:26:29.456403  6112 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:26:29.490937  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:29.465611  5963 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:29.460932  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:29.468694 11832 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:29.468500 11871 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.469565  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:29.470260  6116 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:29.469470  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.483009  6118 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:26:29.485292  6109 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:29.492165  6042 raft_consensus.cc:2889] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:29.455528 11974 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:29.515497 11812 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.515746 11974 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.516222 11974 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:29.517983  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:29.518692  5968 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:29.520330  6006 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:29.520486  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:29.495209  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:29.496079 11983 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.495829 11867 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.456993 11787 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:29.544065  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 60344.8us
I20260709 12:26:29.456993 11138 raft_consensus.cc:697] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:29.496702  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:29.543996  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:29.497835  6038 raft_consensus.cc:1217] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Deduplicated request from leader. Original: 10.10->[12.11-21.16]   Dedup: 13.12->[15.13-21.16]
I20260709 12:26:29.492990  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:29.511245  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:29.515100  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:29.514854 11528 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.525949  5963 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:29.486402 11717 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:29.543989  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 105090us
I20260709 12:26:29.528832  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:29.568456  6040 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:29.496425 11722 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.521173  6044 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:29.573841  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:29.553918  6042 raft_consensus.cc:2393] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 15: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:26:29.554040  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 61120.1us
I20260709 12:26:29.576587  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:29.554562  6038 pending_rounds.cc:85] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 12
I20260709 12:26:29.554311  6646 raft_consensus.cc:2410] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 14 because replica has last-logged OpId of term: 13 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 9.
I20260709 12:26:29.557152  5961 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: [10.7-11.8]
I20260709 12:26:29.576064  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:29.577730  5963 raft_consensus.cc:2368] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:29.557577  6109 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:29.553200  6037 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:29.558311  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 10 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:29.560019  5964 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:29.571633  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:29.568068  6611 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:29.498848 11948 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.580250  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:29.580857  5965 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:29.588454  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:29.588479  6118 raft_consensus.cc:606] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:29.583179  6038 pending_rounds.cc:107] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:26:29.590183  6038 raft_consensus.cc:2889] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:29.590519  6038 pending_rounds.cc:107] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:26:29.590735  6038 raft_consensus.cc:2889] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:29.577093  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:29.576000  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:29.580201  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:29.587625  5966 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:26:29.593520  6039 raft_consensus.cc:2368] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:29.593704 11900 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:29.594372  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:29.593734 11948 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.558758 11792 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:29.600229  6041 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:26:29.580971  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:29.602267  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:29.604688  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:29.605422  6042 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 18: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:29.600437  5959 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:29.606968  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:29.607692  6116 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 14: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:29.608454  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.608958  6113 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:29.572758 11823 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:29.609952  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.612565  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:29.613662  6113 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:26:29.609264 11959 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:29.612353 11954 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:29.610288 11812 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.603138  6037 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 14: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:29.619349  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.620123  6109 raft_consensus.cc:2368] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10.
I20260709 12:26:29.611991 11982 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:29.617769  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:29.574764 11884 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.613509  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:29.617911  6115 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:29.586622 11859 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.600498 11926 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:29.632428  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:29.629103  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:29.627225  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:29.631533  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:29.611764  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:29.630623  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:29.640102  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:29.643615  5963 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:29.645197  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:29.615368 11823 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.587081 11898 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.042s
I20260709 12:26:29.628064  5960 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:34550
I20260709 12:26:29.554772 11983 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.620848 11959 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.650153  5960 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:29.653802  5960 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:29.654907  6042 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:26:29.655939 11867 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.652379 11787 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.663576 11787 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.656181 11959 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:29.665781 11787 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.628510 11884 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.637553 11859 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.623700 11812 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.671278 11983 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.672397 11812 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.673154  6039 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 10.
I20260709 12:26:29.653164 11823 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:29.674964 11871 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.676343  6111 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 8. Preceding OpId from leader: term: 12 index: 8. (term mismatch)
I20260709 12:26:29.676708  6111 pending_rounds.cc:85] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 7
I20260709 12:26:29.676941  6111 pending_rounds.cc:107] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 11.8
I20260709 12:26:29.677171  6111 raft_consensus.cc:2889] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:29.677662  6081 leader_election.cc:400] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:29.680835 11959 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.685823 11959 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.687042 11956 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.697890  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:29.701571  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 89881.8us
I20260709 12:26:29.703547  6040 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:26:29.704703  6082 leader_election.cc:400] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:29.705684  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:29.706987  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:29.803038  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 99946.5us
I20260709 12:26:29.806656  6042 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: [18.10-18.10]
I20260709 12:26:29.676563 11717 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.672397 11859 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.809734  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:29.704856  5960 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:29.709502 11985 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:29.847563  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 140634us
I20260709 12:26:29.807461 11546 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:29.802671 11863 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:29.643018 11138 consensus_queue.cc:237] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 8.6, Last appended by leader: 6, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.808143 11956 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:29.709105 11979 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.144s
I20260709 12:26:29.810632 11812 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:29.870398  5960 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:29.750520 11974 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.876448  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:26:29.811156 11793 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.051s
W20260709 12:26:29.885119  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 290784us
W20260709 12:26:29.861949 11629 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.598s	user 0.016s	sys 0.033s
I20260709 12:26:29.923918  6611 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:29.927940  6611 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:29.930941  6037 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:26:29.935447  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.940613  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.941262  6115 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:29.929632  6611 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:29.940608  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 74835us
I20260709 12:26:29.945621  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:29.953987  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:29.955253  6649 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:29.922912 11832 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:29.938647 11629 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.675s	user 0.016s	sys 0.033s
W20260709 12:26:29.977984  6043 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.560s	user 0.028s	sys 0.058s
I20260709 12:26:29.978382  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:29.959741  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:29.939900 11898 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:29.938498 11859 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:29.952744 11786 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:29.982214  6043 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.564s	user 0.029s	sys 0.059s
I20260709 12:26:29.982016 11984 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:29.870065 11956 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.988660  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:29.994813  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:29.995324  6117 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:29.982375  6646 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:29.996323  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:29.981953  5934 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:29.953032 11957 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:29.983458 11696 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.599s	user 0.008s	sys 0.040s
I20260709 12:26:29.995673  6117 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:29.938565 11812 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.998013 11787 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:29.957995 11823 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:29.953403 11863 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.047s
I20260709 12:26:30.009622 11863 consensus_queue.cc:1243] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer f1bb8e63c2b448cdafd51f05d277c741 log is divergent from this leader: its last log entry 16.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:26:30.009981  6044 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:30.010774 11823 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:30.011343 11974 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:29.982375 11976 consensus_queue.cc:1059] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.017s
I20260709 12:26:29.943346 11865 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.055s
I20260709 12:26:30.017419  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:29.998235 11869 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:30.016240  6117 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 14.15, Last appended by leader: 15, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.024919  6117 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:30.002943 11696 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.617s	user 0.009s	sys 0.041s
I20260709 12:26:29.984874 11832 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.026403  6081 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:30.014027 11983 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.036469  6646 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
W20260709 12:26:30.036962  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 469047us
I20260709 12:26:29.957823 11959 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:30.013432 11846 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.024s
I20260709 12:26:30.003844 11984 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:30.019496 11957 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.037s
I20260709 12:26:30.013695 11859 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.024s
I20260709 12:26:30.067806  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:30.038164  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 426641us
I20260709 12:26:30.069577  6043 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:30.044646  6113 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:29.999691 11786 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.025184 11869 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.071117  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:30.073398  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:30.073999  6113 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
I20260709 12:26:30.073791  5934 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:30.082942  5934 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:30.084972 11959 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:30.085606 11959 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:30.078545 11869 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:30.086488 11959 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:30.088142 11974 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:30.092543 11974 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.092897 11974 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:30.049162 11956 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:30.052124 11812 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:30.098580  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:30.099066  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:30.101136  6642 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:30.101249 11984 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:30.105540  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:30.104053  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:30.053624 11832 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:30.056581 11629 raft_consensus.cc:3055] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:30.089660  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:30.044993 11722 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:30.106388  6113 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
W20260709 12:26:30.088927 11990 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.072s	user 0.002s	sys 0.000s
I20260709 12:26:30.108043 11629 raft_consensus.cc:740] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:30.116539 11629 consensus_queue.cc:260] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:30.064668 11983 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.085152 11786 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:30.112569  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:30.124688  6111 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
W20260709 12:26:30.123603  6608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.547s	user 0.006s	sys 0.015s
W20260709 12:26:30.125526  6608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.549s	user 0.006s	sys 0.015s
I20260709 12:26:30.110064 11956 raft_consensus.cc:2764] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:26:30.127972  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:30.128225  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 582966us
I20260709 12:26:30.132838  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:30.120697 11629 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:30.139984  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:30.140723  6649 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:30.126061 11954 raft_consensus.cc:697] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:30.129093 11528 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:30.134626 11929 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:30.138399 11931 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:30.145004 11793 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:30.163874  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:30.169020  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:30.148722 11812 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:30.149019 11982 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.151643 11929 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.150259 11722 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:30.138917 11974 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:30.159126 11867 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:30.167138 11931 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:30.178105 11929 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:30.177230 11982 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:30.238484 11974 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:30.239286 11991 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.103s	user 0.000s	sys 0.000s
I20260709 12:26:30.239730  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:30.252255  6116 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:30.252877 11983 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:30.234617 11823 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:30.254796  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:30.257841 11982 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:30.173739 11812 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:30.260008 11812 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:30.224504 11722 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:30.263792  6084 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:30.266534 11982 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.186576 11954 consensus_queue.cc:237] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:30.267131 11982 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:30.269465 11931 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 17.9, Last appended by leader: 9, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:30.270164 11982 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:30.266355  6116 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 22.
I20260709 12:26:30.271193 11869 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:30.273633 11869 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:30.274374  5934 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:30.276201  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:30.276906  6112 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:30.278172 11982 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:30.278944 11982 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.244228 11984 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
W20260709 12:26:30.281435  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 327173us
I20260709 12:26:30.230492 11867 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:30.281459 11984 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:30.248373 12003 consensus_queue.cc:1059] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.055s
W20260709 12:26:30.312106  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 285800us
I20260709 12:26:30.287609 11869 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:30.319684  6117 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:30.286314 11528 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:30.327662  6112 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:30.302213 12007 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:30.328969  5934 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:30.312232 11984 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:30.289425 11998 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:26:30.339751  6084 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:30.323975 11970 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:30.322496 11869 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:30.328948 11976 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:26:30.336223 11974 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:30.313302 11722 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 14.15, Last appended by leader: 15, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:30.390661  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 221698us
I20260709 12:26:30.393695  6009 leader_election.cc:400] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 9. Current term is 10.
I20260709 12:26:30.349520 12007 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.357461 11970 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:30.397161  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:30.397847  6043 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
W20260709 12:26:30.399960  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 86485.8us
I20260709 12:26:30.400884  6043 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:30.401607  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:30.396976  6609 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:30.370193 11985 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:30.402127  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:30.403154  6037 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 18: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:30.406371  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:30.391299 11867 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:30.394518 11974 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:30.409497  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:30.420542 11974 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:30.420979  6043 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:30.407140  6039 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:30.399436 11954 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.422917 11954 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.424607  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:30.408424  6081 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:30.416764 12007 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:30.426555  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:30.428881 11869 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:30.430199 12004 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:26:30.428911 11981 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:30.424733 11970 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:30.425258 11528 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:30.434823 11982 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:30.434649 11929 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:30.435638 12008 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:26:30.437175 11546 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:30.429600 12009 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:26:30.444772  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:30.452034  6009 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:30.456187  6039 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:30.443257 11856 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:30.462155  5960 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15. Ops: [14.11-14.11]
I20260709 12:26:30.444276 11981 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.455029 11867 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:30.466682 11812 raft_consensus.cc:3055] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:30.461139 11629 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:30.478394 11948 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:30.488740  6110 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:30.463274 11970 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:30.461469 11954 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:30.464185 11856 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:30.471452 11981 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:30.498683  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:30.488269 11867 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.502718 11976 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:30.503294 11976 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.503907 11867 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:30.502722  5967 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:30.507784 11976 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:30.508654  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:30.510057  6040 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:30.513731 11884 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:30.514496 12014 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.515146 12014 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.517441 12014 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:30.520705 11856 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:30.523167  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3129) took 1002 ms. Trace:
I20260709 12:26:30.523609  5968 rpcz_store.cc:276] 0709 12:26:29.521264 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.521383 (+   119us) service_pool.cc:224] Handling call
0709 12:26:29.578117 (+ 56734us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:29.610558 (+ 32441us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.610589 (+    31us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:29.624708 (+ 14119us) log.cc:844] Serialized 52 byte log entry
0709 12:26:30.030980 (+406272us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:26:30.071978 (+ 40998us) log.cc:844] Serialized 14 byte log entry
0709 12:26:30.078290 (+  6312us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.078387 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:30.279007 (+200620us) raft_consensus.cc:1685] finished
0709 12:26:30.279026 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:30.522974 (+243948us) spinlock_profiling.cc:243] Waited 10.3 ms on lock 0x7b5400197650. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:30.523099 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10590,"prepare.queue_time_us":38438,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":30376,"raft.run_cpu_time_us":194,"raft.run_wall_time_us":1779,"spinlock_wait_cycles":23793920,"thread_start_us":374442,"threads_started":1,"wal-append.queue_time_us":605794}
I20260709 12:26:30.473270 11812 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:30.533205 11722 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.002s
W20260709 12:26:30.536017 11993 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.508s	user 0.002s	sys 0.006s
W20260709 12:26:30.538817  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:30.539991  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.539590 11812 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.540807 11812 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:30.548432  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:30.561481  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:30.573216  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 166073us
I20260709 12:26:30.581226  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:30.582510  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:30.583680  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:30.587872  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 135915us
I20260709 12:26:30.588655  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:30.588873  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2763) took 1101 ms. Trace:
I20260709 12:26:30.587893  6115 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:26:30.593006  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 1956) took 1181 ms. Trace:
I20260709 12:26:30.589198  6038 rpcz_store.cc:276] 0709 12:26:29.487741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.497232 (+  9491us) service_pool.cc:224] Handling call
0709 12:26:29.497607 (+   375us) raft_consensus.cc:1471] Updating replica for 6 ops
0709 12:26:30.103588 (+605981us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:26:30.142140 (+ 38552us) log.cc:844] Serialized 14 byte log entry
0709 12:26:30.397518 (+255378us) log.cc:844] Serialized 14 byte log entry
0709 12:26:30.401041 (+  3523us) raft_consensus.cc:1539] Triggering prepare for 4 ops
0709 12:26:30.411109 (+ 10068us) log.cc:844] Serialized 104 byte log entry
0709 12:26:30.411276 (+   167us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:26:30.411854 (+   578us) log.cc:844] Serialized 14 byte log entry
0709 12:26:30.443948 (+ 32094us) log.cc:844] Serialized 14 byte log entry
0709 12:26:30.538377 (+ 94429us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b18003b5ea0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481dee1c0a 00007f4827621219 00007f481df69a40 00007f481df644e4 00007f481df64455 00007f482104c060 00007f482105e716 00007f482106f287 00007f482106f208
0709 12:26:30.587986 (+ 49609us) log.cc:844] Serialized 14 byte log entry
0709 12:26:30.588394 (+   408us) log.cc:844] Serialized 14 byte log entry
0709 12:26:30.588555 (+   161us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.588631 (+    76us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:30.588673 (+    42us) raft_consensus.cc:1685] finished
0709 12:26:30.588686 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:30.588819 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":307123,"prepare.queue_time_us":63726,"prepare.run_cpu_time_us":166,"prepare.run_wall_time_us":2371,"raft.queue_time_us":208755,"raft.run_cpu_time_us":337,"raft.run_wall_time_us":13311,"spinlock_wait_cycles":4398848,"thread_start_us":697703,"threads_started":2,"wal-append.queue_time_us":262018}
I20260709 12:26:30.593403  6036 rpcz_store.cc:276] 0709 12:26:29.411679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.414890 (+  3211us) service_pool.cc:224] Handling call
0709 12:26:29.415187 (+   297us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:29.415545 (+   358us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.415571 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:29.416024 (+   453us) log.cc:844] Serialized 26 byte log entry
0709 12:26:29.689388 (+273364us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:29.689423 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:29.689495 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:30.535373 (+845878us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:30.554954 (+ 19581us) raft_consensus.cc:1685] finished
0709 12:26:30.554978 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:30.592941 (+ 37963us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":5325,"raft.run_cpu_time_us":62,"raft.run_wall_time_us":64,"spinlock_wait_cycles":7057792,"thread_start_us":272999,"threads_started":1,"wal-append.queue_time_us":568497}
I20260709 12:26:30.642377  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:30.672905  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:30.683883  6082 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:30.685156 11786 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:30.685355  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 83169.7us
I20260709 12:26:30.628968 11931 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:30.627506 12017 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:30.703711  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:30.588420 11926 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.103s
I20260709 12:26:30.706001  6042 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:30.687448 11884 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:30.595392 11999 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.105s
I20260709 12:26:30.685774 11786 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:30.705400 12012 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:30.690965 11983 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:30.728880  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:30.732775  6110 raft_consensus.cc:2410] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 19 because replica has last-logged OpId of term: 17 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 8.
W20260709 12:26:30.735224 12027 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:26:30.736090 12029 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:30.736827 12029 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.741917 11999 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:30.742378 11999 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:30.742579  6118 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:30.743070  6118 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:30.743289 11999 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.743758  6118 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:30.744524 11999 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:30.745807 12025 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:26:30.759057  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:30.759253  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:30.760241  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:30.722930 11884 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:30.745931 11856 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.762090  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:30.763825  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:30.766249  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 176530us
I20260709 12:26:30.765494  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:31.073101  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 113848us
W20260709 12:26:31.077200 12032 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
I20260709 12:26:31.069305 11717 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:31.077970 11696 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:31.078675 11696 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:26:31.078933 11981 consensus_meta.cc:287] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.563s	user 0.001s	sys 0.009s
I20260709 12:26:30.902998 11832 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:30.962889  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 261497us
W20260709 12:26:31.000909 12034 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:26:30.996665 11786 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:30.844048  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:31.022197  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:30.847884  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:30.964648 11984 consensus_meta.cc:287] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.613s	user 0.004s	sys 0.007s
I20260709 12:26:30.890702  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 1951) took 1531 ms. Trace:
I20260709 12:26:31.102662  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:31.102522  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 80362.6us
I20260709 12:26:31.104765  5932 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:26:30.843681 12018 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.117s	user 0.000s	sys 0.000s
I20260709 12:26:30.768890 12023 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 14.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.142s
I20260709 12:26:30.708101 11931 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.078697 11717 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:30.755858 11948 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:31.010289 11970 consensus_meta.cc:287] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.511s	user 0.004s	sys 0.002s
I20260709 12:26:30.760821 12014 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:30.846377  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:30.872737  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.119985  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:31.120213  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:30.922660 11722 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:30.756067 11983 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.104372 11823 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:31.003993 12011 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.526s	user 0.001s	sys 0.000s
I20260709 12:26:31.000757  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:31.126436  5959 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:30.916112  6115 raft_consensus.cc:2368] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17.
I20260709 12:26:30.843936 11884 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:30.844696  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:30.757077 11939 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.138s
I20260709 12:26:31.131913  6039 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 8 index: 6. Preceding OpId from leader: term: 10 index: 7. (index mismatch)
I20260709 12:26:31.092553 11981 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.115427 11869 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:30.957142  6645 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:30.947378  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:31.002766  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:30.888384  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:30.844602  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:30.923205  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:30.905470  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:31.090139 11832 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:31.010149 12021 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.534s	user 0.001s	sys 0.000s
I20260709 12:26:30.874536 11684 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:31.102887  5967 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:31.105428  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:31.103224  5962 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:31.100703  6035 rpcz_store.cc:276] 0709 12:26:29.359455 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.360381 (+   926us) service_pool.cc:224] Handling call
0709 12:26:29.360673 (+   292us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:29.583570 (+222897us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:26:30.017601 (+434031us) log.cc:844] Serialized 14 byte log entry
0709 12:26:30.350772 (+333171us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:30.350850 (+    78us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:26:30.350906 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.890411 (+539505us) spinlock_profiling.cc:243] Waited 223 ms on lock 0x7b54001ba654. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:30.890484 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:30.890633 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":471633,"prepare.run_cpu_time_us":27,"prepare.run_wall_time_us":26,"raft.queue_time_us":15376,"raft.run_cpu_time_us":137,"raft.run_wall_time_us":3402,"spinlock_wait_cycles":512197376,"thread_start_us":751148,"threads_started":2,"wal-append.queue_time_us":376833}
I20260709 12:26:31.108608  6114 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 17 index: 9. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:26:31.100355 11974 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:31.112221  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:31.113781  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:31.114737  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:31.104405 11786 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:31.121526  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:31.090452 11696 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.122411  6038 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:31.123883  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:31.124048  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:31.125365  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:31.163834  6044 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:26:31.129186  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:31.114480 11867 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.130828  5960 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:26:31.132754  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:31.102784  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:31.131780  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:31.134449  5966 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:31.141134  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:31.141393  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 9 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:31.104436 11984 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.006237 12029 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.145445 11684 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.146543  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:31.151945 11981 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:31.160022 11856 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.152595  6112 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:31.181355 11900 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:26:31.180267 11696 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:31.131248 11722 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.195633 11722 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.196226 11722 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:31.196686 11722 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:31.199206 11983 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.130757 11823 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.142762 12023 consensus_queue.cc:1059] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.012s
I20260709 12:26:31.156780 11832 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:31.139887 11974 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:31.125725 11898 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.139040 11869 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:31.158919 11786 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.171687  6643 raft_consensus.cc:2410] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 15 because replica has last-logged OpId of term: 14 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 10.
I20260709 12:26:31.205461  5962 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:31.193333  5963 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: [15.12-15.12]
I20260709 12:26:31.122903 11948 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.172966 12017 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:31.232925  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 120784us
I20260709 12:26:31.210907 11974 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:31.222873  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 73444.9us
I20260709 12:26:31.234506  6044 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:31.233781  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:31.233662  6041 raft_consensus.cc:2393] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 15: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:31.235112  5964 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
W20260709 12:26:31.241154  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 76444.5us
I20260709 12:26:31.171414 12052 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.090s
I20260709 12:26:31.176928 11867 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.239619  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:31.261484 12058 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:31.243825 11546 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.262140 11787 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:31.263064 11546 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.266234  6647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 1367) took 1749 ms. Trace:
I20260709 12:26:31.279297  6647 rpcz_store.cc:276] 0709 12:26:29.501941 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.502128 (+   187us) service_pool.cc:224] Handling call
0709 12:26:29.502428 (+   300us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:29.884469 (+382041us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:29.884502 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:29.885028 (+   526us) log.cc:844] Serialized 26 byte log entry
0709 12:26:30.323411 (+438383us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:30.323452 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:30.323517 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:31.003394 (+679877us) spinlock_profiling.cc:243] Waited 10.6 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:31.243063 (+239669us) raft_consensus.cc:1685] finished
0709 12:26:31.243083 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:31.251148 (+  8065us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":65405,"raft.queue_time_us":96918,"raft.run_cpu_time_us":101,"raft.run_wall_time_us":101,"spinlock_wait_cycles":24348416,"thread_start_us":629300,"threads_started":2,"wal-append.queue_time_us":484737}
I20260709 12:26:31.266651  6037 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
W20260709 12:26:31.261616  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 129947us
I20260709 12:26:31.269686  6118 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:31.273590  5864 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 309) took 25262 ms (client timeout 15000 ms). Trace:
W20260709 12:26:31.272785 11812 consensus_meta.cc:287] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.732s	user 0.010s	sys 0.002s
I20260709 12:26:31.242147 11869 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:31.274611  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:31.303153  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:31.303838  6040 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:31.232264 11898 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.307982  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.309739  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:31.266918 12031 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.391s	user 0.001s	sys 0.003s
I20260709 12:26:31.321429  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:31.317572  6118 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 12. (term mismatch)
I20260709 12:26:31.262101 12058 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:31.325786  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.267799 11929 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:31.274089  5863 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 13 to 14, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 14 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:31.268106 11867 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.323917  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.322184  6038 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:31.265985 11546 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:31.310786 11979 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.297827 11982 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:31.310770 11970 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:31.333268 11948 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:31.333386 11684 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.371899  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.333015  5863 catalog_manager.cc:5697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 9 to 11, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 11 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:31.334692 11786 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.310308 12023 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.041s
I20260709 12:26:31.244845 11722 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.9, Last appended by leader: 9, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.238548 12017 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.339963 11898 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.328387 12058 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:31.306403 11787 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.341926 12003 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:31.345700 12036 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.702s	user 0.003s	sys 0.000s
I20260709 12:26:31.330263  6009 leader_election.cc:400] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17.
I20260709 12:26:31.413425  6009 leader_election.cc:403] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:31.306195 11981 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:31.322966  6118 pending_rounds.cc:85] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 11
I20260709 12:26:31.414480  6118 pending_rounds.cc:107] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 15.12
I20260709 12:26:31.414770  6118 raft_consensus.cc:2889] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:31.332573  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:31.338218 11974 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.338306 11823 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.335619 11984 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:31.382066  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.383039  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:31.430527  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:31.432233  5863 catalog_manager.cc:5697] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 10 to 12, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 12 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.432334  6036 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:31.434418  6117 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 22: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:31.385046  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.387785  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:31.381624 12059 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:26:31.370710 11867 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:31.418401  6038 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:31.379663 11948 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:31.286327  5864 rpcz_store.cc:269] 0709 12:26:06.062976 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:06.063157 (+   181us) service_pool.cc:224] Handling call
0709 12:26:31.273455 (+25210298us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:27.338352 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:27.415100 (+ 76748us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:27.415150 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:26:27.415183 (+    33us) tablet.cc:662] Decoding operations
0709 12:26:27.416661 (+  1478us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:27.416746 (+    85us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:27.416774 (+    28us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:26:27.417860 (+  1086us) tablet.cc:701] Row locks acquired
0709 12:26:27.417908 (+    48us) write_op.cc:260] PREPARE: finished
0709 12:26:27.418099 (+   191us) write_op.cc:270] Start()
0709 12:26:27.418246 (+   147us) write_op.cc:276] Timestamp: P: 1783599987418027 usec, L: 0
0709 12:26:27.418268 (+    22us) op_driver.cc:348] REPLICATION: starting
0709 12:26:27.521798 (+103530us) log.cc:844] Serialized 4364 byte log entry
0709 12:26:28.013138 (+491340us) op_driver.cc:464] REPLICATION: finished
0709 12:26:28.182188 (+169050us) write_op.cc:301] APPLY: starting
0709 12:26:28.182301 (+   113us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:28.423540 (+241239us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:28.423667 (+   127us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:28.586002 (+162335us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:28.586315 (+   313us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:26:28.586361 (+    46us) write_op.cc:312] APPLY: finished
0709 12:26:28.586795 (+   434us) log.cc:844] Serialized 105 byte log entry
0709 12:26:28.586988 (+   193us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:28.587129 (+   141us) write_op.cc:454] Released schema lock
0709 12:26:28.587193 (+    64us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:28.587666 (+   473us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:28.587692 (+    26us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":43294,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":155369,"apply.run_cpu_time_us":19647,"apply.run_wall_time_us":405487,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50129,"num_ops":11,"prepare.queue_time_us":333882,"prepare.run_cpu_time_us":22584,"prepare.run_wall_time_us":357880,"raft.queue_time_us":280191,"raft.run_cpu_time_us":26148,"raft.run_wall_time_us":232409,"replication_time_us":546738,"thread_start_us":667498,"threads_started":4,"wal-append.queue_time_us":90159,"wal-append.run_cpu_time_us":39007,"wal-append.run_wall_time_us":1962185}]]}
W20260709 12:26:31.421433  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 91294.1us
I20260709 12:26:31.425261  6118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3091) took 1439 ms. Trace:
W20260709 12:26:31.430025 11863 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 16 current term: 16 is higher.
I20260709 12:26:31.320858 11884 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:31.433863  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 46192.4us
I20260709 12:26:31.369755 11979 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.425812 11981 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.437551  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.440341  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:31.381464 11931 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:31.440776  6118 rpcz_store.cc:276] 0709 12:26:29.976383 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.978733 (+  2350us) service_pool.cc:224] Handling call
0709 12:26:29.992217 (+ 13484us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:30.742448 (+750231us) spinlock_profiling.cc:243] Waited 17.7 ms on lock 0x7b54000846a0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fcbdc0 00007f48210561c0 00007f4821057231 00007f4821053d8f 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c
0709 12:26:31.269230 (+526782us) spinlock_profiling.cc:243] Waited 218 ms on lock 0x7b580044dbd0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fb00aa 00007f4821032447 00007f482104afe7 00007f482104c7de 00007f4821056b49 00007f4821057416 00007f4821053d8f 00007f482105383e 00007f4826018419 00007f481f58fbd4
0709 12:26:31.415224 (+145994us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:31.415479 (+   255us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":542268672}
I20260709 12:26:31.451166  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.445910  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:31.462150  6117 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:31.463604  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:31.468104  5863 catalog_manager.cc:5697] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 7 to 8, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 8 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:31.426604 12052 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17.
I20260709 12:26:31.373299 11982 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.383670  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:31.374716 11970 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.474225  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:31.441282  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:31.476454  6117 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15. Ops: [14.12-14.12]
I20260709 12:26:31.478559  5863 catalog_manager.cc:5697] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 5 to 7, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 7 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:31.476908  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 92986.5us
I20260709 12:26:31.442230  5967 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 15: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:31.412557 11787 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.489398  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:31.420787 12003 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.476737 12053 raft_consensus.cc:3055] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:31.475243 12038 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:31.498605  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:31.469091 11823 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:31.521571 12053 raft_consensus.cc:740] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:31.596432  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:31.529953 11884 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:31.533399 11982 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:31.499589 12062 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:31.537678  5863 catalog_manager.cc:5697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 8 to 10, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 10 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:31.527278  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:31.532346 12055 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.360s	user 0.002s	sys 0.000s
I20260709 12:26:31.528523 11945 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:31.579559  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:31.445535 11867 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.622584 12053 consensus_queue.cc:260] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.623696 12053 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:31.624053 11867 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.458210 11948 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.626106 11948 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:31.626629 11948 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:31.526798  6609 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:31.499923 12023 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:31.575887 12061 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:26:31.628455  6113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1286) took 1075 ms. Trace:
I20260709 12:26:31.583899 11787 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:31.586293 12063 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:26:31.530710  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 296994us
I20260709 12:26:31.587806  6645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1571) took 1060 ms. Trace:
I20260709 12:26:31.588061 11970 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:31.614758 12060 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.611799 11812 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:31.590152 11974 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:31.591585  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 93062.9us
W20260709 12:26:31.592244  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:31.596702  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.543538  6109 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:31.603858 12003 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.607225 12017 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:31.577608 12032 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:26:31.619211  6118 raft_consensus.cc:2410] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 16 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
I20260709 12:26:31.614439 12049 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:31.643703  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.622074  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:31.631942  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 105220us
I20260709 12:26:31.632432  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:31.631138  6645 rpcz_store.cc:276] 0709 12:26:30.527342 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.527895 (+   553us) service_pool.cc:224] Handling call
0709 12:26:30.528182 (+   287us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:31.133354 (+605172us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:31.587570 (+454216us) spinlock_profiling.cc:243] Waited 429 ms on lock 0x7b54006aead4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:31.587743 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":986064128}
I20260709 12:26:31.628914  6113 rpcz_store.cc:276] 0709 12:26:30.553144 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.570586 (+ 17442us) service_pool.cc:224] Handling call
0709 12:26:30.571098 (+   512us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:30.762985 (+191887us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:30.763014 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:30.845747 (+ 82733us) log.cc:844] Serialized 26 byte log entry
0709 12:26:31.047436 (+201689us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:31.047472 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:31.047554 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:31.532045 (+484491us) spinlock_profiling.cc:243] Waited 7.88 ms on lock 0x7b240020b328. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481dded9c4 00007f481ddebacb 00007f481dfa6dc9 00007f481dfa6a55 00007f481dfa609d 00007f4820bd810e 00007f4820bef88c 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221
0709 12:26:31.628131 (+ 96086us) raft_consensus.cc:1685] finished
0709 12:26:31.628154 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:31.628380 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":62966,"raft.queue_time_us":141937,"raft.run_cpu_time_us":133,"raft.run_wall_time_us":3392,"spinlock_wait_cycles":18124160,"thread_start_us":193653,"threads_started":2,"wal-append.queue_time_us":204130}
I20260709 12:26:31.589169 11979 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:31.639246  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.652765  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.653457  6116 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 15: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:31.640911  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:31.654183  6647 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:31.659194  6113 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 15. Preceding OpId from leader: term: 15 index: 16. (index mismatch)
I20260709 12:26:31.660267  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.661722  6647 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 15. Preceding OpId from leader: term: 15 index: 16. (index mismatch)
I20260709 12:26:31.640937  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:31.648777  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:31.626348 11717 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:31.663036  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.640230  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:31.665736  6642 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:31.664196  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:31.655442  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:31.666150  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:31.637439 11865 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:31.673100  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:31.677752  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:31.678767  6038 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:31.681861  6116 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:31.682778  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:31.683792  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.687995  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:31.637570 11970 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:31.641947 12023 raft_consensus.cc:697] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:31.692404  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.695398  6115 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:26:31.694223  6118 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:31.697445  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.663820 11884 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:31.699009 11884 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.641599 12060 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.699321 11786 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260709 12:26:31.698400 11717 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:26:31.701083 11884 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.704037  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.704689  6115 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:31.637568 12061 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:26:31.664414 11974 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:31.727097 11974 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:31.727638 11974 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:31.727969 11985 raft_consensus.cc:993] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:26:31.729975 11981 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:31.663906 11948 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:31.680387 11865 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:31.731359 11865 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:31.701215 12060 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.701578 11970 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.734179 12023 consensus_queue.cc:237] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 7.5, Last appended by leader: 5, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.680768 12003 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:31.735687 12003 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:31.736070 12003 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:31.736439 11970 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:31.692823 12074 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:31.620985 12062 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.653961 12049 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.744294 12049 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:31.690160 11979 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:26:31.753328 12057 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:26:31.755129  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52979.9us
I20260709 12:26:31.788069  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:31.791179  6118 raft_consensus.cc:2410] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 20 because replica has last-logged OpId of term: 18 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 9.
I20260709 12:26:31.816092  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:31.825425  6642 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:31.829291  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:31.830521  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:31.833806 11926 consensus_queue.cc:1059] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 10.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:31.834717  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:31.834079 11945 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:31.836992  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 75169.3us
W20260709 12:26:31.847800  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 48879.1us
I20260709 12:26:31.744294 12062 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:31.835827 11974 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.843000 12039 raft_consensus.cc:1081] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:26:31.841711 11982 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:31.838013 11931 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:26:31.832026 12074 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.033s
I20260709 12:26:31.885272  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1284) took 1332 ms. Trace:
I20260709 12:26:31.811452 12058 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:31.873862 11869 consensus_meta.cc:287] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.555s	user 0.010s	sys 0.000s
I20260709 12:26:31.855158 12040 raft_consensus.cc:3055] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:31.892325  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:31.893236  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:31.893981  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:31.897174  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:31.897522  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:31.898772  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:31.885715  6111 rpcz_store.cc:276] 0709 12:26:30.552546 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.552706 (+   160us) service_pool.cc:224] Handling call
0709 12:26:30.592454 (+ 39748us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:31.110802 (+518348us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:31.110834 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:31.375690 (+264856us) spinlock_profiling.cc:243] Waited 876 us on lock 0x7b2c0003b2d8. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f94da11 00007f481f95d372 00007f482108fa01 00007f482105443a 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2
0709 12:26:31.391094 (+ 15404us) log.cc:844] Serialized 26 byte log entry
0709 12:26:31.521323 (+130229us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:31.828475 (+307152us) log.cc:844] Serialized 14 byte log entry
0709 12:26:31.874419 (+ 45944us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:31.874527 (+   108us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:31.874571 (+    44us) raft_consensus.cc:1685] finished
0709 12:26:31.885060 (+ 10489us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:31.885203 (+   143us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":279258,"prepare.queue_time_us":205221,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":37,"raft.queue_time_us":206315,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":7175,"spinlock_wait_cycles":2015616,"thread_start_us":700586,"threads_started":3,"wal-append.queue_time_us":206698}
I20260709 12:26:31.902837  6036 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
W20260709 12:26:31.910367  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 211955us
I20260709 12:26:31.916110  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 3123) took 1345 ms. Trace:
I20260709 12:26:31.914002  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:31.917169  6112 rpcz_store.cc:276] 0709 12:26:30.570957 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:30.583482 (+ 12525us) service_pool.cc:224] Handling call
0709 12:26:31.915878 (+1332396us) spinlock_profiling.cc:243] Waited 568 ms on lock 0x7b540023a0d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:31.916034 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1306744704}
I20260709 12:26:31.903779 12040 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:31.920820 12040 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.922171 12040 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:31.856220 11865 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:31.924641 11722 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:31.906719 11869 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:31.942808 11974 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:31.943807  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:31.944124 12058 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.945590  5965 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:31.948969 11865 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:31.919555 12057 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.016s
I20260709 12:26:31.966373  6611 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:31.970860  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:31.974390  6042 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:31.981547  5966 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14. Ops: []
W20260709 12:26:31.969590 12080 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.098s	user 0.003s	sys 0.000s
I20260709 12:26:31.986039  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:31.972016 12076 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.097s	user 0.000s	sys 0.003s
I20260709 12:26:32.000636  6611 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:31.978942 11865 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:32.012188  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.005937 12041 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:32.006397 11846 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:32.012991  5962 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:32.011983  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.014752  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.027813  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:32.028434  5959 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:32.030767  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.032294  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.041450 12003 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.044313  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.047565  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.048385  5967 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:26:32.050382  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 16 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.052574  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.053730 11869 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:32.054772  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.057090  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.057902  5959 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:32.058449  6042 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:32.059393  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:32.060163  5960 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:32.062449  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:32.060856 12079 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.081s	user 0.000s	sys 0.000s
I20260709 12:26:32.058691 12003 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:32.066926  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.069769  5962 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:32.081246  5960 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:32.086640 11982 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:32.086786 12060 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.087350 12060 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:32.088066  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 123726us
I20260709 12:26:32.089290  6006 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.089373 12060 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:32.087667 11982 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.091023 12052 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:32.091708  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:32.092795  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.094992 12062 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:32.096418  6006 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.096956  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2762) took 1089 ms. Trace:
I20260709 12:26:32.097438 12052 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:32.099196  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:32.099956 12003 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:32.100405 12003 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:32.100746  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 2758) took 1118 ms. Trace:
I20260709 12:26:32.097383  5966 rpcz_store.cc:276] 0709 12:26:31.007199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.202150 (+194951us) service_pool.cc:224] Handling call
0709 12:26:31.211395 (+  9245us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:31.994538 (+783143us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.096695 (+102157us) spinlock_profiling.cc:243] Waited 768 ms on lock 0x7b54002f1054. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:32.096887 (+   192us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1766462208}
I20260709 12:26:32.104473  6042 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:32.104905  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:32.102773  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.106433  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:32.101907  5965 rpcz_store.cc:276] 0709 12:26:30.982035 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.189258 (+207223us) service_pool.cc:224] Handling call
0709 12:26:31.945394 (+756136us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:31.969866 (+ 24472us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.100519 (+130653us) spinlock_profiling.cc:243] Waited 754 ms on lock 0x7b5400036950. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:32.100676 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1734196992}
I20260709 12:26:32.109743  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.110793 12052 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:32.110657  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:32.111174  6039 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:32.112306  6006 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.113400  6044 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:32.115983  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:32.116801  6042 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:26:32.100834 12003 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:32.117868  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:32.189543  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:32.190240  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.192823  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.193152  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:32.194147  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:32.119410 12060 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:32.221122  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 103322us
I20260709 12:26:32.221943  6006 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:32.223266  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:32.119632 12062 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:32.227772  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:32.230146  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.228644  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.231552  6006 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:32.236421  6037 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 16 index: 8. Preceding OpId from leader: term: 18 index: 10. (index mismatch)
I20260709 12:26:32.227923 12052 raft_consensus.cc:2764] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:26:32.243145  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:32.246577  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:32.247509  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.248087  6006 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.248932  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.235245 12002 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:32.235033 11546 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.232270 12075 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:32.257253  6006 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.238435 11823 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:32.261740  6648 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:32.241634 12062 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:32.258594 11982 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.006s
W20260709 12:26:32.264937 12089 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.078s	user 0.001s	sys 0.000s
W20260709 12:26:32.281337  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 448480us
I20260709 12:26:32.259416 11914 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:32.257871 12002 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:32.265672 11985 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:32.286165 11982 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:32.305162 12049 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.305577  6081 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.305714 12049 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:32.286841 12062 raft_consensus.cc:697] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:32.307516  6081 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:32.266731 11546 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.295898 12002 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:32.323165  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:32.268287 12075 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.324229 11793 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:32.326604 12041 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:32.323765 12095 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:32.334204  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 77044.5us
I20260709 12:26:32.335496  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:32.338163  6110 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:32.323169  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:32.346591  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.342700  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:32.347509  6118 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:32.327690 11985 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:32.331131 12039 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.351372  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:32.351740  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:32.343528  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:32.330478 12053 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.361776  6116 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 15: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:32.350312 11982 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:32.363636 12096 consensus_queue.cc:1059] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.023s
W20260709 12:26:32.379189 12094 log.cc:927] Time spent T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:26:32.327019 12062 consensus_queue.cc:237] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 11.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:32.343072 12048 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.368033  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:32.343775 12037 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:32.382115  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:32.379397 11981 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:32.389859  6118 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:32.343992 11793 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.402824 12075 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:32.394811 12048 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.403350 11982 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:32.456431 11982 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.349246 12095 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:32.409529 12049 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:32.460301 12095 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:32.379812 12053 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.461018 11982 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:32.345489 12041 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.462690 12053 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:32.463282 12041 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:32.410599 12082 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:32.465974 11926 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:32.466454 11926 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.468676 11926 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:32.473353 12003 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:32.476253 11793 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:32.415132 11884 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:32.384533 12037 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:32.487365 12037 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:32.488256  6609 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:32.490638 11856 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:32.491184 11856 raft_consensus.cc:697] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:32.492075 11856 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.425034 11970 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 14.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:32.426867 11546 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:32.427695 11869 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:32.429030 12083 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:32.391952 12052 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:32.396391 11823 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.047s
I20260709 12:26:32.455065 12075 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:32.505508 12075 raft_consensus.cc:3055] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:32.505960 12075 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:32.506793 12075 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:32.364115 12039 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:32.455739 12048 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:32.392827 11981 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:32.511413 11981 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.512537 11981 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:32.514168 12041 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:32.514817  6116 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 10. (term mismatch)
I20260709 12:26:32.515194  6116 pending_rounds.cc:85] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 9
I20260709 12:26:32.515420  6116 pending_rounds.cc:107] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 18.10
I20260709 12:26:32.515641  6116 raft_consensus.cc:2889] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:32.519367 12041 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.527659 12041 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:32.527523 12052 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:32.530795 12052 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:32.534912 12002 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:32.556972  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:32.557693  6044 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:32.559365  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:32.559958  6044 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 21.
I20260709 12:26:32.510278 12039 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:32.567699  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 212988us
I20260709 12:26:32.563648  6609 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:32.592113  6609 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:32.595417  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 244103us
I20260709 12:26:32.596298  6082 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:32.597097  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 240001us
I20260709 12:26:32.627380  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.629343  6084 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:32.594494 11997 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:32.622578 11863 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:32.633798 11914 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:32.635823 12002 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:32.624533 12041 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:32.636773 12041 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.620167 12043 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:32.642534  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.644465  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.645123  5962 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:32.638055 12037 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:32.632230 11997 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:32.656570  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:32.656903  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:32.640092 12043 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:32.623032 11717 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 6, Time since last communication: 0.023s
I20260709 12:26:32.658737  6116 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:32.661164  6642 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:32.662160  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:32.666342  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:32.667186  6648 raft_consensus.cc:2410] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 16 because replica has last-logged OpId of term: 14 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 11.
W20260709 12:26:32.659354  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 273633us
I20260709 12:26:32.668748  5932 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:32.671156  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:32.651321 11793 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:32.653124 11863 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:32.650143 12103 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:32.650424  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 304241us
I20260709 12:26:32.675007 11974 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:32.661895 12043 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:32.677173 12002 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:32.677273  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:32.656440 11997 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:32.680557  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:32.680908  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.686124  6006 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.690922  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:32.692338  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:32.675937  5932 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:32.734974  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:32.701805  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:32.706642  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:32.745090  6110 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: [14.9-14.9]
W20260709 12:26:32.742772  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 44372.2us
I20260709 12:26:32.706678  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:32.754297  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.673183 12003 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:32.754781  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:32.674085 12104 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:32.762123  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:32.763705 11684 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:32.764195 11684 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:32.764532 11684 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:32.735857 12090 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.508s	user 0.007s	sys 0.006s
I20260709 12:26:32.672348 11869 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.080s
I20260709 12:26:32.727618 11884 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:32.695557 11786 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:32.731168 12105 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:32.751379 12082 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:26:32.790371  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:32.790446  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 114600us
W20260709 12:26:32.796772  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 110703us
I20260709 12:26:32.799973  6006 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:32.728720 12002 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.827234  6113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3126) took 1093 ms. Trace:
I20260709 12:26:32.827661  6113 rpcz_store.cc:276] 0709 12:26:31.733987 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:31.737619 (+  3632us) service_pool.cc:224] Handling call
0709 12:26:31.737949 (+   330us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:31.902785 (+164836us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:31.902817 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:31.903314 (+   497us) log.cc:844] Serialized 26 byte log entry
0709 12:26:32.061182 (+157868us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:32.061218 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.061276 (+    58us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:32.735576 (+674300us) spinlock_profiling.cc:243] Waited 11.8 ms on lock 0x7b240020b328. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481dded9c4 00007f481ddebacb 00007f481dfa6dc9 00007f481dfa6a55 00007f481dfa609d 00007f4820bd810e 00007f4820bef88c 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221
0709 12:26:32.821294 (+ 85718us) raft_consensus.cc:1685] finished
0709 12:26:32.821322 (+    28us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:32.827167 (+  5845us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":474318,"raft.queue_time_us":178420,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":4570,"spinlock_wait_cycles":28500224,"thread_start_us":157585,"threads_started":1,"wal-append.queue_time_us":211178}
I20260709 12:26:32.802531 12062 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:32.823602 11884 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:32.828248 12104 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:32.849298 12052 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:32.850610 12037 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:32.828521 11786 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:32.853910 12118 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.060s	user 0.000s	sys 0.001s
I20260709 12:26:32.838972 11684 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.936578 11884 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.937577 11684 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:32.803939 12082 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:32.802063 12105 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:32.909898  6113 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:32.845878 12017 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:32.844050 11931 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:32.955034  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:32.936421 12115 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.097s	user 0.000s	sys 0.000s
I20260709 12:26:32.841748 12112 consensus_queue.cc:1059] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 13.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.183s
W20260709 12:26:32.933077 12109 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
W20260709 12:26:33.120961  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 321069us
I20260709 12:26:33.121902  6006 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:33.123412  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2787) took 1037 ms. Trace:
I20260709 12:26:33.123307  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:33.123920  6037 rpcz_store.cc:276] 0709 12:26:32.086446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.111735 (+ 25289us) service_pool.cc:224] Handling call
0709 12:26:32.187853 (+ 76118us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:32.236871 (+ 49018us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:33.115442 (+878571us) spinlock_profiling.cc:243] Waited 48.2 ms on lock 0x7b540030ded4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:33.123329 (+  7887us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":110810496}
W20260709 12:26:33.134442  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.064452 12110 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:33.136092 11914 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:33.079890 11786 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:33.136618 11684 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:33.174803 11900 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.139168 12112 raft_consensus.cc:3055] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:26:33.041798 12093 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.773s	user 0.011s	sys 0.005s
I20260709 12:26:33.139684 11997 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.044541 12052 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:33.015939 12037 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:32.960621 12097 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.641s	user 0.005s	sys 0.000s
W20260709 12:26:33.143546  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 343796us
W20260709 12:26:32.982477 12088 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
W20260709 12:26:33.145054  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 328114us
I20260709 12:26:32.937635 12002 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:33.042181 11974 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:32.978502 12082 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:33.067297 12105 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:33.197705  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 74476.7us
I20260709 12:26:33.214571  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:33.206220  6648 raft_consensus.cc:2410] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 15 because replica has last-logged OpId of term: 13 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:26:33.208952  6109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3128) took 1017 ms. Trace:
I20260709 12:26:33.252498  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:33.211165  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:33.282112  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:33.292428  6113 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:33.292754  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:33.294870  6642 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:33.292135  6114 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:33.293336  6109 rpcz_store.cc:276] 0709 12:26:32.191454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.191583 (+   129us) service_pool.cc:224] Handling call
0709 12:26:32.191986 (+   403us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:32.192321 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:32.192346 (+    25us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:32.192791 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:26:32.300259 (+107468us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:32.300298 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:32.300367 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:32.959906 (+659539us) spinlock_profiling.cc:243] Waited 2.85 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:33.208630 (+248724us) raft_consensus.cc:1685] finished
0709 12:26:33.208651 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:33.208885 (+   234us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":19716,"raft.queue_time_us":36631,"raft.run_cpu_time_us":141,"raft.run_wall_time_us":5600,"spinlock_wait_cycles":6563200,"thread_start_us":66658,"threads_started":1,"wal-append.queue_time_us":94890}
I20260709 12:26:33.203128 12017 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:33.297258  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 86193.7us
I20260709 12:26:33.298079  5932 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:33.200826 11914 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:33.278142  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:33.204057 12112 raft_consensus.cc:740] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:33.199576 12110 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.197932 12039 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:32.930243 12104 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.282137 11974 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.316207 11974 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:33.303206  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:33.205888 11997 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:33.300631 12043 consensus_meta.cc:287] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.000s
I20260709 12:26:33.202808 11900 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.205772 12037 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:33.319634  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.310276 11914 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:33.308074 12105 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:26:33.329229  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 396271us
I20260709 12:26:33.329756  6110 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:26:33.326484  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:33.302407 12130 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:33.313261 12100 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:33.340713  5932 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:33.342221  6109 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:33.330183 11974 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:33.357599 11846 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:33.358297 11846 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.360909 11846 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:33.362084  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:33.344580 12133 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
W20260709 12:26:33.365149  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 72472.3us
I20260709 12:26:33.322853 12043 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.368643  6006 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:33.370919  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.319032 12039 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:33.374616  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:33.350793 11997 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:33.341735 11929 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.026s
I20260709 12:26:33.349341 11985 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:33.381186 12104 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:33.381330 12127 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:33.366627 12052 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:33.390491  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1297) took 1052 ms. Trace:
I20260709 12:26:33.395442  6112 rpcz_store.cc:276] 0709 12:26:32.338335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.338694 (+   359us) service_pool.cc:224] Handling call
0709 12:26:32.339137 (+   443us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:32.348986 (+  9849us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:32.349007 (+    21us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:32.349036 (+    29us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:32.349062 (+    26us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:33.390229 (+1041167us) spinlock_profiling.cc:243] Waited 9.65 ms on lock 0x7b54000613d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:33.390273 (+    44us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:33.390407 (+   134us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":22192000}
I20260709 12:26:33.389127  6643 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:33.371025 11846 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:33.371090 12129 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:33.345014 12112 consensus_queue.cc:260] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:33.407830 12110 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:33.391045 11985 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:33.410671  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 62754.4us
I20260709 12:26:33.411310 11985 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:33.411933 12112 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:33.413705  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:33.414343  6118 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:26:33.415376  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:33.418072 11900 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:33.419260  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:33.420490  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:33.398660 12052 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:33.422183 12052 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:33.422875 12037 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:33.435837  6110 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:33.424089 12049 raft_consensus.cc:3055] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:33.452771 12049 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:33.453948 12039 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:33.453758 12049 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:33.455003 12049 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:33.462764  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 63670.1us
I20260709 12:26:33.464756 12075 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:33.468380  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:33.468668  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:33.438773 12037 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:33.402699 11846 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.482434  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:33.404629 12017 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:33.388284 11997 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.491225  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:33.493593  6037 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 16 index: 9. Preceding OpId from leader: term: 19 index: 10. (index mismatch)
I20260709 12:26:33.498059  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:33.502147  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:33.502847  5963 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:33.506388  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:33.507225  5959 raft_consensus.cc:2393] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 16: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:33.508872  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:33.509539  5968 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:33.516337  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.518054  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:33.520340  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:33.520691  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:33.523572  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:33.521477  6642 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:33.525050  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:33.525785  5961 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:33.526667  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:33.520712  5962 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:26:33.486804 11931 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:33.528414  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:33.529129  6642 raft_consensus.cc:2368] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16.
I20260709 12:26:33.530601  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:33.531639  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:33.532228  6645 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:33.536898  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:33.538131  6084 leader_election.cc:400] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16.
I20260709 12:26:33.497753 12017 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.540923 12017 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:33.513763 11884 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:33.541883 11884 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.544063 11884 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:33.545753 11846 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:33.547289 11914 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.549506 11914 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:33.487586 11974 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.041s
I20260709 12:26:33.487372 12037 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.566360  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:33.572130  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:33.579550  6084 leader_election.cc:403] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:33.567507  5934 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:33.571475  6117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1302) took 1230 ms. Trace:
W20260709 12:26:33.600811  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 62845.7us
I20260709 12:26:33.609897  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:33.611547  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:33.614344  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:33.618827  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:33.619735  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:33.620252  5968 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:33.622592  5959 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:33.595541  6117 rpcz_store.cc:276] 0709 12:26:32.341150 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.352692 (+ 11542us) service_pool.cc:224] Handling call
0709 12:26:32.352929 (+   237us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:32.385745 (+ 32816us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:32.385774 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:32.396086 (+ 10312us) log.cc:844] Serialized 26 byte log entry
0709 12:26:32.645985 (+249899us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:32.646025 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:33.562620 (+916595us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b54001027d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:33.562672 (+    52us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:33.562717 (+    45us) raft_consensus.cc:1685] finished
0709 12:26:33.562736 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:33.571392 (+  8656us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":20120,"raft.queue_time_us":93973,"raft.run_cpu_time_us":77,"raft.run_wall_time_us":78,"spinlock_wait_cycles":28246912,"thread_start_us":243156,"threads_started":1,"wal-append.queue_time_us":332102}
I20260709 12:26:33.624635  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:33.626976  6042 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:33.629063  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:33.629491  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:33.630733  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:33.631910  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:33.629791  6040 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:33.634086  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:33.635535  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:33.635723  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:33.636471  6035 raft_consensus.cc:2410] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 8.
W20260709 12:26:33.637624  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:33.638669  6043 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36260
I20260709 12:26:33.639259  6043 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:33.639623  6043 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:33.640409  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:33.641260 12024 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:33.641675 12024 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:33.642019 12024 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:33.536154 11931 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.638556 11929 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:33.643013 11929 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:33.643381 11929 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:33.644412 11931 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:33.645376 11865 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:33.646358  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:33.647547 12139 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:33.653017 11997 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:26:33.638624  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:33.653980  6040 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:26:33.660199  6037 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:33.661631  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:33.661936  6118 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:33.666026  6043 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:33.668183  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:33.668442  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:33.670550  5961 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:33.671007  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:33.671610  5962 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:33.672223  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:33.676653  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:33.678637  6035 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:33.680719  6043 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:33.670516  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:33.555260 12043 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:33.683085  5964 raft_consensus.cc:2368] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16.
I20260709 12:26:33.683938  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:33.688169  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:33.685261  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:33.686177  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:33.689628  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:33.633965 12110 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16.
I20260709 12:26:33.694569  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:33.697947  5932 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:33.687650  5962 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:33.685814  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:33.691725  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:33.691931  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:33.708076  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:33.714715  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:33.714948  6035 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:33.715200  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:33.715937  5968 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 14: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:33.688337 11974 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:33.718806  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:33.680836 12052 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.761375  6041 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:33.762562 12052 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:33.683370 11865 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:33.704144 12130 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:33.783289  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:33.789208  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 81229.9us
I20260709 12:26:33.706823 11985 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:33.802809  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 84081.5us
W20260709 12:26:33.759011 12138 log.cc:927] Time spent T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:26:33.803890  6006 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:33.791639  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:33.796761  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:33.797693  6117 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
W20260709 12:26:33.802150  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 110274us
I20260709 12:26:33.720160 12057 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:33.806128  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:33.807838  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:33.773435 11717 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:33.704933 12103 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.098s
I20260709 12:26:33.774601 11787 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:33.712844 12048 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.094s
I20260709 12:26:33.801568 12100 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:33.820050  6006 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:33.801867 11997 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:33.815197 12114 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
I20260709 12:26:33.823194 11999 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:33.834404 11999 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:33.810930 12143 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.835871  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:33.777983 12134 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.067s
I20260709 12:26:33.813155 11717 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:33.811982 12057 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:33.840245 11999 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:33.847646 12142 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:33.842185  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:33.839298 11997 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.848685 11929 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:33.831143 12108 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:33.823843 12141 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:33.837386 12100 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:33.837769 11786 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 16.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:26:33.830801 11787 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.860816  6645 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:33.891711  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:33.892516  6647 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:33.864084  6006 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:33.886636  6648 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50472 (request call id 1592) took 1206 ms. Trace:
W20260709 12:26:33.900297  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 115991us
I20260709 12:26:33.897670  6648 rpcz_store.cc:276] 0709 12:26:32.680238 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.680354 (+   116us) service_pool.cc:224] Handling call
0709 12:26:33.886381 (+1206027us) spinlock_profiling.cc:243] Waited 509 ms on lock 0x7b54003354d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:33.886560 (+   179us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1170971904}
I20260709 12:26:33.912262  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:33.930231  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:33.859922 11717 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:33.872345 12039 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:33.933482  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:33.860355 12057 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:33.860065 11982 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:33.870034 12159 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:33.865545 11997 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:33.861004 11884 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:33.877259 12014 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:33.852650 12037 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:33.898195 12062 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:33.898034 12095 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:33.883047 12010 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:33.872432 12108 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:33.872314 12141 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:33.864419 12142 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:33.867209 12100 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:33.868165 11929 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:33.897369 11985 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:33.953619 12103 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:33.951733  5966 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:33.876991 11999 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.958410 11856 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:33.934521 12053 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:33.961922  6643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 1145) took 1262 ms. Trace:
I20260709 12:26:33.938894 11914 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.034s
I20260709 12:26:33.850435 12024 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:33.963660  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 165184us
I20260709 12:26:33.942562 12039 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:33.865600 12143 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.941516 12159 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:33.877828 11787 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:33.858582 11865 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:33.945901 12105 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.020s	sys 0.009s
W20260709 12:26:34.002584 12105 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.586s	user 0.020s	sys 0.009s
I20260709 12:26:33.974529 12141 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.005905 12041 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:34.006721 11999 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:34.007112 12159 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:34.007758 12039 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:34.008224 12159 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:33.975507 12103 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:34.010210  6642 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:34.011816 12024 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:33.989105  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:33.987253  6643 rpcz_store.cc:276] 0709 12:26:32.699163 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.699317 (+   154us) service_pool.cc:224] Handling call
0709 12:26:32.699630 (+   313us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:33.397476 (+697846us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:33.961508 (+564032us) spinlock_profiling.cc:243] Waited 689 ms on lock 0x7b5400607a54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:33.961753 (+   245us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1584262400}
I20260709 12:26:33.968815 12010 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.958827 12014 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:33.955237 11884 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:33.963920 12095 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:34.160703  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 354626us
I20260709 12:26:34.224364  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:34.068931  5966 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 12 index: 8. (index mismatch)
I20260709 12:26:34.204043  6042 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 7 index: 5. Preceding OpId from leader: term: 11 index: 6. (index mismatch)
I20260709 12:26:34.187590  6648 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:26:34.199311  6110 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1310) took 1260 ms (client timeout 1671 ms). Trace:
W20260709 12:26:34.272226  6110 rpcz_store.cc:269] 0709 12:26:32.938806 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:32.939527 (+   721us) service_pool.cc:224] Handling call
0709 12:26:34.199081 (+1259554us) spinlock_profiling.cc:243] Waited 215 ms on lock 0x7b5400239bd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:34.199229 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":493757312}
W20260709 12:26:34.186131  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 480144us
I20260709 12:26:34.273739  6081 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:34.274852 11863 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:34.275242  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:34.273571  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 49306us
I20260709 12:26:34.075366  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:34.267709  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 59650.2us
I20260709 12:26:33.976625 12003 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:33.971612 12108 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.071401  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:34.367385  6116 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:34.367501  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 92308.8us
I20260709 12:26:34.371826  6041 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: []
W20260709 12:26:34.125429 12164 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.111s	user 0.002s	sys 0.002s
W20260709 12:26:34.140563 12163 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.134s	user 0.002s	sys 0.002s
I20260709 12:26:34.020622 12037 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.190631 12132 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.187737 11914 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:34.189563 11823 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:34.185941 12062 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:34.148164 12100 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:34.179149 12082 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:34.383728 12141 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.188167 12143 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:34.188373 12129 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:34.186862 12060 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:34.392290  6081 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:34.267378 12159 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.439110 12159 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:33.979537 11985 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.383966  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:34.275388 12075 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:34.447240  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 63335.8us
I20260709 12:26:34.021168 12112 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.375s
W20260709 12:26:34.384673 12160 log.cc:927] Time spent T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.393s	user 0.001s	sys 0.000s
I20260709 12:26:34.421393 12133 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:34.202884 12039 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:34.423565 12139 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.021s
I20260709 12:26:34.408629 12132 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.149119 12010 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:34.432775 12082 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.410748 12102 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:34.472074 12108 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.414359 12130 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:34.472892 12130 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.474516 12039 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:34.475390 12130 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.475828 12014 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.441823 12129 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.480305 12129 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.445060 12060 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.481287 12095 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:34.426100 11823 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.482823 12168 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20260709 12:26:34.483340 11823 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.483625 11884 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:34.442706  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 50524.4us
I20260709 12:26:34.425189 12046 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:34.448724 12048 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:34.408826 11546 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.028s
I20260709 12:26:34.448644  6116 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:26:34.427424 12062 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.185258 11717 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.422878 11914 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.500458  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:34.501601 11914 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.503706  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:34.504441  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:34.504782 12062 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.504993  6040 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 9. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:34.506811  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:34.506991  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:34.508720  6035 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:34.507617  6110 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:34.509701  6112 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:34.451831 11863 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:34.489883 12075 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:34.510512 11863 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:34.510973 11863 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:34.510664 12075 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:34.509920  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:34.512789 12075 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:34.441987 12057 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:34.459452 12171 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.096s	user 0.000s	sys 0.000s
I20260709 12:26:34.385617 12003 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.486425  6611 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:34.482750 12060 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.514675  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:34.489192  6084 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:34.489611  6081 leader_election.cc:400] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16.
I20260709 12:26:34.515707  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:34.446022  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:34.491631 12046 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:34.493702 12053 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:34.495694 11985 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.457568 12133 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:34.425937  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 152021us
I20260709 12:26:34.472504 12082 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.499153  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:34.528645  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:34.521085  6084 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:34.499631  5965 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:34.435262 12100 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.456089 12159 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:34.408968 12037 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:34.516285  6040 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:34.516126  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:34.518957  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:34.522179 11957 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:34.524328 12057 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.520442 12022 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:34.525429  6042 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:26:34.526518 12003 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.531635  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.551589  5964 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:34.531898  6037 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:34.535952  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.536907  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.536546  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.551079 12022 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.554600 12022 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:34.549849 11546 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:34.555673  6118 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:34.535826 12176 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 15.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.029s
I20260709 12:26:34.543959  6642 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:34.545950  6081 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:34.558120  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:34.559114  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.545025  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:34.546556  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.545074  6643 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:34.547465  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.519897 12132 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.548673  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.548292  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.533077 12168 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:34.554524 12133 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.562148  6116 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19. Ops: []
W20260709 12:26:34.541061  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.562819  5962 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 15: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:34.563501  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:34.573556  6110 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:34.565416  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.566771  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:34.566921  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.536170 12039 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:34.583737  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.584930  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.585877  5963 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:34.585862  5960 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:34.580583  5965 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:34.568080  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:34.572386  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:34.588994  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.591545  5965 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:34.544450 12024 consensus_queue.cc:1059] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.035s
I20260709 12:26:34.567965 12014 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:34.605965  5959 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:34.604029 11900 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:26:34.586072 12039 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:34.593557 12102 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:34.573442 11546 consensus_queue.cc:1059] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:26:34.601449 12014 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.602281 12010 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:34.595963 12049 consensus_queue.cc:1059] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.027s
I20260709 12:26:34.650641 12049 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:34.651046 12049 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:34.651904 12049 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.653175 12049 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:34.629761 12175 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:26:34.626449 12127 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.008s
I20260709 12:26:34.628616  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:34.639168 12022 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.639772 12037 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:34.660784  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.641860  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.642093 12046 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:34.643044 11717 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.643973 12100 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.644776 12102 raft_consensus.cc:3055] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:34.672190 12102 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:34.673151 12102 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.674384 12102 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:34.648059 11863 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:34.619112 12039 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:34.679323 12075 raft_consensus.cc:3055] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:34.679771 12075 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:34.680063  5934 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:34.680577 12075 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:34.681902 12075 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:34.625438 12014 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:34.687110  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:34.628712 12010 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.687816 12010 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:34.688323 11957 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:34.688865  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:34.693523  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 154222us
I20260709 12:26:34.665799  5968 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:34.699841  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:34.700604  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 2814) took 1003 ms. Trace:
I20260709 12:26:34.701836  6609 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:34.702622 12024 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election lost for term 10. Reason: could not achieve majority
I20260709 12:26:34.703438  6609 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:34.703711  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 276738us
I20260709 12:26:34.704195 12024 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:34.704571  6609 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:34.706653  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:34.625685 11684 raft_consensus.cc:3055] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:34.656883 12126 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:34.681062 12130 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:34.711104  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:34.668721 12103 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:34.700984  6036 rpcz_store.cc:276] 0709 12:26:33.696879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:33.696989 (+   110us) service_pool.cc:224] Handling call
0709 12:26:33.697306 (+   317us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:33.757632 (+ 60326us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:33.757668 (+    36us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:33.772963 (+ 15295us) log.cc:844] Serialized 52 byte log entry
0709 12:26:33.914157 (+141194us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:34.173942 (+259785us) log.cc:844] Serialized 14 byte log entry
0709 12:26:34.404443 (+230501us) log.cc:844] Serialized 14 byte log entry
0709 12:26:34.700035 (+295592us) spinlock_profiling.cc:243] Waited 3.65 ms on lock 0x7b180041fec0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481dee1c0a 00007f4827621219 00007f481df69a40 00007f481df644e4 00007f481df64455 00007f482104c060 00007f482105e716 00007f482106f287 00007f482106f208
0709 12:26:34.700240 (+   205us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:34.700308 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:34.700417 (+   109us) raft_consensus.cc:1685] finished
0709 12:26:34.700431 (+    14us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:34.700547 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":151640,"prepare.queue_time_us":513707,"prepare.run_cpu_time_us":106,"prepare.run_wall_time_us":4912,"raft.queue_time_us":246246,"raft.run_cpu_time_us":362,"raft.run_wall_time_us":64412,"spinlock_wait_cycles":8385792,"thread_start_us":474590,"threads_started":3,"wal-append.queue_time_us":170353}
I20260709 12:26:34.715780  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.719515  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.722975  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:34.723136  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:34.733116  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.723716  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:34.724681  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:34.727111  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 126125us
I20260709 12:26:34.728003  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:34.728631  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.729190  6116 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:26:34.694365 12169 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.509s	user 0.004s	sys 0.000s
I20260709 12:26:34.737074  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:34.742720 12178 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.743319 12178 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:34.743882 11863 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:34.745301 12178 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:34.736884 12048 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:34.716341 11684 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:34.747159 12103 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:34.747900 11684 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.749148 11684 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:34.751703 12022 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:34.753358  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.753738  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.754244  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:34.755041  6649 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 15: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:34.755439  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.754987  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 12 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.757433 12014 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:34.758613 12130 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:34.759310 12052 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.760509  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.761691  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:34.763082  6111 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:34.764501  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.730769  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:34.757905 12039 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.771435  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:34.777985  6648 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 15: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:34.774055  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:34.778846  6118 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:34.774844  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:34.779873  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:34.780138  6040 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 17: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:34.775480  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:34.775563  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:34.776846  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:34.778545  6039 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:34.782589 12060 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:34.783092 12060 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:34.719817 12099 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.064s
I20260709 12:26:34.785070 12060 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:34.773061  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:34.786988  6041 raft_consensus.cc:2393] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:34.787891  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:34.791677 12014 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:34.759768 12052 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:34.797061  6035 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
W20260709 12:26:34.797837  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 69911.8us
I20260709 12:26:34.798127 12052 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:34.781179  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.801222  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:34.819766  6039 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:34.802184  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.803851 12003 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:34.806910 12048 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:34.807520 12122 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:34.782155 12024 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:34.759701 12130 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:34.816393  6084 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:34.817641  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:34.777217  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 46521.6us
I20260709 12:26:34.803289  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:34.821489  6112 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:34.833539  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:34.834632  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:34.823100  6116 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:34.825387  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:34.836023  6648 raft_consensus.cc:2393] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 12: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:26:34.829074  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 93911.6us
I20260709 12:26:34.834281  6111 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:34.839507  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.841914  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:34.843135  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.830493 12048 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:34.838574  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.847748 12048 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:34.848235 12131 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:34.849331  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:34.849927  5961 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:34.856678  6081 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:34.858109  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:34.851179 12060 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:34.863157  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:34.864144  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 96869.1us
I20260709 12:26:34.864061  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:34.863972  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:34.866981  6006 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:34.869299  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 51739.4us
I20260709 12:26:34.837193 12014 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:34.878981 12014 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:34.879459 12014 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:34.876076 12189 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:26:34.882678  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:34.883145 12057 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 6, Time since last communication: 0.010s
W20260709 12:26:34.884402 12167 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.710s	user 0.001s	sys 0.003s
I20260709 12:26:34.868809 12024 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:34.893348 12024 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.897132  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:34.869588  6081 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:34.874698  6039 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:34.846628 12049 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:34.878865 12176 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:34.835974 12178 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:26:34.916298  6648 raft_consensus.cc:2368] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12.
I20260709 12:26:34.910634  6609 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:34.876529 11786 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 19.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:34.925701  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:34.914441  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:34.871640 12102 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:34.922951  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 56026.2us
I20260709 12:26:34.873850 12075 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:34.932770  6081 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:34.934144  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 70245.7us
I20260709 12:26:34.934827  6009 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:34.933147 12131 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:34.933308 11900 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.005s
I20260709 12:26:34.936120  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:34.938009 11823 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:34.938566 11823 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:34.939425 11823 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.941555 12108 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:34.942605  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:34.943028 12003 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:34.943434 12003 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:34.943895 12003 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:34.935597 12131 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:34.947183 12131 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:34.950654 11957 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:34.951187 11957 raft_consensus.cc:697] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:34.951315  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:34.953536  6084 leader_election.cc:400] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12.
I20260709 12:26:34.953851  6084 leader_election.cc:403] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Cancelling election due to peer responding with higher term
I20260709 12:26:34.916858 12039 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:34.919313 11863 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:34.960168  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:34.960978  6044 raft_consensus.cc:2368] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12.
I20260709 12:26:34.958210 11982 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:26:34.921537 12060 raft_consensus.cc:697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:34.943359  5966 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 15: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:34.957839 12102 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:34.956982  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:34.971092  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 56760.2us
I20260709 12:26:34.921111 12010 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.992449  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:35.003252  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 70563.7us
I20260709 12:26:34.976500 12142 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:34.962006 11722 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:34.977696 11957 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:34.971837 12178 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:35.014827 12178 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.016891 12178 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:34.972003 12062 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:35.017524 12062 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.019519 12062 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:34.999954 12132 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:35.022171 12060 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 13.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.023819 12048 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:35.007933 12142 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:35.010416 12103 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:34.964689 12108 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:26:34.962056 11863 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.030200 11863 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:35.004324  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:34.973481  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:35.008713  6081 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.039144  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:35.035205  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 61763.7us
I20260709 12:26:35.034163 12162 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:35.052639  6042 raft_consensus.cc:2393] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 11: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:26:35.061328  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 102452us
I20260709 12:26:35.062383  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:35.064301  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:35.069914  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:35.053459 12046 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:35.058470 12074 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:35.078792  6084 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.070974 12048 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:35.059348 12162 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:35.066475 11717 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:35.072738 12157 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:35.090474 12014 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.096850 11863 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.105581 12102 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election lost for term 11. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12.
I20260709 12:26:35.114996 12142 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.139127 12142 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:35.139510 11863 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:35.142107 12014 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:35.133502  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:35.147961  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:35.149566  6009 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.150187  5964 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:35.149658  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:35.083592 12039 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:35.147946  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:35.152729  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:35.152880  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:35.159812  6043 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 17: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:26:35.134687 12185 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:35.157066 11856 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.165735 11856 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:35.158260 12060 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:35.130385 12075 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:35.168290  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.177182  6009 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.145413 12162 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:35.185410 12075 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.187937 12075 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:35.189077  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:35.191754 12157 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:35.192754 12157 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:35.198901  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 134682us
I20260709 12:26:35.204641  6115 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:35.206233  6116 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:35.198992 12082 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:35.207736 12082 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:35.208587 12082 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:35.154424 12108 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:35.213455 11856 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:35.192724  5963 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:35.217924  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:35.217866  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:35.129098 11717 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.215546 12062 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:35.175722 11982 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:35.232606  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 55524.8us
I20260709 12:26:35.249063  6009 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:35.239554 11863 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:35.239897 12162 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:35.241852 11717 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:35.258512 11982 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:35.237763 12129 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:35.282195  6082 leader_election.cc:400] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12.
I20260709 12:26:35.284627  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.288784  6009 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.291288  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:35.291893  5964 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:35.292580  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:35.296283 12039 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:35.298559 12057 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:35.298980 12057 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:35.299836 12057 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.10, Last appended by leader: 10, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.300948 12057 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:35.301400 12010 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:35.239348 12003 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:35.302716 11863 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:35.303690 11863 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.307053 11717 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:35.307605 11717 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:35.309633 11717 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:35.316190 12003 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:35.317126  6038 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:35.328044 12099 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:35.336982 12105 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.337586 12105 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.339752 12105 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:35.361304  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 72605.9us
I20260709 12:26:35.362165  6009 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.362766  6081 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:35.237226 12131 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.381592  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 7 index: 5 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:35.386288  6116 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13. Ops: []
W20260709 12:26:35.387955  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.387856  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:35.388617  6116 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:35.392622  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:35.392740  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:35.393364  6110 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:35.393452  6109 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:35.394644  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:35.395205  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:35.396656  6110 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:26:35.397987  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:35.377858 12102 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:35.401515  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:35.403612  6116 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:35.410635  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:35.380779 12132 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:35.413522  6115 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 15: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:35.414922  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:35.417297  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:35.414126  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:35.423306  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:35.426631  6041 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:35.428364  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:35.429165  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:35.433318  6009 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.444670  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.454553  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.456167  6009 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.459676  5934 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:35.458473  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:35.467555  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:35.428352 12102 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:35.481503  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:35.487825  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.466377 12129 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:35.479650 12141 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:35.498004  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:35.448312 12139 raft_consensus.cc:2764] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 11: won
I20260709 12:26:35.475401 12126 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:35.475195 12132 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:35.458141 12082 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 6, Time since last communication: 0.041s
I20260709 12:26:35.482450 12205 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:35.503679  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:35.483017 12189 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:35.519667  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:35.506260 12126 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.495374 11869 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:35.482203 12100 consensus_queue.cc:1059] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:26:35.554286 12102 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.571743 11914 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.572309 11914 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.551105 11846 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:35.573410 11846 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:35.485729 12196 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:26:35.555174 12131 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:35.525276 12126 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:35.559540  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 55947.2us
I20260709 12:26:35.561010 12139 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:35.482923 12184 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.031s
I20260709 12:26:35.506628 12099 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:35.507375 12207 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.066s
I20260709 12:26:35.524765 12205 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:35.500962 12141 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.621093 12141 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:35.574385 11914 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:35.579941  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 112467us
I20260709 12:26:35.591862  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:35.592084  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:35.593066  6116 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:35.629200  6114 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:35.574364 11846 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:35.648252 12205 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:35.666313 12184 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:35.667380 12184 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:35.669629 12184 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:35.674975 11865 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:35.675415 11865 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:35.676321 11865 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:35.677733 11865 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:35.681056 12210 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.180s	user 0.001s	sys 0.001s
W20260709 12:26:35.685349  5863 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 320) took 28603 ms (client timeout 15000 ms). Trace:
W20260709 12:26:35.685775  5863 rpcz_store.cc:269] 0709 12:26:07.081861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:07.090944 (+  9083us) service_pool.cc:224] Handling call
0709 12:26:35.685257 (+28594313us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:32.035895 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:32.036413 (+   518us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:32.036450 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:26:32.036468 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:32.037217 (+   749us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:32.037291 (+    74us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:32.037317 (+    26us) tablet.cc:685] Acquiring locks for 6 operations
0709 12:26:32.037782 (+   465us) tablet.cc:701] Row locks acquired
0709 12:26:32.037811 (+    29us) write_op.cc:260] PREPARE: finished
0709 12:26:32.037953 (+   142us) write_op.cc:270] Start()
0709 12:26:32.038072 (+   119us) write_op.cc:276] Timestamp: P: 1783599992037903 usec, L: 0
0709 12:26:32.038090 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:26:32.062288 (+ 24198us) log.cc:844] Serialized 2444 byte log entry
0709 12:26:32.743897 (+681609us) spinlock_profiling.cc:243] Waited 51.3 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:33.529915 (+786018us) op_driver.cc:464] REPLICATION: finished
0709 12:26:33.856997 (+327082us) write_op.cc:301] APPLY: starting
0709 12:26:33.857085 (+    88us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:33.885705 (+ 28620us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:33.885729 (+    24us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:34.184240 (+298511us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:34.184476 (+   236us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=12,key_file_lookups=12,delta_file_lookups=12,mrs_lookups=0
0709 12:26:34.184520 (+    44us) write_op.cc:312] APPLY: finished
0709 12:26:34.184785 (+   265us) log.cc:844] Serialized 65 byte log entry
0709 12:26:34.198915 (+ 14130us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:34.199046 (+   131us) write_op.cc:454] Released schema lock
0709 12:26:34.199095 (+    49us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:34.202189 (+  3094us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:34.202218 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1721549,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":323247,"apply.run_cpu_time_us":11229,"apply.run_wall_time_us":345045,"cfile_cache_hit":26,"cfile_cache_hit_bytes":29219,"num_ops":6,"prepare.queue_time_us":184451,"prepare.run_cpu_time_us":34156,"prepare.run_wall_time_us":193322,"raft.queue_time_us":278737,"raft.run_cpu_time_us":9059,"raft.run_wall_time_us":321516,"replication_time_us":1473992,"spinlock_wait_cycles":118082944,"thread_start_us":674286,"threads_started":4,"wal-append.queue_time_us":201753,"wal-append.run_cpu_time_us":71484,"wal-append.run_wall_time_us":2920486}]]}
I20260709 12:26:35.673187 12186 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:35.695608 12186 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:35.696485 12186 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:35.697675 12186 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:35.695628 12213 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.175s	user 0.001s	sys 0.000s
I20260709 12:26:35.673506 12014 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.699450 12014 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.700062 12211 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:35.700515 12211 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:35.701630 12014 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:35.694017  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:35.711005 12003 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:35.711951 12003 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:35.712271 12003 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:35.713526  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:35.714164  6035 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:35.714426 12205 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:35.713011 12003 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:35.716269 12003 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:35.701289 12211 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.723107 12211 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:35.726472  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 247255us
I20260709 12:26:35.715339  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:35.730171  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:35.732726 12014 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:35.733244 12014 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.733680 12014 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:35.734678  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:35.736917  6035 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
W20260709 12:26:35.738340  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 279947us
I20260709 12:26:35.739954  5932 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:35.751978 11717 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:35.756928  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:35.757706  5963 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 16: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:35.760490  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:35.761044  5963 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:35.761781  6113 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:35.766446  6044 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:26:35.649652 12126 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:35.782287  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:35.784456  5963 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:35.786959  5862 catalog_manager.cc:5697] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:35.782145  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:35.765275 12108 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.009s
I20260709 12:26:35.794889  5966 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:35.792280  6006 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.788410  5862 catalog_manager.cc:5697] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 7 to 8, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 8 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
W20260709 12:26:35.816982  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 335016us
I20260709 12:26:35.803427  6609 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:35.800535  5967 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:35.791725 12225 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:35.820207 12074 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.007s
I20260709 12:26:35.827171  6643 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:35.831655  6111 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:26:35.832841 12127 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:35.833016  6113 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:35.833411 12127 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:35.835848 12127 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:35.839502  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:35.841719  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:35.842897  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 50688.7us
I20260709 12:26:35.843770  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:35.845304  6113 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: [12.8-12.8]
I20260709 12:26:35.847270 12132 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:35.840202 12225 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.850102 12225 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:35.856897  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.871440 12209 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:35.880081  6109 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:35.881322  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:35.882082  6037 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
W20260709 12:26:35.882536  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 79296.1us
I20260709 12:26:35.893081  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:35.794996 12176 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.090s
W20260709 12:26:35.908335  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 65509.8us
I20260709 12:26:35.913285  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:35.931095  6648 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:35.932224  6115 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:35.881316 12127 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:35.934194  6643 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:35.886134 12131 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:35.936666  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:35.891695  5862 catalog_manager.cc:5697] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:35.938005  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:35.886343 11900 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:35.945091  6608 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:35.946591  5862 catalog_manager.cc:5697] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 17, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 17 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:35.936537 12161 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:35.967754 12161 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.968179 12161 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:35.936710 12225 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.016s
I20260709 12:26:35.952790  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:35.958045  5862 catalog_manager.cc:5697] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 9 to 16, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 16 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:35.962816  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:35.973044  6115 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:35.892848 12142 consensus_queue.cc:1059] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 11.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.051s
I20260709 12:26:35.963054 12195 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:35.939807 12131 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:35.890148 12226 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.056s
I20260709 12:26:35.984501 12141 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.948230 11717 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:35.889097 12014 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:35.995930  5862 catalog_manager.cc:5697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 10 to 14, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 14 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:36.002568 12222 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:26:35.980839 12166 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.022s
I20260709 12:26:35.971438 12108 consensus_queue.cc:1059] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.030s
I20260709 12:26:35.975905 12126 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:36.015410 12014 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:35.994738 12131 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:36.018507  5862 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 12 to 13, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 13 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:36.020416  6036 raft_consensus.cc:2368] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16.
I20260709 12:26:36.027261  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:36.027920  6039 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:36.028993  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:36.029471  5966 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:36.030068  5934 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:35.998215 12211 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.026s
I20260709 12:26:36.025802  5862 catalog_manager.cc:5697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:36.042863  5862 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:36.023357 12157 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.025s
I20260709 12:26:36.037112 12126 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:36.062700  6115 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:26:36.060109  5862 catalog_manager.cc:5697] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 8 to 12, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 12 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.074527  5862 catalog_manager.cc:5697] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 11 to 12, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 12 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:36.076237  6039 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:26:36.077497  5862 catalog_manager.cc:5697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 9 to 11, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 11 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:36.089131  5932 leader_election.cc:400] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16.
I20260709 12:26:36.089434  5932 leader_election.cc:403] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:36.095788  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:36.103984 12226 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:36.107504 11982 raft_consensus.cc:3055] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:36.107980 11982 raft_consensus.cc:740] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:36.108954 11982 consensus_queue.cc:260] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:36.112483  5966 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:26:36.126395  5967 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:36.126936 12014 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:36.127583 12014 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:36.128424 12014 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:36.145174  5862 catalog_manager.cc:5697] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:36.154721  5862 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:36.156230 12141 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:36.156678  5862 catalog_manager.cc:5697] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 11 to 13, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 13 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:36.162874 12053 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:36.163643  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:36.163424  5862 catalog_manager.cc:5697] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 12 to 15, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 15 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:36.167858  5862 catalog_manager.cc:5697] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 11 to 14, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 14 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.170213  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:36.170889  6109 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:36.129777 12057 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:26:36.177088  5862 catalog_manager.cc:5697] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 7 to 10, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 10 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:36.177536 12139 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.198424  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:36.201293 12157 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:36.202630 12105 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:36.209707 11884 raft_consensus.cc:3055] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:36.210179 11884 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:36.211081 11884 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:36.211823 12161 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:36.212428 11884 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:36.212881  5862 catalog_manager.cc:5697] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:36.214733 12139 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:36.217026 12139 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:36.218971  6044 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:36.220151 12226 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.220715 12226 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:36.223518  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:36.224225  5964 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:36.228571 12161 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:36.245841 11982 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:36.214293  5862 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:36.234664 12039 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:36.235682  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:36.250944  6645 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:36.242947  6041 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 11. (term mismatch)
I20260709 12:26:36.251976  6041 pending_rounds.cc:85] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 10
I20260709 12:26:36.252240  6041 pending_rounds.cc:107] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 11.11
I20260709 12:26:36.252478  6041 raft_consensus.cc:2889] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:36.231204  6006 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:36.255048 11914 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:36.255437 11914 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.255782 11914 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:36.257431 12189 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:36.269523  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:36.270262  5964 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 22.
I20260709 12:26:36.263034 12226 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:36.271880  5862 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:36.273828  5862 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 8 to 11, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 11 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.275739  5862 catalog_manager.cc:5697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 10 to 15, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 15 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:36.277587  5862 catalog_manager.cc:5697] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 16, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 16 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:36.288712  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:36.289711 12131 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:36.291010 12199 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:36.296868 12199 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.297381 12199 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:36.302934  6037 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:36.303427  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:36.309500 12053 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:36.311009 12053 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:36.311405 12053 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:36.312219 12053 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:36.313298 12053 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:36.327461  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:36.328236  6037 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:36.341516 12199 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:36.243022  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:36.356830  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:36.418730  6114 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:36.372249 12057 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election lost for term 15. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16.
I20260709 12:26:36.371702  6109 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:36.377890 12131 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:36.432984  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:36.433612  5964 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:36.435793  5961 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:36.440413  5964 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 23.
I20260709 12:26:36.441799  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:36.443725 11957 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:36.444458 11957 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 23 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:36.449882  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:36.445369 11957 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:36.497206  6037 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:36.497416 12052 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:36.498564 11914 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:36.510777  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:36.504256  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:36.513631  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:36.514513  6113 raft_consensus.cc:2410] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:26:36.511370 12052 raft_consensus.cc:697] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:36.518407 12199 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:36.518791 12052 consensus_queue.cc:237] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:36.522192 12252 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.071s	user 0.001s	sys 0.000s
I20260709 12:26:36.525813 11914 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:36.526537  6114 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:36.522114  5961 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:36.592370  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 87943.1us
W20260709 12:26:36.615242  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 83806.5us
I20260709 12:26:36.619300  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:36.529886  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:36.626838  6037 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Advancing to term 23
W20260709 12:26:36.635838  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:36.640981 11722 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:36.641909 11722 raft_consensus.cc:697] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:36.643692 11722 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:36.647420  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:36.648690  6648 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:36.651489 11884 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:36.652379 11884 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:36.656978 11884 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:36.661890 11884 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:36.677824 11982 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:36.706831  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:36.712569 12176 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.713337 12176 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:36.715405  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:36.716467  6111 raft_consensus.cc:2393] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 16: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:36.693305 11982 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:36.719357 12176 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:36.729185  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:36.730393  6036 raft_consensus.cc:2410] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 14 because replica has last-logged OpId of term: 12 index: 8, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 7.
I20260709 12:26:36.739661 11982 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:36.751820  6035 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:26:36.771003  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:36.772511  6111 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 20: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:36.781973  6037 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 23.
I20260709 12:26:36.782931  6648 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:36.758198  5961 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:36.788713 12176 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:36.794131 11823 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.796777 11823 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:36.799149  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 11 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:36.801862 11823 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:36.804266  5966 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:26:36.825829  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:36.826717  5964 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:36.828264  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:36.829319  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:36.830451  5963 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 23.
I20260709 12:26:36.848563  5964 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:26:36.857923  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:36.882339 12039 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:36.883179 12039 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:36.887116  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:36.888111  6648 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:36.853969  6009 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:36.889891  6084 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:36.890985  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:36.891990  6035 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 18: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:36.893687 12176 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:36.894225 12176 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:36.894681 12176 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:36.893708 12039 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:36.904685  6081 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:36.913393 12053 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:36.913844 12170 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:36.906308  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:36.919468 11823 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:36.919912 11823 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:36.920293 11823 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:36.925596 11982 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:36.926380 11982 raft_consensus.cc:697] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:36.927628 11982 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:36.931653  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 77847.4us
I20260709 12:26:36.939538 11823 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:36.957055 12170 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:36.971900 12170 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:36.974175 12170 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:36.965026  6035 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:26:36.961602  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:36.978076 11865 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:26:36.978608 11884 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:36.979028 11884 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:36.979359 11884 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:36.991326  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:36.992185  6041 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:37.004868  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:37.007754  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:37.008932 12139 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:37.009323 12139 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:37.009680 12139 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:36.955550 12176 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:37.015110  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:37.015401  5967 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:37.017854 11884 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:36.956841 11823 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:37.028752 12139 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:37.037953  5967 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:26:37.042603  6035 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 23. Current term is 24. Ops: [23.17-23.17]
I20260709 12:26:37.040661  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:37.045951  5966 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
W20260709 12:26:37.054327  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 77200.5us
I20260709 12:26:37.056802 12014 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:37.057368 12014 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.057771 12014 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:37.058617 11717 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:37.059260 11717 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:37.061738 11717 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:37.067569  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:37.067656  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:37.069581  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:37.071269  5961 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:37.072922  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:37.073701  6111 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 13: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:37.073882  6037 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 18: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:37.075670  6648 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:37.064126 11865 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.007s
I20260709 12:26:37.087239  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:37.089286 11884 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:37.085629 12132 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.012s
I20260709 12:26:37.090333 12141 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:37.090947 12141 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:37.091980 12141 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:37.098778  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:37.100093 12176 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:37.102680 12209 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:26:37.103714 12209 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:37.104043 12209 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:37.104913 12209 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:37.109674  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:37.115787  6113 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:37.106215 12209 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:37.115897  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:37.126614  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 45198.9us
I20260709 12:26:37.127302 12157 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:37.127856 12157 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:37.128275 12157 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:37.127408 12170 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.137869 12170 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:37.144388 12170 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:37.145349 11823 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:37.155304 12139 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:37.160787  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:37.161679  6113 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 20: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:37.160822  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:37.169265  6035 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
W20260709 12:26:37.178283  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 47684.5us
I20260709 12:26:37.188127  6645 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:37.201123  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:37.199399  6084 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:37.219591  6643 raft_consensus.cc:2410] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 24 because replica has last-logged OpId of term: 23 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 12:26:37.222837 12039 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:37.230727 12176 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election won for term 18
W20260709 12:26:37.243688  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 55272.8us
I20260709 12:26:37.241096 12039 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.249469 12014 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:37.251814 12039 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:37.267031 12014 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:37.268373  6115 raft_consensus.cc:2368] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17.
I20260709 12:26:37.270035  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:37.301458 12265 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.051s	user 0.000s	sys 0.002s
I20260709 12:26:37.290267 11982 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.312915 12014 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.315394 12014 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:37.297748 12176 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:37.273634 12157 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:37.337021 12039 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:37.348920  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:37.349578  5964 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:26:37.350376  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:37.352687  5966 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:37.362527  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:37.320869 11982 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:37.378888 11823 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.387874  5966 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:37.398916  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:37.400170 12014 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:37.398996 12176 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:37.413339  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:37.415735  6039 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:37.416960 12132 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:26:37.423264 12157 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:37.425803  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:37.426671  6109 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 13: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:37.382663 11823 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:37.428272 12266 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.064s	user 0.002s	sys 0.000s
I20260709 12:26:37.428732 11823 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:37.435729  6081 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:37.439321  5968 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:26:37.450785 12014 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:37.451434 12014 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:37.454198 12014 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:37.474907 11982 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:37.500607  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 86009us
I20260709 12:26:37.501775  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:37.502379  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:37.503031  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:37.503942  5966 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:37.503845  5961 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:37.509474  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:37.525943  5961 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:37.526300  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:37.523734  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:37.527971  6039 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:37.529070  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:37.529702  5968 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:37.529829  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:37.537678 12039 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:37.538614  6009 leader_election.cc:400] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17.
I20260709 12:26:37.541826  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:37.542520  6651 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:26:37.544142  6650 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 12 index: 10. (index mismatch)
I20260709 12:26:37.545778  6648 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:37.553068  6039 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:26:37.564450  5966 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:26:37.572964  6111 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:26:37.573591  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:37.574978 12268 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:37.575537 12053 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:37.576053 12053 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:37.576915 12053 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 19.10, Last appended by leader: 10, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:37.585239  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:26:37.602208  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 73861.4us
I20260709 12:26:37.596410 11884 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:37.607456 11884 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:37.611415  5862 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 327) took 18280 ms (client timeout 15000 ms). Trace:
I20260709 12:26:37.607842 11884 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:37.611907  5862 rpcz_store.cc:269] 0709 12:26:19.330501 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:19.380921 (+ 50420us) service_pool.cc:224] Handling call
0709 12:26:37.608343 (+18227422us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:36.434372 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:36.434949 (+   577us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:36.434981 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:26:36.434998 (+    17us) tablet.cc:662] Decoding operations
0709 12:26:36.436711 (+  1713us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:36.436792 (+    81us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:36.436820 (+    28us) tablet.cc:685] Acquiring locks for 24 operations
0709 12:26:36.534824 (+ 98004us) tablet.cc:701] Row locks acquired
0709 12:26:36.535748 (+   924us) write_op.cc:260] PREPARE: finished
0709 12:26:36.540205 (+  4457us) write_op.cc:270] Start()
0709 12:26:36.547847 (+  7642us) write_op.cc:276] Timestamp: P: 1783599996538878 usec, L: 0
0709 12:26:36.553069 (+  5222us) op_driver.cc:348] REPLICATION: starting
0709 12:26:36.561700 (+  8631us) log.cc:844] Serialized 9331 byte log entry
0709 12:26:36.709928 (+148228us) op_driver.cc:464] REPLICATION: finished
0709 12:26:36.876816 (+166888us) write_op.cc:301] APPLY: starting
0709 12:26:36.876995 (+   179us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:37.112198 (+235203us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:37.112350 (+   152us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:37.301434 (+189084us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:37.301874 (+   440us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=48,key_file_lookups=48,delta_file_lookups=48,mrs_lookups=0
0709 12:26:37.301925 (+    51us) write_op.cc:312] APPLY: finished
0709 12:26:37.312967 (+ 11042us) log.cc:844] Serialized 212 byte log entry
0709 12:26:37.318680 (+  5713us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:37.319089 (+   409us) write_op.cc:454] Released schema lock
0709 12:26:37.319164 (+    75us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:37.332957 (+ 13793us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:37.333006 (+    49us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":1271079,"reported_tablets":46,"child_traces":[["op",{"apply.queue_time_us":166436,"apply.run_cpu_time_us":36524,"apply.run_wall_time_us":456152,"cfile_cache_hit":98,"cfile_cache_hit_bytes":104495,"num_ops":24,"prepare.queue_time_us":93543,"prepare.run_cpu_time_us":9325,"prepare.run_wall_time_us":130091,"raft.queue_time_us":142707,"raft.run_cpu_time_us":33118,"raft.run_wall_time_us":71547,"replication_time_us":156214,"thread_start_us":281586,"threads_started":4,"wal-append.queue_time_us":2648}]]}
I20260709 12:26:37.597738 12139 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.023s
I20260709 12:26:37.607877 12170 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:37.631359  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:37.632507 12268 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:37.633039 12268 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:37.633937 12268 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:37.634766 12170 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:37.637229 12170 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:37.638883  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:37.639580  6039 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:37.641839  6082 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:37.647536 12170 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:37.647954 12170 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:37.648334 12170 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:37.661367 11884 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:37.671347  5968 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:37.672089  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:37.674520  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:37.697275  6006 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:37.723235 12161 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:37.723981 12161 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:37.723289 12141 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:37.724866 12141 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.725222 12141 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:37.726106 12161 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:37.727349 12166 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:37.705143 11982 raft_consensus.cc:2764] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election decision vote started in defunct term 20: won
I20260709 12:26:37.705509 12176 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:37.744206  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:37.748494  5968 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 15: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:37.744663 12176 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:37.766598  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:37.767544  6044 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 18: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:37.740947 12141 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:37.770629 12141 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:37.772267 12176 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:37.794092  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 46314.2us
I20260709 12:26:37.799691 12274 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:37.799199  5865 catalog_manager.cc:5697] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 12 to 13, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 13 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:37.800329 12274 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:37.800850  5865 catalog_manager.cc:5697] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 7 to 9. New cstate: current_term: 9 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:37.802512 12052 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.085s
I20260709 12:26:37.806413  6114 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:37.808085 11982 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:37.808589 11982 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:37.811332  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:37.813874 11884 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:37.815610  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:37.816255  5968 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:37.819782  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:37.823910 12170 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:37.824963  6109 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:37.826385  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:37.826982  6648 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:37.835887  6648 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:26:37.836410  6109 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
W20260709 12:26:37.837004  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 88360.8us
I20260709 12:26:37.839200  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:37.840181 12139 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:37.840808 12139 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:37.841833 12139 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:37.850672  5865 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:37.859841  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:37.860562  5967 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:37.788558 12141 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:26:37.859043  5865 catalog_manager.cc:5697] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:37.867841  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:37.870543  6114 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:37.862166 11982 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:37.888330  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:37.884956  5968 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:37.928325  6648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:26:37.929109  6648 raft_consensus.cc:606] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:37.929455  6648 raft_consensus.cc:614] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:37.932287  5865 catalog_manager.cc:5697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 10 to 13. New cstate: current_term: 13 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:37.939909  5865 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 11 to 15. New cstate: current_term: 15 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:37.941802  5865 catalog_manager.cc:5697] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 9 to 16, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 16 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:37.918377 11823 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 6, Time since last communication: 0.025s
I20260709 12:26:37.943967 12170 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:37.945302  6113 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:26:37.944695  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:37.956058  5959 raft_consensus.cc:2368] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16.
I20260709 12:26:37.957031  5934 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:37.960258  6044 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:37.952791 11823 consensus_queue.cc:1243] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer 0069e2ba1f02412e8e1d6c20a1fb510f log is divergent from this leader: its last log entry 17.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 6
W20260709 12:26:37.962782  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 94438.1us
I20260709 12:26:37.969130  6081 leader_election.cc:400] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16.
I20260709 12:26:37.969707  6081 leader_election.cc:403] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Cancelling election due to peer responding with higher term
I20260709 12:26:37.969888  6006 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:37.971599  6006 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:37.982928  5865 catalog_manager.cc:5697] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 8 to 11. New cstate: current_term: 11 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:37.984364 12211 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:37.984812 12211 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:37.985189 12211 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:37.984417  5865 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 10 to 17. New cstate: current_term: 17 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:37.991007  6642 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:37.985563 11884 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:37.992164 11884 raft_consensus.cc:697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:37.992765 12283 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:37.993036 11884 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:37.993654 12283 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:37.994005 12283 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:37.994757 12283 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:38.003677  5966 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:37.974864 12139 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:38.014922 12284 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:38.015437 12284 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:38.016426 12284 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:38.017859 12284 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:38.021454 12176 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:38.006628 12283 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:38.028118 12274 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:37.987879 12039 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election lost for term 15. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16.
I20260709 12:26:38.008069  5865 catalog_manager.cc:5697] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index 6 to 8, term changed from 8 to 13, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to <none>, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 13 committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.055371  6113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b70d6df693140769deef828413df1ba"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:38.056308  6113 raft_consensus.cc:606] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:38.056587  5865 catalog_manager.cc:5697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 7 to 13, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 13 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.058858  5865 catalog_manager.cc:5697] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 9 to 10, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 10 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:38.060672  5865 catalog_manager.cc:5697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 10 to 12, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 12 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.032362 12139 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:38.063071 12139 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:38.065372 12176 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:38.069666  5865 catalog_manager.cc:5697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 9 to 11. New cstate: current_term: 11 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.071694  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:38.077700  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:38.072300  6648 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:38.076530  6113 raft_consensus.cc:614] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:38.086766  5865 catalog_manager.cc:5697] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 14 to 20, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 20 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:38.092432  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:38.086316  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:38.095321  5865 catalog_manager.cc:5697] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 14 to 16, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 16 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.097050  5865 catalog_manager.cc:5697] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:38.099946 12290 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:26:38.099792  6084 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:38.101184 12170 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:38.101809  6111 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 13: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:26:38.109422  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 241763us
I20260709 12:26:38.131108  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:38.070179 12211 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:38.094030 12274 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.048s
I20260709 12:26:38.172725  6035 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:26:38.143424 12139 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:38.179183  6110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:38.179872  6110 raft_consensus.cc:606] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:38.180208  6110 raft_consensus.cc:614] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:38.180549 12139 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:38.181265  6041 raft_consensus.cc:2368] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:38.177403 12283 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:26:38.187609  6110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:38.188344  6110 raft_consensus.cc:606] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:38.188781  6110 raft_consensus.cc:614] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:38.192227  5966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "adcfbfcb66fd4891959337c005335841"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:26:38.192818  5966 raft_consensus.cc:606] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:38.193132  5966 raft_consensus.cc:614] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:38.200670 12211 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:38.216176  6110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:38.218434  6110 raft_consensus.cc:606] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:38.219172  6110 raft_consensus.cc:614] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:38.219240  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 68553.1us
W20260709 12:26:38.238427  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 86701.3us
I20260709 12:26:38.243669  6044 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 17 index: 11. (term mismatch)
I20260709 12:26:38.244139  6044 pending_rounds.cc:85] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 10
I20260709 12:26:38.245980  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:38.244375  6044 pending_rounds.cc:107] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:26:38.251350  6044 raft_consensus.cc:2889] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:38.264547  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:38.265228  5961 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:26:38.266796  6110 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1e2d6430774a629131a0953161507b"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:26:38.267422  6110 raft_consensus.cc:606] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:38.267699  6110 raft_consensus.cc:614] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:26:38.281162  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 116709us
I20260709 12:26:38.282660  6110 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:38.285871  5959 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 19 index: 10. Preceding OpId from leader: term: 21 index: 11. (index mismatch)
I20260709 12:26:38.286406  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 7
I20260709 12:26:38.295188  5961 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:38.297664  6006 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:38.298753 12131 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:38.299273 12131 raft_consensus.cc:697] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:38.300235 12131 consensus_queue.cc:237] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:38.303418  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:38.304221  6039 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 18: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:38.294030  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:38.302366 12014 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:26:38.306192 12170 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.009s
I20260709 12:26:38.308737 12272 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:26:38.315654 12272 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:38.316061 12272 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:38.320657  6111 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:26:38.345703  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:38.329222 12272 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:38.348109 12272 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:38.353979  5932 leader_election.cc:400] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:38.354480  5932 leader_election.cc:403] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:38.356526  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:38.365291  6110 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:38.354972 12302 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.059s	user 0.000s	sys 0.000s
I20260709 12:26:38.372056  5934 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:38.397758 12270 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:38.410633 12299 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:38.412716  6110 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:38.413837  6111 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 14. (term mismatch)
I20260709 12:26:38.414824  6111 pending_rounds.cc:85] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 13
I20260709 12:26:38.415122  6111 pending_rounds.cc:107] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 18.14
I20260709 12:26:38.415412  6111 raft_consensus.cc:2889] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:38.411305 12299 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:26:38.459477  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 84513.3us
I20260709 12:26:38.467113 12299 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:38.475366  6113 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:38.476415 12291 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:26:38.506167 11884 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.002s
I20260709 12:26:38.519707  6645 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:38.556025 12141 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:38.580245  5961 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 13 index: 8. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
W20260709 12:26:38.672986  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 46237.4us
I20260709 12:26:38.673605 12131 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:38.679555 12268 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:38.680153 12268 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:38.682185 12268 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:38.698279  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:38.700047  6036 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 24: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:38.707293  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:38.707939  6642 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 24.
W20260709 12:26:38.716638  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 89115.8us
I20260709 12:26:38.744019  5934 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:38.752363 12299 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:38.752790 12299 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:38.753159 12299 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:38.761236 12299 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:38.764485 12299 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:38.780289  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:38.791488  6036 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 24: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:38.788075 12284 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:38.792501 12284 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:38.794934 12284 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:38.798543  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:38.799458  6114 raft_consensus.cc:2410] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:26:38.808410  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:38.822279  5863 catalog_manager.cc:5697] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 7 to 11. New cstate: current_term: 11 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:38.823774  5863 catalog_manager.cc:5697] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 16, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 16 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:38.828013  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:38.833757  5863 catalog_manager.cc:5697] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:38.835204  5863 catalog_manager.cc:5697] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 8 to 10. New cstate: current_term: 10 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:38.836680  5863 catalog_manager.cc:5697] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:38.837505  5968 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:38.842304  5863 catalog_manager.cc:5697] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 10 to 14. New cstate: current_term: 14 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.843650  5863 catalog_manager.cc:5697] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 16 to 18, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 18 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:38.848543  5863 catalog_manager.cc:5697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 15, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 15 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:38.855504  6642 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 24.
I20260709 12:26:38.850291  5863 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:38.858048  5934 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:38.859078 12268 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:38.859719  5863 catalog_manager.cc:5697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 17, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 17 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:38.861238  5863 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 16 to 18, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 18 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.870047  6113 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 7. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:26:38.871953 12268 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:38.873045  6114 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:38.873778 12284 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:38.874212  5863 catalog_manager.cc:5697] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 9 to 13, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 13 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.874960 12211 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:38.875906  5863 catalog_manager.cc:5697] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 12 to 13, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 13 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.877285  5863 catalog_manager.cc:5697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 11 to 12, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 12 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.860666  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:38.880589  5865 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 321) took 10697 ms. Trace:
I20260709 12:26:38.873028 12268 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:38.885039  5863 catalog_manager.cc:5697] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 15, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 15 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:38.896502  5863 catalog_manager.cc:5697] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 11 to 12, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 12 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.891243 12284 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:38.899261  5863 catalog_manager.cc:5697] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 13 to 14, leader changed from <none> to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 14 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.914718  6036 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:38.885409  5865 rpcz_store.cc:276] 0709 12:26:28.182886 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.186698 (+  3812us) service_pool.cc:224] Handling call
0709 12:26:38.880494 (+10693796us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:38.309243 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:38.309918 (+   675us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:38.309966 (+    48us) write_op.cc:435] Acquired schema lock
0709 12:26:38.309985 (+    19us) tablet.cc:662] Decoding operations
0709 12:26:38.311443 (+  1458us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:38.311566 (+   123us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:38.311596 (+    30us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:26:38.312994 (+  1398us) tablet.cc:701] Row locks acquired
0709 12:26:38.313209 (+   215us) write_op.cc:260] PREPARE: finished
0709 12:26:38.313405 (+   196us) write_op.cc:270] Start()
0709 12:26:38.313560 (+   155us) write_op.cc:276] Timestamp: P: 1783599998313331 usec, L: 0
0709 12:26:38.313578 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:26:38.314336 (+   758us) log.cc:844] Serialized 6678 byte log entry
0709 12:26:38.488994 (+174658us) spinlock_profiling.cc:243] Waited 4.35 ms on lock 0x7b54003a8aa8. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f48274109e1 00007f482740f64c 00007f4824a8b3bb 00007f4824a8d71a 00007f4824a8d6a8 00007f4824a8d628 00007f4824a8d5e3 00007f4824a8c7fc 00007f4826ebf2f6 00007f4826eb9aa8 00007f4821060310
0709 12:26:38.489152 (+   158us) op_driver.cc:464] REPLICATION: finished
0709 12:26:38.515169 (+ 26017us) write_op.cc:301] APPLY: starting
0709 12:26:38.515267 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:38.571769 (+ 56502us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:38.571805 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:38.617427 (+ 45622us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:38.617733 (+   306us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 12:26:38.617780 (+    47us) write_op.cc:312] APPLY: finished
0709 12:26:38.618134 (+   354us) log.cc:844] Serialized 156 byte log entry
0709 12:26:38.626113 (+  7979us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:38.626279 (+   166us) write_op.cc:454] Released schema lock
0709 12:26:38.626330 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:38.683550 (+ 57220us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:38.683579 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":268848,"reported_tablets":47,"child_traces":[["op",{"apply.queue_time_us":25665,"apply.run_cpu_time_us":30197,"apply.run_wall_time_us":168342,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75221,"num_ops":17,"prepare.queue_time_us":145584,"prepare.run_cpu_time_us":5517,"prepare.run_wall_time_us":21291,"replication_time_us":112519,"spinlock_wait_cycles":10001280,"thread_start_us":115992,"threads_started":2}]]}
I20260709 12:26:38.891739 12131 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.020s
I20260709 12:26:38.926994 12130 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 11, Time since last communication: 0.003s
I20260709 12:26:38.917616  5863 catalog_manager.cc:5697] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 5 to 11, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 11 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.941817  5863 catalog_manager.cc:5697] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 12 to 15, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 15 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.946318  5863 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 9 to 15, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 15 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.948966  5863 catalog_manager.cc:5697] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 20 to 22, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 22 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:38.950935  5863 catalog_manager.cc:5697] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 20. New cstate: current_term: 20 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.963346  5863 catalog_manager.cc:5697] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 4 to 8. New cstate: current_term: 8 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.967458  5863 catalog_manager.cc:5697] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 10 to 12. New cstate: current_term: 12 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:38.975662  5863 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 12 to 13, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 13 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:38.977484  5863 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 11 to 16, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 16 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.986377  5863 catalog_manager.cc:5697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:38.988166  5863 catalog_manager.cc:5697] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 11 to 14, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 14 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:38.995249  5863 catalog_manager.cc:5697] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 11 to 12, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 12 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:39.304750  6036 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:26:39.309121 12130 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:26:39.452739  6642 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:26:39.458999 12299 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:26:39.566591  5863 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 328) took 2735 ms. Trace:
I20260709 12:26:39.567975  5863 rpcz_store.cc:276] 0709 12:26:36.821629 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:36.821913 (+   284us) service_pool.cc:224] Handling call
0709 12:26:36.867951 (+ 46038us) spinlock_profiling.cc:243] Waited 39.7 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:26:39.556880 (+2688929us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:39.120647 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:39.122123 (+  1476us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:39.122184 (+    61us) write_op.cc:435] Acquired schema lock
0709 12:26:39.122205 (+    21us) tablet.cc:662] Decoding operations
0709 12:26:39.126810 (+  4605us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:39.126960 (+   150us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:39.126993 (+    33us) tablet.cc:685] Acquiring locks for 29 operations
0709 12:26:39.135798 (+  8805us) tablet.cc:701] Row locks acquired
0709 12:26:39.135821 (+    23us) write_op.cc:260] PREPARE: finished
0709 12:26:39.135968 (+   147us) write_op.cc:270] Start()
0709 12:26:39.136095 (+   127us) write_op.cc:276] Timestamp: P: 1783599999135920 usec, L: 0
0709 12:26:39.136124 (+    29us) op_driver.cc:348] REPLICATION: starting
0709 12:26:39.137153 (+  1029us) log.cc:844] Serialized 11292 byte log entry
0709 12:26:39.233452 (+ 96299us) op_driver.cc:464] REPLICATION: finished
0709 12:26:39.277094 (+ 43642us) write_op.cc:301] APPLY: starting
0709 12:26:39.312816 (+ 35722us) spinlock_profiling.cc:243] Waited 23.1 ms on lock 0x7b54003a8aa8. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f48274109e1 00007f482740f64c 00007f4824a9fe10 00007f4824a8b97c 00007f4824a8fd61 00007f4824a8fd19 00007f4824a8fca9 00007f4824a8fc71 00007f4824a8ee9d 0000000000388634 0000000000388479
0709 12:26:39.312934 (+   118us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:39.373466 (+ 60532us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:39.373489 (+    23us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:39.464795 (+ 91306us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:39.465171 (+   376us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=58,key_file_lookups=58,delta_file_lookups=58,mrs_lookups=0
0709 12:26:39.465215 (+    44us) write_op.cc:312] APPLY: finished
0709 12:26:39.465674 (+   459us) log.cc:844] Serialized 252 byte log entry
0709 12:26:39.473377 (+  7703us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:39.489614 (+ 16237us) write_op.cc:454] Released schema lock
0709 12:26:39.494566 (+  4952us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:39.510902 (+ 16336us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:39.510935 (+    33us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":201986,"reported_tablets":47,"spinlock_wait_cycles":91404032,"child_traces":[["op",{"apply.queue_time_us":43330,"apply.run_cpu_time_us":38559,"apply.run_wall_time_us":233793,"cfile_cache_hit":118,"cfile_cache_hit_bytes":125405,"num_ops":29,"prepare.queue_time_us":7099,"prepare.run_cpu_time_us":7813,"prepare.run_wall_time_us":21017,"replication_time_us":97169,"spinlock_wait_cycles":53201792,"thread_start_us":49000,"threads_started":2}]]}
I20260709 12:26:39.628692  5861 catalog_manager.cc:5697] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 9 to 14. New cstate: current_term: 14 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.633345  5861 catalog_manager.cc:5697] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 12 to 17, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 17 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.636497  5861 catalog_manager.cc:5697] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 7 to 11, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 11 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.702714  5863 catalog_manager.cc:5697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 17 to 18, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 18 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.704322  5863 catalog_manager.cc:5697] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 13 to 16, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 16 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:39.705610  5863 catalog_manager.cc:5697] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 13 to 16, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 16 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:39.706689 12130 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:39.707237 12130 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:39.707108  5863 catalog_manager.cc:5697] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:39.709522 12130 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:39.710096  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:39.710520  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:39.710744  6113 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:39.711988  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:39.709194  5863 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 15 to 17, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 17 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:39.716212 12130 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:39.716648 12130 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:39.716307  5863 catalog_manager.cc:5697] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 17. New cstate: current_term: 17 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:39.716974 12130 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:39.717526  5863 catalog_manager.cc:5697] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 13 to 24. New cstate: current_term: 24 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:39.719077  5863 catalog_manager.cc:5697] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:39.720155  5863 catalog_manager.cc:5697] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 16 to 21, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 21 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:39.721391  5863 catalog_manager.cc:5697] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 10 to 12, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 12 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:39.741276 12130 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:39.747610 12130 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:39.750331  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:39.750797  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:39.751024  6642 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:26:39.751399  6113 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:39.767096  6642 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:39.768759  5861 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 310) took 10174 ms. Trace:
I20260709 12:26:39.791369  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:39.769189  5861 rpcz_store.cc:276] 0709 12:26:29.593955 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:29.594601 (+   646us) service_pool.cc:224] Handling call
0709 12:26:30.148461 (+553860us) spinlock_profiling.cc:243] Waited 8.54 ms on lock 0x7b5400002490. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df300b2 00007f4826ea9759 00007f4826e41a76 00007f4826e12d58 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc
0709 12:26:39.768692 (+9620231us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:39.640436 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:39.640942 (+   506us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:39.640979 (+    37us) write_op.cc:435] Acquired schema lock
0709 12:26:39.640996 (+    17us) tablet.cc:662] Decoding operations
0709 12:26:39.641471 (+   475us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:39.641540 (+    69us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:39.641566 (+    26us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:26:39.641864 (+   298us) tablet.cc:701] Row locks acquired
0709 12:26:39.641879 (+    15us) write_op.cc:260] PREPARE: finished
0709 12:26:39.642006 (+   127us) write_op.cc:270] Start()
0709 12:26:39.642110 (+   104us) write_op.cc:276] Timestamp: P: 1783599999641962 usec, L: 0
0709 12:26:39.642130 (+    20us) op_driver.cc:348] REPLICATION: starting
0709 12:26:39.644738 (+  2608us) log.cc:844] Serialized 1303 byte log entry
0709 12:26:39.646827 (+  2089us) op_driver.cc:464] REPLICATION: finished
0709 12:26:39.647291 (+   464us) write_op.cc:301] APPLY: starting
0709 12:26:39.647380 (+    89us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:39.649242 (+  1862us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:39.649340 (+    98us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:39.666769 (+ 17429us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:39.666936 (+   167us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:26:39.666978 (+    42us) write_op.cc:312] APPLY: finished
0709 12:26:39.667200 (+   222us) log.cc:844] Serialized 41 byte log entry
0709 12:26:39.667361 (+   161us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:39.667452 (+    91us) write_op.cc:454] Released schema lock
0709 12:26:39.667494 (+    42us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:39.667847 (+   353us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:39.667876 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":911820,"reported_tablets":47,"spinlock_wait_cycles":19640192,"child_traces":[["op",{"apply.queue_time_us":234,"apply.run_cpu_time_us":5087,"apply.run_wall_time_us":20519,"cfile_cache_hit":12,"cfile_cache_hit_bytes":12546,"num_ops":3,"prepare.queue_time_us":138,"prepare.run_cpu_time_us":2762,"prepare.run_wall_time_us":4586,"replication_time_us":4554}]]}
I20260709 12:26:39.792558 12130 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:39.793067 12130 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:39.793889 12130 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:39.860487  6113 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:39.902776  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:39.962064  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 138907us
W20260709 12:26:40.007217  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 49700us
I20260709 12:26:40.031934  5863 catalog_manager.cc:5697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 12 to 15, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 15 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.075742  5865 catalog_manager.cc:5697] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 14 to 19, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 19 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:40.077528  5865 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 10 to 12, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 12 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:26:40.091570  5866 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 207) took 11278 ms (client timeout 15000 ms). Trace:
W20260709 12:26:40.107098  5866 rpcz_store.cc:269] 0709 12:26:28.813103 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:28.814568 (+  1465us) service_pool.cc:224] Handling call
0709 12:26:40.091360 (+11276792us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":508573,"reported_tablets":37}
I20260709 12:26:40.113703  5865 catalog_manager.cc:5697] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 8 to 12. New cstate: current_term: 12 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:40.126171  5865 catalog_manager.cc:5697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 9 to 14, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 14 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.153755  5968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:26:40.154412  5968 raft_consensus.cc:606] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:40.157421  6642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38df61ba407240499023581d9f885037"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:26:40.158053  6642 raft_consensus.cc:606] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:40.158392  6642 raft_consensus.cc:614] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:40.163126  6642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:26:40.163792  6642 raft_consensus.cc:606] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:40.167104  5968 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:26:40.167711  5968 raft_consensus.cc:606] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:40.170842  6642 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ba1e2d6430774a629131a0953161507b"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:26:40.171476  6642 raft_consensus.cc:606] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:40.172724  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:26:40.174495  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:40.161280  5865 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 17 to 19, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 19 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.175268  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:40.178325  5865 catalog_manager.cc:5697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 13 to 15, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 15 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:40.187234  5865 catalog_manager.cc:5697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 12 to 15, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 15 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:40.188666  5865 catalog_manager.cc:5697] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 11 to 14, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 14 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:40.190059  6642 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:40.198617  6111 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:40.200430 12330 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:40.207544  6114 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:40.208061  5968 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:40.209736 11957 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:40.214599 12196 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:40.323590 12196 raft_consensus.cc:993] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:26:40.324232 12331 raft_consensus.cc:1081] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:26:40.340166 11957 raft_consensus.cc:2955] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Committing config change with OpId 14.12: config changed from index 8 to 12, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:40.343405  5968 raft_consensus.cc:2955] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 8 to 12, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:40.363483  6110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ba1e2d6430774a629131a0953161507b"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:42484
I20260709 12:26:40.364140  6110 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.364467  6110 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:40.367471  5865 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 322) took 1206 ms. Trace:
I20260709 12:26:40.369227 12299 raft_consensus.cc:993] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:26:40.369817 12299 raft_consensus.cc:1081] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:26:40.367915  5865 rpcz_store.cc:276] 0709 12:26:39.141257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:39.141498 (+   241us) service_pool.cc:224] Handling call
0709 12:26:40.347856 (+1206358us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:40.193947 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:40.194446 (+   499us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:40.194518 (+    72us) write_op.cc:435] Acquired schema lock
0709 12:26:40.194533 (+    15us) tablet.cc:662] Decoding operations
0709 12:26:40.195336 (+   803us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:40.195400 (+    64us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:40.195427 (+    27us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:26:40.196051 (+   624us) tablet.cc:701] Row locks acquired
0709 12:26:40.196070 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:26:40.196198 (+   128us) write_op.cc:270] Start()
0709 12:26:40.196305 (+   107us) write_op.cc:276] Timestamp: P: 1783600000196156 usec, L: 0
0709 12:26:40.196330 (+    25us) op_driver.cc:348] REPLICATION: starting
0709 12:26:40.196999 (+   669us) log.cc:844] Serialized 3194 byte log entry
0709 12:26:40.208613 (+ 11614us) op_driver.cc:464] REPLICATION: finished
0709 12:26:40.209626 (+  1013us) write_op.cc:301] APPLY: starting
0709 12:26:40.209712 (+    86us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:40.226283 (+ 16571us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:40.226391 (+   108us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:40.269438 (+ 43047us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:40.269629 (+   191us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:26:40.269671 (+    42us) write_op.cc:312] APPLY: finished
0709 12:26:40.269920 (+   249us) log.cc:844] Serialized 81 byte log entry
0709 12:26:40.273581 (+  3661us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:40.273713 (+   132us) write_op.cc:454] Released schema lock
0709 12:26:40.273760 (+    47us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:40.288579 (+ 14819us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:40.288608 (+    29us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":32597,"reported_tablets":38,"child_traces":[["op",{"apply.queue_time_us":807,"apply.run_cpu_time_us":10966,"apply.run_wall_time_us":78920,"cfile_cache_hit":32,"cfile_cache_hit_bytes":33456,"num_ops":8,"prepare.queue_time_us":95,"prepare.run_cpu_time_us":3356,"prepare.run_wall_time_us":14600,"replication_time_us":12101,"spinlock_wait_cycles":48384}]]}
I20260709 12:26:40.382313  6645 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:40.388011  6036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36266
I20260709 12:26:40.393628 11722 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:40.401100  5853 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet 7d1c158430bb487aa1d4c5a69165aa32 with cas_config_opid_index 8: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:26:40.385690  6110 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:40.403323  5863 catalog_manager.cc:5697] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 8 to 12, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New cstate: current_term: 14 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:40.417076  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:40.417682  5966 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:40.423985  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:40.424630  6642 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:40.424929  6642 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:40.425655  6642 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:40.427088  6642 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:40.434698  6642 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:40.435328  6110 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:40.439077  6084 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:40.440649  5966 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:40.450306  6025 tablet_service.cc:1558] Processing DeleteTablet for tablet 7d1c158430bb487aa1d4c5a69165aa32 with delete_type TABLET_DATA_TOMBSTONED (TS 0557a7246c8945b99e5215c99d4ddf9c not found in new config with opid_index 12) from {username='slave'} at 127.0.0.1:36246
I20260709 12:26:40.453550 12271 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:26:40.568611  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 139456us
I20260709 12:26:40.487612 12271 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:40.603108  6036 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.603579  6036 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:40.641004 12342 tablet_replica.cc:333] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:26:40.642601 12342 raft_consensus.cc:2243] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:26:40.697312  6036 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:40.715996  6036 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:40.732231  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:40.733016  5968 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:40.733366  5968 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:40.666570 12271 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:40.747146 12342 raft_consensus.cc:2272] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:26:40.758164 12196 raft_consensus.cc:993] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:26:40.734128  5968 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:40.767091  5968 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:40.768950  6118 raft_consensus.cc:2955] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Committing config change with OpId 14.12: config changed from index 8 to 12, VOTER 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) evicted. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:40.803025  5968 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
W20260709 12:26:40.807894  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 294699us
I20260709 12:26:40.825098  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:40.828341  6113 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:40.762157 12342 ts_tablet_manager.cc:1916] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:26:40.837692  6113 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
W20260709 12:26:40.843091  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:40.827976 12348 raft_consensus.cc:1081] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:26:40.892756  6044 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:26:40.893313  6044 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:40.893718  6044 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:40.895277 12342 ts_tablet_manager.cc:1929] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 14.11
I20260709 12:26:40.895839 12342 log.cc:1199] T 7d1c158430bb487aa1d4c5a69165aa32 P 0557a7246c8945b99e5215c99d4ddf9c: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/wals/7d1c158430bb487aa1d4c5a69165aa32
I20260709 12:26:40.903007  6044 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:40.912096  6044 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:40.923436  5861 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 16 to 17, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 17 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:40.942747  5851 catalog_manager.cc:5028] TS 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): tablet 7d1c158430bb487aa1d4c5a69165aa32 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
W20260709 12:26:40.986914  5851 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 80741.8us
I20260709 12:26:41.006811  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:41.007413  6650 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:41.007711  6650 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:41.008486  6650 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:41.009725  6650 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:41.013283 12360 raft_consensus.cc:993] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:26:41.013891 12360 raft_consensus.cc:1081] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:26:41.034291  6650 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:26:41.099017  6009 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:41.107611 12375 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:41.108247 12375 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:41.109176 12375 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:41.105932  6009 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:41.118134 12377 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:41.118860  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:41.120309  5959 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:41.121623 12377 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:41.126520 12377 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:41.145084  5959 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:26:41.146212  6036 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36266
I20260709 12:26:41.146871  6036 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:41.147251  6036 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:41.167199  6036 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:41.170271  6041 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:41.174975 12346 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:41.176388 12346 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:41.176756 12346 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:41.177579 12346 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:41.199090  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:41.202968  6110 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:41.198186  6036 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:41.204161  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:41.207671  5865 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 18 to 19, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 19 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:41.184367 12346 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:41.219270  6110 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:26:41.228053  6650 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:41.230024  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:41.230566 12353 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:26:41.284677  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 54740.7us
I20260709 12:26:41.295778 12328 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:26:41.888236 12378 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.660s	user 0.013s	sys 0.024s
I20260709 12:26:42.783838 12383 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:43.085336 12384 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:43.096136  5959 consensus_meta.cc:287] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 1.824s	user 0.026s	sys 0.009s
I20260709 12:26:43.132416  5959 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:26:43.103498 12387 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.099772 12385 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.107734 12390 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:26:43.133893 12378 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 1.903s	user 0.014s	sys 0.024s
I20260709 12:26:43.136734 12387 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.135293 12384 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.148705 12384 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.139082 12385 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.151178 12385 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:43.151705 12385 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.152191 12385 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.135483 12383 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.211555 12328 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:43.142894 12390 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.216420 12391 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:43.219873 12385 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.241438 12392 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.254232 12390 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:43.258814 12383 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:43.251627 12388 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.263007 12388 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.265688 12388 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:43.270996 12387 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.252485 12392 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.273610 12392 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.273860 12390 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:43.275341 12328 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.241539 12391 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.274436 12390 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.288491 12390 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:43.273630 12397 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.289883 12397 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.292165 12397 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:43.294294 12391 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.442708 12397 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:43.443306 12397 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.445371 12397 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:43.284091 12385 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:43.465018 12385 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.467450 12385 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.477276 12399 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:43.477443 12397 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.477942 12399 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.478274 12397 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.480284 12399 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.480747 12397 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:43.509925 12391 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.511490 12389 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.512120 12389 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.525123 12394 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.525593 12405 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.526064 12387 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.526175 12390 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.525873 12397 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.526221 12405 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.525673 12394 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.527182 12397 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.528962 12394 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.529109 12405 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.529597 12405 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.529762 12397 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.528977 12390 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.526474 12385 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:43.530443 12397 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:43.531167 12385 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.531394 12397 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.532307 12390 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:43.526621 12387 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.533306 12385 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.530049 12405 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.534309 12387 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:43.535509 12405 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.607995 12396 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.608222 12404 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.515547 12400 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.609033 12397 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:43.608930 12404 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.609345 12400 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.612200 12400 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:43.613880 12389 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.515718 12391 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.628129 12386 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.630438 12386 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.629552 12400 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.634853 12402 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:43.635252 12400 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.635972 12386 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:43.634930 12388 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.636718 12388 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.637404 12400 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:43.638314  5959 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 3306) took 2434 ms (client timeout 2033 ms). Trace:
I20260709 12:26:43.638724 12388 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:43.629333 12399 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.645352 12398 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:43.638753  5959 rpcz_store.cc:269] 0709 12:26:41.203800 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.203917 (+   117us) service_pool.cc:224] Handling call
0709 12:26:43.638077 (+2434160us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b5400260554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:43.638192 (+   115us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":155544960}
I20260709 12:26:43.628271 12392 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.654744 12407 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.655295 12407 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.656280 12393 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.656872 12393 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.658079 12389 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.647673 12402 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.661155 12397 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.645975 12398 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.633438 12387 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.673784 12387 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.650828 12390 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.651983 12405 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.665112 12383 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.665450 12401 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.665740 12391 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:43.665944 12395 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.667289 12389 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.652437 12392 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.669927 12402 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:43.663141 12407 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.670842 12404 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.608692 12396 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.647240 12385 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.671705 12394 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:43.663152 12388 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.652102 12403 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.681053 12383 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.678478 12401 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.687867 12395 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.692464 12384 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:43.680891 12390 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.693459 12392 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.694974 12387 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.695888  5861 catalog_manager.cc:5697] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 18 to 19, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 19 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:43.696619 12389 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.647296 12399 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.673401 12397 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.686746 12405 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.798676 12388 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.799872 12413 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:43.800498 12413 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.800930 12388 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:43.717659 12393 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:43.801846 12398 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:43.807796 12414 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:43.808030 12418 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:43.808382 12414 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.808529 12418 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.810580 12418 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:43.810606 12414 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:43.710183 12407 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.729455 12409 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:43.781514 12412 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.717255 12396 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.791131 12411 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.810873 12421 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:43.831127 12383 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.812004 12417 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:43.718559 12385 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.848775 12411 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.806632 12403 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.820084 12392 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.831341 12413 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:43.804947 12384 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:43.805140 12394 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.036866 12395 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:43.829741 12409 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.908134 12415 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:43.912439 12400 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:43.947562  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:43.823474 12407 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.040577 12400 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.970121  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:43.849825 12390 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.042280 12392 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:43.854605 12421 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.039201 12415 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.009310  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:43.832291 12414 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:44.041963  6651 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:43.947204  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:43.906384  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:44.050173  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.049674  6646 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:26:44.059682 12406 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:44.060343 12406 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.061563 12400 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:44.062150 12400 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:44.062355 12360 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:44.074764 12400 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.043568 12299 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:43.830118 12418 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.052547  6643 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:43.852888 12420 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:43.909286 12272 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:43.831691 12412 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.038100 12417 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.049214 12401 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:44.385746  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.648092  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:44.381862  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:44.660656  6643 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:44.116225  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.144776  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.052073 12413 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:44.654515  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:44.664980  6113 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:44.154826  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:44.664762  5934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.538s	user 0.001s	sys 0.019s
W20260709 12:26:44.668885  5934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.542s	user 0.001s	sys 0.019s
I20260709 12:26:44.145110 12395 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:44.293282  6672 debug-util.cc:398] Leaking SignalData structure 0x7b08002cba80 after lost signal to thread 4824
I20260709 12:26:44.159482 12357 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:44.157560 11722 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:44.198176 12404 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:44.324970 12388 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:44.379154 12383 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:44.689798  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:44.664626 12406 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.689970 12404 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.690025 12388 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.205690 12421 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.198446 12416 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:44.692165 12416 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.422405 12423 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:44.112821 12299 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.360849 12415 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.275389 12386 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:44.160352 12410 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:44.422968 12412 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.098366 12414 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.755481  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.755784  6113 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
W20260709 12:26:44.756572  6672 debug-util.cc:398] Leaking SignalData structure 0x7b080036e400 after lost signal to thread 5900
I20260709 12:26:44.406064 12328 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:44.152809 12393 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:44.126400 12398 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:44.662986 12400 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:44.291849 12402 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:44.831377  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.428195 12405 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.760421  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:44.745450  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:44.126945 12418 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:44.809165  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 137206us
I20260709 12:26:44.694597  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:44.661599 12403 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:44.113147 12360 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.819738  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:44.816582  6672 debug-util.cc:398] Leaking SignalData structure 0x7b080032e360 after lost signal to thread 5992
I20260709 12:26:44.842314  6113 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 22.
W20260709 12:26:44.843431  6672 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0de0 after lost signal to thread 6068
W20260709 12:26:44.843712  6672 debug-util.cc:398] Leaking SignalData structure 0x7b0800104e60 after lost signal to thread 6069
W20260709 12:26:44.844671  6672 debug-util.cc:398] Leaking SignalData structure 0x7b0800329e60 after lost signal to thread 6142
W20260709 12:26:44.845537  6672 debug-util.cc:398] Leaking SignalData structure 0x7b0800395c60 after lost signal to thread 6675
W20260709 12:26:44.845705  6672 debug-util.cc:398] Leaking SignalData structure 0x7b08002238e0 after lost signal to thread 6676
I20260709 12:26:44.421289 12272 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.693112 12388 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.833564  6040 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:26:44.836400  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:44.837589  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:44.804924 12415 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:44.812886 12406 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:44.809369 12408 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:44.862397  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:44.829898 12345 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:44.665959 12420 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.855803  6117 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:44.830682 12350 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.690294 12383 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.863232  6113 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:44.861330 12404 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.689818 11722 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.832258 12393 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.870226 11722 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.870414 12393 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.808117 12386 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.870760 12432 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:44.871429 12432 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.872391 12386 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.679713 12413 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.873011 12414 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:44.874385 12413 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:44.755074 12357 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.684811 12395 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.875212  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.875826  6643 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:44.876452  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.876742  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.877156  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.878019 12431 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:44.878269  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.878543 12417 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.878913  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.879323  6650 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:44.870705 12350 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.876618 12395 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.803735 12423 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.880882 12415 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.813474 12410 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.882939 12415 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.884541  6648 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:44.887702  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.832737 12409 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:44.865319  6006 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 2.033s (SENT) [suppressed 7 similar messages]
I20260709 12:26:44.830176 12328 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.907254  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:44.908058  6113 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:44.900990 12383 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.901420 12350 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.938840  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:44.883905 12408 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.940865 12350 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:44.941267 11722 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:44.941696 12408 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.927194 12357 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.837905 12402 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.942898 12328 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.941818 11722 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.944011 12402 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.839179 12398 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.918126 12268 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:44.944670  5966 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:44.945791 12398 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.890246 12431 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.946607  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:44.946897  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:44.947499  6109 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:26:44.948347  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:44.948909  6118 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:26:44.944705 11722 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.949806  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:44.912108  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.912458 12392 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.950523  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:44.912876 12360 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.914101 12299 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.950937  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:44.915963 12420 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.916098 12432 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.948266  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:44.952275  6111 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:44.916925 12346 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:44.917513 12418 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:44.918869 12435 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:44.950436  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:44.967940  6116 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:44.920554  5959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:26:44.925309  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.926206  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:44.970120  5963 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:44.926488 12356 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:44.927139  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:44.928403  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.928524  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.929641 12385 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:44.929906  6084 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:44.980854  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 51012.4us
I20260709 12:26:44.981271  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:44.930980 12397 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.931145  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:44.926350  5968 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:26:44.932365  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:44.983219  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 147181us
I20260709 12:26:44.932664 12423 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:26:44.933068 12407 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:44.889140 12345 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.933635 12411 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:44.934576  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.033819  6643 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 24.
I20260709 12:26:44.934995 12272 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.864850 12406 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.936537 12416 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:44.937150  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.918035 12355 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:44.944806 12268 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:44.955011  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:44.958958  6037 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:44.977120 11722 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.942221 12408 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:44.981552  6084 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:44.984687  5959 raft_consensus.cc:606] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:44.985132  5961 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 19 index: 11. (index mismatch)
I20260709 12:26:45.045450  6113 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
W20260709 12:26:45.047060  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 65612.5us
I20260709 12:26:44.980590  6647 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:26:44.986899  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:44.987249  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:44.987528  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.982031 12403 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:44.991305  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:44.991640 12424 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:44.994967 12350 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.996783  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:44.998190 12440 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:45.051605  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:44.999562  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:44.931221 12410 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:44.985991 12299 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:45.004246 12384 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.007588  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.009456  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.009928  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.011976  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.015376  6609 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:45.018824 12441 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:45.018901  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.019922 12399 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.020648  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.073724  5965 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:26:45.074781  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.021911  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.023577  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.023963  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.024073 12345 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.024217 12394 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:44.982769 12432 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:44.948304 12431 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.026875 12435 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:44.988014 12360 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:45.086661 12360 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.087574 12435 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.028402  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.028842  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.029600  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.029846  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.030634  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.030656  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.031250  6117 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:45.031908 12357 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:44.952935 12346 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.035540  6009 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:44.966985 12130 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:45.042240  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.051271 12403 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:44.988919 12356 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.091315  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.045658 11722 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.050071  6116 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:45.047982  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:45.003051 12442 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:45.144223 12424 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:45.144562 12442 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:45.145974 12394 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:45.146486 12394 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:45.146914 12442 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.052134  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.052253  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.148041  6113 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:45.068768 12299 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.093778 12432 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:45.146860 12394 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:45.070058 12408 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.048534 12355 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:45.053558 12411 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:45.071700 12350 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.072644 12441 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.075978  5967 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:26:45.054678  6644 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:45.085314  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.142709  6114 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:45.091185  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.150141  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:45.143543  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 108138us
I20260709 12:26:45.069505  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.097018  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.165335 11722 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.106006  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.163115  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.243824  5962 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:26:45.245955  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:45.043247  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 177949us
I20260709 12:26:45.148937  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.151995  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.152020  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.165691  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.248101  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.248529  6116 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:45.202761  6118 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:45.167965  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.253233  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.253921  5962 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:45.165625 12424 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:45.258903 12424 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:45.090373 12268 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.162935 12130 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.263726  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.078640 12440 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.262012  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.264431  5959 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:45.142076 12403 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:45.247020  5964 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:26:45.246708  5965 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:45.264364  5962 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:45.244302  6038 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:26:45.265663  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.247252  5966 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:45.270181  6117 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:45.206104  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.143500  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.283246  6109 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
W20260709 12:26:45.144268  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 96344.7us
I20260709 12:26:45.245528  6115 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:45.289717  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.290330  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.293609  6044 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:45.297405  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.298904  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:45.243505  5968 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:45.298888  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.304833  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.305066  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.287458  6084 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:45.264266 12130 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.088662 12360 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.101626 12406 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.305585  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.164111 12299 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.346138  5961 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:45.320384  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.318879  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.389885 12393 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.101s
I20260709 12:26:45.384310  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.488322  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.388984  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.306589  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:45.455837  5861 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 325) took 4203 ms. Trace:
W20260709 12:26:45.500924  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 270608us
I20260709 12:26:45.319197  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:45.499560  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 193039us
I20260709 12:26:45.505009  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:45.505066  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.305682  5963 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:45.506381  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:45.089311 12443 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:45.505425  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.246121 12411 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:45.498888  5932 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:45.259850 12356 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:45.509162  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 221784us
I20260709 12:26:45.258363 12432 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.507853  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:45.518524  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.319307  6609 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:45.511507  6109 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:26:45.522115  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:26:45.522302  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 203058us
I20260709 12:26:45.519367  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:45.523950  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.499682  5861 rpcz_store.cc:276] 0709 12:26:41.248273 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:41.248442 (+   169us) service_pool.cc:224] Handling call
0709 12:26:43.261600 (+2013158us) spinlock_profiling.cc:243] Waited 2.01 s on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:26:45.452039 (+2190439us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:44.160511 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:44.161154 (+   643us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:44.161195 (+    41us) write_op.cc:435] Acquired schema lock
0709 12:26:44.161214 (+    19us) tablet.cc:662] Decoding operations
0709 12:26:44.195632 (+ 34418us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:44.211912 (+ 16280us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:44.276600 (+ 64688us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:44.321197 (+ 44597us) tablet.cc:701] Row locks acquired
0709 12:26:44.325274 (+  4077us) write_op.cc:260] PREPARE: finished
0709 12:26:44.334919 (+  9645us) write_op.cc:270] Start()
0709 12:26:44.361243 (+ 26324us) write_op.cc:276] Timestamp: P: 1783600004328516 usec, L: 0
0709 12:26:44.375432 (+ 14189us) op_driver.cc:348] REPLICATION: starting
0709 12:26:44.406823 (+ 31391us) log.cc:844] Serialized 538 byte log entry
0709 12:26:45.067378 (+660555us) op_driver.cc:464] REPLICATION: finished
0709 12:26:45.400799 (+333421us) write_op.cc:301] APPLY: starting
0709 12:26:45.400898 (+    99us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:45.402070 (+  1172us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:45.402172 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:45.402908 (+   736us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:45.403102 (+   194us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:26:45.403147 (+    45us) write_op.cc:312] APPLY: finished
0709 12:26:45.403349 (+   202us) log.cc:844] Serialized 25 byte log entry
0709 12:26:45.403527 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:45.403614 (+    87us) write_op.cc:454] Released schema lock
0709 12:26:45.403654 (+    40us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:45.468855 (+ 65201us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:45.472633 (+  3778us) write_op.cc:454] Released schema lock
Metrics: {"reported_tablets":1,"spinlock_wait_cycles":4624375680,"child_traces":[["op",{"apply.queue_time_us":333155,"apply.run_cpu_time_us":3391,"apply.run_wall_time_us":51700,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":314941,"prepare.run_cpu_time_us":23485,"prepare.run_wall_time_us":565114,"raft.queue_time_us":164191,"raft.run_cpu_time_us":17638,"raft.run_wall_time_us":194133,"replication_time_us":691760,"thread_start_us":760925,"threads_started":4,"wal-append.queue_time_us":429082}]]}
I20260709 12:26:45.319180 12386 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:45.240057 12357 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:45.397820 12346 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.399893 12440 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.525532  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.526211  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.506486 12416 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:45.510577 12328 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:45.512672 12384 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:45.529003 12384 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:45.528333 12416 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:45.524750 12418 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:45.512552 12399 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:45.521695 12411 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:45.531687  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.527693  5965 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:45.529546 12416 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:45.530508 12418 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:45.524724 12415 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:45.530612 12384 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:45.528770 12328 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:45.529253 12355 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.523734 12360 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:45.510819 12443 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:45.527904 12386 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:45.547124  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:45.530311  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.533910  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.534101  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.501753 12424 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.535135  5968 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:26:45.531833 12399 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:45.533236 12415 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:45.539253  5964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:26:45.533185 12418 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:45.563784  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.573968  5964 raft_consensus.cc:606] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:45.565657 12357 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.554711 12386 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:45.567101  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.567849  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.569052  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.539667 12360 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:45.535485 12328 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:45.573076  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.574520  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.570657  5959 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:26:45.576730  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.578516  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.570194 12393 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:45.582847 12408 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.589355  6611 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:45.588778  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.576596  5967 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:45.540433 12443 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:45.584709  5964 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:26:45.602311  5964 raft_consensus.cc:606] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:45.599684  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.602787  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.599929  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.597848 12393 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:45.604753 12393 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:45.605324  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.573926 12399 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:45.611400  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.575471 12415 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:45.603180  6611 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:45.573563 12441 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.613649  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.616951  5960 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:45.619724  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.620146  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.619783  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:45.593530 12360 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:45.593729 12423 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:45.556583 12403 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.589206 12384 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:45.625949  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:45.628389  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:45.630064  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.637542  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.638633  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.637501  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.640224  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.643648  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.645087  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.630846 12444 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:26:45.648394  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 129065us
I20260709 12:26:45.649118  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:45.651386  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:45.651829  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 119341us
W20260709 12:26:45.652978  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 129339us
I20260709 12:26:45.654009  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.626480 12423 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.655825  6084 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:45.657121  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 135072us
I20260709 12:26:45.648298 12444 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:45.660506  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.652108 12455 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:45.665923  6081 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:45.661938  6611 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:45.658211 12421 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:45.660372 12444 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:45.676061 12421 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:45.676328  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.676556  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.678407  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.678957  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.679108 12415 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:45.692361 12415 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.692581  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.694738  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.696040  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.679879  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.680190  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.680555  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.702128  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.702322  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.681193  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.681807  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.682665  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.685793  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.661835 12452 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:45.690371 12459 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:45.690551 12458 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:26:45.716239  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 50392.2us
I20260709 12:26:45.714092  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.699434  5964 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
W20260709 12:26:45.718863  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 60626.9us
I20260709 12:26:45.721856  6009 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:45.722939  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.723661  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.685966 12421 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:45.727280  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.727782  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.728089  6643 raft_consensus.cc:2410] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 12.
I20260709 12:26:45.716586 12458 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:45.731508 12458 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:45.717445 12452 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:45.734745 12452 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:45.736416 12424 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.736917 12443 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.738713 12461 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:45.739202 12461 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:45.739573 12461 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:45.739840 12418 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.734756  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.683799 12416 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:45.726305  6081 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:45.745790  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 90038.9us
I20260709 12:26:45.746819  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.747570  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.748806  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.749922  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.747180  6084 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:45.752552 12443 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.719424 12384 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.745467 12393 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:45.772346 12393 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.745234 12328 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.754158  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.775595  6041 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:45.716923 12459 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:45.759714 12416 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.785017  6043 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:45.769680 12411 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.774740  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.755606  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.789196  6649 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:45.777503  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.778169  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:45.780411  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.781776  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.782492  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.783448  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.742255 12418 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:45.784842  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:45.766932 12423 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.785749  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.785756  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:45.804904  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:45.786398  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:45.806219  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 59098.3us
I20260709 12:26:45.806401  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:45.807861  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:45.809226  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:45.810333  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:45.805811  6608 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:45.718851 12462 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:45.787109  5962 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:45.795280 12411 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.796392 12360 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:45.813387 12462 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:45.813828 12462 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:45.787016 12459 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:45.817482  5961 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:45.817832  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.798887 12421 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.799041 12452 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.799223 12386 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.776690 12328 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.800544 12403 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.803910 12444 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.850718 12467 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:45.851202 12467 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:45.851554 12467 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:45.852061 12444 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.839918 12421 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.818627  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:45.825045  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.826864  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.857206 12462 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.827950  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.829401  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:45.859041 12394 consensus_meta.cc:287] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.552s	user 0.004s	sys 0.006s
I20260709 12:26:45.830082  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.859545 12394 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.830732  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:45.831344  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 44085.8us
I20260709 12:26:45.862596 12408 raft_consensus.cc:993] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:26:45.863173  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:45.833366  6608 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:45.863725 12441 raft_consensus.cc:993] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:26:45.864163 12441 raft_consensus.cc:1081] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:26:45.864500  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:45.865325 12423 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:45.820282 12457 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:45.834395  6113 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:45.822679 12418 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:45.891449  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 211190us
I20260709 12:26:45.847430 12458 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:45.848367 12403 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:45.863343 12440 raft_consensus.cc:1081] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:26:45.865636  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:45.864077 12460 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:45.839862 12386 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.866124  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:45.894057  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 117463us
I20260709 12:26:45.895358  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.896418  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.838606 12411 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:45.822365 12360 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:45.861636 12394 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.862200 12452 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.901875  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:45.902402  6115 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:45.866127 12457 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:45.908648  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 96947.9us
I20260709 12:26:45.899428  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:45.903913  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 177348us
I20260709 12:26:45.899453  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:45.917624  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 52057.4us
I20260709 12:26:45.899533 12403 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:45.892459 12461 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:45.902417 12411 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:45.909456  6084 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:45.904043 12272 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:45.917356  6110 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:26:45.921706  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:45.919479  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:45.919911  6647 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:26:45.892705 12399 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.917305 12457 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:45.943464  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:45.925105  6043 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:45.948536  6647 raft_consensus.cc:606] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:45.943087  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:45.954223  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 44863.6us
I20260709 12:26:45.988440 11722 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:45.920571 12418 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:45.994499 12463 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:45.994978 12463 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:45.995332 12463 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:45.996762 12462 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:45.938771 12458 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:45.992734 12464 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:46.000309 12464 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:46.000772 12464 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:45.940601 12461 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:46.004480 12467 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.924132 12272 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.010664 12272 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:46.012053  5934 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.015859 12467 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:46.019426  5934 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.020407 12299 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.021014 12130 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:46.021370  5934 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.022132 11722 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:46.022593  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.023324 11722 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:46.023736  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.024492 12299 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:46.025098 12457 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.025123  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.030505 12463 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.925239 12411 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:46.056322  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 232981us
I20260709 12:26:46.054805  5934 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.033156  6043 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:45.923048 12403 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:45.989312  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 69905.9us
I20260709 12:26:46.058516 11722 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:46.057183  6006 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:46.061144  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:46.031335 12464 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:45.927299 12408 raft_consensus.cc:993] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
W20260709 12:26:46.043058  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 318056us
I20260709 12:26:46.071012  6651 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
W20260709 12:26:46.048707  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 56624.6us
I20260709 12:26:46.063488  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.065004  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.066871  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.072036 11722 raft_consensus.cc:1081] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:26:46.073378  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:46.074728  5934 consensus_peers.cc:597] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: a0b00ef9114f441baff2557bc164b4d7. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:46.075495  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.056351 12299 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:46.070634 12461 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:46.078159 12461 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:46.078562 12461 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:46.079566 12464 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:46.081681  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:46.071785 12393 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.011s
I20260709 12:26:46.082638 12463 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:46.083339  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:46.084123  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 162166us
I20260709 12:26:46.087405  6084 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.088752  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.089079  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.073303  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.091818  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:46.092913  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:45.942296 12459 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:46.097764  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.097980  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.096261  6644 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:46.097944  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.033890 12272 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.101056 11722 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:46.098893 12299 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.103744  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.104974  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.105504  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.108017 12458 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:46.108462 12458 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.108608 12299 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:46.103933 12468 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.007s
I20260709 12:26:46.113929 12457 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:46.114856 12299 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:46.116197 12399 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:46.117714  6084 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.118542 12473 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:46.119016 12473 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:46.119359 12473 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:46.120504 12465 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.121696 12464 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.121834 12465 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:46.122668 12328 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:46.123097 12328 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:46.123605 12328 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:46.122942 12471 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:46.124498 12471 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:46.124833 12471 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:46.125619 12471 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.117144 12403 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.126590 12476 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:46.126888  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:46.128155  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:46.128407 12403 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:46.128702  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:46.129478  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:46.129912  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:46.130615  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.127077 12476 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:46.131188  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.131742 12476 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:46.134599 12458 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:46.138612  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.139562 12468 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:46.137502  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:46.140090 12459 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:46.138761  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 66762.5us
I20260709 12:26:46.141956 12299 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:46.142433 12299 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:46.142519 12424 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:46.143095 12299 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:46.141870  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.149147 12424 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:46.149670 12424 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:46.152011  6082 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.154264  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.155304 12464 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:46.156098 12464 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:46.157485 12464 raft_consensus.cc:3055] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:26:46.158396  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 232880us
I20260709 12:26:46.159619  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.106302  6009 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:46.157816 12464 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:46.161056  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.162283 12464 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.163743 12464 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:46.162670  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:46.166273  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 60030.2us
I20260709 12:26:46.167027  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:46.167285  6082 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.168120  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.169741  6110 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:26:46.170308  6110 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:46.170707  6110 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:46.172274  6111 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:46.173190  6109 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:26:46.150239 12424 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:46.173807  6109 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:46.169186  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:46.174643  6109 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:46.175479  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.176143  5962 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 20: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:46.175288  5934 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:46.176921 11722 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:46.177312 11722 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:46.178227 11722 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:46.175803 12384 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:46.179673 12384 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:46.180070 12393 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:46.180524 12393 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:46.180944 12393 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:46.181171 12457 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:46.182278 12443 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:46.182690 12443 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:46.183782  6117 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:26:46.183490 12443 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.180411 12272 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:46.179741 12386 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
W20260709 12:26:46.184784  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 84606.7us
I20260709 12:26:46.186512  6609 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:46.187392 12328 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.173949 12454 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:46.184221  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 9 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.187640  6117 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:46.188761  6117 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:46.189272  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:46.179996  6081 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.190251  6009 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:46.190117  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:46.177363  6082 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.191464  6009 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:46.188293 12454 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:46.192494 12415 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:46.180087 12384 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:46.187590 12478 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:46.193604 12386 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:46.193981 12386 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:46.176697 12468 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.194335 12386 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:46.196298 12443 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:46.156075 12471 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:46.199955 12415 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:46.200429 12415 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:46.202690 12453 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:46.203193 12453 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:46.204134 12453 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.205371 12453 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:46.207146 12478 raft_consensus.cc:697] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:46.208139 12478 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.209441 12328 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:46.211196  6109 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.213189  6109 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:46.192642 12454 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:46.218781  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.220705 12459 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:26:46.222982  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.177559  5934 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:46.223134  6110 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.223191  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:46.275758  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52862.1us
W20260709 12:26:46.224005  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 46513.8us
I20260709 12:26:46.280728  6112 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: []
W20260709 12:26:46.238405  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 48398.7us
I20260709 12:26:46.283262  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:46.229858  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.232393  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 12:26:46.222342  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45057.7us
W20260709 12:26:46.285109  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 61992.4us
I20260709 12:26:46.225587  6043 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:46.286643  6082 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.247658 12415 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.224254 12399 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:46.229478 12299 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.238238 12416 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:46.289414 12468 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:46.289674 12416 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:46.289829  5965 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:46.290181 12416 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:46.290645 12415 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:46.269908  6117 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.286958 12346 consensus_queue.cc:1059] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:46.238197 12461 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.292447 12346 raft_consensus.cc:3055] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:46.292796 12346 raft_consensus.cc:740] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:46.293455 12461 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:46.224422 12272 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:46.293639 12346 consensus_queue.cc:260] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.294301 12272 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:46.294755 12272 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:46.294991 12346 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:46.255095  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.224381 12328 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:46.299377 12328 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:46.299782 12328 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:46.300086  6117 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:46.298918 12457 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:46.289134 12473 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.275338 12384 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.301307  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.302786  6648 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:46.303627 12473 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:46.259953 12458 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.307577 12458 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:46.287057  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:46.308938  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:46.315192 11722 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.255986 12454 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.279953  6009 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:46.291242 12415 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:46.232088 12411 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.250917 12393 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.316359 12415 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:46.316809 12415 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:46.319327  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.320281 12393 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:46.320955 12393 raft_consensus.cc:2764] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election decision vote started in defunct term 9: won
I20260709 12:26:46.321225  6109 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:46.321586 12393 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.224107 12403 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:26:46.299055  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 44039.4us
I20260709 12:26:46.312763 12457 consensus_queue.cc:1059] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 11.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:46.322741  6112 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:46.323133 12457 raft_consensus.cc:3055] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:46.323619 12457 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:46.325556  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.327958 12454 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:46.328902  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.330233  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:46.313421  6110 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:46.314769  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.275727 12482 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:46.331830  6117 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 20: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:46.325038  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.325006 12457 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.325913 12408 consensus_queue.cc:1059] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:26:46.309561  6648 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:46.343092 11722 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:46.311339 12384 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:46.333141  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.259953 12386 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.346033  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.350373  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.343576  6115 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:26:46.286696  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.352258  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.346601  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:46.351689  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 65119.9us
I20260709 12:26:46.353379  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.347680  6084 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:46.349261  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.353698  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:46.354823  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.360023 12130 raft_consensus.cc:3055] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:46.360570 12130 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:46.361491 12130 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.363104 12457 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:46.363834 12411 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:46.364740 12476 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.360244 12416 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.366010 12478 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:46.366703 12478 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:46.367067 12478 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:46.344467 12475 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.369946 12440 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 22.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:46.371141 12440 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:26:46.371500 12440 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:46.371747 12424 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.372313 12440 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.373579 12440 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:46.373996  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.376070  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.376718  6113 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:46.382911  6646 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:26:46.386612 12386 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:46.381877 12399 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:46.362064 12415 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.392143  6043 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:46.344419 12346 consensus_queue.cc:1059] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.046s
W20260709 12:26:46.396978  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 110335us
I20260709 12:26:46.397792 12130 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:46.397940 12458 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:46.400120 12272 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.402755  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.407861  6042 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:46.401631  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.403723  6648 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:46.404099  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.405192  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.405243  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.406316  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:46.382401 12471 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:46.391569 12416 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:46.414307  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.415005  6035 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10. Ops: []
I20260709 12:26:46.415967  6110 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:26:46.416695 12459 consensus_queue.cc:1059] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:46.418025 12424 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:46.418726 12476 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:46.419250 12346 raft_consensus.cc:3055] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:46.419656 12346 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:46.420501 12346 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.407233  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.409909  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.410622  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.428001 12328 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.400717 12408 raft_consensus.cc:2955] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:26:46.423456 12415 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:46.429466 11722 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:46.429966 11722 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.431892 11722 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:46.423622  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.436343  6642 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:46.422152 12346 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:46.423276 12299 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:46.438648  6113 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:46.439813  6041 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:46.439334  6035 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:46.400785 12478 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.440907 12328 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:46.443964  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.453199  6113 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:46.453544  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.454578  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.455233  6110 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:46.455369  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.445616  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.446295  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.446918  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.456552  6115 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 20: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:46.407177 12399 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:46.442909 12403 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:46.449950  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:46.451542  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.422052 12272 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:46.460582  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.443133 12423 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:46.461690  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.464365  6110 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:26:46.467325  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.468665  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.465629  5934 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:46.470726  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.471886  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.470038  5934 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:46.477864 12272 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:46.479173 12272 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:46.479442 12471 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.468331 12464 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.477676 12458 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:46.480033 12272 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.487156 12458 consensus_queue.cc:1059] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:46.488255 12458 raft_consensus.cc:3055] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:46.488601 12458 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:46.489339 12458 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.490211  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.472497 12423 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.492568 12423 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:46.492722  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.494289  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.494803  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.495882  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.496093 12299 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:46.496649 12299 raft_consensus.cc:697] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:46.497236  6036 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:46.497488 12299 consensus_queue.cc:237] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.498270  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.498816  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.499576 12399 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 15.16, Last appended by leader: 16, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.500468  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.501551  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:46.502247  6041 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:46.503772  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.504150  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.505342  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.506448  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.507305  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.509691  6110 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:26:46.489163 12403 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.510772  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.516103  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.517153  5961 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 20: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:46.512642  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.518047  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 16 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.513808  6040 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23. Ops: []
I20260709 12:26:46.518685  5962 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:46.519023  5962 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:26:46.510790  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 227682us
I20260709 12:26:46.503916 12469 raft_consensus.cc:3055] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:26:46.512986  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.519590 11722 consensus_queue.cc:1059] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:46.521483  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:46.523766  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 57594.1us
I20260709 12:26:46.525731  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.518263 12478 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:46.534588  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:46.534734  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:46.535130  6035 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:46.535036 12459 consensus_queue.cc:1059] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:46.536172 12457 raft_consensus.cc:3055] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:46.536578 12457 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:46.537436 12457 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.539021  6044 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:46.539875  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.541252  6040 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:46.541962  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.544911  6043 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:46.545190  6039 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:46.541160 11722 consensus_queue.cc:1243] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer 24012af7747d4c4ea89c3da2ff950099 log is divergent from this leader: its last log entry 10.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:26:46.547887  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:46.548555  5967 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:46.551076  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.552604  6038 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:46.552917  6037 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:46.543713  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:46.555182  6042 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 24. Current term is 25. Ops: []
I20260709 12:26:46.557430  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:46.560678  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:46.560678  5861 catalog_manager.cc:5697] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 9 to 10, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 10 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:46.563030  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.563349 11722 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:46.553751  5962 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 15.16, Last appended by leader: 16, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.564751  6642 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:46.564813  6006 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.565210  5962 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:46.517429 12458 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:46.521958 12469 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:46.572453  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.559027 12360 raft_consensus.cc:3055] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Stepping down as leader of term 9
I20260709 12:26:46.583408  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:46.582099  5967 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:26:46.567057 12457 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:46.573036 12360 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:46.568953 12424 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:46.566941 12461 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:46.576423 12418 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:46.568487 12384 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:46.596328  5966 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 23.
I20260709 12:26:46.609684  6116 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:46.609004  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:46.612603  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.612823  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.616290  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.617031  5932 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:46.618099  6642 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 19. Current term is 20. Ops: []
I20260709 12:26:46.573609 12421 consensus_queue.cc:1059] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.038s
I20260709 12:26:46.624848  5932 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:46.628072  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.630398 11722 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:46.633448  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:46.633540  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.634780  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.635497  6042 raft_consensus.cc:2393] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 18: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:46.636117  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:46.636878  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.633495  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.637872  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:46.636025  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.640980  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.641228  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.641842  6038 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:46.636488  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.641004  6642 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:46.644403  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:46.644330  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:46.646924  6110 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 16: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:46.654786  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.610006 12384 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:46.660879  6009 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.662266 11722 consensus_queue.cc:1059] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:46.667145  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.669463  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.669627  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:46.670715  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:46.671036  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:46.671079  6082 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.672572  6036 raft_consensus.cc:2393] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 14: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:46.628197 12464 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:46.673326  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.660849  6115 raft_consensus.cc:2955] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
W20260709 12:26:46.677085  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 47111.3us
I20260709 12:26:46.631444 12476 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:46.631528 12130 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:46.675087  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.677865  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:46.678045  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:46.685694  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:46.673740  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.642411 12469 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.678396  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.673179  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.680624 12464 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:46.702507 12464 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 22.13, Last appended by leader: 13, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.692016 12468 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:46.692404 12469 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:46.686935  6037 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 17: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:46.686947  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:46.687965  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:46.696316  6040 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:46.693181 12440 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:46.631001 12473 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 12:26:46.693333 12454 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:46.707656 12454 raft_consensus.cc:697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:46.708595 12454 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.686336 12408 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48350 (request call id 1) took 1732 ms. Trace:
I20260709 12:26:46.681643 12328 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:26:46.710835 12408 rpcz_store.cc:276] 0709 12:26:44.942604 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:44.943015 (+   411us) service_pool.cc:224] Handling call
0709 12:26:44.966968 (+ 23953us) log.cc:844] Serialized 499 byte log entry
0709 12:26:45.091412 (+124444us) spinlock_profiling.cc:243] Waited 7.96 ms on lock 0x7b54000c5920. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fcd142 00007f4820fadeaa 00007f4820fb4d53 00007f4820fb4cd9 00007f4820fb4c69 00007f4820fb4c31 00007f4820fb3dfd 0000000000388634 0000000000388479 00007f481df67475
0709 12:26:45.146654 (+ 55242us) spinlock_profiling.cc:243] Waited 2.58 ms on lock 0x7b18001ec720. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821090d01 00007f4820fcd691 00007f4820fadeaa 00007f4820fb4d53 00007f4820fb4cd9 00007f4820fb4c69 00007f4820fb4c31 00007f4820fb3dfd 0000000000388634 0000000000388479
0709 12:26:46.672906 (+1526252us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":26491,"raft.run_cpu_time_us":4991,"raft.run_wall_time_us":96593,"spinlock_wait_cycles":24246912,"thread_start_us":85799,"threads_started":1,"wal-append.queue_time_us":196930,"wal-append.run_cpu_time_us":1610,"wal-append.run_wall_time_us":1001628}
I20260709 12:26:46.714428  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.715925  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.716987  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.688129 12272 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:46.718600 12478 consensus_queue.cc:1059] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:46.693102 12403 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:46.719692 12420 raft_consensus.cc:3055] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:46.720171 12420 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:46.721031 12420 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.722163 12420 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:46.687191 12357 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:46.724385  6040 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
I20260709 12:26:46.693747  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.732280  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.732389  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:46.706590 12484 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:46.734355  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:46.672436 12384 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:46.728245  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:46.691088  5866 catalog_manager.cc:5697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 18 to 19, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 19 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:26:46.733198  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.737426  6044 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 23: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:46.733906  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:46.730880  6109 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:26:46.740525  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.741613  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.742383  6113 raft_consensus.cc:2393] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:46.742633  6110 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:46.744050  6109 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:46.744542  6112 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:46.740780  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.746603  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.757156  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:46.759148  6043 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:46.762218  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.729609 12421 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:46.746110  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:46.753268  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:46.753537  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 65653.6us
I20260709 12:26:46.763195  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:46.783016  6042 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:46.785789  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:46.734242  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 96476.8us
I20260709 12:26:46.770241  6082 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.730688 12357 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:26:46.790700  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.791592  6040 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 14: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:46.792659  5932 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.733978 12424 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:46.734786 12411 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:46.749922 12459 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:46.744802 12403 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:46.751230 12484 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:46.797271  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:46.746726 12476 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:26:46.673074 12360 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 9.10, Last appended by leader: 10, Current term: 9, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.745456 12393 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.053s
I20260709 12:26:46.813789  6042 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:46.809824  5965 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:46.746433 12482 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:46.744670 12461 consensus_queue.cc:1059] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.054s
I20260709 12:26:46.785105 12492 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:26:46.746558 12478 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.056s
I20260709 12:26:46.750762 12386 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.053s
I20260709 12:26:46.798147 12440 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:46.808173  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.801990 12462 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:46.827311 12461 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:46.814162 12299 consensus_queue.cc:1059] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 9.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.014s
I20260709 12:26:46.827804 12461 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:46.828662 12461 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.829952 12461 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:46.833349 12495 consensus_queue.cc:1059] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:26:46.835336  6611 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:46.836951 12423 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.836894  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.838186 12423 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.838398  6611 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:46.839201 12423 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:46.839052 12484 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.839730 12423 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:46.840624 12423 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.838542 12424 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:46.843705 12424 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:46.844739 12424 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.845146  6611 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.846184 12457 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.847832  6611 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.852102 12418 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.854701 12468 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:46.855240 12468 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:46.858115 12418 consensus_queue.cc:1059] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:46.859143 12416 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:46.859586 12416 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:46.859625 12478 raft_consensus.cc:3055] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:46.860101 12478 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:46.860541 12416 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.860888 12478 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.861831 12416 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:46.852257 12475 raft_consensus.cc:3055] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:46.862887 12475 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:46.863852 12475 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.865396 12475 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:46.871542 12495 raft_consensus.cc:3055] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:46.872092 12495 raft_consensus.cc:740] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:46.873158 12495 consensus_queue.cc:260] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.873867 12360 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:46.874732 12495 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:46.880127 12478 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:46.833390 12384 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.888846  6044 raft_consensus.cc:1240] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:46.889959 12384 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:46.890811 12399 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
W20260709 12:26:46.891927  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 83803.8us
I20260709 12:26:46.893783  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:46.898267  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:46.899339  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:46.900914  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:46.901830 12479 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.279s	user 0.027s	sys 0.013s
I20260709 12:26:46.902001 12418 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:46.902745 12497 raft_consensus.cc:993] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:26:46.846133 12424 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:46.903227 12443 raft_consensus.cc:1081] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:26:46.901973 12399 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:46.912436 12464 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:26:46.899088 12490 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.004s
I20260709 12:26:46.913955 12418 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:46.899879 12500 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.069s	user 0.000s	sys 0.005s
I20260709 12:26:46.798022 12421 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:46.762554 12328 consensus_queue.cc:1059] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:26:46.804312 12459 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:46.924588 12459 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.925727 12459 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:46.927219 12468 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:46.803440 12408 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:46.817301 12357 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:46.822634 12487 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.139s	user 0.001s	sys 0.000s
I20260709 12:26:46.929837 12357 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:46.900029 12488 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.085s	user 0.005s	sys 0.000s
I20260709 12:26:46.932097 12468 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:46.923236 12421 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.935084 12501 raft_consensus.cc:3055] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:46.935562 12501 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:46.936326 12501 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:46.919941 12457 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:46.938923 12457 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:46.939107 12501 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:46.939990 12457 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:46.799209  5932 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:46.969918  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 322847us
W20260709 12:26:46.972528  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 173274us
I20260709 12:26:46.974057  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:46.977886  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:46.986652  5966 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 9 index: 10. Preceding OpId from leader: term: 10 index: 11. (index mismatch)
W20260709 12:26:46.995217  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:46.815121  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 89078.6us
I20260709 12:26:46.999459  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:47.011788  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:47.015686 11722 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:47.019054 12130 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:47.026111 12130 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:47.027452  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.028904 12130 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:26:47.031112  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50330.5us
I20260709 12:26:47.024318 11722 consensus_queue.cc:1059] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.006s
I20260709 12:26:47.031898 12130 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:47.034008 12130 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:47.041047 12393 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election lost for term 11. Reason: could not achieve majority
I20260709 12:26:46.918751  6082 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:47.048398  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 136157us
I20260709 12:26:47.053297  6115 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:47.054176 12476 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:47.055565 12476 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:47.057089 12482 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:47.057596 12482 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:47.059088 12468 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:47.062418 12506 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:26:47.064167  6651 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 16. Preceding OpId from leader: term: 16 index: 17. (index mismatch)
I20260709 12:26:47.064641 12474 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:26:47.067018  5962 consensus_meta.cc:287] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.501s	user 0.014s	sys 0.014s
I20260709 12:26:47.067610  5962 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
W20260709 12:26:47.070555 12499 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.125s	user 0.000s	sys 0.000s
I20260709 12:26:47.071097 12464 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.001s
I20260709 12:26:47.077759 12399 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:47.050287  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:47.082995  6116 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:47.084239  6648 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:47.085311  6115 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:47.085932 12399 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:47.059172 12482 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:47.096606 12482 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:26:47.096745  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.105324 12493 raft_consensus.cc:3055] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:47.105885 12493 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:47.107399 12493 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:47.109095 12493 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:47.119041 12496 consensus_queue.cc:1059] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:47.121049 12496 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:47.127594 12440 raft_consensus.cc:3055] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:47.128317 12440 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:47.126246 12492 raft_consensus.cc:3055] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:47.131579 12492 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:47.133204 12492 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:47.108037  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:47.136575 11722 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:47.140300 12357 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:47.143059 12130 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:47.144158  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 59493us
I20260709 12:26:47.163235 12508 ts_tablet_manager.cc:933] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:26:47.162003 11722 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:26:47.129824 12440 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
W20260709 12:26:47.169278  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:47.172021  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.177417  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:47.171800 12496 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:47.187793 12440 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:47.194195 12492 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:47.194731 12130 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:47.198895  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 91121.7us
I20260709 12:26:47.219498  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:47.199846  6082 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:47.202867 12468 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:47.203665 12399 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:47.223922 12357 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:47.240034 12468 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:26:47.243851  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 44240us
I20260709 12:26:47.244786  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:47.247208  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:47.248445 12468 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:47.249310 12458 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:47.249670  5932 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:47.258222 11722 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:47.259342  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:47.267527  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 255911us
I20260709 12:26:47.271579  6044 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:47.275313  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:47.276438 12462 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:47.259616 12508 tablet_copy_client.cc:323] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.65:42981
I20260709 12:26:47.285554  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:47.285691  5863 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 15 to 16, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 16 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.290185 12501 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:47.293155  6082 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:47.294118 12462 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:47.294840  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:47.287287  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:47.298700  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 49218.2us
I20260709 12:26:47.300756 12468 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:47.305073  6042 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:47.306957  5932 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:47.309405  5932 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:47.309768 12130 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:47.316285  5978 tablet_copy_service.cc:140] P f1bb8e63c2b448cdafd51f05d277c741: Received BeginTabletCopySession request for tablet a0b00ef9114f441baff2557bc164b4d7 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:37174)
I20260709 12:26:47.317025  5978 tablet_copy_service.cc:161] P f1bb8e63c2b448cdafd51f05d277c741: Beginning new tablet copy session on tablet a0b00ef9114f441baff2557bc164b4d7 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:37174: session id = 24012af7747d4c4ea89c3da2ff950099-a0b00ef9114f441baff2557bc164b4d7
I20260709 12:26:47.322089 12501 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:26:47.339607  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52479.6us
I20260709 12:26:47.341012  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:47.342617 12501 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
W20260709 12:26:47.351058  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 56275us
I20260709 12:26:47.352174  6082 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:47.353196 12468 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:47.354727  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:47.358672 12468 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:47.355479 12493 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:47.364362 12501 consensus_queue.cc:1059] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:47.365636 12501 raft_consensus.cc:3055] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:47.366104 12501 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:47.353144  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 43914.8us
I20260709 12:26:47.368955  6042 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:47.358271  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:47.358700 12458 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:47.384749 12468 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:47.385882  5978 tablet_copy_source_session.cc:215] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:47.391249 12495 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 12:26:47.397039  5863 catalog_manager.cc:5697] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 22 to 23, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 23 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.399384 12501 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.401086 12501 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:47.400069  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:47.410126  6040 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:26:47.411680  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.412683  6643 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:26:47.415207 12459 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:47.412184  5866 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 19 to 20, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 20 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.381980 12462 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:47.418975  5863 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index -1 to 11, term changed from 17 to 18, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to <none>, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 18 committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:26:47.425304  5863 catalog_manager.cc:5697] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 17 to 18, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 18 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:47.423202  5866 catalog_manager.cc:5697] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 19 to 20, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 20 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.428185 12508 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a0b00ef9114f441baff2557bc164b4d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:47.432049  5866 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 17 to 18, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 18 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:47.440116  5962 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:26:47.448386  6009 consensus_peers.cc:597] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e3ef3cb064eb4a1597f89e040fce3c7e. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:47.449347 12424 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.005s
I20260709 12:26:47.449837  6643 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:47.450852 12458 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:47.457171 12478 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:47.458993 12440 consensus_queue.cc:1059] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:47.459463 11722 consensus_queue.cc:1059] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 10.7, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260709 12:26:47.459741 12492 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:47.460408 11722 raft_consensus.cc:3055] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:47.460758 11722 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:47.461640 11722 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:47.463449 12408 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:26:47.463891 12408 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:47.464921 12408 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:47.467589 12357 raft_consensus.cc:3055] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:47.467989 12357 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:47.469039 12357 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:47.470918 12408 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:47.471765 12357 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:47.493788 12511 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:47.494764 11722 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:47.495165 12511 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:47.495594 12511 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:47.496553  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 96631.2us
I20260709 12:26:47.498068 12462 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:47.499433 12492 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:47.502310 12462 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:47.502981 12462 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:47.503244 12511 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.504581 12511 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:47.504272 12462 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:47.505570 12462 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:47.511876 12468 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:26:47.517051  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.517639 12458 raft_consensus.cc:3055] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:47.518085 12458 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:47.519205 12458 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:47.522058 12440 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:47.522540 12440 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:26:47.545874  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.546552  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:47.557096  5865 catalog_manager.cc:5697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 11 to 12, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 12 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.557835 12424 consensus_queue.cc:1059] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.002s
I20260709 12:26:47.560297 12328 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:47.535516 12493 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.011s
I20260709 12:26:47.536110 12468 consensus_queue.cc:1059] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.011s
I20260709 12:26:47.556774 12501 consensus_queue.cc:1059] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:26:47.556010  5861 catalog_manager.cc:5697] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 12 to 13, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 13 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.560670 12328 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:47.562359 12440 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:47.570679  5865 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 12 to 13, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 13 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:47.569566 12130 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:26:47.599709  5962 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:47.600530  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:47.601204  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.572858  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:47.642069  6044 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:26:47.634369  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:47.650764 12528 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.101s	user 0.001s	sys 0.000s
W20260709 12:26:47.650596  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 104222us
I20260709 12:26:47.657418  6040 raft_consensus.cc:2393] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 18: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:47.664253  5962 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:47.634599 12328 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.663288  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:47.672555 12493 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.692780 12420 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:47.668776 12478 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:26:47.693300 12420 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.696277  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:47.695765  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 87375.3us
I20260709 12:26:47.689519 12464 raft_consensus.cc:3055] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:47.690066 12130 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:47.701650  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.695573 12458 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:47.705950  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45730.8us
I20260709 12:26:47.706849  6115 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:47.707115  6112 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: []
W20260709 12:26:47.707918  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.710011 12420 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:47.712195 12526 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.147s	user 0.002s	sys 0.002s
I20260709 12:26:47.712256 12328 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:47.700780 12464 raft_consensus.cc:740] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:47.692451 12493 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.719132 12464 consensus_queue.cc:260] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:47.722201  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:47.720434 12464 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:47.777657  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.721268 12482 raft_consensus.cc:3055] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:47.780972  6111 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:47.783864  6116 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:47.785869  6112 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:47.794230  6042 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:47.800190  5962 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:47.802541  6116 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:26:47.810755 12492 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:26:47.811204 12492 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:47.812129 12492 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.813561 12492 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:47.782740 12482 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:47.815160  6112 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:47.815915 12482 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:47.817147 12482 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:47.818722  6111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:42484
I20260709 12:26:47.819384  6111 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:47.819720  6111 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:47.825153 12440 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:47.827564  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.830797  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:47.832175  6040 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 24. Current term is 25. Ops: []
I20260709 12:26:47.836483  5968 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 16. Preceding OpId from leader: term: 16 index: 17. (index mismatch)
I20260709 12:26:47.839354  5968 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 22 index: 13. Preceding OpId from leader: term: 23 index: 14. (index mismatch)
I20260709 12:26:47.842264  6111 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.846812  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:47.848039  6111 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:47.848389  5965 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:47.852394  6117 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:47.852536  6116 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
W20260709 12:26:47.854768  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.855886 12508 tablet_copy_client.cc:806] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:47.856873 12529 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:47.857448 12529 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.859930 12529 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:47.856597 12508 tablet_copy_client.cc:670] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:47.860471  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:47.860822  5968 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:26:47.861111 12457 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:47.861887 12457 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.863667 12457 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:47.864470 12457 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:47.864899 12457 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:47.865926  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:47.866636  6643 raft_consensus.cc:3055] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:47.866725 12457 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:47.867265  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:47.869166  6643 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:47.868510  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:47.872224 12475 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:47.871929  6643 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.872735 12475 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.870296  5965 raft_consensus.cc:1217] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Deduplicated request from leader. Original: 18.13->[19.14-19.14]   Dedup: 19.14->[]
I20260709 12:26:47.874116  5965 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 19. Current term is 20. Ops: [19.14-19.14]
I20260709 12:26:47.860131 12357 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.015s
I20260709 12:26:47.871189  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:47.873116  6643 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:47.868423  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:47.876786  5959 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 14: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:47.878839  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:47.879613  6040 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:26:47.882907  6651 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 13 index: 12. (index mismatch)
I20260709 12:26:47.881177  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:47.884325  6648 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 16: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:47.884760 12424 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:47.885757  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:47.886587 12475 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:47.894701  6081 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:47.896205  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 44829.6us
I20260709 12:26:47.898850 12529 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:47.899190  5968 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 19. Current term is 20. Ops: [19.11-19.11]
I20260709 12:26:47.901067 12493 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:47.911965 12464 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.912592 12464 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.908121 12529 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:47.914506 12529 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:47.915213 12475 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:26:47.915591  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.StartTabletCopy -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 45771us
I20260709 12:26:47.916154 12478 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.916656 12478 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.919196  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:47.920241  6651 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
W20260709 12:26:47.920825  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.920729  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:47.921826  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:47.922293  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:47.921618  6084 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:47.922619  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:47.923265  6117 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:26:47.923617  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:47.923729 12468 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:47.924160 12468 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.915683 12475 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:47.924532 12468 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:47.925685  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:47.926295  6643 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:47.932394  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:47.936661  5964 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:26:47.939072  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:47.942641  6040 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:47.942901  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:47.943826  5965 raft_consensus.cc:2393] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:47.930605 12464 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:47.934034 12475 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:47.947109  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:47.947070  5968 raft_consensus.cc:2393] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:47.950296  6084 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:47.955879  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.955838 12508 tablet_copy_client.cc:538] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:47.942030 12493 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:47.958012 12493 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:47.958073  6115 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:47.958438 12493 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:47.959779  5962 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 19. Current term is 20. Ops: [19.15-19.15]
I20260709 12:26:47.965463 12440 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:47.948141 12495 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:47.956835  6609 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:47.966051 12440 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.966816 12495 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.971705  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:47.980127  6117 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:47.980304 12492 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:47.980882 12492 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.982648 12440 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:47.982967 12492 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:47.983983 12495 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:47.984848  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:47.985618  6040 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:47.985901  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:47.986632  6116 raft_consensus.cc:2393] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 16: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:26:47.986552  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.987831  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:47.988260  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:47.988875  6642 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:47.987818  6609 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:47.989782 12495 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:47.990156 12495 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:47.973165 12464 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:47.990808 12464 raft_consensus.cc:697] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:47.990504 12495 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:47.992784  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:47.995667  5966 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:26:47.991808 12464 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:47.993964  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:47.997341 12408 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:47.997723 12408 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:47.998126 12408 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:47.985138  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:47.973310 12420 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:48.009454  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:47.976814 12478 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.008500 12420 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.014662  6115 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 13: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:48.020080  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:48.020640  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.017540 12420 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:48.023775  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:48.031736  5967 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:26:48.032439  6040 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 13 index: 9. (index mismatch)
I20260709 12:26:48.035918  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:26:48.038344  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.039078 12511 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:48.039650 12511 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:48.040606 12511 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:48.041338 12475 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.045114  6006 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:48.046430 12482 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:48.049505  6081 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:48.050158 12462 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:26:48.051748  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:48.050671 12531 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:48.052783 12399 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:48.053380 12399 raft_consensus.cc:697] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:48.053900 12482 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:26:48.056068  6111 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 20: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:48.056469  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:48.064154  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:48.070902 12493 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.072055 12529 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:48.073550 12493 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.074154  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:48.074877  6115 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:48.030027 12457 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.078755  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:48.085795  5861 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 13 to 14, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 14 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:26:48.086768 12492 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:48.088351 12501 consensus_queue.cc:1059] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:48.089627 12501 raft_consensus.cc:3055] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:48.090104 12501 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:48.090711  6115 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:26:48.090997 12482 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:48.092164 12328 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:48.092752 12408 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.091180 12529 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:48.091977 12482 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.004s
I20260709 12:26:48.095678 12529 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.097123 12478 consensus_queue.cc:1059] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 12.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:48.098784 12459 raft_consensus.cc:3055] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:48.099092 12539 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:48.056680 12495 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.099412  6111 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:48.102883  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:48.102542 12459 raft_consensus.cc:740] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:48.103451 12539 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:26:48.104228 12475 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.080677 12399 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:48.104526 12459 consensus_queue.cc:260] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.104919  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:48.105846 12459 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:48.099603  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:48.107877  6117 raft_consensus.cc:2393] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 16: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:48.110666  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:48.103492  6040 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:48.112499  6117 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19. Ops: [18.14-18.14]
I20260709 12:26:48.113271  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:48.120703  5932 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:48.123771  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:48.124027  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:48.124598  5967 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:48.124725  5964 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:48.126504 12130 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:48.127013 12457 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.133095 12536 ts_tablet_manager.cc:933] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:48.133693  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:48.134758  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:48.135617  6115 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 20: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:48.135778  6042 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:26:48.122452 12440 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.011s
I20260709 12:26:48.137274  6112 raft_consensus.cc:2393] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 13: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:26:48.140182  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48517.7us
W20260709 12:26:48.137372  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 81000.7us
I20260709 12:26:48.144886  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:48.135063 12492 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:48.091065 12501 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:48.145756 12492 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:48.146339 12501 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:48.146745  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:48.146953 12464 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:48.147392 12464 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:48.147835 12464 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:48.148948  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:48.151479 12482 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:26:48.147356  5966 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:48.150352  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:48.143108  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:48.099068 12468 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.187397 12457 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:48.214262  5966 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:48.189669 12420 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.190630 12458 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.200588 12508 tablet_bootstrap.cc:492] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:26:48.211160 12495 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.226050 12420 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.215648 12408 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.187568 12539 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.034s
I20260709 12:26:48.229687  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:48.230000 12468 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.230541  6643 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:48.232434  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:48.232852  6116 raft_consensus.cc:2368] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15.
I20260709 12:26:48.179083 12464 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.146755 12492 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.227555 12458 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.227999 12529 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.233078  6642 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 15
I20260709 12:26:48.237561  6040 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:48.271031  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:48.271733  6044 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:48.272378 12549 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:48.272969 12549 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.239885 12457 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:48.275319 12549 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.275571 12457 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.278864  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:48.279616  5966 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:48.214335 12424 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
W20260709 12:26:48.292184  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 127908us
I20260709 12:26:48.296350 11722 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:48.279309  5863 catalog_manager.cc:5697] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 14 to 15, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 15 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.298192  5863 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 18 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:48.310842  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:48.311738  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:48.312337  6117 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:26:48.314285  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:48.317092  5966 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:48.317943  6044 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
W20260709 12:26:48.318527  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 168285us
W20260709 12:26:48.317968  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.319779  6081 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:48.320595  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:48.320842 11722 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.318761  6084 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:48.323683  6112 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 14
W20260709 12:26:48.324265  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 137416us
I20260709 12:26:48.315059 12539 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:48.329898  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:48.329433  6611 leader_election.cc:400] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15.
I20260709 12:26:48.379843  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:48.380760  6643 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 16: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:48.361672  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:48.379781  6112 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:48.338789  6611 leader_election.cc:403] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:26:48.338544  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.342888  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:48.353865 12492 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.383981 12492 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.382956  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:48.346824 12531 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.391746 12531 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.396219  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:48.397143  6040 raft_consensus.cc:2393] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:48.397984  6117 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:48.399937  5968 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:48.400452 11722 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.401286  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:48.407270  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 82107.1us
I20260709 12:26:48.407871  6642 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:48.410079  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:48.347250  6609 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:48.410933  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 63778.4us
I20260709 12:26:48.328326 12399 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:48.331009 12462 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:48.412369  6609 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:48.328166 12536 tablet_copy_client.cc:323] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.66:45473
I20260709 12:26:48.351327 12540 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.351915 12464 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.331327 12539 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:48.457243  6643 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:26:48.346796 12328 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.427732  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:48.409159 12478 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 14. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15.
W20260709 12:26:48.461347  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 99813.4us
I20260709 12:26:48.420287 12459 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:48.474648  5962 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
W20260709 12:26:48.475660  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48029.5us
I20260709 12:26:48.430889 12462 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:48.454761 12495 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:26:48.481560  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 80388.1us
I20260709 12:26:48.483111 11722 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.483683 11722 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:48.485760 11722 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.458608 12468 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:48.459597 12399 raft_consensus.cc:697] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:48.487655  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:48.493703  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:48.495621  5962 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:48.472235 12529 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.507426  6040 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
W20260709 12:26:48.508261 12551 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:26:48.479055 12501 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:48.482426 12499 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.053s	user 0.001s	sys 0.000s
I20260709 12:26:48.481258 12462 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:48.521405  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:48.549088 12552 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:26:48.552897  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.471412 12328 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:48.592317  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 71034.4us
I20260709 12:26:48.593600 12328 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.499629 12495 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:48.459848 12540 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.597198 12399 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.522704 12420 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.582568 12532 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.583087 12562 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.583817 12458 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:48.539099  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:48.595391 11722 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:48.627060 11722 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:48.627592 11722 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
W20260709 12:26:48.632295  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 325469us
I20260709 12:26:48.636209 12482 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.636833 12482 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:48.637879  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 118707us
I20260709 12:26:48.638974  6006 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:48.641362  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:48.642702 12511 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:26:48.643293 12555 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:26:48.643782 12552 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:48.644353 12552 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:48.645273 12552 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:48.647133 12482 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.647794  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:48.649076  6006 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:48.649959 12543 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:26:48.650245 12482 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:48.651190 12482 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:48.652988 12328 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.653564 12328 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:48.652171 12482 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:48.608747 12540 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.659107 12328 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.661387 12492 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:48.668296 12557 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.072s	user 0.003s	sys 0.000s
I20260709 12:26:48.673334  5932 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:48.674976  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:48.675694  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:48.676945 12478 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:48.526189 12529 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.684321  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:48.685204 11722 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.594802 12495 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.690842  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:48.694599  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:48.695298  6111 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:48.697209  5966 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:26:48.619949 12420 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.549947 12539 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.704741  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:48.620390 12532 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.706869  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:48.709962  5964 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:48.710573  6643 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:48.685894 12531 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.698634 12492 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:48.719343  6115 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:48.713392  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:48.698127 12328 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:48.622838 12562 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.730219 12459 raft_consensus.cc:697] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:26:48.731971  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 46485.8us
W20260709 12:26:48.728250 12550 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.209s	user 0.000s	sys 0.001s
I20260709 12:26:48.704054 12478 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.748613 12532 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.749513 12478 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.749962 12532 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.750571 12532 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.751590 12562 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:48.752704 12532 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.751619 12420 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:48.750274 12328 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:48.755746 12420 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:48.756309 12420 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.757165 12328 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.758476 12420 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:48.727891 12492 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.764364 12492 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:48.771378  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 64604.6us
I20260709 12:26:48.728472 12468 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:48.772526  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 319470us
I20260709 12:26:48.772560  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:48.741839 12531 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:48.786659 12558 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:48.786414 12531 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.787114 12558 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.787492 12558 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:48.741983 12408 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.790033 12408 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:48.792209 12408 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.800751  5962 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:48.801400  5967 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:48.776643 12464 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:48.799016 12440 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:48.837339  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:48.834230  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 100117us
I20260709 12:26:48.844295  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:48.845178 12564 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.845594  6111 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:26:48.845770 12564 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.848452 12564 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.849547 12564 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.849850 12531 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.850401 12531 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.850956 12531 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:48.852579  6648 consensus_meta.cc:287] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.001s
I20260709 12:26:48.852852 12458 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:48.853243 12531 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.853747 12531 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:48.854493 12575 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:48.855157 12529 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.855075 12575 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:48.835686 12464 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.858837 12464 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:48.861541  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:48.857226 12575 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:48.862380  6037 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 16: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:48.862741  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:48.864583  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:48.865254  6035 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:48.866735  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:48.866982  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:48.867887  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:48.868537  6042 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:26:48.867378  5963 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:48.869863  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:48.870365  6054 tablet_copy_service.cc:140] P 0557a7246c8945b99e5215c99d4ddf9c: Received BeginTabletCopySession request for tablet e3ef3cb064eb4a1597f89e040fce3c7e from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:60122)
I20260709 12:26:48.870545  6036 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:48.870936 12424 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.871639  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:48.871450 12424 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.872251  5962 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:48.873142 12558 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.874208  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:48.873991  6648 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:48.877087  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:48.850054 12564 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.877884 12581 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.870966  6054 tablet_copy_service.cc:161] P 0557a7246c8945b99e5215c99d4ddf9c: Beginning new tablet copy session on tablet e3ef3cb064eb4a1597f89e040fce3c7e from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:60122: session id = 24012af7747d4c4ea89c3da2ff950099-e3ef3cb064eb4a1597f89e040fce3c7e
I20260709 12:26:48.878664 12581 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.873469  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:48.884186  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:48.882257  6081 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:48.888536  6117 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:48.880688  6039 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:26:48.817015 12559 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:48.891166  6111 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 15: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:48.891963  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:48.892189  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:48.892272  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 178942us
I20260709 12:26:48.890089  6006 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:48.896345  6643 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:48.899710  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:48.900100  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:48.900806  6648 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:48.901052  5962 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:26:48.899710  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:48.902509  6112 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 17: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:48.904420  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:48.840387 12440 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.905095  5963 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 25.
I20260709 12:26:48.873797 12424 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.816603 12462 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.918252  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:48.919044  6643 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:48.920703  6648 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:48.921311  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:48.920528  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:48.891304 12501 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:48.894122 12399 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:48.924260  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:48.922247  6113 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:48.921909  6110 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:48.913172 12440 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:48.913414 12459 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.933384  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:48.924407 12482 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:48.932607  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:48.938745  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:48.927711 12399 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.924539 12532 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:48.948805  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:48.927565  6648 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:26:48.949397  5966 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:48.943293 12567 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:48.924129 12501 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.922663 12464 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.910128 12559 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:48.944545 12462 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.942827 12581 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:48.947098  6643 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
W20260709 12:26:48.950354  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 53056.5us
I20260709 12:26:48.947539  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:48.917418 12420 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.021s
I20260709 12:26:48.943213 12558 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:48.989063  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 43574.1us
I20260709 12:26:48.989573  5966 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:48.946151 12482 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:48.929950 12492 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:48.995791  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:48.995980  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 63599.6us
I20260709 12:26:49.067898  6642 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:48.948625 12399 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:48.997414  6054 tablet_copy_source_session.cc:215] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:26:48.950449  6648 raft_consensus.cc:606] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:48.952461 12501 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:49.009467 12583 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:49.014209  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:49.074427  6643 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:49.015152 12581 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:48.931337 12468 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.015761  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:48.993193 12531 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.952605 12532 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:48.996824 12540 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:48.996838 12408 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.024960 12559 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.013162 12495 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:26:49.026836  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.092880  5965 raft_consensus.cc:2393] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 18: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:49.010754 12564 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:49.022226  5865 catalog_manager.cc:5697] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 19 to 20, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 20 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:49.031001  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:49.031889  6040 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:49.100299  5960 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:49.036906 12440 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.037871 11722 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:49.038602 12464 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:49.039603 12563 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:49.043752  6035 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:26:49.044873  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:49.045322  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:49.046512  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.048448  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:49.048990 12462 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.013340  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.056898  6041 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:49.064088  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.113659  6037 raft_consensus.cc:2393] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 9: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:49.066084  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:49.113544  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 100280us
W20260709 12:26:49.114426  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48419.8us
I20260709 12:26:49.070441  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:49.078807  6042 raft_consensus.cc:2393] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 13: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:49.080615  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:49.067104 12482 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:49.083405 12583 raft_consensus.cc:697] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:49.088666  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:49.089138  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:49.076231 12539 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:49.123654 12424 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:49.102007  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.107880  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:49.099907 12495 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.111167  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.111971  6651 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:49.111630  6036 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
W20260709 12:26:49.113869  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 49867.2us
I20260709 12:26:49.132062  5968 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 17: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:49.104204 12408 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.122867 12462 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:49.100895  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 153439us
I20260709 12:26:49.126057  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.130191  5964 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:26:49.133966  5965 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 25.
I20260709 12:26:49.011787 12567 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:49.119778  6084 consensus_peers.cc:597] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:26:49.135741  5961 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 17: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:49.123231  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.115077  6611 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:49.125094  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:49.127787 12458 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:49.142343  5959 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:26:49.145009  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:49.152199  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.099117 12531 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.127534 12575 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:26:49.155613  5966 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:49.102430 12540 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.156481  6112 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:49.133097 12495 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:49.152987  6035 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:26:49.161825  6109 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:26:49.151300  6110 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:49.167071  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:49.167829  6644 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:49.167120  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:49.170451  6036 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 16: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:49.173045 12540 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.117890 12559 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.036s
I20260709 12:26:49.139590 12464 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.036s
I20260709 12:26:49.167968 12408 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.166319  5960 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:49.179934 12588 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.180583 12588 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.182614 12542 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:49.183202 12542 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.183605 12542 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:49.183784  6009 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:49.184770 12581 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.185307 12581 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.186298 12575 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.193578  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:49.198056  6651 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:49.180814  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.200640  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.202704  6110 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:26:49.210199  6646 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:49.211254  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:49.215379  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:49.149020 12561 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:49.223713 12511 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:49.220996  6608 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.117636 12563 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.228561  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.197373 12575 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:49.186923 12458 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:49.240136  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 104150us
I20260709 12:26:49.240926  6084 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:49.242057  6084 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:49.248744  6084 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:49.253373  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.254137  5959 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:49.257027 12579 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.257655 12579 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.228379 12540 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:49.264055  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.228622 12475 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:49.260721  6084 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:49.263129 12420 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:49.267499 12420 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.269951 12420 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.245754 12567 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.281793  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:49.282974  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 99264.2us
I20260709 12:26:49.283807  6009 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:49.263509 12529 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:49.265666 12475 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:49.237699 12561 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.308807  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.309619  5966 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:26:49.288966 12529 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.292688 12475 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:49.312539  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.313135  5966 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:49.317414  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.323736  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:49.324373  6109 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:49.310303 12581 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.325594  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.311313 12492 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.317008 12529 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:49.314078 12570 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:49.271651 12583 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.317391 12440 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:49.317597 12595 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:49.319322 12582 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.338738 12570 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.316058 12458 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.342605 12593 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:49.343127 12597 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:49.343575 12598 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.334389 12554 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:26:49.356122  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.326676 12532 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.338322 12581 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:49.363026 12600 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.025s
I20260709 12:26:49.354718  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:49.332796 12408 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:49.329468 12592 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.152s
I20260709 12:26:49.358276 12569 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:49.390672 12569 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:49.391119 12569 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:49.346011 12492 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:49.394023 12492 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.380870 12597 raft_consensus.cc:697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:49.394734 12408 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.395396 12597 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.397509 12563 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.365924 12582 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.380631 12598 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:49.398692 12591 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.211s	user 0.001s	sys 0.000s
I20260709 12:26:49.376435 12581 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.400190 12582 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.400949  5967 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:49.402343  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:49.402977  6113 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:49.365664 12440 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:49.365212 12399 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.403836 12440 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.405193 12399 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:49.374678 12531 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.332381 12542 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.406078 12440 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.366353 12570 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:49.407780 12542 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.380301 12574 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:49.409057 12574 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.409404 12574 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:49.380959  6649 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:49.400269 12581 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:49.403499 12598 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.413167  5934 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.373984 12578 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:49.374282 12554 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.422897 12579 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:49.425434 12501 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.426846 12603 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:49.427284 12603 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.427639 12603 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:49.428223  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:49.428879  6113 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:49.429948  6645 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:26:49.431640  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 295437us
I20260709 12:26:49.432091  5934 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.432366  6609 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:49.432852  5861 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 339) took 1119 ms. Trace:
I20260709 12:26:49.433230  5861 rpcz_store.cc:276] 0709 12:26:48.313071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.313229 (+   158us) service_pool.cc:224] Handling call
0709 12:26:49.432761 (+1119532us) inbound_call.cc:177] Queueing success response
Metrics: {"reported_tablets":2}
I20260709 12:26:49.434249  6642 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:49.374675 12595 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:49.380012 12590 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:49.418852 12578 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.436092 11722 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:49.447499 11722 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:49.448113 11722 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:49.449435 12542 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.005s
I20260709 12:26:49.451967  6109 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:49.422955 12554 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:49.462252  5934 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.449303 12578 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:49.409070 12569 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.426187 12529 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.447310 12478 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:49.468166  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:49.475948  6650 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:49.477159 11722 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.480333  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:49.481703  6040 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:49.480958  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:49.480964  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 342373us
I20260709 12:26:49.483217  6042 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:49.490599  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.483953  6081 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:49.453599 12575 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.468554 12440 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:49.500861  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:49.503149  6042 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:49.505987  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 43831.2us
I20260709 12:26:49.475792 12478 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:49.506963  6644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:26:49.509153  6644 raft_consensus.cc:606] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:49.509433  6644 raft_consensus.cc:614] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:49.479223 12569 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:49.510162  6043 raft_consensus.cc:2368] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 25. Current term is 26.
I20260709 12:26:49.499964 12567 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:49.460999 12590 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.478363 12482 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.518630  6042 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:49.518894 12564 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.522437 12564 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.523429  6650 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:49.524237 12616 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:49.524408 12564 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.504593 12598 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.512228 12478 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:49.529758 12575 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:49.531296  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:49.535518 12529 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:49.536055 12462 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.505268 12597 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:26:49.546980  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:49.549041  6650 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:49.549829  6039 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:49.551179 12592 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:49.551751 12592 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.553870 12592 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:49.555150 12561 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.556079 12482 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.557518 12570 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.512097 12440 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.524950 12567 raft_consensus.cc:697] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:49.560961  6642 raft_consensus.cc:2368] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:49.560271 12440 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.554349 12592 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:49.569428  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.563591 12564 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.575022 12607 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.575732 12590 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.524896 12574 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.578655  6644 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:26:49.519088 12595 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.544636 12598 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.582831 12607 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.582950  6644 raft_consensus.cc:606] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:49.583510  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:49.598758 12607 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.599262  6042 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:49.601671  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:49.565789 12495 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.604184 12495 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.604743 12508 tablet_bootstrap.cc:492] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=12 overwritten=1 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:26:49.604909  6651 raft_consensus.cc:2368] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:26:49.605719 12508 tablet_bootstrap.cc:492] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:26:49.594920 12567 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.601577 12581 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.589557  6650 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:49.608223  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.646639  5960 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:49.570039 12440 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:49.609923  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.610411  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.653157  5964 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:49.654868  5964 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:49.611193  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:49.655337  6649 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:49.616382  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.618194  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:49.595661 12574 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.599525 12598 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:49.597854 12603 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.629539  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.582101 12564 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.630215  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.636861  6042 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:49.580890 12570 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.656236  5961 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 14
I20260709 12:26:49.656785  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.667440  5960 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:49.667573  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:49.667738  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:49.668186  6042 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:49.652165 12475 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.670722  6648 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 25.
I20260709 12:26:49.660296  5968 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:49.671128 12603 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.672473 12475 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.674393  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:49.679040 12508 ts_tablet_manager.cc:1403] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 1.523s	user 0.039s	sys 0.030s
I20260709 12:26:49.652258 12552 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.664302  5963 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:26:49.666339  5965 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:49.632437 12482 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.668344  5959 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:49.680032  6036 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:49.696137  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.680400  5961 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:49.662151  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:49.684037 12588 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.581756 12592 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.702625  5964 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:49.707717  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.712865  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:49.717905  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:49.718798  6042 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:49.714730 12607 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.731141  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:49.720029  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 11 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.719908 12607 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.733078  6110 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:49.733819  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:49.734550 12607 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.736456  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.736969  5966 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:49.734599  6113 raft_consensus.cc:2393] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 17: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:49.732600  6042 raft_consensus.cc:2368] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:49.685861 12508 raft_consensus.cc:359] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:49.708310 12475 raft_consensus.cc:993] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:26:49.727766  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.739130  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:49.744270  5959 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 26.
I20260709 12:26:49.745973  5961 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:49.744665  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.746639  6036 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:49.698436 12464 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:49.758755 12464 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.759465 12564 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.760241 12475 raft_consensus.cc:1081] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:26:49.663623 12578 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.729867 12462 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:49.727993 12531 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:26:49.763423 12462 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:49.764408 12462 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:49.664471 12440 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.748783  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:49.767689  6112 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:49.749078  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:49.748847  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:49.770005  6113 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:49.757436 12478 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.771651  5961 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:49.772586  6116 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 17: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:49.743880  6038 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 22.
W20260709 12:26:49.777819  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:49.782559  5964 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:26:49.784664  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:49.739099 12597 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:49.787153  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:49.796262  6117 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:26:49.793044  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.793679  6111 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:49.794842  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.706593 12482 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.809783  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:49.810532  6115 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:49.767006 12588 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:49.763516 12578 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:49.805152  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:49.707149 12552 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.805790  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:49.806082  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:49.742720 12508 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:26:49.804915  6043 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:49.806690  6644 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:49.801591  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:49.761003 12464 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:49.826876  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.828240  5961 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:26:49.818042  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:49.829270  6642 raft_consensus.cc:2368] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:49.824903  6042 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:49.824862  6651 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:49.830848  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.831539  5959 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:49.832409  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:49.833221  6646 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 17: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:49.835008  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.838609  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.758193 12554 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.841495 12554 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:49.843225 12592 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.849409  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.850100 12508 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:49.851521  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:49.852123  6109 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 22.
I20260709 12:26:49.852993  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:49.853528  6109 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 10 FOLLOWER]: Advancing to term 12
I20260709 12:26:49.854856 12440 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:49.850109  6041 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:49.856757 12478 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.857488  6118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:42484
I20260709 12:26:49.858059  6118 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:49.796041 12539 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
I20260709 12:26:49.860687  6044 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:49.861678  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:49.862213  6044 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:49.817716 12616 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:49.864332  6040 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:49.864666 12616 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:49.867329  6081 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.868223  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.868634 12529 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:49.869053 12529 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.869457 12529 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:49.872058  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.872838  6038 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 21: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:49.854502  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:49.873952 12530 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:49.868947  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:49.875253  6082 leader_election.cc:400] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:49.875516  6082 leader_election.cc:403] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:26:49.875771 12536 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e3ef3cb064eb4a1597f89e040fce3c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:26:49.876215  6082 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:49.877601  6036 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 22: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:49.882093  6112 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:49.885954  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:49.886793  5962 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:49.888230  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.858373  6118 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:49.889642  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.890357  5959 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:49.877179  6081 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.877538  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:49.878954  5934 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.894534  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:49.894774  6042 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:49.874221  6609 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:49.893262  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.896700  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:49.902763  6109 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:26:49.904428  6044 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:26:49.898377  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.906502  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:49.907217  6112 raft_consensus.cc:2368] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:49.907379  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.906283  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:49.899096  6609 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:49.908121  6110 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:49.908226  5934 leader_election.cc:400] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:26:49.908540  5934 leader_election.cc:403] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:26:49.873600 12408 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:49.909680  6645 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:49.910446  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:49.912530  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.913228  6044 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:49.913849  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:49.914371  6109 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 15: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:49.905541  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.917621  6081 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.920987  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.918089  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:49.921934  5934 leader_election.cc:400] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:49.922253  5934 leader_election.cc:403] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:26:49.897759 12618 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:26:49.922049  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.891086 12607 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:49.895742 12576 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:49.893939 12564 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:49.894076 12543 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:49.923446  6006 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:49.923225  6609 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:49.906773 12578 raft_consensus.cc:2764] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election decision vote started in defunct term 10: won
I20260709 12:26:49.931492  5934 leader_election.cc:400] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:49.933311  6609 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:49.936961  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:49.930316  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:49.909123 12475 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:49.941861  6044 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 17: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:49.917532 12592 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:49.943878  6609 leader_election.cc:400] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 25. Current term is 26.
I20260709 12:26:49.941948  5962 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:26:49.944196  6110 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:26:49.944906  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:49.905882 12540 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.033s
I20260709 12:26:49.928584 12408 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:26:49.927865 12464 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:49.879940 12588 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:49.929877 12558 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:26:49.946075  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:49.951442  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:49.980580  6042 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:49.935384 12543 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.930027 12593 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:26:49.938277 12554 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:49.947944  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:50.000710  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:50.001307  6112 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 17: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:49.935205 12582 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 13. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14.
I20260709 12:26:49.934851 12564 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:49.947036 12562 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:50.018859  6043 raft_consensus.cc:2410] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:26:50.019212 12588 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:50.003269 12543 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:49.969035 12592 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:50.021224  6042 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:26:49.965970 12464 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.022006 12464 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:49.968143 12558 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.023452 12558 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:50.023650  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:50.024992  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:50.025700  6112 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 17: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:49.942876 12475 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:50.026510 12475 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:50.028162 12615 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.452s	user 0.003s	sys 0.000s
I20260709 12:26:50.029315 12399 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:49.944506 12569 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:50.030238 12399 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.030861 12569 raft_consensus.cc:697] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:49.979560  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:50.031616 12508 ts_tablet_manager.cc:1434] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.352s	user 0.010s	sys 0.000s
I20260709 12:26:49.972574  6113 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:50.033306  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:50.009658 12462 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:49.975443 12549 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:49.966200 12539 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.051s
I20260709 12:26:49.938923 12603 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.040s
I20260709 12:26:50.031059 12576 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:50.058507  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:50.034186  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:50.059098  5959 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:26:50.032474  6609 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:49.963757 12561 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:26:50.049582  5962 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:50.053658  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 144127us
I20260709 12:26:50.055148  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:50.065868  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:50.018330 12562 raft_consensus.cc:697] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:26:50.048908 12604 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
I20260709 12:26:50.032357 12564 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:49.952697 12607 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.106s
I20260709 12:26:50.017594 12597 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:50.089214  6113 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:50.086382  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:50.106539  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 74132.8us
I20260709 12:26:50.107920 12609 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.199s
I20260709 12:26:50.108644 12540 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:50.108810 12562 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.109392 12609 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:50.109810 12609 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.110121 12609 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:50.087393  5966 raft_consensus.cc:2368] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 25. Current term is 26.
I20260709 12:26:50.109292 12540 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:50.113497  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:50.053045 12554 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:26:50.113791  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 190883us
I20260709 12:26:50.057667 12576 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.121415  5959 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:26:50.064445 12478 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:50.125917  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 208314us
I20260709 12:26:50.129412  5932 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:50.122051  6044 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:50.121551  6084 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:50.057531 12593 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 26 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:50.131844  6118 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.106305 12561 raft_consensus.cc:697] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:50.104548 12594 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:50.134071  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:50.133177  6081 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:50.095934  5962 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:50.058302 12549 raft_consensus.cc:697] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:50.124306  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 200781us
I20260709 12:26:50.137794  6084 leader_election.cc:400] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14.
I20260709 12:26:50.119302 12617 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:50.123883 12576 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:50.145777  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:50.021618 12592 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.163229  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:50.136617 12582 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:50.175583  6118 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:50.181911 12462 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:50.151304 12440 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:50.134378 12478 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.160151 12617 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:50.170056 12468 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:50.163551 12597 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
W20260709 12:26:50.244923  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.203372 12594 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.208634 12617 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:50.191207 12582 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:50.207039 12492 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:50.209381 12458 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:26:50.276798  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 165228us
I20260709 12:26:50.167577 12569 consensus_queue.cc:237] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.291136  6609 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:50.250556 12468 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:50.294570  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 131440us
I20260709 12:26:50.289805 12458 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.301054  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:50.301839  6038 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 12: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:50.300566 12458 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:50.305284 12468 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.276162 12638 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:26:50.277828  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:50.328644  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 168167us
I20260709 12:26:50.287298 12636 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:50.369464  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 3031) took 1397 ms. Trace:
I20260709 12:26:50.375666  6039 rpcz_store.cc:276] 0709 12:26:48.911430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.911598 (+   168us) service_pool.cc:224] Handling call
0709 12:26:50.309013 (+1397415us) spinlock_profiling.cc:243] Waited 621 ms on lock 0x7b54001aa754. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:50.309198 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1427258624}
I20260709 12:26:50.208166 12593 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.211126 12554 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.278066 12594 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:50.377452 12630 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.255s	user 0.001s	sys 0.000s
I20260709 12:26:50.217576 12540 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:50.395177 12641 log.cc:927] Time spent T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.098s	user 0.001s	sys 0.000s
I20260709 12:26:50.371592 12399 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:50.398837 12632 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.230s	user 0.001s	sys 0.000s
I20260709 12:26:50.288307 12561 consensus_queue.cc:237] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 8.8, Last appended by leader: 8, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.380723 12600 raft_consensus.cc:2764] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:26:50.410295 12638 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.004s
I20260709 12:26:50.416455 12408 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:26:50.395499 12582 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:50.292704 12549 consensus_queue.cc:237] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 10.7, Last appended by leader: 7, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:50.427767  5961 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 10.
I20260709 12:26:50.371070 12529 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:50.434952 12594 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:50.436036 12646 consensus_queue.cc:1059] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:26:50.436975 12646 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:50.437426 12646 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:50.435110 12642 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:50.438885 12642 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:50.440038 12399 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:50.439777 12642 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.440405 12399 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:50.441212 12399 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.447108 11722 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:50.442343 12399 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:50.459425 12646 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:50.439070 12478 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:50.443248 12501 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:50.472695  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 181657us
W20260709 12:26:50.486835  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 189884us
W20260709 12:26:50.486524  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 353391us
I20260709 12:26:50.500573  6081 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:50.429529 12576 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.523061  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:50.448787 12464 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:50.535598  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:50.525566 12646 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:50.548416  6112 raft_consensus.cc:2368] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18.
W20260709 12:26:50.549458  5964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.006s	sys 0.013s
W20260709 12:26:50.549883  5964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.006s	sys 0.013s
W20260709 12:26:50.537178 12543 consensus_meta.cc:287] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.516s	user 0.008s	sys 0.003s
I20260709 12:26:50.551059 12543 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.551419  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:50.552125  6648 raft_consensus.cc:3055] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:50.552457  6648 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:50.553404 12543 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:50.553210  6648 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.539978 12636 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:50.555626  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:50.557015  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:50.560947  6648 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:50.561348  6649 raft_consensus.cc:3055] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:50.561694  6649 raft_consensus.cc:740] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:50.554948 12646 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:50.563830  6649 consensus_queue.cc:260] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:50.584551  6083 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.590s	user 0.001s	sys 0.009s
W20260709 12:26:50.584954  6083 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.001s	sys 0.009s
W20260709 12:26:50.584605  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.586591 12619 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:50.611972  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:50.619544 12482 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:50.622922 12639 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.246s	user 0.000s	sys 0.000s
I20260709 12:26:50.577129 12646 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:50.632128 12617 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:50.635856  5934 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:50.640792 12617 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:50.643450 12578 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:50.643728 12655 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.644285 12655 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.646085 12408 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:50.650215  5934 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:50.655660  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:50.647884 12650 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.099s	user 0.001s	sys 0.000s
W20260709 12:26:50.648703 12558 consensus_meta.cc:287] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.625s	user 0.008s	sys 0.001s
I20260709 12:26:50.563251 12636 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 19.11, Last appended by leader: 11, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:50.602164 12609 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.654557 12617 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:50.646414 12655 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:50.658277 12529 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:50.717972  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:50.689006 12475 consensus_meta.cc:287] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.631s	user 0.010s	sys 0.000s
I20260709 12:26:50.712211 12652 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.710088 12440 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:50.709849 12616 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:50.646656 12408 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:50.770545  6643 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:26:50.656162  6648 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:50.690979 12539 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:50.785037  6084 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:50.714447 12558 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:50.657538 12578 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:50.808179 12564 consensus_meta.cc:287] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.691s	user 0.012s	sys 0.000s
I20260709 12:26:50.774736 12475 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.822204 12592 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:50.818166 12539 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.904745  6647 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:50.906497 12539 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:50.780210 12652 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:50.786337 12616 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:50.933230  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1563) took 1072 ms. Trace:
I20260709 12:26:50.902788 12440 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:26:50.936925 12660 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:26:50.908056 12492 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:26:50.937861 12665 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.163s	user 0.000s	sys 0.000s
I20260709 12:26:50.946532  6651 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:50.903021 12670 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:50.908269 12642 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:50.891402 12564 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:50.939210  6111 rpcz_store.cc:276] 0709 12:26:49.860722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.119524 (+258802us) service_pool.cc:224] Handling call
0709 12:26:50.119938 (+   414us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:50.127790 (+  7852us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:50.127821 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:50.135531 (+  7710us) log.cc:844] Serialized 26 byte log entry
0709 12:26:50.368683 (+233152us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:50.368787 (+   104us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.369650 (+   863us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:50.932999 (+563349us) raft_consensus.cc:1685] finished
0709 12:26:50.933021 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:50.933168 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3974,"raft.queue_time_us":6036,"raft.run_cpu_time_us":181,"raft.run_wall_time_us":8528,"thread_start_us":191508,"threads_started":1,"wal-append.queue_time_us":343328}
I20260709 12:26:50.988705  6651 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:26:50.993651  6109 raft_consensus.cc:2368] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13.
W20260709 12:26:50.996435 12664 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.158s	user 0.000s	sys 0.000s
I20260709 12:26:50.934751 12592 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:51.003544 12663 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.111s	user 0.000s	sys 0.000s
I20260709 12:26:50.955900 12492 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:51.006811 12492 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:51.008407 12654 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.009064 12654 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:51.012480 12592 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:51.013592 12678 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:26:50.991829  5934 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.703s (SENT) [suppressed 22 similar messages]
I20260709 12:26:50.990267 12529 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.034s
I20260709 12:26:51.028085 12475 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:51.030056  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3013) took 1195 ms. Trace:
I20260709 12:26:50.993630 12656 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:51.003381 12558 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:51.030474  5964 rpcz_store.cc:276] 0709 12:26:49.824210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.824359 (+   149us) service_pool.cc:224] Handling call
0709 12:26:49.824753 (+   394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:49.836753 (+ 12000us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:49.836788 (+    35us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:49.891832 (+ 55044us) log.cc:844] Serialized 26 byte log entry
0709 12:26:50.550264 (+658432us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:50.550310 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.550404 (+    94us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:51.019078 (+468674us) raft_consensus.cc:1685] finished
0709 12:26:51.019099 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:51.019234 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":90,"raft.run_cpu_time_us":95,"raft.run_wall_time_us":95,"thread_start_us":614580,"threads_started":1,"wal-append.queue_time_us":784071}
I20260709 12:26:51.033077  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:51.034725  6111 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:26:51.036223  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:50.983361 12440 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:51.033119 12674 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.125s	user 0.001s	sys 0.000s
I20260709 12:26:50.990712 12642 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:51.068396  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:51.072113 12666 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.311s	user 0.001s	sys 0.000s
I20260709 12:26:50.975592 12670 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:51.038286 12658 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:26:51.074854 12468 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.504s	user 0.010s	sys 0.021s
W20260709 12:26:51.127203 12468 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.010s	sys 0.021s
W20260709 12:26:51.146235 12399 consensus_meta.cc:287] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.675s	user 0.010s	sys 0.001s
W20260709 12:26:51.147297  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 155498us
I20260709 12:26:51.135079  6111 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:26:51.150107  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 3395) took 1028 ms. Trace:
I20260709 12:26:51.150915  6111 rpcz_store.cc:276] 0709 12:26:50.121365 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.032827 (+911462us) service_pool.cc:224] Handling call
0709 12:26:51.150043 (+117216us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:51.105947 12408 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:51.157713  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:51.128568 12658 raft_consensus.cc:697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:51.040125 12656 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:51.162210  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:51.146931 12652 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:51.163879  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:51.165374  6111 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:51.149765 12609 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:51.153575 12399 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.171440  6111 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:26:51.178079 12399 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:51.179488 12672 log.cc:927] Time spent T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
W20260709 12:26:51.180651  6116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 3440) took 1899 ms (client timeout 1703 ms). Trace:
I20260709 12:26:51.180811 12399 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:51.181191  6116 rpcz_store.cc:269] 0709 12:26:49.281379 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.281520 (+   141us) service_pool.cc:224] Handling call
0709 12:26:51.180373 (+1898853us) spinlock_profiling.cc:243] Waited 485 ms on lock 0x7b5400206554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:51.180533 (+   160us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1114486016}
I20260709 12:26:51.175019 12654 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:51.181730 12642 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:51.202561 12670 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:51.202587 12609 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:51.204603 12609 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:51.212164  6038 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:42450
I20260709 12:26:51.212949  6038 raft_consensus.cc:606] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:51.213323  6038 raft_consensus.cc:614] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:51.182404  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:51.184255 12440 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:51.184455 12616 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:51.219779  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 3017) took 1336 ms. Trace:
I20260709 12:26:51.220254  5963 rpcz_store.cc:276] 0709 12:26:49.883600 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.883739 (+   139us) service_pool.cc:224] Handling call
0709 12:26:51.219531 (+1335792us) spinlock_profiling.cc:243] Waited 862 ms on lock 0x7b54000b8954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:51.219683 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1983597312}
I20260709 12:26:51.221849  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 3450) took 1349 ms. Trace:
I20260709 12:26:51.222294  6112 rpcz_store.cc:276] 0709 12:26:49.872018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.026215 (+154197us) service_pool.cc:224] Handling call
0709 12:26:51.221639 (+1195424us) spinlock_profiling.cc:243] Waited 489 ms on lock 0x7b54000924d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:51.221781 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1124047616}
I20260709 12:26:51.223565  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:51.224327  6112 raft_consensus.cc:2368] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23.
I20260709 12:26:51.225284  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:51.225899  6112 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:51.228783  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:51.229422  6110 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:26:51.233620  6042 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
W20260709 12:26:51.234898  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.202435  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:51.230422  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:51.242574  6110 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 17: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:51.243623  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:51.253232  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:51.254383  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 3394) took 1135 ms. Trace:
I20260709 12:26:51.254835  6111 rpcz_store.cc:276] 0709 12:26:50.118580 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.201393 (+1082813us) service_pool.cc:224] Handling call
0709 12:26:51.254269 (+ 52876us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:51.269815  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:51.270015  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 12:26:51.272079  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 1.10431e+06us
I20260709 12:26:51.272969  6036 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 22: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:51.273250  6006 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:51.161755 12408 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:51.274431  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:51.282361  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:51.777462  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:51.778100  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:51.778311  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:51.778905  6043 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 23.
W20260709 12:26:51.777196  6646 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.603s	user 0.007s	sys 0.060s
I20260709 12:26:51.780138  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:51.764472  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:51.780774  6646 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.606s	user 0.008s	sys 0.061s
I20260709 12:26:51.781288  6116 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:51.556625  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3453) took 1661 ms. Trace:
I20260709 12:26:51.491256  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:51.538959  5866 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 219) took 2839 ms. Trace:
W20260709 12:26:51.366896  6040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 2918) took 1659 ms (client timeout 1935 ms). Trace:
I20260709 12:26:51.325624  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:51.786973  6112 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:51.326179  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:51.788378  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1566) took 1338 ms. Trace:
I20260709 12:26:51.782047  6115 rpcz_store.cc:276] 0709 12:26:49.895374 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.555669 (+1660295us) service_pool.cc:224] Handling call
0709 12:26:51.556071 (+   402us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:51.556271 (+   200us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:51.556297 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:51.556339 (+    42us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:51.556387 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:51.556439 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:51.556556 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:51.790674  6642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1756) took 1221 ms. Trace:
W20260709 12:26:51.794240  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:51.793478  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1564) took 1759 ms. Trace:
I20260709 12:26:51.797159  6111 rpcz_store.cc:276] 0709 12:26:50.034270 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.792389 (+1758119us) service_pool.cc:224] Handling call
0709 12:26:51.792714 (+   325us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:51.793026 (+   312us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:51.793053 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:51.793098 (+    45us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:51.793128 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:51.793290 (+   162us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:51.793419 (+   129us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:26:51.785729  6040 rpcz_store.cc:269] 0709 12:26:49.707107 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.707328 (+   221us) service_pool.cc:224] Handling call
0709 12:26:51.366663 (+1659335us) spinlock_profiling.cc:243] Waited 153 ms on lock 0x7b5400312ed4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:51.366815 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":351717760}
I20260709 12:26:51.788702  6110 rpcz_store.cc:276] 0709 12:26:50.449634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.325933 (+876299us) service_pool.cc:224] Handling call
0709 12:26:51.788311 (+462378us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:51.800745  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:51.783560  5866 rpcz_store.cc:276] 0709 12:26:48.659635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.660375 (+   740us) service_pool.cc:224] Handling call
0709 12:26:49.178113 (+517738us) spinlock_profiling.cc:243] Waited 171 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:26:51.499220 (+2321107us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":14838,"reported_tablets":3,"spinlock_wait_cycles":392448896}
I20260709 12:26:51.498550  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:26:51.805756  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:51.342973 12567 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.580s	user 0.004s	sys 0.026s
I20260709 12:26:51.812356 11722 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:51.830744 11722 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:51.816187  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1565) took 1509 ms. Trace:
I20260709 12:26:51.791126  6642 rpcz_store.cc:276] 0709 12:26:50.555402 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.555529 (+   127us) service_pool.cc:224] Handling call
0709 12:26:50.555817 (+   288us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:50.557841 (+  2024us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:50.557870 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:50.560976 (+  3106us) log.cc:844] Serialized 26 byte log entry
0709 12:26:50.738572 (+177596us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:50.738618 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.738681 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:51.776953 (+1038272us) raft_consensus.cc:1685] finished
0709 12:26:51.776977 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:51.777122 (+   145us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1642,"raft.queue_time_us":10558,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":3710,"thread_start_us":155447,"threads_started":1,"wal-append.queue_time_us":427352}
I20260709 12:26:51.829010  5934 leader_election.cc:400] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18.
I20260709 12:26:51.832334  5934 leader_election.cc:403] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:51.287004 12652 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:26:51.698498 12646 consensus_meta.cc:287] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 1.047s	user 0.007s	sys 0.003s
I20260709 12:26:51.832641  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:51.833107  6036 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
W20260709 12:26:51.290694 12682 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.129s	user 0.000s	sys 0.001s
W20260709 12:26:51.483588 12458 consensus_meta.cc:287] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 1.179s	user 0.013s	sys 0.000s
I20260709 12:26:51.828708  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:51.827986  6112 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:26:51.842948  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3399) took 1304 ms. Trace:
I20260709 12:26:51.843246  6112 rpcz_store.cc:276] 0709 12:26:50.538804 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.827420 (+1288616us) service_pool.cc:224] Handling call
0709 12:26:51.827768 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:51.842658 (+ 14890us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:51.842888 (+   230us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:51.834491  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2914) took 2116 ms. Trace:
W20260709 12:26:51.701251 12689 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.262s	user 0.000s	sys 0.000s
I20260709 12:26:51.831908  6111 rpcz_store.cc:276] 0709 12:26:50.306770 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.815414 (+1508644us) service_pool.cc:224] Handling call
0709 12:26:51.815719 (+   305us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:51.815890 (+   171us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:51.815915 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:51.815957 (+    42us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:51.815988 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:51.816038 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:51.816131 (+    93us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:51.301951 12636 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:51.836052  6115 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:51.836544  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:51.867200  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3393) took 1752 ms. Trace:
I20260709 12:26:51.867619  6115 rpcz_store.cc:276] 0709 12:26:50.114980 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.791175 (+1676195us) service_pool.cc:224] Handling call
0709 12:26:51.832839 (+ 41664us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:51.866887 (+ 34048us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:51.867139 (+   252us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:51.828469 12582 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:51.832549 12637 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:51.841959  6645 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:51.791232 12530 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:51.826339 12617 consensus_meta.cc:287] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 1.079s	user 0.017s	sys 0.000s
I20260709 12:26:51.360523 12552 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:51.595789 12656 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:51.282191 12616 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:51.845912  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:51.810881  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:51.898983  6111 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:51.844097  6037 rpcz_store.cc:276] 0709 12:26:49.695447 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.695572 (+   125us) service_pool.cc:224] Handling call
0709 12:26:49.719943 (+ 24371us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:49.859534 (+139591us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:49.859564 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:49.860076 (+   512us) log.cc:844] Serialized 26 byte log entry
0709 12:26:49.965847 (+105771us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:49.965888 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:51.793464 (+1827576us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54001f3454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:51.793515 (+    51us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:51.793557 (+    42us) raft_consensus.cc:1685] finished
0709 12:26:51.793569 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:51.812195 (+ 18626us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7703,"raft.run_cpu_time_us":85,"raft.run_wall_time_us":85,"spinlock_wait_cycles":320158592,"thread_start_us":105416,"threads_started":1,"wal-append.queue_time_us":250560,"wal-append.run_cpu_time_us":2709,"wal-append.run_wall_time_us":1290340}
I20260709 12:26:51.847982 12440 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:51.828815 12592 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:51.851100 12609 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:51.448729 12658 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 14.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:51.854561 12622 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 2.040s	user 0.004s	sys 0.000s
I20260709 12:26:51.854979 12634 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:51.856442 12619 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 18
W20260709 12:26:51.835628 12567 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.068s	user 0.028s	sys 0.055s
I20260709 12:26:51.776670 12564 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:51.863214  6116 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:26:51.448349 12424 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:51.190809 12578 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:51.913193  6116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 3400) took 1370 ms. Trace:
I20260709 12:26:51.873800 12636 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:51.892186  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 617767us
I20260709 12:26:51.895294  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:51.913766  6116 rpcz_store.cc:276] 0709 12:26:50.543187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.216086 (+672899us) service_pool.cc:224] Handling call
0709 12:26:51.913135 (+697049us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:51.899116  6117 raft_consensus.cc:2368] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18.
I20260709 12:26:51.844905 12408 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:51.845261 12646 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:51.837066 12652 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:51.905234  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3401) took 1358 ms. Trace:
I20260709 12:26:51.866892 12458 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:51.920953 12408 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:51.921113 12652 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:51.921793  6114 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:51.922689 12458 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:51.923807  6114 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 3396) took 1800 ms (client timeout 1820 ms). Trace:
W20260709 12:26:51.906821  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 77958.8us
I20260709 12:26:51.911803  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2298) took 1269 ms. Trace:
W20260709 12:26:51.912214  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 65502.8us
I20260709 12:26:51.877856 11722 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:51.846835  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:51.923714  6118 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:51.893862 12617 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:51.901022 12703 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:51.885476 12637 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:51.916249  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:51.892910 12530 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:51.920570  6115 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:26:51.922614 12536 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.StartTabletCopy from 127.0.0.1:50454 (request call id 1566) took 3953 ms. Trace:
I20260709 12:26:51.882561 12582 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:51.924031  6111 rpcz_store.cc:276] 0709 12:26:50.546393 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.904376 (+1357983us) service_pool.cc:224] Handling call
0709 12:26:51.904726 (+   350us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:51.904903 (+   177us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:51.904928 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:51.904973 (+    45us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:51.905003 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:51.905053 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:51.905171 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:26:51.931587  6082 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:51.927021  5934 leader_election.cc:400] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23.
W20260709 12:26:51.924232  6114 rpcz_store.cc:269] 0709 12:26:50.122953 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.427991 (+305038us) service_pool.cc:224] Handling call
0709 12:26:51.923628 (+1495637us) spinlock_profiling.cc:243] Waited 1.38 s on lock 0x7b5400372654. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:51.923753 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3165235072}
I20260709 12:26:51.932242  5934 leader_election.cc:403] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Cancelling election due to peer responding with higher term
I20260709 12:26:51.932776 12567 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:51.924788  6035 rpcz_store.cc:276] 0709 12:26:50.639507 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.639667 (+   160us) service_pool.cc:224] Handling call
0709 12:26:50.658005 (+ 18338us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:50.696334 (+ 38329us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:50.696366 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:50.715272 (+ 18906us) log.cc:844] Serialized 26 byte log entry
0709 12:26:50.946450 (+231178us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:50.946509 (+    59us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:50.946577 (+    68us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:51.908586 (+962009us) raft_consensus.cc:1685] finished
0709 12:26:51.908605 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:51.908825 (+   220us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1505,"raft.queue_time_us":47271,"raft.run_cpu_time_us":145,"raft.run_wall_time_us":4985,"thread_start_us":165972,"threads_started":1,"wal-append.queue_time_us":350831}
I20260709 12:26:51.912794 12634 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:51.933708  6111 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:51.920943 12646 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:51.907575 12592 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:51.908790 12440 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:51.947650  6111 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:51.951431  6113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1561) took 2095 ms. Trace:
I20260709 12:26:51.950519  5934 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:51.908174 12616 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:51.953451  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:51.951864  6113 rpcz_store.cc:276] 0709 12:26:49.851984 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.049621 (+197637us) service_pool.cc:224] Handling call
0709 12:26:50.083135 (+ 33514us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:50.104359 (+ 21224us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:51.947378 (+1843019us) spinlock_profiling.cc:243] Waited 5.87 ms on lock 0x7b5400206054. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:51.947591 (+   213us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":13505408}
I20260709 12:26:51.939702 12564 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:51.924474 12424 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:51.968964 11722 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:51.942538 12704 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:51.969000  5934 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:51.981015  6114 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:51.983829 11722 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:51.984314 11722 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:51.984791 11722 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:51.954172 12617 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:51.989378  6646 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
W20260709 12:26:51.992856  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 165156us
I20260709 12:26:51.966859 12705 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:51.993639 12581 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:51.994901 12616 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:51.996150 12646 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:51.998548 12704 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:51.999624 12697 log.cc:927] Time spent T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:26:52.027311 12399 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:52.001888 12637 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:52.002717 12700 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.090s	user 0.001s	sys 0.000s
I20260709 12:26:52.003261  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:52.005280 12464 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:51.930516 12536 rpcz_store.cc:276] 0709 12:26:47.968891 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.969079 (+   188us) service_pool.cc:224] Handling call
0709 12:26:48.133511 (+164432us) ts_tablet_manager.cc:934] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
0709 12:26:49.874442 (+1740931us) tablet_copy_client.cc:368] Tablet copy session begun
0709 12:26:50.415117 (+540675us) tablet_metadata.cc:665] Metadata flushed
0709 12:26:50.415255 (+   138us) tablet_copy_client.cc:497] Wrote new tablet metadata
0709 12:26:50.706746 (+291491us) tablet_copy_client.cc:418] Wrote new consensus metadata
0709 12:26:50.765982 (+ 59236us) tablet_replica.cc:206] Creating consensus instance
0709 12:26:51.922221 (+1156239us) spinlock_profiling.cc:243] Waited 20.3 ms on lock 0x7b5800085b98. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df301a2 00007f4826e71889 00007f4825fa2d88 00007f4826069973 00007f482606570f 00007f48260672d3 00007f4826098f4e 00007f482607dfdd 00007f482607df89
0709 12:26:51.922379 (+   158us) ts_tablet_manager.cc:989] Replica registered.
0709 12:26:51.922527 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"dns_us":85983,"spinlock_wait_cycles":46663040,"tablet-copy.queue_time_us":94072,"thread_start_us":152596,"threads_started":2}
I20260709 12:26:52.080886 12709 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:52.008841 12582 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.009660 12634 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:52.011672 12530 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.012799  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:52.018666  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 213396us
W20260709 12:26:52.086417  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.028795  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:51.930819 12703 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:52.037424 12440 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.038787 12592 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.039885 12636 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.044570  6114 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:52.047706 11722 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:52.100485 12713 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:52.101236 11722 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:52.056720 12408 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:52.079926 12399 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:52.102819 12408 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:52.104938 12399 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:52.081753 12711 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.105902 12711 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.108116 12711 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:52.088506 12581 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:52.109635  5865 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 329) took 3454 ms. Trace:
I20260709 12:26:52.109321 12581 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:51.850641  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:26:52.111701 12581 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:52.055092  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:52.000326 12701 log.cc:927] Time spent T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.069s	user 0.000s	sys 0.000s
I20260709 12:26:52.054186  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:52.104935 12408 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:52.113957  6647 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1763) took 1085 ms. Trace:
I20260709 12:26:52.115341 12667 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:52.114385  6647 rpcz_store.cc:276] 0709 12:26:51.028868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.029769 (+   901us) service_pool.cc:224] Handling call
0709 12:26:51.030103 (+   334us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:51.052251 (+ 22148us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:51.052283 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:51.068409 (+ 16126us) log.cc:844] Serialized 26 byte log entry
0709 12:26:51.412923 (+344514us) spinlock_profiling.cc:243] Waited 3.07 ms on lock 0x7b180025b8e0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:26:51.632606 (+219683us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:51.632656 (+    50us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:51.632738 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:52.113618 (+480880us) raft_consensus.cc:1685] finished
0709 12:26:52.113639 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:52.113895 (+   256us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":7414,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":13727,"spinlock_wait_cycles":7060736,"thread_start_us":219375,"threads_started":1,"wal-append.queue_time_us":834665}
I20260709 12:26:52.115748 12667 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:26:52.076053  6651 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50454 (request call id 1582) took 1490 ms (client timeout 1650 ms). Trace:
I20260709 12:26:52.076225 12424 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:52.056479 12710 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.022s
I20260709 12:26:52.053803 12705 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:52.081557 12709 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.119591 12705 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:52.078586  6117 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:52.120725  6117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3456) took 1090 ms. Trace:
I20260709 12:26:52.064587 12643 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:52.121833 12643 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.055663 12576 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.065392 12616 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:52.089254  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 60553.4us
I20260709 12:26:52.121258  6117 rpcz_store.cc:276] 0709 12:26:51.030232 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.918147 (+887915us) service_pool.cc:224] Handling call
0709 12:26:51.918382 (+   235us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:52.078425 (+160043us) spinlock_profiling.cc:243] Waited 7.34 ms on lock 0x7b540014f120. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fcbdc0 00007f48210561c0 00007f4821057231 00007f4821053d8f 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c
0709 12:26:52.120476 (+ 42051us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:52.120669 (+   193us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":16872192}
I20260709 12:26:52.090648 12703 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:52.081892 12582 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:52.093801 12531 raft_consensus.cc:1064] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:26:52.081585 12536 tablet_copy_client.cc:806] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:26:52.095824 12704 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:52.136696  6109 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 3449) took 2254 ms (client timeout 1852 ms). Trace:
W20260709 12:26:52.117231  6651 rpcz_store.cc:269] 0709 12:26:50.585995 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.611654 (+ 25659us) service_pool.cc:224] Handling call
0709 12:26:52.075860 (+1464206us) spinlock_profiling.cc:243] Waited 334 ms on lock 0x7b540080b954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:52.075966 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":767737600}
W20260709 12:26:52.114296  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 60191.7us
I20260709 12:26:52.116170 12667 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:52.138383  6611 leader_election.cc:400] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18.
W20260709 12:26:52.137252  6109 rpcz_store.cc:269] 0709 12:26:49.871777 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:49.915051 (+ 43274us) service_pool.cc:224] Handling call
0709 12:26:52.126101 (+2211050us) spinlock_profiling.cc:243] Waited 1.05 s on lock 0x7b540023a0d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:52.126247 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2418227584}
I20260709 12:26:52.140523  6611 leader_election.cc:403] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Cancelling election due to peer responding with higher term
I20260709 12:26:52.121492 12709 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:52.157151 11722 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:52.158085 11722 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:52.166075  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 184910us
I20260709 12:26:52.116070 12652 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:52.173576  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:52.132546 12581 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:52.133313 12424 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:52.136190 12511 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:52.180018 11722 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.197453  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:52.157126 12408 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:52.205407  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:52.170298 12619 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18.
I20260709 12:26:52.157414 12576 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.171773 12536 tablet_copy_client.cc:670] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:26:52.156849 12594 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election lost for term 17. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18.
I20260709 12:26:52.138911 12616 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.142009 12582 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:52.285260  6118 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 3397) took 2152 ms (client timeout 1768 ms). Trace:
I20260709 12:26:52.398643  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:52.208315  6038 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:26:52.348758  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:52.285770  6649 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:52.210705 11722 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.359580  6042 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:52.255188  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:52.392587  6035 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
I20260709 12:26:52.394438  5932 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:52.405241  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:52.393486  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.402863  6118 rpcz_store.cc:269] 0709 12:26:50.132644 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.277540 (+144896us) service_pool.cc:224] Handling call
0709 12:26:52.285009 (+2007469us) spinlock_profiling.cc:243] Waited 1.55 s on lock 0x7b54000e29d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:52.285176 (+   167us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3575275904}
I20260709 12:26:52.402179 11722 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.409638  6037 raft_consensus.cc:2368] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18.
I20260709 12:26:52.404513  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:52.412954  6042 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:52.424891  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 303402us
I20260709 12:26:52.445223  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:52.450978  6113 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:52.443843  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:52.448446  6042 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:52.359059 12635 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.275485 12643 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:52.358491 12328 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:52.430680 12617 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader election lost for term 22. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23.
I20260709 12:26:52.458319  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:52.392590 12714 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:52.410559 12552 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.463109  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:52.407310 12588 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.484225 12705 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:52.484350 12588 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.255092 12440 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:52.464998  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:52.255541 12712 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:52.468291 11722 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.465895  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:52.467775  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:52.110064  5865 rpcz_store.cc:276] 0709 12:26:48.655635 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:48.655794 (+   159us) service_pool.cc:224] Handling call
0709 12:26:49.019297 (+363503us) spinlock_profiling.cc:243] Waited 172 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbe090 00007f482105cf3a 00007f4826e12e9c 00007f4826f1104e 00007f48253d22a4 00007f48253d2232 00007f48253d2161 00007f48253d20dc 00007f48253d1392 00007f481f38f48c 00007f481f38e8c6
0709 12:26:52.109552 (+3090255us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:49.571187 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:49.571758 (+   571us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:49.571790 (+    32us) write_op.cc:435] Acquired schema lock
0709 12:26:49.571806 (+    16us) tablet.cc:662] Decoding operations
0709 12:26:49.572166 (+   360us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:49.572250 (+    84us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:49.572281 (+    31us) tablet.cc:685] Acquiring locks for 1 operations
0709 12:26:49.573758 (+  1477us) tablet.cc:701] Row locks acquired
0709 12:26:49.573778 (+    20us) write_op.cc:260] PREPARE: finished
0709 12:26:49.574081 (+   303us) write_op.cc:270] Start()
0709 12:26:49.574228 (+   147us) write_op.cc:276] Timestamp: P: 1783600009573883 usec, L: 0
0709 12:26:49.574249 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:26:49.575128 (+   879us) log.cc:844] Serialized 538 byte log entry
0709 12:26:49.719910 (+144782us) op_driver.cc:464] REPLICATION: finished
0709 12:26:50.167329 (+447419us) write_op.cc:301] APPLY: starting
0709 12:26:50.170348 (+  3019us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:50.451403 (+281055us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:50.455941 (+  4538us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:50.564704 (+108763us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:50.577009 (+ 12305us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=2,key_file_lookups=2,delta_file_lookups=2,mrs_lookups=0
0709 12:26:50.589747 (+ 12738us) write_op.cc:312] APPLY: finished
0709 12:26:50.634219 (+ 44472us) log.cc:844] Serialized 25 byte log entry
0709 12:26:50.651692 (+ 17473us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:50.719170 (+ 67478us) write_op.cc:454] Released schema lock
0709 12:26:50.746667 (+ 27497us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:50.822784 (+ 76117us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:50.824525 (+  1741us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":809979,"reported_tablets":1,"spinlock_wait_cycles":396442368,"child_traces":[["op",{"apply.queue_time_us":410903,"apply.run_cpu_time_us":16681,"apply.run_wall_time_us":640430,"cfile_cache_hit":6,"cfile_cache_hit_bytes":8309,"num_ops":1,"prepare.queue_time_us":342093,"prepare.run_cpu_time_us":3058,"prepare.run_wall_time_us":8238,"replication_time_us":145514,"thread_start_us":461996,"threads_started":2}]]}
I20260709 12:26:52.210407 12592 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:52.477203  6649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1759) took 1919 ms. Trace:
I20260709 12:26:52.475720 12328 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.480701 12570 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:52.407722 12408 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.483321 12531 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 11, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.469417 12709 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.206701 12424 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.520710 11722 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.432219 12576 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.537873 11722 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.211126 12511 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.524401  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:52.539101  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 411145us
I20260709 12:26:52.203181 12581 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.459877 12691 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:52.458591 12698 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:26:52.462656 12720 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:52.539126  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:52.486424 12588 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.519471 12634 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.540230 12681 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.464475 12619 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.077s
I20260709 12:26:52.531304 12617 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:52.463850 12554 consensus_queue.cc:1059] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.077s
I20260709 12:26:52.463873 12711 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 12:26:52.555938  6042 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:52.543442  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 138284us
I20260709 12:26:52.557484 11722 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.554860  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:52.577041  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:52.476791 12686 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.073s
W20260709 12:26:52.551126  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 383101us
I20260709 12:26:52.548345 12539 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:52.473109 12635 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:52.519266 12552 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.530441 12440 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.608929  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:52.609913 12562 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:52.610333 12562 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:52.520246 12714 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.610579  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:52.611734  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:52.612768  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:52.613830  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:52.614388  6116 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:52.615164  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:52.616016 12424 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.616345 12705 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:52.616966  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:52.603436 12724 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:52.618944 12726 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.058s	user 0.000s	sys 0.000s
I20260709 12:26:52.619277  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:52.619928 12716 log.cc:927] Time spent T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:26:52.621620 12539 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.622128 12576 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.582755  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3398) took 2052 ms. Trace:
I20260709 12:26:52.623821 12539 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:52.571190 12681 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.530061 12712 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:52.547847 12709 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.626834 12609 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.627228 12712 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:52.627386 12709 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:52.567915 12634 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.573577 12720 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:52.627405 12609 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.629544 12634 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.630429 12609 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.610105  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:52.631603  6645 raft_consensus.cc:2393] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 15: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:52.583519  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:52.632454  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:52.632807  6036 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:52.633661  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:52.634353  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:52.634720  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:52.634980  6041 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:26:52.635949  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:52.636524  6036 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:52.556447 12691 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.637351  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:52.594751 12636 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:52.638643 12691 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.540498 12570 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.616966 12616 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.588347 12582 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.586913 12328 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.599313 11722 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.642693 11722 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:52.598665 12728 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:52.644551 11722 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:52.598734 12575 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:52.644598 12728 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.645205 12575 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:52.645612 12575 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:52.647042 12728 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.602010  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:52.601238  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:52.603740  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:52.605490  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:52.539721 12592 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.616232  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:52.597710  6009 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:52.587585 12511 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.585155 12581 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.638841 12636 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:52.648500  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:52.602648  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:52.649844  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52213.7us
I20260709 12:26:52.620002  6044 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 18: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:52.622701  6110 rpcz_store.cc:276] 0709 12:26:50.530721 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.828080 (+1297359us) service_pool.cc:224] Handling call
0709 12:26:51.828805 (+   725us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:52.034419 (+205614us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:52.035575 (+  1156us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:52.088742 (+ 53167us) log.cc:844] Serialized 26 byte log entry
0709 12:26:52.460257 (+371515us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:52.475962 (+ 15705us) log.cc:844] Serialized 14 byte log entry
0709 12:26:52.476219 (+   257us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:52.476298 (+    79us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:52.582521 (+106223us) raft_consensus.cc:1685] finished
0709 12:26:52.582544 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:52.582694 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":15594,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":4305,"raft.queue_time_us":20073,"raft.run_cpu_time_us":92,"raft.run_wall_time_us":92,"spinlock_wait_cycles":14553984,"thread_start_us":549007,"threads_started":2,"wal-append.queue_time_us":469215}
I20260709 12:26:52.627826  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:52.638411  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:53.051340  6042 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
W20260709 12:26:52.661237  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.055024  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:52.825268  6041 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 23.
I20260709 12:26:52.706494  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:52.782290  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:52.680457  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:53.063584  6116 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:26:53.061010  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:53.066499  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.890280  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 314811us
W20260709 12:26:52.753631  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:52.889562  6112 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.718s	user 0.000s	sys 0.013s
W20260709 12:26:53.069478  6112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.898s	user 0.000s	sys 0.020s
I20260709 12:26:53.057385  6036 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:53.078018  6036 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:53.061477  6650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1770) took 1134 ms. Trace:
I20260709 12:26:53.083364  6650 rpcz_store.cc:276] 0709 12:26:51.926749 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.926910 (+   161us) service_pool.cc:224] Handling call
0709 12:26:51.932842 (+  5932us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:51.933050 (+   208us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:51.933073 (+    23us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:51.935001 (+  1928us) log.cc:844] Serialized 26 byte log entry
0709 12:26:52.401570 (+466569us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:52.401609 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:52.401679 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:52.791007 (+389328us) raft_consensus.cc:1685] finished
0709 12:26:52.791029 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:53.061417 (+270388us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":425451,"threads_started":1,"wal-append.queue_time_us":754561}
I20260709 12:26:53.059010  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:53.061501  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.078891  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:52.660257  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:53.052758  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.079357 12681 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.642198 12570 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:53.118909  5964 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
W20260709 12:26:53.120690  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 61763.9us
I20260709 12:26:53.122017 12588 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.634824 12652 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:53.057967  6643 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
W20260709 12:26:53.016465 12667 consensus_meta.cc:287] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.844s	user 0.010s	sys 0.000s
I20260709 12:26:53.132345 12667 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.132736  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.134362  5968 raft_consensus.cc:3055] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:53.134650 12539 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:53.134730  5968 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:53.073137 12562 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.108150  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:53.139840  5966 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:53.109485  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:53.116637  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:53.106649  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.116783  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.123522  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:53.125180  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 55998.7us
I20260709 12:26:53.105243  5962 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: [16.14-16.14]
W20260709 12:26:53.117383  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 456268us
I20260709 12:26:52.781556 12720 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:52.880667 12714 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:53.118340 12619 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:53.128749 12328 consensus_queue.cc:1059] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 17.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:53.142616  6645 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:52.677464 12634 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:52.772145 12567 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.131057 12636 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:52.610136 12440 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.630896 12408 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:52.724352 12582 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:53.135116  6644 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:53.127334  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:53.183714  6036 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:53.145084  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:53.136234  5968 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.136276 12562 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:53.027242 12724 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:53.125504 12657 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:53.153800  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:53.129120 12703 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:53.159391  6116 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:26:52.772919 12574 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:52.720875 12616 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:52.729009 12735 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.129549 12588 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:53.163102  5978 tablet_copy_service.cc:342] P f1bb8e63c2b448cdafd51f05d277c741: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-a0b00ef9114f441baff2557bc164b4d7 received from {username='slave'} at 127.0.0.1:37174
I20260709 12:26:53.148044 12619 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:53.164193  6609 leader_election.cc:400] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18.
W20260709 12:26:53.209712  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45662.9us
I20260709 12:26:53.164052  6084 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:53.164626 12570 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:26:53.168013  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.013741 12552 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:53.170061  5934 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:52.705226 12712 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.467s
I20260709 12:26:52.647682 12617 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:53.214740  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 50760.2us
I20260709 12:26:52.996820 12592 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:53.098502 12704 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.179353  5964 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 23.
I20260709 12:26:53.225638  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:53.185101  5968 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:53.128921 12652 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:53.191218  5961 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:53.232268  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.211476 12619 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:53.235948  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.206710  6036 raft_consensus.cc:2410] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 18 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:26:53.122996 12705 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.067s
I20260709 12:26:53.224501 12531 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:53.198982 12581 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:53.214216  5978 tablet_copy_service.cc:434] P f1bb8e63c2b448cdafd51f05d277c741: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-a0b00ef9114f441baff2557bc164b4d7 on tablet a0b00ef9114f441baff2557bc164b4d7 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:53.215335  5934 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:53.212180 12575 consensus_meta.cc:287] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.566s	user 0.010s	sys 0.001s
I20260709 12:26:53.199234 12574 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:53.181555  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.184007 12567 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:53.192600  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 47589.9us
I20260709 12:26:53.279143  5961 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:53.198263  5966 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:26:53.215114 12724 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:53.281683  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.239595  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.282629  5966 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 21: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:53.240013  6044 raft_consensus.cc:2393] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 17: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:53.194744 12582 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:53.211081  5962 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:53.278118  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:53.208220 12657 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.210276 12616 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:53.284482  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:53.256371 12531 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:53.277551  5959 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:26:53.210047 12735 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.254175 12536 tablet_copy_client.cc:538] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:26:53.285181  5961 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:53.277401  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:53.223430 12617 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:53.285732  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 70457.7us
I20260709 12:26:53.232573 12704 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:53.287788  6608 leader_election.cc:400] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 25. Current term is 26.
I20260709 12:26:53.287773  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.256749 12581 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:53.291765  5966 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:26:53.300832  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.301563  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:53.301888  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.293115  5959 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:53.302747  6110 raft_consensus.cc:2393] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 19: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:53.302563  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.303455  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.297303  6608 leader_election.cc:403] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 election: Cancelling election due to peer responding with higher term
I20260709 12:26:53.279487 12575 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.291246 12686 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:53.291623 12531 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:53.305757  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:53.313848  6110 raft_consensus.cc:2368] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13.
I20260709 12:26:53.304824  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.286422 12720 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:53.308478  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:53.327903  6648 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:53.329257  5961 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:26:53.332976  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:53.346211  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 58539.8us
I20260709 12:26:53.304193 12581 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:53.293623 12744 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:53.356249  6036 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:53.349213  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:53.348178  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:53.360404  6651 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:53.371778  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:53.389827  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 161291us
I20260709 12:26:53.392225  6643 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:53.392400  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:53.306674  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.400887  5934 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:53.406787  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:53.480517  5968 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:26:53.408548 12747 log.cc:927] Time spent T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.120s	user 0.000s	sys 0.000s
W20260709 12:26:53.409379 12743 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:26:53.409940 12745 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.184s	user 0.000s	sys 0.001s
W20260709 12:26:53.410568 12741 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.145s	user 0.001s	sys 0.000s
W20260709 12:26:53.411291 12740 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.107s	user 0.000s	sys 0.000s
I20260709 12:26:53.410573 12635 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:53.417128  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3458) took 2378 ms. Trace:
I20260709 12:26:53.418179  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2306) took 1234 ms. Trace:
I20260709 12:26:53.423462 12511 raft_consensus.cc:3055] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:53.423713 12735 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:53.426623 12408 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:52.527557  6649 rpcz_store.cc:276] 0709 12:26:50.557484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.557809 (+   325us) service_pool.cc:224] Handling call
0709 12:26:50.561228 (+  3419us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:52.285527 (+1724299us) spinlock_profiling.cc:243] Waited 785 ms on lock 0x7b580044c3d0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fb00aa 00007f4821032447 00007f482104afe7 00007f482104c7de 00007f4821056b49 00007f4821057416 00007f4821053d8f 00007f482105383e 00007f4826018419 00007f481f58fbd4
0709 12:26:52.476568 (+191041us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:26:52.476597 (+    29us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:52.476641 (+    44us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:52.476940 (+   299us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:52.477010 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:52.477141 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4047,"raft.queue_time_us":4151,"raft.run_cpu_time_us":124,"raft.run_wall_time_us":39227,"spinlock_wait_cycles":1806335744}
I20260709 12:26:53.437526 12588 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:53.355140 12570 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:26:53.438920 12582 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:53.448073 12744 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:53.465325  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:53.467487  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:53.470527  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:53.472990  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 114129us
I20260709 12:26:53.473824  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:53.475782  5967 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:53.526026  6608 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:53.476874  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:53.374369 12642 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:53.482111  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:53.492170  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:53.485608  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.527978  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.353609 12720 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:53.503203  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 102404us
I20260709 12:26:53.490645  6112 rpcz_store.cc:276] 0709 12:26:51.038597 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:51.925539 (+886942us) service_pool.cc:224] Handling call
0709 12:26:51.925817 (+   278us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:51.942107 (+ 16290us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:26:52.171048 (+228941us) log.cc:844] Serialized 14 byte log entry
0709 12:26:53.129770 (+958722us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:53.129820 (+    50us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:53.129868 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.416831 (+286963us) spinlock_profiling.cc:243] Waited 16.1 ms on lock 0x7b5400239bd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:53.416889 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:53.417059 (+   170us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":54875,"prepare.queue_time_us":50891,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":35,"raft.queue_time_us":60934,"raft.run_cpu_time_us":75,"raft.run_wall_time_us":75,"spinlock_wait_cycles":36924672,"thread_start_us":1127660,"threads_started":2,"wal-append.queue_time_us":1051306}
I20260709 12:26:53.492280  6043 rpcz_store.cc:276] 0709 12:26:52.183950 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.184083 (+   133us) service_pool.cc:224] Handling call
0709 12:26:52.399655 (+215572us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:52.555982 (+156327us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:26:52.988162 (+432180us) log.cc:844] Serialized 14 byte log entry
0709 12:26:53.281025 (+292863us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:53.281075 (+    50us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:26:53.281131 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.417929 (+136798us) spinlock_profiling.cc:243] Waited 156 ms on lock 0x7b5400171454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:53.417978 (+    49us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:53.418114 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":32116,"prepare.run_cpu_time_us":29,"prepare.run_wall_time_us":30,"raft.queue_time_us":1234,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":5937,"spinlock_wait_cycles":359011072,"thread_start_us":705108,"threads_started":2,"wal-append.queue_time_us":380021}
I20260709 12:26:53.529882  5934 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:53.528265  5962 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:53.530850  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:53.534543  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:53.515486  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:53.518415  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.521698  5968 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
W20260709 12:26:53.536263  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.524190  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:53.353910 12574 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.527343  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:53.502693 12592 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:53.537969  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.501441 12575 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:53.488458 12670 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:53.541191  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:53.542887  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.543576  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.551178  6038 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:53.500964 12511 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:53.544816  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:53.550798  6110 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:53.549036  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:53.550570  6112 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:26:53.553575  6113 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:53.552009  6111 raft_consensus.cc:2376] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21. Re-sending same reply.
W20260709 12:26:53.554647  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 74467.1us
I20260709 12:26:53.526616 12617 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:53.563519  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.561722  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.564685  6113 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:26:53.568681  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.528501 12744 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:53.573642  6117 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:53.560492  5962 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:53.694633  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.561826  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.695538  6118 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:26:53.562393  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.562565  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:53.598011  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 70748.3us
I20260709 12:26:53.697753  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:53.699115  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:53.565393  6112 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:53.600643  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2309) took 1389 ms. Trace:
I20260709 12:26:53.600705 12668 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:53.602015 12750 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.153s	user 0.000s	sys 0.000s
I20260709 12:26:53.602571 12667 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:53.604269 12569 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.548039 12635 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:53.563025 12574 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:53.607020  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:53.561142 12583 consensus_queue.cc:1175] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0557a7246c8945b99e5215c99d4ddf9c" responder_term: 20 status { last_received { term: 20 index: 15 } last_committed_idx: 15 last_received_current_leader { term: 20 index: 15 } }
I20260709 12:26:53.617740  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:53.619689  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:53.726963  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.620613  6113 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:26:53.621654  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.622830  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:53.622997  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.728662  5967 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:53.729760  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.731037  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:53.731644  5967 raft_consensus.cc:2376] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 23. Re-sending same reply.
I20260709 12:26:53.623670  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:53.733093  5961 raft_consensus.cc:2376] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18. Re-sending same reply.
I20260709 12:26:53.623194  5861 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 18 to 19, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 19 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.624761  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.627784  6644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 1586) took 1500 ms. Trace:
I20260709 12:26:53.545655 12588 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:53.735997  6644 rpcz_store.cc:276] 0709 12:26:52.127869 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.128075 (+   206us) service_pool.cc:224] Handling call
0709 12:26:52.128420 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:53.187281 (+1058861us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.627546 (+440265us) spinlock_profiling.cc:243] Waited 1.01 s on lock 0x7b54006aead4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:53.627723 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2314774272}
I20260709 12:26:53.633090 12704 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:53.545436 12582 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:53.640228 12720 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:53.549690 12616 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:53.537705 12739 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:53.648694  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:53.650131 12598 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:53.650772 12567 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:53.651751  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:53.544914 12642 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:53.656034  6649 raft_consensus.cc:2410] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 12:26:53.564752 12670 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:53.769985  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.771212  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.660344 12657 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:53.664160 12562 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:53.666577 12458 consensus_queue.cc:1059] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:53.667521  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:53.570899 12735 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:53.567747  6042 raft_consensus.cc:2955] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:26:53.676323  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.529707 12539 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:53.677467  6110 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:53.754153 12739 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:53.777846 12739 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:53.778107  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.565990  6114 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:53.778331  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.601176 12511 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:53.705622  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 150077us
I20260709 12:26:53.706246  6115 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 21: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:53.706573  6109 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 16: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:53.707445  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:53.702020  6040 rpcz_store.cc:276] 0709 12:26:52.210811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:52.211232 (+   421us) service_pool.cc:224] Handling call
0709 12:26:52.211580 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:52.559049 (+347469us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:52.559080 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:52.571004 (+ 11924us) log.cc:844] Serialized 26 byte log entry
0709 12:26:52.800448 (+229444us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:26:52.800488 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:53.424183 (+623695us) spinlock_profiling.cc:243] Waited 347 ms on lock 0x7b5400270454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:53.424230 (+    47us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:53.597393 (+173163us) raft_consensus.cc:1685] finished
0709 12:26:53.597417 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:53.600562 (+  3145us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":797565184,"thread_start_us":212715,"threads_started":1,"wal-append.queue_time_us":704694}
I20260709 12:26:53.779036  5964 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:53.708779  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.779932  6112 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:53.780756  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:53.711798  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.711773  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.558287  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:53.782810  6118 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:53.718576  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.719278  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.723569  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:53.738188  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.738646  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:53.746876  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.712189 12686 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:53.790071  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.791286  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.792428  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.747880  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:53.747880  5966 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:53.735049  5861 catalog_manager.cc:5697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 17 to 18, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 18 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:26:53.794250  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.794876  5966 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:26:53.795720  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.796701  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.797694  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.750275  5961 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19. Ops: [18.11-18.11]
I20260709 12:26:53.799007  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.714622 12759 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:53.751003  5967 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:53.752764  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.727869 12635 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.753624  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.802177  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.757236  5959 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:53.759157 12598 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:53.737900 12408 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:53.751477 12724 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.723045 12569 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.831971  6113 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:53.833194 12569 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:53.772611 12766 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.044s
I20260709 12:26:53.770068 12642 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.839407  6113 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:53.842680 12662 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:53.843649 12662 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:26:53.816119 12511 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:53.771278 12670 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:53.657260 12399 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:53.851089 12399 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:53.772342 12619 consensus_meta.cc:287] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.514s	user 0.008s	sys 0.003s
I20260709 12:26:53.772293  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:53.854354 12619 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:53.855343  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:53.783507  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 225262us
I20260709 12:26:53.856422  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:53.790078  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:53.803534  5861 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 15 to 16, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 16 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:26:53.856874 12619 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:53.787036  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.815629  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.814391  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.818537  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.858767 12657 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:53.819196  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:53.859956  6114 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:53.821069  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.822132  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.790702 12735 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:53.822813  5965 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:26:53.827682  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 47231.5us
W20260709 12:26:53.827891  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 160472us
I20260709 12:26:53.864496  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:53.868661  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.824213  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.829864  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:53.871800  5966 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19. Ops: []
I20260709 12:26:53.772889 12562 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.858278  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.830523  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:53.874531  5962 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:26:53.855592  5963 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:53.793658 12686 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:53.878640 12686 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:53.805661 12759 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:53.873935  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:53.859357  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:53.877833 12769 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:53.882882  6646 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:26:53.886979  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:53.873704  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:53.887984  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:53.866243  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:53.874709  5964 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:53.892323  6110 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:53.776260 12581 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.890090  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:53.895687  6645 pending_rounds.cc:85] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 10
I20260709 12:26:53.896147  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:53.898720  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:53.900254  6648 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 14: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:53.901269  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:53.904946  6113 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:53.906392  5961 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 21 index: 12. (index mismatch)
I20260709 12:26:53.908401  5961 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:53.853781 12399 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:53.912276  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:26:53.913239  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:26:53.914268  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.910823  5934 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:53.920027  5934 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:53.925566  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:53.896106  6645 pending_rounds.cc:107] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:26:53.931532  6645 raft_consensus.cc:2889] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:53.823333 12744 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.932989  5964 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:26:53.890692 12759 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:53.886015 12735 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:53.890614 12616 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:53.890825 12769 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:53.897642 12720 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:26:53.943938  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 199101us
I20260709 12:26:53.909735 12619 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:53.917546 12569 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:53.918931 12592 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:26:53.867170 12408 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.922600 12617 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:53.957091  5965 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:53.871582 12724 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:53.934108 12705 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election won for term 19
W20260709 12:26:53.957765  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 172443us
I20260709 12:26:53.937985 12399 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:53.943034 12582 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:53.939868 12768 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:26:53.950515 12539 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:53.922222 12670 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.038s
W20260709 12:26:54.010680  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 96129.5us
I20260709 12:26:53.948786 12769 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:26:53.966205 12531 consensus_meta.cc:287] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.638s	user 0.004s	sys 0.005s
I20260709 12:26:54.040280  5967 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:26:53.947925 12758 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:26:53.960599 12616 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:54.011960  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 328010us
W20260709 12:26:54.095913  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 52537.3us
W20260709 12:26:54.097503  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:53.965814 12598 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:54.006973 12705 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:54.003988 12709 consensus_queue.cc:1059] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.097s
I20260709 12:26:54.042646 12768 raft_consensus.cc:697] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:54.109194  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 196016us
W20260709 12:26:54.102747 12570 consensus_meta.cc:287] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.580s	user 0.013s	sys 0.005s
I20260709 12:26:54.125388  6114 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:54.011579 12539 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:54.128003 12570 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 26 FOLLOWER]: Leader election lost for term 25. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 25. Current term is 26.
I20260709 12:26:54.143199  6650 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 26 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:26:54.155011 12635 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:54.096675 12531 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:54.160975 12531 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:54.161876 12768 consensus_queue.cc:237] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 11.6, Last appended by leader: 6, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:54.169637  6116 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:54.127769 12562 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:54.185575 12328 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Stepping down as leader of term 13
W20260709 12:26:54.186094 12761 log.cc:927] Time spent T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.176s	user 0.001s	sys 0.000s
W20260709 12:26:54.187561 12771 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:26:54.188712 12770 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:26:54.190961 12767 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.238s	user 0.000s	sys 0.001s
I20260709 12:26:54.186122 12328 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:54.192453 12539 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:54.192729 12328 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:54.194108 12328 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:54.195835  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 2945) took 1803 ms. Trace:
I20260709 12:26:54.196228  6042 rpcz_store.cc:276] 0709 12:26:52.392079 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.113700 (+721621us) service_pool.cc:224] Handling call
0709 12:26:53.114258 (+   558us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:26:53.160542 (+ 46284us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:53.160572 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:26:53.163333 (+  2761us) log.cc:844] Serialized 525 byte log entry
0709 12:26:53.523267 (+359934us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:53.815324 (+292057us) log.cc:844] Serialized 14 byte log entry
0709 12:26:53.872999 (+ 57675us) log.cc:844] Serialized 14 byte log entry
0709 12:26:54.195068 (+322069us) spinlock_profiling.cc:243] Waited 4.18 ms on lock 0x7b18003ec4a0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481dee1c0a 00007f4827621219 00007f4824f2858f 00007f481df67571 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd
0709 12:26:54.195435 (+   367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.195510 (+    75us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:54.195633 (+   123us) raft_consensus.cc:1685] finished
0709 12:26:54.195646 (+    13us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.195777 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":375545,"prepare.queue_time_us":58473,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":371519,"raft.run_cpu_time_us":326,"raft.run_wall_time_us":43687,"spinlock_wait_cycles":9608448,"thread_start_us":359534,"threads_started":1,"wal-append.queue_time_us":566259}
I20260709 12:26:54.198052 12744 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:54.198335  6109 raft_consensus.cc:1240] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:54.187553 12581 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:54.200606  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:54.201850 12536 tablet_bootstrap.cc:492] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:26:54.204382  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:54.204154 12759 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:54.205945  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:54.177452 12724 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:54.228308  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:54.135466 12569 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:54.235234  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:54.240001  6648 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14. Ops: []
W20260709 12:26:54.236495  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 118589us
I20260709 12:26:54.241488 12634 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election won for term 21
W20260709 12:26:54.250349  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 330358us
I20260709 12:26:54.259722  5934 leader_election.cc:400] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13.
I20260709 12:26:54.260143  5934 leader_election.cc:403] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:26:54.272332  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 325547us
I20260709 12:26:54.273371  6081 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:54.239876 12657 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:54.230122 12758 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:54.249845 12634 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:54.309139  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 65847.1us
I20260709 12:26:54.321415  6082 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:54.339004  6650 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:26:54.238756 12652 consensus_queue.cc:1059] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.077s
I20260709 12:26:54.205884 12705 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:54.260561 12458 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.314975 12724 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 12. Current term is 13.
W20260709 12:26:54.336668 12574 consensus_meta.cc:287] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.598s	user 0.007s	sys 0.003s
I20260709 12:26:54.310140 12657 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:54.373271  6006 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:54.374377  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:54.375777  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 61171us
I20260709 12:26:54.336831 12634 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:54.377203  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:54.377400  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:54.386507  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 65193.9us
I20260709 12:26:54.387598  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:54.375777  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 102503us
I20260709 12:26:54.389171  6081 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:54.377367  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 126197us
W20260709 12:26:54.336681  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 331047us
W20260709 12:26:54.381991  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.378512  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:54.383575  6643 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:26:54.314138 12581 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.068s
W20260709 12:26:54.397435  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:54.406843  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.428419 12424 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:54.432857  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:54.434329 12574 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:54.440753  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:54.441375  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:54.444537  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:54.445398  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:54.446367  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:54.447606  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:26:54.449326  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 60234.4us
I20260709 12:26:54.450066  6081 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:54.452634  6081 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:54.457180  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:54.458904  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:54.465369  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.479897  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:54.485747  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:54.486886  6644 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 26.
W20260709 12:26:54.488758  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 115562us
I20260709 12:26:54.489696  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:54.492936  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:54.494621  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:54.384356 12657 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:54.497001  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 109484us
W20260709 12:26:54.501245  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.506017  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:54.507192  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:54.508603  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 55987.1us
I20260709 12:26:54.503472  6006 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:54.511951  6081 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:54.392163 12399 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:54.394742 12619 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.374513 12458 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:54.496737 12739 consensus_meta.cc:287] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.707s	user 0.006s	sys 0.005s
I20260709 12:26:54.512625  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:54.375922 12703 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.122s
I20260709 12:26:54.395066 12575 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:54.483906 12635 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:54.524811  5963 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 10 index: 9. (index mismatch)
W20260709 12:26:54.496268 12511 consensus_meta.cc:287] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.650s	user 0.011s	sys 0.000s
I20260709 12:26:54.701567 12562 raft_consensus.cc:3055] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:54.504076 12772 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.175s
I20260709 12:26:54.607614 12681 raft_consensus.cc:3055] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:54.700532 12536 tablet_bootstrap.cc:700] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: Time spent opening tablet: real 0.101s	user 0.002s	sys 0.000s
I20260709 12:26:54.603011 12766 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:54.618676 12784 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:26:54.598865  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:54.653143 12634 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:54.600948 12636 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:54.612385  6643 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50454 (request call id 1597) took 1122 ms. Trace:
I20260709 12:26:54.768901 12803 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.742578 12328 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:26:54.690187 12769 consensus_meta.cc:287] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.588s	user 0.004s	sys 0.006s
I20260709 12:26:54.619904 12588 raft_consensus.cc:3055] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:26:54.605690 12686 consensus_meta.cc:287] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.727s	user 0.008s	sys 0.003s
I20260709 12:26:54.513442 12424 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:54.504459 12758 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:54.744302  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:54.825445  5962 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:54.745445  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:54.544175 12739 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:54.605564 12408 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:54.622869 12399 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:54.648319 12759 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:54.747023  5934 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:54.830251  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 324296us
I20260709 12:26:54.747615 12575 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:54.504735 12652 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:54.495936 12531 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:26:54.459681 12789 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:54.612361  6115 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
W20260709 12:26:54.617921  6116 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 3477) took 1320 ms (client timeout 1708 ms). Trace:
W20260709 12:26:54.840819  6116 rpcz_store.cc:269] 0709 12:26:53.298018 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.303216 (+  5198us) service_pool.cc:224] Handling call
0709 12:26:54.617721 (+1314505us) spinlock_profiling.cc:243] Waited 865 ms on lock 0x7b540020c454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:54.617859 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1990063872}
I20260709 12:26:54.392264 12569 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:54.543386 12619 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:54.731863 12787 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:26:54.754236  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 61811.5us
I20260709 12:26:54.739537 12657 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:54.736881  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3042) took 1181 ms. Trace:
I20260709 12:26:54.769747  6041 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17. Ops: []
W20260709 12:26:54.742087  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 229533us
I20260709 12:26:54.855974  6006 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:54.777619  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 525433us
I20260709 12:26:54.797961  6044 raft_consensus.cc:2410] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 19 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 10.
W20260709 12:26:54.766593 12768 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.017s	sys 0.025s
W20260709 12:26:54.802124  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.815620  6643 rpcz_store.cc:276] 0709 12:26:53.489933 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.490376 (+   443us) service_pool.cc:224] Handling call
0709 12:26:54.612220 (+1121844us) spinlock_profiling.cc:243] Waited 847 ms on lock 0x7b54005ac154. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:54.612329 (+   109us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1947064064}
W20260709 12:26:54.725299  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 213408us
I20260709 12:26:54.779345 12562 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:54.800645 12681 raft_consensus.cc:740] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:54.799978 12635 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:54.824069  6042 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:54.800104 12703 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:54.828224  5967 raft_consensus.cc:2393] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:54.611855 12458 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:54.831175  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:54.848611  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:54.833405  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 86480.5us
I20260709 12:26:54.822654 12588 raft_consensus.cc:740] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:54.856272  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.827723 12800 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.863032  5960 raft_consensus.cc:2393] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 17: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:54.824388 12769 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:54.827067 12328 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:54.821030 12803 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:54.828121 12686 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:55.501873  6044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 3063) took 1756 ms (client timeout 2079 ms). Trace:
I20260709 12:26:54.853629  5968 rpcz_store.cc:276] 0709 12:26:53.555696 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.556927 (+  1231us) service_pool.cc:224] Handling call
0709 12:26:53.557181 (+   254us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:53.566951 (+  9770us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:26:53.679840 (+112889us) log.cc:844] Serialized 14 byte log entry
0709 12:26:54.308734 (+628894us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:54.308802 (+    68us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:54.308858 (+    56us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.736562 (+427704us) spinlock_profiling.cc:243] Waited 9.57 ms on lock 0x7b54001cacd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:54.736619 (+    57us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:54.736797 (+   178us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7829,"prepare.queue_time_us":112500,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":29002,"raft.run_cpu_time_us":8766,"raft.run_wall_time_us":45001,"spinlock_wait_cycles":22009216,"thread_start_us":620613,"threads_started":2,"wal-append.queue_time_us":282915}
I20260709 12:26:54.984127  6039 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16. Ops: []
W20260709 12:26:54.930501  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:54.935927  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 71486.6us
W20260709 12:26:55.504448  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:54.910728  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.054638  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:55.499529  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 643604us
I20260709 12:26:55.504467  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:55.506392  6006 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:55.006824  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:54.850018 12399 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:26:55.502920  6044 rpcz_store.cc:269] 0709 12:26:53.745502 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.792178 (+ 46676us) service_pool.cc:224] Handling call
0709 12:26:55.501656 (+1709478us) spinlock_profiling.cc:243] Waited 1 s on lock 0x7b54001f2f54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:55.501809 (+   153us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2310598912}
W20260709 12:26:54.860911 12768 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.695s	user 0.017s	sys 0.025s
I20260709 12:26:54.848587 12788 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:55.511874  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:54.848433 12408 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:55.516927  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 654799us
I20260709 12:26:55.057358 12424 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:54.939664 12636 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:55.539427  6649 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:54.982239 12570 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.541997  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:55.543077  6036 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.580s	user 0.014s	sys 0.024s
I20260709 12:26:55.263069 12575 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:55.237474 12739 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:55.299530 12652 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.306869 12657 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:55.499528 12619 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:55.116863 12804 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:54.861718 12531 raft_consensus.cc:697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:55.588650  6649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1793) took 1721 ms. Trace:
I20260709 12:26:55.589099  6649 rpcz_store.cc:276] 0709 12:26:53.867199 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.868479 (+  1280us) service_pool.cc:224] Handling call
0709 12:26:53.870897 (+  2418us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:55.547729 (+1676832us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.588399 (+ 40670us) spinlock_profiling.cc:243] Waited 1.67 s on lock 0x7b54004b8cd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:55.588584 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3836654976}
W20260709 12:26:55.591141  6041 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.014s	sys 0.017s
W20260709 12:26:55.591483  6041 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.014s	sys 0.017s
W20260709 12:26:55.550985  6111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.689s	user 0.014s	sys 0.026s
W20260709 12:26:55.552901  6036 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.590s	user 0.014s	sys 0.024s
I20260709 12:26:55.554647  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3491) took 1105 ms. Trace:
W20260709 12:26:55.592971  6111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.739s	user 0.014s	sys 0.027s
I20260709 12:26:55.557014 12793 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:54.964047 12511 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.584s
I20260709 12:26:55.533047 12795 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:55.510236 12662 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.050s
I20260709 12:26:55.510061 12703 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:55.585850  5966 raft_consensus.cc:1240] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: []
W20260709 12:26:55.591828  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 66883.2us
I20260709 12:26:55.538650 12788 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:55.594707  5960 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 3043) took 1965 ms (client timeout 1630 ms). Trace:
I20260709 12:26:55.535970 12784 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.031s
I20260709 12:26:55.509585 12800 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:55.599576  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 768428us
I20260709 12:26:55.566929 12575 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.603272 12794 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:55.547465 12705 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:55.598775 12768 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:55.603533 12810 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:26:55.646919  5960 rpcz_store.cc:269] 0709 12:26:53.620430 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.676095 (+ 55665us) service_pool.cc:224] Handling call
0709 12:26:55.585519 (+1909424us) spinlock_profiling.cc:243] Waited 1.08 s on lock 0x7b54000f8a54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:55.585671 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2480577920}
I20260709 12:26:55.672559  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:55.600035 12619 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:55.551535 12424 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:55.673290  6118 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16. Ops: [15.14-15.14]
I20260709 12:26:55.640672 12814 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 12:26:55.601338 12657 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:55.674013  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:55.598304 12739 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:55.676622  6110 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14. Ops: []
I20260709 12:26:55.677021  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:55.661159 12705 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:55.561561 12570 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:55.678097  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:55.661583 12794 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:55.597115 12652 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:55.640513 12511 raft_consensus.cc:3055] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:55.635587 12634 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:55.678376  6113 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:26:55.688290  6114 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:55.565332 12562 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:55.691924  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:55.602492 12793 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:55.691841  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:55.691636  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3489) took 1244 ms. Trace:
I20260709 12:26:55.681614 12328 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:55.678848 12619 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:55.705892  6111 rpcz_store.cc:276] 0709 12:26:54.446877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.483684 (+ 36807us) service_pool.cc:224] Handling call
0709 12:26:54.484057 (+   373us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:54.815625 (+331568us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:54.815655 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:54.821867 (+  6212us) log.cc:844] Serialized 26 byte log entry
0709 12:26:55.593347 (+771480us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:26:55.593388 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.593457 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:55.691443 (+ 97986us) raft_consensus.cc:1685] finished
0709 12:26:55.691461 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:55.691583 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":24010,"raft.queue_time_us":111379,"raft.run_cpu_time_us":125,"raft.run_wall_time_us":126,"thread_start_us":1046888,"threads_started":2,"wal-append.queue_time_us":813171}
I20260709 12:26:55.732182  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:55.597065 12804 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:55.693535 12511 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:55.604167 12399 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:55.672461 12575 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:55.560333 12681 consensus_queue.cc:260] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:55.737083  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:55.738293  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:55.745278  6114 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:26:55.677196 12768 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:55.692639 12794 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:55.740147  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:55.685395 12458 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.048s
I20260709 12:26:55.641633 12635 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:55.756655 12819 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
I20260709 12:26:55.734026 12619 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:55.736445 12562 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:55.764552  6117 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:55.692224 12739 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:55.679572 12810 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:55.671499 12795 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:55.742394 12769 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:55.757560 12686 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:55.777513 12681 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:55.776474 12800 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:55.730675 12531 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:55.882524 12570 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:55.887923 12810 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:55.867168 12575 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:55.890743 12795 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:55.890969  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.865804 12703 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:55.866246 12539 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:55.868935 12724 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:26:55.876945 12822 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:26:55.870152 12424 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:55.894151  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.785823 12803 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:55.898097  6645 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 1614) took 1228 ms. Trace:
I20260709 12:26:55.868492 12686 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:55.916952  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:55.899267  6645 rpcz_store.cc:276] 0709 12:26:54.669785 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.670884 (+  1099us) service_pool.cc:224] Handling call
0709 12:26:54.671238 (+   354us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:54.671585 (+   347us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:54.671613 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:54.688927 (+ 17314us) log.cc:844] Serialized 26 byte log entry
0709 12:26:54.861493 (+172566us) raft_consensus.cc:1645] Marking committed up to 18
0709 12:26:54.861532 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.861588 (+    56us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:55.897838 (+1036250us) raft_consensus.cc:1685] finished
0709 12:26:55.897863 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:55.898026 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3489,"raft.run_cpu_time_us":164,"raft.run_wall_time_us":5763,"thread_start_us":172192,"threads_started":1,"wal-append.queue_time_us":873729}
W20260709 12:26:55.897379 12825 log.cc:927] Time spent T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.170s	user 0.000s	sys 0.001s
I20260709 12:26:55.924540  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:55.925026  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:55.903342 12827 log.cc:927] Time spent T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.224s	user 0.000s	sys 0.001s
I20260709 12:26:55.932482  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:55.933311  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:55.933632 12824 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:26:55.931773  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:55.959149  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:55.959925  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:55.960628  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:55.968189  6117 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:26:55.788545 12511 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:55.960561 12823 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.278s	user 0.000s	sys 0.001s
W20260709 12:26:55.975369 12830 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:26:55.902619 12539 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:55.980854  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.984818 12804 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:55.985031  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 312520us
I20260709 12:26:55.986004 12768 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:55.961465 12739 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:55.962148 12795 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:55.966415 12788 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:55.992430  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:55.901391 12724 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:55.994882  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 355470us
I20260709 12:26:55.969807 12686 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:26:55.998059  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 491700us
I20260709 12:26:55.990887 12705 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:55.989493 12800 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:56.001137  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 490881us
I20260709 12:26:55.997401  6611 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:55.988821 12652 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:55.995460 12458 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:55.999929  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2333) took 1065 ms. Trace:
W20260709 12:26:56.004737 12815 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.271s	user 0.000s	sys 0.001s
I20260709 12:26:56.015201  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:56.015491  6041 rpcz_store.cc:276] 0709 12:26:54.934492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.934714 (+   222us) service_pool.cc:224] Handling call
0709 12:26:54.999080 (+ 64366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.999278 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 9
0709 12:26:55.591802 (+592524us) log.cc:844] Serialized 14 byte log entry
0709 12:26:55.999528 (+407726us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:55.999613 (+    85us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:26:55.999660 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.999733 (+    73us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:55.999866 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":13948,"prepare.queue_time_us":641176,"prepare.run_cpu_time_us":30,"prepare.run_wall_time_us":30,"raft.queue_time_us":12075,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":2562,"thread_start_us":946393,"threads_started":2}
I20260709 12:26:56.001221 12793 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:56.022042  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 332014us
I20260709 12:26:56.030009  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2334) took 1089 ms. Trace:
I20260709 12:26:56.030578  6036 rpcz_store.cc:276] 0709 12:26:54.940857 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.940985 (+   128us) service_pool.cc:224] Handling call
0709 12:26:54.941271 (+   286us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.941458 (+   187us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:26:55.600456 (+658998us) log.cc:844] Serialized 14 byte log entry
0709 12:26:56.029661 (+429205us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:56.029712 (+    51us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:56.029780 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.029842 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:56.029954 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":9573,"prepare.queue_time_us":698807,"prepare.run_cpu_time_us":38,"prepare.run_wall_time_us":38,"thread_start_us":1050465,"threads_started":2}
W20260709 12:26:56.038525  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 532032us
I20260709 12:26:56.044087  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.045009  5960 raft_consensus.cc:2393] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 15: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:56.045670  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.046388  5967 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:26:56.046746  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.047426  5962 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 11.
I20260709 12:26:56.049192  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:56.051191  5967 pending_rounds.cc:85] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 12
W20260709 12:26:56.050734  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 66394.2us
I20260709 12:26:56.051527  5967 pending_rounds.cc:107] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 16.13
W20260709 12:26:56.051970  6608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.610s (SENT) [suppressed 23 similar messages]
I20260709 12:26:56.019794 12788 consensus_queue.cc:1059] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:26:56.041384 12793 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:56.015928 12720 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.027673 12458 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:56.071874 12735 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.006s	sys 0.003s
I20260709 12:26:56.072976  5967 raft_consensus.cc:2889] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:26:56.076416  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 129300us
I20260709 12:26:56.014140 12800 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.015157 12739 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:56.078725  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:56.082991  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:56.099067  5934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.559s	user 0.004s	sys 0.016s
I20260709 12:26:56.009637 12795 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:56.099454  5934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.559s	user 0.004s	sys 0.016s
I20260709 12:26:56.087265 12843 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.019s
I20260709 12:26:56.101336 12795 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:56.089285 12735 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.525s	user 0.006s	sys 0.004s
I20260709 12:26:56.039194 12652 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:56.102774 12652 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:56.103273 12652 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:56.105049 12800 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:56.102597 12735 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:56.051877 12705 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:56.100097  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 595692us
I20260709 12:26:56.106225 12735 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.099408  5959 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:26:56.107046  5934 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:56.107786 12739 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.108541  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:56.097800  6009 leader_election.cc:336] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.768s (SENT)
W20260709 12:26:56.109664  6009 leader_election.cc:336] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.820s (SENT)
I20260709 12:26:56.109757  5934 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:56.114220  6009 leader_election.cc:336] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.848s (SENT)
I20260709 12:26:56.102053 12795 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:56.116794  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 98228.9us
I20260709 12:26:56.069898  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2336) took 1034 ms. Trace:
I20260709 12:26:56.027055 12804 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:26:56.071624 12703 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.043s
I20260709 12:26:56.089468 12839 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:56.111572 12833 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.110324 12328 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.006s
I20260709 12:26:56.076416 12634 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.041s
I20260709 12:26:56.109833 12739 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:56.118709  6038 rpcz_store.cc:276] 0709 12:26:55.035843 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.035966 (+   123us) service_pool.cc:224] Handling call
0709 12:26:55.499583 (+463617us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:55.499799 (+   216us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:26:55.998810 (+499011us) log.cc:844] Serialized 14 byte log entry
0709 12:26:56.069149 (+ 70339us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:56.069276 (+   127us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:56.069363 (+    87us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.069496 (+   133us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:56.069767 (+   271us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":21064,"prepare.queue_time_us":176357,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":3210,"raft.queue_time_us":15313,"raft.run_cpu_time_us":173,"raft.run_wall_time_us":15364,"thread_start_us":516590,"threads_started":2}
W20260709 12:26:56.084913  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 65843.8us
I20260709 12:26:56.108454 12735 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:56.079622 12636 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.042s
I20260709 12:26:56.117166 12810 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.106781 12705 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.123121 12575 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:26:56.137885  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:56.145256  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:56.145983  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.145821  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:56.152335  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:56.152515 12724 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:56.153129 12570 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:56.153612 12834 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:26:56.153713 12739 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:56.153069 12856 consensus_queue.cc:1059] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:26:56.135362 12839 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.171491 12735 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:56.151197  5932 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:56.159292  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:56.088241 12720 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.124078 12843 consensus_queue.cc:1059] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.021s
I20260709 12:26:56.174794  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.170398 12575 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:56.177871 12832 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:56.123950 12795 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:56.179075 12634 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 17.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:26:56.183660  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:56.183995  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 74310.4us
W20260709 12:26:56.186340  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 161821us
I20260709 12:26:56.238153  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:56.189239  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.191236  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:56.137534 12850 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:56.243439 12816 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 1.281s	user 0.007s	sys 0.010s
I20260709 12:26:56.243758 12850 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:56.244238 12795 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:56.244971 12850 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:56.155622 12840 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.057s	user 0.001s	sys 0.000s
I20260709 12:26:56.114565 12686 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 13.12, Last appended by leader: 12, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.137954 12833 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:56.247706 12839 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:55.593178  6112 rpcz_store.cc:276] 0709 12:26:54.448747 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.448874 (+   127us) service_pool.cc:224] Handling call
0709 12:26:54.449112 (+   238us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:54.449310 (+   198us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:26:54.818209 (+368899us) log.cc:844] Serialized 14 byte log entry
0709 12:26:55.554258 (+736049us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:26:55.554319 (+    61us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:55.554362 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:55.554426 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:55.554588 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":615610,"prepare.queue_time_us":588539,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":623742,"raft.run_cpu_time_us":149,"raft.run_wall_time_us":26148,"thread_start_us":433143,"threads_started":2}
W20260709 12:26:56.216500  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 65390.6us
I20260709 12:26:56.139518 12804 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.055s
W20260709 12:26:56.192868 12845 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:26:56.217598  5964 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:56.219278 12539 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:56.225883 12598 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:56.183250 12834 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:56.185580 12724 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:56.211642 12831 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.318s	user 0.000s	sys 0.002s
I20260709 12:26:56.242014  5934 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:56.173686 12810 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:56.250348  6081 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:56.268925  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:56.236506 12575 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
W20260709 12:26:56.277503  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 147499us
W20260709 12:26:56.300863  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.283217  5964 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:56.283607  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:56.302666 12814 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:26:56.304430  6042 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15. Ops: []
W20260709 12:26:56.304391  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 62461.3us
I20260709 12:26:56.305136  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:56.305840  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:56.271431 12837 raft_consensus.cc:3055] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:56.303745  6081 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:56.277086 12619 consensus_meta.cc:287] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.500s	user 0.009s	sys 0.001s
W20260709 12:26:56.322104  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.322314  5934 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:56.305893  6038 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:56.274187 12598 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:56.274026 12856 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:56.271770 12843 consensus_queue.cc:1243] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer 0069e2ba1f02412e8e1d6c20a1fb510f log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:26:56.325309  5964 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:56.320113 12539 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.334920  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:56.335289  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:56.280436 12833 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:56.303093 12814 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:56.331504  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:56.332985  6042 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:26:56.336439  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:56.336699  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:56.334987  6646 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:26:56.338439  5934 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:56.343652  6038 raft_consensus.cc:2376] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18. Re-sending same reply.
I20260709 12:26:56.330955  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:56.344913  6646 raft_consensus.cc:606] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:56.345371  6646 raft_consensus.cc:614] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:56.345906  6038 raft_consensus.cc:1240] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: [16.12-16.12]
I20260709 12:26:56.344194  6044 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 15: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:56.341025  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.339600 12849 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:56.344482  6043 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:26:56.347271  5964 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:56.342998 12539 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.342027  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:56.308254 12769 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:56.349227 12769 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:26:56.308635 12794 consensus_meta.cc:287] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.540s	user 0.005s	sys 0.006s
I20260709 12:26:56.349448  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.350805 12705 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:56.350905 12598 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.351521  6118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1585) took 2686 ms. Trace:
I20260709 12:26:56.351903  6118 rpcz_store.cc:276] 0709 12:26:53.664923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.907988 (+243065us) service_pool.cc:224] Handling call
0709 12:26:53.935024 (+ 27036us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:55.680641 (+1745617us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.351259 (+670618us) spinlock_profiling.cc:243] Waited 1.74 s on lock 0x7b5400091ad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:56.351430 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3997051648}
I20260709 12:26:56.349805 12794 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:56.354952 12794 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:56.355684 12769 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:56.240634 12832 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.359737  6111 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:56.323182 12724 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election lost for term 9. Reason: could not achieve majority
I20260709 12:26:56.371767  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:56.344666  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:56.371215  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:56.369557  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:56.370123  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:56.370824  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:56.310305 12837 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:56.362274  6113 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: []
W20260709 12:26:56.369349  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 65680.5us
I20260709 12:26:56.373347  6040 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:26:56.410224  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:56.411655  6118 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:56.412037  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:56.359442 12458 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:56.415230  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:56.415894  6117 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
I20260709 12:26:56.416491 12863 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.417088 12863 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:56.338919 12856 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:56.419095 12817 log.cc:927] Time spent T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 1.481s	user 0.005s	sys 0.014s
I20260709 12:26:56.420358  6651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1802) took 2190 ms. Trace:
W20260709 12:26:56.421720 12841 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.269s	user 0.000s	sys 0.001s
I20260709 12:26:56.351997 12598 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:56.375044 12705 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:56.328138 12619 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.424531 12619 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:56.425380  5962 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 18: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:56.426193  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3406) took 2674 ms. Trace:
I20260709 12:26:56.414242  6643 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5744a277c5a3409b95831573168daf3f"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:26:56.427007  6643 raft_consensus.cc:606] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:56.427105  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.428464 12837 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.427597  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:56.428455  5960 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:56.420722  6651 rpcz_store.cc:276] 0709 12:26:54.230378 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:54.230524 (+   146us) service_pool.cc:224] Handling call
0709 12:26:54.230828 (+   304us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:54.231159 (+   331us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:54.231185 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:54.380000 (+148815us) log.cc:844] Serialized 26 byte log entry
0709 12:26:54.840785 (+460785us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:26:54.840829 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:54.840898 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:56.339462 (+1498564us) spinlock_profiling.cc:243] Waited 50.3 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:26:56.419985 (+ 80523us) raft_consensus.cc:1685] finished
0709 12:26:56.420015 (+    30us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:56.420264 (+   249us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":110782,"raft.run_cpu_time_us":154,"raft.run_wall_time_us":26855,"spinlock_wait_cycles":115795200,"thread_start_us":300077,"threads_started":1,"wal-append.queue_time_us":449041}
W20260709 12:26:56.370062  5934 connection.cc:256] RPC call timeout handler was delayed by -1.5248681799998849s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1708s for a response
I20260709 12:26:56.360108 12814 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 11 FOLLOWER]: Advancing to term 12
W20260709 12:26:56.418354 12852 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.217s	user 0.001s	sys 0.000s
I20260709 12:26:56.451860  5934 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:56.426614  5966 rpcz_store.cc:276] 0709 12:26:53.751415 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:53.872512 (+121097us) service_pool.cc:224] Handling call
0709 12:26:55.585671 (+1713159us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:55.641416 (+ 55745us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:56.425916 (+784500us) spinlock_profiling.cc:243] Waited 1.71 s on lock 0x7b54000f8a50. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:56.426099 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3939264384}
I20260709 12:26:56.360268 12839 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:26:56.449205  5964 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 8.
I20260709 12:26:56.449224  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:56.453451  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.454697  5966 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:26:56.455387  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.455833  5966 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:26:56.456497  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.456911  5966 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:26:56.457469  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.453502  6040 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:26:56.459830  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:56.460589  5959 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:56.465067  6118 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:56.452446  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.407931 12539 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:56.468271  5960 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 24: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:56.471766  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:56.472571  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:56.471314 12739 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:56.475932 12511 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:56.478080  6040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b70d6df693140769deef828413df1ba"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:42450
I20260709 12:26:56.478720  6040 raft_consensus.cc:606] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:56.479120  6040 raft_consensus.cc:614] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:56.339206 12588 consensus_queue.cc:260] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:56.369004 12834 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:56.480427 12588 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:56.480875 12834 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:56.482311  5965 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
W20260709 12:26:56.475520  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 343884us
I20260709 12:26:56.490054  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:56.451515 12794 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:56.497335  5960 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 23. Current term is 24. Ops: []
I20260709 12:26:56.451884 12837 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:56.558802  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 68818.5us
I20260709 12:26:56.600817  6040 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:26:56.491967  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.601915  5965 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 23.
I20260709 12:26:56.601888  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:56.602723  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 150951us
I20260709 12:26:56.592975  5959 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:26:56.451198 12458 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:26:56.584621  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 83320us
I20260709 12:26:56.458140 12839 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.603633  6006 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:56.604580  5934 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:56.450239 12862 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:56.467217 12724 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:56.611348  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:56.611457  6609 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:56.612141  6039 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:56.618377  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:56.621551 12870 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:56.647279 12832 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:56.650995 12810 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:56.584199 12794 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:56.663586  6040 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:42450
I20260709 12:26:56.610529 12804 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:56.482553 12739 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.607928 12720 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:56.658641  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 67495us
I20260709 12:26:56.659401  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:56.611049 12862 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.611442 12839 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Advancing to term 27
W20260709 12:26:56.720542  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 116040us
I20260709 12:26:56.721346  5934 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:56.606632 12735 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:56.610225 12619 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:56.627089 12872 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.160s	user 0.000s	sys 0.001s
I20260709 12:26:56.658432 12793 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:56.599907 12652 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.723373  5934 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:56.643206 12598 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 23.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.121s
I20260709 12:26:56.614303 12458 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.598758 12803 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.065s
I20260709 12:26:56.682934 12880 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:56.765018 12575 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.666188 12794 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:56.766021 12562 consensus_meta.cc:287] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.991s	user 0.006s	sys 0.005s
I20260709 12:26:56.656114 12724 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
W20260709 12:26:56.768431  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 359190us
I20260709 12:26:56.658116 12870 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:56.621214 12843 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:56.839373 12843 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.839857 12843 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:56.839716 12870 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.639395 12856 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:26:56.771982  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:56.690339  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:56.843746  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.844043 12575 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:56.782816  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 115258us
I20260709 12:26:56.846701 12784 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:56.801045 12863 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:56.847397 12784 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:56.848038 12874 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:26:56.850718 12784 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:56.795676  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:56.810359  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:56.856644 12458 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:56.718427  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:56.859076  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 140755us
I20260709 12:26:56.860316 12511 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:56.686014 12804 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:56.769491 12539 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:56.862699 12804 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:56.863309 12539 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.865715 12539 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:56.819347  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:56.659399  6006 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:56.818219  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 94915.7us
I20260709 12:26:56.866827  6115 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:26:56.768625 12862 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:26:56.822570 12860 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:26:56.774164 12720 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:26:56.772764 12619 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:56.850896 12652 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:56.852214 12739 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:56.854496 12724 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:56.770931 12795 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:56.878785 12832 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election won for term 19
W20260709 12:26:56.824502 12805 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 1.972s	user 0.006s	sys 0.040s
I20260709 12:26:56.682714 12833 consensus_queue.cc:1059] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.163s
I20260709 12:26:56.944300 12833 raft_consensus.cc:3055] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:56.944700 12833 raft_consensus.cc:740] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:56.772710 12793 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.872388  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:56.950968  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 78658.5us
I20260709 12:26:56.952250  5934 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:56.818873 12866 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:56.954795 12866 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.957193 12866 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:56.842034 12769 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:56.882606  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:56.891394  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 287401us
I20260709 12:26:56.958171 12862 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:56.867810  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 208485us
I20260709 12:26:56.959472 12769 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:56.911345  6035 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:26:56.959687  6006 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:56.960247 12862 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:56.960606 12793 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:56.960009 12784 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:56.961361 12784 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.961627 12843 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.962715  6040 raft_consensus.cc:606] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:56.963116  6040 raft_consensus.cc:614] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:26:56.878969 12686 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.018s
I20260709 12:26:56.963554 12784 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:56.964007 12843 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:56.894860 12832 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:56.965258 12832 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:56.971122 12588 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:56.971604 12588 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.971971 12588 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:56.972702 12570 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:26:56.973099 12570 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:56.973963 12570 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.960109 12797 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:56.975546 12797 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:56.975889 12797 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:56.979998 12800 raft_consensus.cc:3055] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:56.980459 12800 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:56.981312 12800 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.982314 12800 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:56.984637 12739 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:56.985203 12739 raft_consensus.cc:697] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:56.986055 12739 consensus_queue.cc:237] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:56.975029 12863 consensus_queue.cc:1059] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.013s
I20260709 12:26:56.954145  5934 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:56.990932  5960 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:56.992690  5960 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:26:56.942741 12814 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.997176  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.942868 12839 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:56.963027  6006 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:56.932585 12804 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:56.945499 12833 consensus_queue.cc:260] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:56.975150 12570 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:56.997850  5961 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:26:56.996568  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:57.012856  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:56.995112  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:57.018581  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 55624.3us
I20260709 12:26:57.022445  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.023294  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.024595  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:57.025682  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 66595.2us
I20260709 12:26:57.026893  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:56.988982 12724 raft_consensus.cc:3055] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:26:57.029932  5963 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 26. Current term is 27. Ops: [26.19-26.19]
I20260709 12:26:57.035115  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.030272  6116 raft_consensus.cc:2393] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 12: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:57.034168  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.036316  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.033980  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.016381 12795 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:57.035719  5967 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:26:57.029067  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:57.040074  6006 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:57.042361 12880 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:57.045009  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:57.045702  5960 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:57.047029  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:57.047906  5967 raft_consensus.cc:2393] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:57.049060  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:57.049726  5962 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:57.022450 12803 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:26:57.028697 12868 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:57.062517 12803 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.078091  6608 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:57.080425  6114 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:26:57.033492 12724 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:57.039196 12795 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.073249  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:57.074085  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:57.033566 12787 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:57.070222  5960 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:26:57.104976  6109 raft_consensus.cc:2410] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:26:57.081621  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:57.081887  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.081471  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:57.069729  5962 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
I20260709 12:26:57.088980  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.108651  5961 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:57.108899  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:57.060971 12575 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:26:57.106339  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.117369  5960 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:26:57.110334  6608 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:57.119370  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:57.121863  6115 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:57.122536  6608 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:57.120447  5962 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: [10.9-10.9]
I20260709 12:26:57.124730  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.082908 12788 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:57.082902 12803 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:57.133141  6608 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:57.125495  6651 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:26:57.105001 12795 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:57.136365  6110 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:57.140373  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.120957 12575 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.120395 12686 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:57.120170 12843 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:57.125945 12866 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:57.144605  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.154592  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.143209  6608 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:57.113687 12886 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.073s
I20260709 12:26:57.183243  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.158229  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.155233 12575 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:57.136766 12562 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:26:57.200116  6643 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:57.157754 12686 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:57.202234  6642 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:57.201799  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.125406 12882 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.085s
I20260709 12:26:57.206895 12856 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:57.187116 12797 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:57.209692 12588 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:57.210832 12794 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:57.210961 12832 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:57.154767 12539 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:57.207000 12884 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
I20260709 12:26:57.160843 12724 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:57.219146 12724 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:57.219892 12814 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:57.214198 12686 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:57.212621 12880 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:57.218508 12789 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:26:57.224351 12839 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 27 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:57.227713 12891 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.084s	user 0.001s	sys 0.000s
I20260709 12:26:57.216286 12856 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.226599 12804 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:57.238099 12856 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:57.265173  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 141321us
W20260709 12:26:57.267325  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:57.269066  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 170741us
I20260709 12:26:57.206518  6646 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
W20260709 12:26:57.283574  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 140307us
I20260709 12:26:57.286150  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:57.286566  6608 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:57.287252  5965 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:57.288388 12536 tablet_bootstrap.cc:492] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=10 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 1 replicates
I20260709 12:26:57.284590  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:57.289463  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:57.290426 12536 tablet_bootstrap.cc:492] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:26:57.228192 12789 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:57.314102 12789 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:57.316179 12789 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:57.317040 12794 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:57.319255 12804 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:57.319078 12759 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:57.320078 12759 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:57.299815 12539 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:57.320590 12759 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:26:57.320909  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:57.321167  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.320181 12804 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.324918 12588 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:57.325176 12804 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:57.325950 12804 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.325798  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:57.326912  6114 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:57.324952  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.329296  6651 raft_consensus.cc:2410] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 18 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:26:57.336122  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3056) took 1292 ms. Trace:
I20260709 12:26:57.337416 12539 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:26:57.337075  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.346516  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.347611  6643 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 18: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:57.337128 12705 consensus_queue.cc:1059] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 9, Time since last communication: 0.012s
I20260709 12:26:57.350536 12705 raft_consensus.cc:3055] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:57.351135 12705 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:57.352519 12705 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:57.353195 12619 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:57.355242  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3071) took 1214 ms. Trace:
I20260709 12:26:57.355798  5966 rpcz_store.cc:276] 0709 12:26:56.140413 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.484133 (+343720us) service_pool.cc:224] Handling call
0709 12:26:56.484996 (+   863us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:56.853642 (+368646us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:56.853673 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:56.869188 (+ 15515us) log.cc:844] Serialized 556 byte log entry
0709 12:26:57.000581 (+131393us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:57.000621 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.354593 (+353972us) spinlock_profiling.cc:243] Waited 368 ms on lock 0x7b54002f1554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:57.354657 (+    64us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:57.354716 (+    59us) raft_consensus.cc:1685] finished
0709 12:26:57.354728 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:57.355054 (+   326us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":846929664,"thread_start_us":131111,"threads_started":1,"wal-append.queue_time_us":227941}
I20260709 12:26:57.356657  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.359179  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.360235  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.360872  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.348857  6643 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
I20260709 12:26:57.345969  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.361651  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.292160  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:57.350253  6650 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:57.355144  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:26:57.359081  6111 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1595) took 1678 ms (client timeout 2165 ms). Trace:
W20260709 12:26:57.373793  6111 rpcz_store.cc:269] 0709 12:26:55.680653 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:55.739926 (+ 59273us) service_pool.cc:224] Handling call
0709 12:26:57.358655 (+1618729us) spinlock_profiling.cc:243] Waited 605 ms on lock 0x7b540023aad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:57.358843 (+   188us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1392537856}
W20260709 12:26:57.376174  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 485686us
I20260709 12:26:57.292153 12536 ts_tablet_manager.cc:1403] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 3.091s	user 0.043s	sys 0.030s
I20260709 12:26:57.361598 12803 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:26:57.390616  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.395138 12804 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.402036  6043 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: []
I20260709 12:26:57.403045 12797 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:57.403241  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 111327us
I20260709 12:26:57.412223 12856 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:57.415064 12855 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:57.415580 12855 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:57.416944  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:57.420037  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:57.420442 12837 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:57.420990 12837 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:57.421545 12837 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:57.423002  5959 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 23 index: 12. (index mismatch)
I20260709 12:26:57.424079  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.425642 12865 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:57.426357  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:57.428996  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:57.432197  6042 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:57.432724 12868 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:57.433296 12868 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:57.430720  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.429476  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:57.429960  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:57.435101  6043 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:57.435849 12803 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:57.336767  5968 rpcz_store.cc:276] 0709 12:26:56.043927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.044950 (+  1023us) service_pool.cc:224] Handling call
0709 12:26:56.080274 (+ 35324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:56.240979 (+160705us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:56.241012 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:56.264795 (+ 23783us) log.cc:844] Serialized 26 byte log entry
0709 12:26:56.463484 (+198689us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:26:56.492293 (+ 28809us) log.cc:844] Serialized 14 byte log entry
0709 12:26:56.492677 (+   384us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:57.335259 (+842582us) spinlock_profiling.cc:243] Waited 160 ms on lock 0x7b540008b454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:26:57.335356 (+    97us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:57.335439 (+    83us) raft_consensus.cc:1685] finished
0709 12:26:57.335573 (+   134us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:57.335887 (+   314us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2419,"prepare.queue_time_us":28511,"raft.queue_time_us":98240,"raft.run_cpu_time_us":311,"raft.run_wall_time_us":17404,"spinlock_wait_cycles":405617024,"thread_start_us":144037,"threads_started":1,"wal-append.queue_time_us":377965}
I20260709 12:26:57.418128  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:57.439113 12883 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:57.439389  6035 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:57.440464 12883 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:57.440898 12795 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:57.441234 12886 consensus_queue.cc:1059] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 8.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:26:57.442019  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 3432) took 1175 ms. Trace:
I20260709 12:26:57.442550  5964 rpcz_store.cc:276] 0709 12:26:56.266041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:56.349210 (+ 83169us) service_pool.cc:224] Handling call
0709 12:26:57.441597 (+1092387us) spinlock_profiling.cc:243] Waited 86.8 ms on lock 0x7b5400035554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:57.441830 (+   233us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":199691136}
I20260709 12:26:57.430320  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:57.444084 12562 consensus_queue.cc:1059] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 10.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:57.445875 12886 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.239518 12880 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.446555 12886 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.449360 12886 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:57.451090  5959 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 18 index: 11. (index mismatch)
I20260709 12:26:57.452693  6644 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:57.456696 12898 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:57.421686  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:57.457644 12898 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:57.459899  6645 raft_consensus.cc:2410] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:26:57.428128  5967 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:26:57.460322  6611 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:57.460843  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
I20260709 12:26:57.444072 12892 raft_consensus.cc:3055] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:26:57.466857 12892 raft_consensus.cc:740] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:57.420898  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.467854 12892 consensus_queue.cc:260] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.412883 12791 raft_consensus.cc:2955] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Committing config change with OpId 18.13: config changed from index 11 to 13, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:57.478821 12570 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:57.480381 12570 raft_consensus.cc:993] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:26:57.493531  6040 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:26:57.494159 12570 raft_consensus.cc:1081] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:26:57.480677  6114 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 22.
I20260709 12:26:57.452001  5934 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:57.491645  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.495173  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:57.454303 12832 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:57.492565  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:57.416908 12855 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.496659  5964 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:57.500015 12833 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:57.440910 12883 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:57.503114  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.503682  5965 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:57.469825 12892 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:26:57.511409  5964 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:26:57.518599  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:57.521270 12855 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:57.524313  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:57.525420  6040 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
W20260709 12:26:57.536185  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.442076 12804 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:57.515527  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:26:57.460376 12898 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:57.559536  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 175648us
I20260709 12:26:57.563978  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:57.562995 12793 consensus_meta.cc:287] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.598s	user 0.009s	sys 0.010s
W20260709 12:26:57.557847  6611 leader_election.cc:336] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 2.165s (SENT)
I20260709 12:26:57.572630  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:57.566884 12793 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.575376 12793 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:57.577010 12536 raft_consensus.cc:359] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 17 NON_PARTICIPANT]: Replica starting. Triggering 1 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:57.581665 12837 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:57.571341 12635 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.219s	user 0.013s	sys 0.013s
I20260709 12:26:57.584661  6651 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 22: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:57.556036 12832 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:57.587318  5965 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:57.587747 12724 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:26:57.588903  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:57.585196  6082 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:57.589846  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:57.595535  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:57.597800  6037 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:57.596056 12724 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:57.589792  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:57.592882 12635 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.448s	user 0.014s	sys 0.014s
W20260709 12:26:57.607049  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:57.606801  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 52180.7us
I20260709 12:26:57.611492  6043 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:57.604437  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:57.609598  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:57.617187 12868 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:57.619239 12837 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:26:57.619880  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:57.603130 12724 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:57.606169 12797 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:57.621477 12866 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:57.621659  5962 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
W20260709 12:26:57.621941 12893 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.287s	user 0.003s	sys 0.001s
I20260709 12:26:57.605700 12883 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.607363 12705 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:57.602655 12832 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:57.606675  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:57.617080  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:57.623626  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:57.621142  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:57.607221  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:57.634384  6644 raft_consensus.cc:2410] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 27 because replica has last-logged OpId of term: 26 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 18.
I20260709 12:26:57.601032 12536 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:26:57.641848  6609 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:57.633625 12797 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:57.652541  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 49379.3us
I20260709 12:26:57.623939 12759 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.638451 12795 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:57.659320  6035 raft_consensus.cc:2410] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 20 because replica has last-logged OpId of term: 18 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 11.
I20260709 12:26:57.649933 12804 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:57.656715  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:57.650992 12539 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:57.641038 12898 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:57.656051  6036 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:26:57.654980 12797 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:26:57.668901  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 132724us
I20260709 12:26:57.668704  6043 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: []
W20260709 12:26:57.678205  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 73959us
I20260709 12:26:57.678898  5964 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:57.662495 12570 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:57.683175  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.681838  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:57.679301  6081 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:57.709554  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.708357  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:57.711515  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:26:57.712298  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 158475us
I20260709 12:26:57.686050 12863 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:57.713511  5959 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:57.679662 12804 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:57.711185  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:57.683277 12570 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:57.722107  5966 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:26:57.722303  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:57.665868 12539 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.724886  5965 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 12.
I20260709 12:26:57.723623 12882 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:57.670083 12536 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 10, Last appended: 16.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:57.723680 12880 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:26:57.715876 12863 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:57.708902 12898 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:57.724419 12570 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:57.737752 12882 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.682842 12635 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
I20260709 12:26:57.720043 12895 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:57.730710 12768 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:26:57.747061  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.747102  6039 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
W20260709 12:26:57.743696 12906 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.075s	user 0.000s	sys 0.001s
I20260709 12:26:57.687047 12793 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 12:26:57.673535  5963 raft_consensus.cc:2955] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 11 to 13, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:26:57.743122  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 55766.3us
I20260709 12:26:57.746078  6037 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
W20260709 12:26:57.751394  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 72138.6us
I20260709 12:26:57.750159 12789 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:57.755118  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:26:57.790691 12878 log.cc:927] Time spent T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
I20260709 12:26:57.789602  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:57.788534 12883 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:26:57.790182  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 113668us
I20260709 12:26:57.789089 12804 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.791571  5964 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
W20260709 12:26:57.770681  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.742425 12863 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:57.755890  5962 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 21. Current term is 22. Ops: [19.11-21.12]
I20260709 12:26:57.744262 12759 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:57.741654 12882 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:57.732504 12791 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.059s
I20260709 12:26:57.800613  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:57.822055 12882 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:26:57.822293  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 77029.5us
I20260709 12:26:57.823227  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:57.824124 12795 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:57.737953 12834 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:57.825177 12834 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:57.826239 12834 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.826537 12768 consensus_queue.cc:1059] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:57.827384 12768 consensus_queue.cc:1243] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer 24012af7747d4c4ea89c3da2ff950099 log is divergent from this leader: its last log entry 15.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:26:57.827955 12768 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:57.828312 12768 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:57.755398 12880 raft_consensus.cc:697] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:57.829341 12768 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.829675 12880 consensus_queue.cc:237] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 10.9, Last appended by leader: 9, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.815536  6609 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:57.818720  5961 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:26:57.828326  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:57.833069  6038 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:57.802838 12833 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:26:57.837823 12909 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.101s	user 0.000s	sys 0.000s
I20260709 12:26:57.839668  6081 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:57.795400 12686 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.847074 12536 ts_tablet_manager.cc:1434] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.440s	user 0.005s	sys 0.005s
I20260709 12:26:57.848448 12848 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:57.821717 12652 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 24.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.024s
I20260709 12:26:57.849781 12652 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:26:57.850193 12652 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:57.851361 12575 consensus_meta.cc:287] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.639s	user 0.006s	sys 0.019s
I20260709 12:26:57.851213 12652 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.852617 12652 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:26:57.834425 12789 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.844589  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:57.855964  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:57.857115  6006 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:57.840165 12883 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:57.858403 12883 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:57.858762 12870 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:26:57.859220 12870 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:57.859563 12870 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:57.851919 12575 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:57.863796 12898 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:57.854920  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:26:57.865986  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 123049us
I20260709 12:26:57.840662 12832 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:57.843310 12768 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:57.916126 12539 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:57.858806 12883 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:57.863129 12511 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:26:57.832214 12856 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:26:57.911288  6648 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:57.921056  5959 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:26:57.915151 12598 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:26:57.917654  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 50318us
I20260709 12:26:57.912479  6609 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:57.913906  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:57.915120 12898 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:57.933920  5961 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
W20260709 12:26:57.941236  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 86450.5us
I20260709 12:26:57.942534  6009 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:57.942723  5861 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 340) took 7535 ms. Trace:
I20260709 12:26:57.910445 12897 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:26:57.952783  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 112372us
W20260709 12:26:57.964640  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 148351us
I20260709 12:26:57.956954 12868 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:57.966394  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:57.944445 12898 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:57.970783  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:57.977037 12686 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:57.978739 12575 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:57.982052 12570 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.984794 12724 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:57.990172  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:57.999640  6038 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:26:57.964012 12562 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:26:57.992080 12793 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.010138 12789 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:57.994701 12898 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:58.011538  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 183352us
I20260709 12:26:57.961702 12833 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:58.020431  5966 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
W20260709 12:26:58.020331  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 163266us
I20260709 12:26:58.023085 12789 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:26:58.023476  6054 tablet_copy_service.cc:342] P 0557a7246c8945b99e5215c99d4ddf9c: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-e3ef3cb064eb4a1597f89e040fce3c7e received from {username='slave'} at 127.0.0.1:60122
I20260709 12:26:58.023761  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:58.024072  6054 tablet_copy_service.cc:434] P 0557a7246c8945b99e5215c99d4ddf9c: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-e3ef3cb064eb4a1597f89e040fce3c7e on tablet e3ef3cb064eb4a1597f89e040fce3c7e with peer 24012af7747d4c4ea89c3da2ff950099
W20260709 12:26:58.025056  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 82708.3us
I20260709 12:26:58.052193  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.013729 12562 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:58.027849 12837 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:58.034669 12793 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.067282 12866 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:26:58.065871 12793 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:58.068614  5934 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:58.070675  6651 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: []
I20260709 12:26:58.071070  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:58.074291 12883 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.074801 12705 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:26:58.075187 12803 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:26:58.075708 12803 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.076107 12803 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:58.079003 12883 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:58.059618 12791 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.032s
I20260709 12:26:58.093029  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:58.096447 12863 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:58.105314  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 78842.1us
I20260709 12:26:58.110158  6006 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:58.059861 12575 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:26:58.115907  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:58.117045  6042 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:58.113162  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:58.123505  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.058650 12837 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:58.075335 12705 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:58.123241 12895 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:58.104737 12562 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.145741  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:58.153888  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:58.157287  5960 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:26:58.137439 12866 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:26:57.943197  5861 rpcz_store.cc:276] 0709 12:26:50.295919 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:50.296093 (+   174us) service_pool.cc:224] Handling call
0709 12:26:57.814697 (+7518604us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:54.151673 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:54.152292 (+   619us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:54.152327 (+    35us) write_op.cc:435] Acquired schema lock
0709 12:26:54.152345 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:54.152932 (+   587us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:54.153005 (+    73us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:54.153040 (+    35us) tablet.cc:685] Acquiring locks for 3 operations
0709 12:26:54.153376 (+   336us) tablet.cc:701] Row locks acquired
0709 12:26:54.153395 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:26:54.153579 (+   184us) write_op.cc:270] Start()
0709 12:26:54.153703 (+   124us) write_op.cc:276] Timestamp: P: 1783600014153497 usec, L: 0
0709 12:26:54.153740 (+    37us) op_driver.cc:348] REPLICATION: starting
0709 12:26:54.159065 (+  5325us) log.cc:844] Serialized 1298 byte log entry
0709 12:26:54.752443 (+593378us) op_driver.cc:464] REPLICATION: finished
0709 12:26:55.643012 (+890569us) write_op.cc:301] APPLY: starting
0709 12:26:55.672700 (+ 29688us) tablet.cc:1367] starting BulkCheckPresence
0709 12:26:56.081149 (+408449us) tablet.cc:1370] finished BulkCheckPresence
0709 12:26:56.098516 (+ 17367us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:26:56.181312 (+ 82796us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:26:56.213974 (+ 32662us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=6,key_file_lookups=6,delta_file_lookups=6,mrs_lookups=0
0709 12:26:56.229067 (+ 15093us) write_op.cc:312] APPLY: finished
0709 12:26:56.268725 (+ 39658us) log.cc:844] Serialized 41 byte log entry
0709 12:26:56.598307 (+329582us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:56.615043 (+ 16736us) write_op.cc:454] Released schema lock
0709 12:26:56.617977 (+  2934us) write_op.cc:341] FINISH: Updating metrics
0709 12:26:56.639944 (+ 21967us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:26:56.640015 (+    71us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":208815,"reported_tablets":10,"child_traces":[["op",{"apply.queue_time_us":842502,"apply.run_cpu_time_us":15641,"apply.run_wall_time_us":1036292,"cfile_cache_hit":14,"cfile_cache_hit_bytes":16673,"num_ops":3,"prepare.queue_time_us":273760,"prepare.run_cpu_time_us":27864,"prepare.run_wall_time_us":346567,"raft.queue_time_us":1295,"raft.run_cpu_time_us":32149,"raft.run_wall_time_us":185944,"replication_time_us":598533,"thread_start_us":886532,"threads_started":5,"wal-append.queue_time_us":918431,"wal-append.run_cpu_time_us":8109,"wal-append.run_wall_time_us":2064173}]]}
I20260709 12:26:58.124864 12789 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:58.144711 12705 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:58.171983  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:58.186517  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 153418us
I20260709 12:26:58.188650  6114 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 16
I20260709 12:26:58.190868  6081 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:58.192085 12910 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.444s	user 0.005s	sys 0.000s
W20260709 12:26:58.192922 12911 log.cc:927] Time spent T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.353s	user 0.000s	sys 0.003s
I20260709 12:26:58.195123 12866 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.152500 12897 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:26:58.198958 12912 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.231s	user 0.002s	sys 0.000s
I20260709 12:26:58.173586 12797 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.154103 12795 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:58.231989  6036 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 27.
I20260709 12:26:58.234159 12652 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:58.234911 12652 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.236521  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:58.221473  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:26:58.228371  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.177769 12863 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:58.237313 12803 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.237784 12897 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.238265 12837 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.265499 12837 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:58.238678  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:58.237805 12575 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:26:58.231858  6113 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:26:58.196269 12919 consensus_queue.cc:1059] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 18.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.010s
I20260709 12:26:58.268872  6115 raft_consensus.cc:2393] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 22: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:58.227262 12759 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.270696 12875 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:26:58.271117 12759 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.240690  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:58.190056 12882 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.273000  6648 raft_consensus.cc:2410] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 18 because replica has last-logged OpId of term: 16 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
I20260709 12:26:58.272850 12882 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.258117  6609 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:58.257140 12652 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:58.260830  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.264488 12803 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:58.281304  6082 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:58.284190 12793 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:26:58.274868 12724 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:58.284215 12575 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:58.305578  5963 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:58.285809 12875 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:58.288540 12570 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:58.296471 12793 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 27 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.295223 12797 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:58.302086  6114 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:58.317612 12803 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Stepping down as leader of term 21
W20260709 12:26:58.334986  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 228836us
I20260709 12:26:58.338917  6006 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:58.342401 12882 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:58.345805 12652 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:26:58.346490 12652 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:58.347445 12652 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.349619  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.350625 12916 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.351191 12916 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.352491 12898 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.350633 12919 consensus_queue.cc:1059] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.003s
I20260709 12:26:58.353430 12916 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:58.353609  6039 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:58.354063 12916 raft_consensus.cc:3055] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:26:58.328691 12803 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:58.327853 12793 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:58.320083 12789 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.359902  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:58.360414  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:58.347879 12866 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:58.371037  5968 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:26:58.360709  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:58.363880  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:58.361475  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 117857us
I20260709 12:26:58.374357  5959 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:58.373021  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:58.375928  5963 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:58.376834  5965 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:58.392081  5960 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 21. Current term is 22. Ops: []
I20260709 12:26:58.354445 12916 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:58.402065  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:58.354583 12681 raft_consensus.cc:2764] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:26:58.355374 12803 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 21.12, Last appended by leader: 12, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.359423 12875 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.376296 12789 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.431392  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:26:58.433377  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 128061us
I20260709 12:26:58.413125 12898 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:58.441061  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 144127us
I20260709 12:26:58.421823 12855 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:58.436066 12870 consensus_meta.cc:287] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.576s	user 0.009s	sys 0.002s
I20260709 12:26:58.446918  5962 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:26:58.435694 12768 consensus_meta.cc:287] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.515s	user 0.013s	sys 0.000s
I20260709 12:26:58.449381  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:58.452919  5965 raft_consensus.cc:2393] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 13: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:58.457827  6042 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:58.473706  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:58.473941  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:58.474695  6642 raft_consensus.cc:2368] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 21. Current term is 22.
I20260709 12:26:58.459947 12705 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.476490 12793 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.477103 12705 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:58.478842  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:58.480607  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:58.460731  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:58.482671  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:58.460929 12895 consensus_queue.cc:1059] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:58.452693 12855 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.486614 12855 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:58.487995 12739 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:26:58.488998 12739 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:26:58.490370  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:58.486631 12789 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:58.491566 12789 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:58.490588  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:58.467806  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:58.471765  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:58.492980  5964 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 27.
I20260709 12:26:58.462548  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:58.494074  5967 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:58.484817 12681 raft_consensus.cc:3055] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:58.494697 12904 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:58.494973 12681 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:58.426877 12575 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 16.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.496099 12681 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.497570 12681 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:58.443849 12803 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:58.499212 12739 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:58.499748 12739 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:58.500584 12739 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.10, Last appended by leader: 10, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.457834 12833 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:26:58.495108 12904 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:58.504361 12895 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.504094 12904 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.504863 12895 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.505548 12904 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:58.506989 12895 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:58.517411 12848 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:58.518579  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.519318  6037 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:26:58.520125  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.520534  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.520844  5934 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:58.503118 12870 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.521742 12848 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:58.522279 12848 raft_consensus.cc:697] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:58.523087  6035 raft_consensus.cc:1240] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 8. Current term is 9. Ops: []
I20260709 12:26:58.519236  6039 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
W20260709 12:26:58.524468  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 56989us
I20260709 12:26:58.526710  5962 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
W20260709 12:26:58.525570  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 207579us
I20260709 12:26:58.526450  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:58.523267 12848 consensus_queue.cc:237] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.9, Last appended by leader: 9, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.491676  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:58.535013  6651 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 11.
W20260709 12:26:58.535950  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 161691us
I20260709 12:26:58.514214  5968 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 24.
I20260709 12:26:58.538830  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:58.540541  6006 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:58.544842  5959 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
W20260709 12:26:58.547626  6038 consensus_meta.cc:287] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.545s	user 0.012s	sys 0.000s
I20260709 12:26:58.547988  6038 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 22.
I20260709 12:26:58.549711  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:58.550060  6643 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:26:58.550650  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.552788  6642 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:58.555307  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:58.556031  6643 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:58.557387  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:58.558341  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:58.561275  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.563455  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:58.565505  6642 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:58.566046  6651 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:58.565053 12768 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:26:58.571427  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:58.574671 12562 consensus_queue.cc:1059] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:26:58.565610 12789 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:26:58.565354 12705 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:58.550631 12833 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 14, Time since last communication: 0.028s
W20260709 12:26:58.579450  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 53110.4us
I20260709 12:26:58.583837 12924 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:26:58.584255 12924 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:58.585052 12924 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.586191 12924 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:58.558436 12635 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.028s
I20260709 12:26:58.586643 12793 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 28 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:58.587229 12870 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:58.590798  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:58.549507 12834 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:58.603691  6648 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:58.566797  6608 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:58.593163  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.593834  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.594558  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 27 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:58.610351  6041 raft_consensus.cc:2410] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 27 because replica has last-logged OpId of term: 26 index: 19, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 18.
I20260709 12:26:58.595201  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:26:58.596401  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.596886  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 11 index: 6 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.612190  6040 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:58.597517  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 18 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:58.600610  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:58.602710  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.607400  5968 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:58.614099  5967 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:58.614666 12759 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:58.544101 12895 consensus_queue.cc:1059] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.061s
I20260709 12:26:58.615590  6039 raft_consensus.cc:2393] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 19: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:58.615628  6651 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
W20260709 12:26:58.616156  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 49453.4us
I20260709 12:26:58.617834  5968 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:58.620675  6608 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:58.623514  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 55082.7us
I20260709 12:26:58.619839  6038 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:26:58.625044  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:58.625674  5968 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:26:58.626441  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 134874us
I20260709 12:26:58.627063  5960 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:58.627610  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:58.628250  5967 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:26:58.628556  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:58.630036  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 28 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:58.630249  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:58.630620  6039 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:26:58.631111 12855 raft_consensus.cc:3055] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:26:58.631482 12855 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:58.632332 12855 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.633679  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.615496 12916 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.633997 12855 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:26:58.634330 12833 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.634840 12833 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:58.607849 12791 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:58.636291 12791 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.618817 12866 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:58.638814  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:58.639163  6081 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:58.639225  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:58.641021  6009 leader_election.cc:400] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 21. Current term is 22.
I20260709 12:26:58.641288  6009 leader_election.cc:403] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:26:58.641855 12870 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:26:58.642542 12870 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 21. Current term is 22.
I20260709 12:26:58.602162 12768 raft_consensus.cc:697] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:58.645741 12768 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.627283  6082 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:58.649084  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:58.650255  6036 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
I20260709 12:26:58.652796  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:58.653368  6036 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:58.654667 12929 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:58.655447  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.656314  6041 raft_consensus.cc:2410] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 19 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:26:58.656409 12635 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:26:58.657588  6038 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:58.657784 12635 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:26:58.660975  6040 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:58.663932  6040 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
W20260709 12:26:58.670630  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 50027.8us
I20260709 12:26:58.658221 12635 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:58.687040  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:26:58.690174  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 87539.3us
I20260709 12:26:58.691460  6609 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:58.688833  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.616664 12834 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:26:58.696630  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:58.697214  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:58.689605  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:58.707345  5968 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 28.
I20260709 12:26:58.662062  5861 catalog_manager.cc:5697] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 14 to 17, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 17 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:58.715108  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:58.687381  6643 raft_consensus.cc:2955] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 11 to 13, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:58.665140 12833 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:58.698151  6084 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:58.722188  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:58.638413 12791 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:58.729274  6648 raft_consensus.cc:2393] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 13: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:58.729961  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:58.696759 12562 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:58.685449 12897 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:58.696393 12635 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:58.733994  5861 catalog_manager.cc:5697] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:58.713555 12834 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:58.743527  6006 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:26:58.749960  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:58.750605  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.747105  5968 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:26:58.747596  5962 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 8. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:58.747025  5861 catalog_manager.cc:5697] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 12 to 14, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 14 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:58.773216  5960 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:26:58.740943 12866 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:26:58.778514  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.746121 12562 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:58.757022  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:58.716621 12837 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.050s
I20260709 12:26:58.775701  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:58.786345  5861 catalog_manager.cc:5697] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:58.798144  5861 catalog_manager.cc:5697] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 12 to 14. New cstate: current_term: 14 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:58.800045  5861 catalog_manager.cc:5697] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 15 to 17, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 17 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:26:58.801903  5861 catalog_manager.cc:5697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 14 to 15, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 15 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:58.818605  6037 raft_consensus.cc:2410] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 22 because replica has last-logged OpId of term: 21 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 10.
I20260709 12:26:58.824173  5968 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:26:58.756738 12929 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:58.825639  5968 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:58.825712  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:58.777516 12575 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:26:58.733243 12652 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.048s
I20260709 12:26:58.827378  5861 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 16 to 17, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 17 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:26:58.829972  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 138604us
I20260709 12:26:58.746495 12833 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.073s
I20260709 12:26:58.835193  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:26:58.791409 12920 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:26:58.818202 12904 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:58.819223 12866 raft_consensus.cc:697] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:26:58.838102  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 189093us
I20260709 12:26:58.839084  5960 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 12:26:58.839735  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:58.858201  5968 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:58.865365  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:58.867009  5934 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:58.850368  5861 catalog_manager.cc:5697] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 12 to 14, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 14 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:58.796046 12562 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:58.778715 12897 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:58.876040  5961 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 24.
I20260709 12:26:58.875535  5861 catalog_manager.cc:5697] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:26:58.833777 12793 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:26:58.881629  5861 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 13 to 14, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 14 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:26:58.888974  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 190884us
I20260709 12:26:58.885519  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:58.886304  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:58.890190  6651 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:58.890951  6644 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 10 index: 9. Preceding OpId from leader: term: 11 index: 10. (index mismatch)
I20260709 12:26:58.891213  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:58.861037 12920 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:58.892025 12797 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:26:58.894501  6009 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:58.898413  6649 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:26:58.892621 12724 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:58.913399  6036 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:58.871747 12575 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:58.906621  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:58.907438 12918 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.001s
I20260709 12:26:58.876209 12945 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:58.911621 12916 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:26:58.912247 12947 consensus_queue.cc:1059] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 8.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:58.912639  6647 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
W20260709 12:26:58.915143  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:58.926872  6647 pending_rounds.cc:85] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 15
I20260709 12:26:58.916343  6041 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:26:58.883067 12855 raft_consensus.cc:3055] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:58.888444 12705 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:58.924085  6644 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:58.913578  6645 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:26:58.883517 12837 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:58.871624 12925 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.044s
I20260709 12:26:58.927142  6647 pending_rounds.cc:107] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 20.16
W20260709 12:26:58.935395 12938 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.093s	user 0.000s	sys 0.000s
I20260709 12:26:58.937390 12920 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:58.943132 12933 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:26:58.900877 12880 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.043s
W20260709 12:26:58.946390 12936 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:26:58.915645 12870 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:26:58.929088 12945 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:26:58.949184 12941 log.cc:927] Time spent T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:26:58.883194 12904 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:58.880626 12898 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 12:26:58.936236 12575 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 21.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:58.969187  6647 raft_consensus.cc:2889] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:26:58.975361  6039 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 28.
I20260709 12:26:58.978992  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:58.902154 12793 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:58.931980 12855 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:59.040192  6651 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
W20260709 12:26:59.037496  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 156539us
I20260709 12:26:58.963008 12759 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:59.011690 12837 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 22 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:26:59.049034  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:59.081014  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 394018us
I20260709 12:26:59.038995 12945 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:59.081934  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:58.959805 12929 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.10, Last appended by leader: 10, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:59.091857  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:59.106743  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2368) took 1018 ms. Trace:
I20260709 12:26:59.107247  6043 rpcz_store.cc:276] 0709 12:26:58.088033 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.088154 (+   121us) service_pool.cc:224] Handling call
0709 12:26:58.104548 (+ 16394us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:58.440976 (+336428us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:58.441006 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:58.448999 (+  7993us) log.cc:844] Serialized 26 byte log entry
0709 12:26:58.670061 (+221062us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:26:58.670102 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:26:58.670165 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:26:59.106374 (+436209us) raft_consensus.cc:1685] finished
0709 12:26:59.106399 (+    25us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:26:59.106674 (+   275us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2044,"raft.queue_time_us":132652,"raft.run_cpu_time_us":103,"raft.run_wall_time_us":100,"thread_start_us":517681,"threads_started":2,"wal-append.queue_time_us":307432}
I20260709 12:26:59.091459 12920 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:26:59.027068 12866 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.143712  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:59.143447 12947 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:59.148415 12949 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:26:59.148880 12598 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:59.149343 12598 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:59.095016 12950 raft_consensus.cc:3055] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Stepping down as leader of term 8
I20260709 12:26:59.150313 12598 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 16.17, Last appended by leader: 17, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.151104 12950 raft_consensus.cc:740] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 8 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:59.151681 12511 raft_consensus.cc:3055] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:26:59.152158 12511 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:59.152259 12950 consensus_queue.cc:260] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 8, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.152992 12511 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.155313 12598 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:59.155905 12793 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.076412 12759 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.175522  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:59.094010 12837 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.142608 12724 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:59.227414  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 51988.7us
I20260709 12:26:59.146886 12947 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.161927 12848 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:26:59.232120  6114 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 18 index: 10. Preceding OpId from leader: term: 22 index: 11. (index mismatch)
I20260709 12:26:59.224746 12705 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:26:59.131249 12855 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.155315 12957 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.081s
W20260709 12:26:59.243189  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.143359 12904 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:59.244562  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 152795us
I20260709 12:26:59.247483  5932 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 27 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:59.234247 12967 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:59.239281 12959 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:26:59.252811 12759 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:59.241753 12705 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:59.246093 12924 consensus_meta.cc:287] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.638s	user 0.011s	sys 0.000s
I20260709 12:26:59.279004 12855 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:59.240736 12724 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:26:59.252833 12953 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.109s	user 0.000s	sys 0.000s
I20260709 12:26:59.261592 12968 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:26:59.262127 12946 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:26:59.263052 12562 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.264086 12848 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:59.283466 12705 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:26:59.265429  5932 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:59.304298 12919 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:26:59.305675  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:59.266088 12795 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 28 FOLLOWER]: Leader election lost for term 27. Reason: could not achieve majority
I20260709 12:26:59.260804  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:59.271778 12947 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:59.274734  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:59.260604  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:59.308169  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.286631  6035 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 22.
I20260709 12:26:59.290779 12570 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.251597 12967 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.244517 12635 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.285593 12959 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 28 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:26:59.258826 12960 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.301947  6648 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: [16.13-16.13]
I20260709 12:26:59.303056  6009 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 9 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:59.305835 12924 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:26:59.351609  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 84041.6us
I20260709 12:26:59.354329 12562 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:59.330616 12960 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.356766 12960 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:59.331378 12919 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader election lost for term 9. Reason: could not achieve majority
I20260709 12:26:59.301321 12968 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.310528 12789 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.358999 12789 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.359798 12968 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:59.361232 12951 consensus_queue.cc:1059] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:26:59.361490 12959 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 26.19, Last appended by leader: 19, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.362444 12951 raft_consensus.cc:3055] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:59.362820 12951 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:59.363616 12951 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.364785  6042 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:26:59.358003 12832 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
W20260709 12:26:59.371634  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 57510.3us
I20260709 12:26:59.372705  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:59.364845 12795 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:59.313822 12967 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:59.304315 12848 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.311800 12930 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.361136 12789 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:59.308794 12803 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 12:26:59.380550  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:59.313493 12570 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.371272 12951 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:26:59.391094  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:26:59.392561  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 61351.8us
I20260709 12:26:59.378759 12795 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:59.394955  5964 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:59.403052 12970 raft_consensus.cc:2764] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:26:59.404700 12970 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:26:59.392100 12875 raft_consensus.cc:2764] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election decision vote started in defunct term 14: won
I20260709 12:26:59.406750 12944 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.366639 12924 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:26:59.405076  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:59.407992  6650 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:59.409466  6646 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:26:59.398317 12795 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:59.380419 12971 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.045s
I20260709 12:26:59.393857 12930 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.432283 12930 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:59.436694 12834 consensus_meta.cc:287] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.660s	user 0.010s	sys 0.002s
I20260709 12:26:59.437391 12834 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:59.438606  6044 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: []
W20260709 12:26:59.439373  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 512460us
I20260709 12:26:59.439709 12795 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:59.440582  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:59.427215  6084 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:26:59.447305  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 54009.3us
I20260709 12:26:59.448694  5932 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:26:59.449025 12875 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:26:59.449802 12598 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:26:59.450215 12598 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.450577 12598 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:59.450838  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:59.457051 12945 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.443109 12724 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:59.460150 12598 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.462363 12848 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:59.462527 12598 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:59.466423 12972 log.cc:927] Time spent T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.182s	user 0.002s	sys 0.000s
I20260709 12:26:59.407399 12944 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:59.466920 12635 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:26:59.468588 12952 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.224s	user 0.001s	sys 0.001s
I20260709 12:26:59.468905 12944 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:59.474854 12974 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:59.475556 12974 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.476311 12834 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:59.477113 12897 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:59.477494 12803 consensus_queue.cc:1059] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:26:59.479331 12924 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:59.481951 12950 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:26:59.483446  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:26:59.489920  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 49418.5us
W20260709 12:26:59.520771  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.523063  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:59.495612 12724 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:26:59.524163 12598 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:26:59.525595  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:59.526690  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:59.531263 12795 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:59.532534 12925 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.533110 12925 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:59.535638 12925 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:59.526708 12803 raft_consensus.cc:3055] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:26:59.537551 12803 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:59.538388 12803 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.539711 12803 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:59.540933 12945 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:59.487655 12570 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:59.543994  5932 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:59.545287  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:59.495311  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:59.552866  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:26:59.553612  6651 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:26:59.545609 12967 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.478327 12974 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:59.569304  6651 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:59.550568 12957 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:26:59.578486  6643 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 19: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:26:59.559056 12598 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
W20260709 12:26:59.583210  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 276465us
W20260709 12:26:59.586449  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 60955.4us
I20260709 12:26:59.587785  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:26:59.590235 12966 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.176s
I20260709 12:26:59.591791 12981 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:26:59.593776  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 218097us
I20260709 12:26:59.602337  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:59.586114 12705 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:59.619824  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 3105) took 1020 ms. Trace:
I20260709 12:26:59.621721  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:26:59.623849  6043 raft_consensus.cc:2410] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 17 because replica has last-logged OpId of term: 16 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 12.
W20260709 12:26:59.625262  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.622130  6042 rpcz_store.cc:276] 0709 12:26:58.599082 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.628302 (+ 29220us) service_pool.cc:224] Handling call
0709 12:26:59.619617 (+991315us) spinlock_profiling.cc:243] Waited 728 ms on lock 0x7b540021f2d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:59.619752 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1675240320}
I20260709 12:26:59.622041  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:26:59.631168  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:59.609329 12951 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:26:59.633191  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:59.633302 12951 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.633637  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:59.635036  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:59.641883  5961 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:26:59.637046  5965 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
I20260709 12:26:59.644563  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:59.644603  5964 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:26:59.650730  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:59.651521  5963 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:26:59.658311  5963 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:26:59.611419 12982 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:26:59.663573  5967 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:26:59.663626  5962 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:26:59.671744  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:59.672578  5964 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:59.628484 12837 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:59.631223 12966 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:59.677605  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:59.678520  5965 raft_consensus.cc:2393] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 20: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:26:59.666703  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:59.646123 12951 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:26:59.625244 12924 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.045s
I20260709 12:26:59.687923  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:59.649323 12930 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:59.697835  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:59.628628 12945 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 16.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.046s
I20260709 12:26:59.684890  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:59.702593  5961 raft_consensus.cc:2393] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 16: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:26:59.672603 12929 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:26:59.699096  5968 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:26:59.712144  6006 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:59.635433 12598 consensus_queue.cc:1059] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.062s
I20260709 12:26:59.694653 12918 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:26:59.743031  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:26:59.743479  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:59.728606  6117 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:26:59.695490 12983 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:59.661752 12789 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 21.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.043s
I20260709 12:26:59.745926  5968 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:26:59.744668  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:59.702139 12930 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.746850  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:59.746779  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:59.709226 12982 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:26:59.709533 12929 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.694588 12880 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:26:59.757718  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:59.695865 12837 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.695338 12944 consensus_queue.cc:1059] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:26:59.788673  6117 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 11. Current term is 12. Ops: []
I20260709 12:26:59.746417  6608 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:26:59.790058  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:26:59.791095  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:59.791508  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:59.789299  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:59.746086 12918 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.791158  5968 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:59.791791  5964 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:59.727197 12897 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:26:59.707536 12919 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.051s
I20260709 12:26:59.797626  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:59.714779 12916 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.057s
I20260709 12:26:59.701363 12966 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.771395 12929 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:26:59.825790  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 3104) took 1213 ms. Trace:
I20260709 12:26:59.757794 12930 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:59.756042 12848 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:26:59.853466 12848 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.855216  6118 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 20. Current term is 21. Ops: []
I20260709 12:26:59.855543  5968 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:26:59.829216  6035 rpcz_store.cc:276] 0709 12:26:58.598811 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.638537 (+ 39726us) service_pool.cc:224] Handling call
0709 12:26:59.812309 (+1173772us) spinlock_profiling.cc:243] Waited 623 ms on lock 0x7b54001ba154. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:26:59.812404 (+    95us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1433085824}
I20260709 12:26:59.856303  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:59.795059 12918 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:26:59.758894 12982 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:26:59.833369  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:59.835275 12945 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.836766 13002 raft_consensus.cc:3055] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Stepping down as leader of term 15
W20260709 12:26:59.837610 12984 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.212s	user 0.001s	sys 0.000s
I20260709 12:26:59.847991 12837 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:59.849157  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:59.849627 12795 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:26:59.850411 12897 raft_consensus.cc:697] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:26:59.851279  6109 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 13 index: 12. Preceding OpId from leader: term: 14 index: 13. (index mismatch)
I20260709 12:26:59.851909  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:59.852804  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:59.745954 12920 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.058s
I20260709 12:26:59.811501 12967 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:26:59.863932 12936 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:26:59.756733 12983 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.872224  6113 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:59.863319 12724 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:26:59.831902 12875 raft_consensus.cc:3055] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:26:59.883294 12875 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:59.867203  6115 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 18. Ops: []
I20260709 12:26:59.884182 12875 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.884624 12983 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:59.885573 12875 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:59.864226 12982 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:26:59.867569 13002 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:26:59.879411  6112 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:26:59.871102 12945 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.882948 12724 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.803505 12791 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.073s
I20260709 12:26:59.876118  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:59.867726 12739 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:26:59.892974  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 283652us
W20260709 12:26:59.893571  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 126044us
I20260709 12:26:59.895677  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:59.898284  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:59.887346 13002 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.900890 13002 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:59.903508  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:59.907480  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:26:59.914419  6110 raft_consensus.cc:2410] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
W20260709 12:26:59.916116  6009 leader_election.cc:336] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.597s (SENT)
I20260709 12:26:59.916568  6009 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:26:59.918309 12929 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:59.906661 12739 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:59.920403 12929 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:26:59.922003  6118 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:26:59.923002  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:26:59.923545  6118 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:26:59.924127 12724 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:59.924440 12795 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:26:59.924815  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:59.924934 12795 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:26:59.898300  6113 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5744a277c5a3409b95831573168daf3f"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:42484
I20260709 12:26:59.926396 12795 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:26:59.927418 12848 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:26:59.930590  6118 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:26:59.937287  5963 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 21 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
W20260709 12:26:59.929754 12992 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.055s	user 0.000s	sys 0.000s
I20260709 12:26:59.938340  6113 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:26:59.938681  6109 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:59.940999  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:59.941821  6113 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:26:59.943377  6643 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
I20260709 12:26:59.940475  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:59.942641  6648 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:26:59.948817  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:26:59.948817  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:26:59.951133  6644 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:26:59.921077 12739 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:26:59.986671  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:59.990600  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:26:59.991097  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:26:59.992657  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 76571.7us
I20260709 12:26:59.944278 12880 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:26:59.941722 12925 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:27:00.006023 12989 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.253s	user 0.002s	sys 0.000s
W20260709 12:26:59.999784 12997 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:27:00.000664 13008 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.106s	user 0.001s	sys 0.000s
I20260709 12:27:00.002844  6044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 3093) took 1442 ms. Trace:
W20260709 12:26:59.998894  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.025966  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:00.004330 12951 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:26:59.998409  6112 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:27:00.014155  6116 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 21.
I20260709 12:27:00.014596  6113 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:00.018384  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:00.022042  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:00.030112  6041 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:00.024530 12930 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:00.014019 12880 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:00.026336  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:00.028635  6039 raft_consensus.cc:2393] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 19: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:00.022738  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 7 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:00.027172  6044 rpcz_store.cc:276] 0709 12:26:58.559851 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.560011 (+   160us) service_pool.cc:224] Handling call
0709 12:26:58.578110 (+ 18099us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.438976 (+860866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.002516 (+563540us) spinlock_profiling.cc:243] Waited 860 ms on lock 0x7b540030d9d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:00.002687 (+   171us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1978378624}
I20260709 12:27:00.033046  6040 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:00.034709  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 8 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:00.022656 12998 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.132s	user 0.000s	sys 0.001s
I20260709 12:26:59.944459 12575 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:27:00.039261  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.041682  6036 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 16 index: 10. (index mismatch)
I20260709 12:27:00.042758  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.047899  6115 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 13: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:00.052488  6114 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 22: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:00.053107  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.053401  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:00.053951  6043 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 21 index: 12. Preceding OpId from leader: term: 22 index: 11. (term mismatch)
I20260709 12:27:00.054338  6043 pending_rounds.cc:85] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 10
I20260709 12:27:00.054689  6043 pending_rounds.cc:107] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 19.11
I20260709 12:27:00.055023  6043 raft_consensus.cc:2889] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:00.055330  6038 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 11. (term mismatch)
I20260709 12:27:00.055330  6043 pending_rounds.cc:107] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 21.12
I20260709 12:27:00.056075  6043 raft_consensus.cc:2889] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:00.064198  6042 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:27:00.072810  6040 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:27:00.055876  6038 pending_rounds.cc:85] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 10
I20260709 12:27:00.073891  6038 pending_rounds.cc:107] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 16.11
I20260709 12:27:00.074226  6038 raft_consensus.cc:2917] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Aborting config change with OpId 16.11: Aborted: Op aborted by new leader
I20260709 12:27:00.076221  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.077024  6116 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 19: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:26:59.949879 12897 consensus_queue.cc:237] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:00.084661  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.085491  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:00.166181  6112 raft_consensus.cc:2376] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17. Re-sending same reply.
I20260709 12:27:00.090281  5934 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:00.167444  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 77227.8us
W20260709 12:27:00.092692  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.119026  6038 raft_consensus.cc:2889] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:00.158519  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.171034  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:00.165315  6109 raft_consensus.cc:2376] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16. Re-sending same reply.
I20260709 12:27:00.168388  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:00.180648  5934 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:00.084596  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:00.193259  6040 raft_consensus.cc:2376] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13. Re-sending same reply.
I20260709 12:27:00.195814  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.196506  6116 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
W20260709 12:27:00.250311  6009 leader_election.cc:336] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.767s (SENT)
W20260709 12:27:00.248248  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 53440us
I20260709 12:27:00.254853  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:00.197046  6084 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:27:00.256925  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 62476.5us
I20260709 12:27:00.255609  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:00.260340  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:00.261474  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:00.266525  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:00.267269  6109 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:00.262008  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:00.191210 12919 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.279812  5965 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 16 index: 11. (index mismatch)
I20260709 12:27:00.195266 12724 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:00.280417  5959 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:00.280844  5960 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 12 index: 11. (index mismatch)
I20260709 12:27:00.281422  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:00.287637  5963 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:00.281602  5932 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:00.284237  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:00.267966 12598 raft_consensus.cc:2804] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:00.266000 12795 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:00.350323  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.351148  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:00.394563  6112 raft_consensus.cc:2368] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16.
I20260709 12:27:00.339533  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.388125  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:00.277429 12848 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:00.271543 12833 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:00.419505  6040 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:00.389127  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:35822 (request call id 1) took 13080 ms. Trace:
I20260709 12:27:00.342635 12999 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:00.452751  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.463461  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.464671  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:00.465646  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.421164  6038 rpcz_store.cc:276] 0709 12:26:47.266482 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:47.268565 (+  2083us) service_pool.cc:224] Handling call
0709 12:26:47.347038 (+ 78473us) log.cc:844] Serialized 499 byte log entry
0709 12:27:00.275926 (+12928888us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10132,"raft.queue_time_us":7203,"raft.run_cpu_time_us":1863,"raft.run_wall_time_us":1863,"thread_start_us":73938,"threads_started":1,"wal-append.queue_time_us":105576,"wal-append.run_cpu_time_us":1757,"wal-append.run_wall_time_us":1003731}
I20260709 12:27:00.470577  6117 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 16: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:00.473353  5963 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 25.
I20260709 12:27:00.411990 12848 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:00.396390 12974 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:00.414253 12945 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:00.393906 12795 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:00.413188 12598 raft_consensus.cc:697] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:00.419167 13010 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.514300  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:00.515872  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 234338us
I20260709 12:27:00.488574 12848 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:00.446265 12833 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:00.522109  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.343664 12919 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:00.526117  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.513298 12795 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:00.551728  5932 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:00.526679 13002 consensus_meta.cc:287] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.625s	user 0.011s	sys 0.000s
W20260709 12:27:00.557338  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 301793us
I20260709 12:27:00.426478 12575 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:27:00.553143  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 302838us
I20260709 12:27:00.565070  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:00.568284  6116 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:27:00.571102  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:00.528786 12979 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:00.458925 12999 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:00.575799  5963 raft_consensus.cc:1240] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:00.555053 12930 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:00.583710  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.588230  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.561621 12880 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:00.591426  6112 raft_consensus.cc:2393] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 14: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:00.591584  6117 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:27:00.537778 12974 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:00.592056  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:00.596385  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.600389  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:00.601179  6038 raft_consensus.cc:2393] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 16: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:27:00.587848 12904 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.305s	user 0.026s	sys 0.025s
I20260709 12:27:00.602980  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.604542  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:27:00.606153  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.589851 12951 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:00.543776 13010 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:00.606722 12904 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.326s	user 0.026s	sys 0.025s
I20260709 12:27:00.590664 12986 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:27:00.615540 12965 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 1.186s	user 0.001s	sys 0.004s
W20260709 12:27:00.618325 13014 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.225s	user 0.001s	sys 0.000s
I20260709 12:27:00.604349 13020 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:00.617758 12724 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:00.623173  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:00.631734  6038 raft_consensus.cc:3060] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:27:00.614357  6041 consensus_meta.cc:287] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.580s	user 0.005s	sys 0.000s
I20260709 12:27:00.624912  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:00.633056  6041 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:27:00.624974  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.634235  6036 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:00.617321  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.635078  6112 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 21: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:00.635468  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:00.633575  6040 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 24.
I20260709 12:27:00.638381  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:00.627874 12511 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:27:00.656196  5914 auto_rebalancer.cc:629] Failed to schedule move for tablet e3ef3cb064eb4a1597f89e040fce3c7e: Aborted: Op aborted by new leader
I20260709 12:27:00.658650 12966 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:00.665300  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 104877us
W20260709 12:27:00.666029  6009 leader_election.cc:336] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.831s (SENT)
I20260709 12:27:00.666399  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:00.674183  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.674846  6040 raft_consensus.cc:1240] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14. Ops: [13.7-13.7]
W20260709 12:27:00.680907  5964 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.611s	user 0.008s	sys 0.013s
I20260709 12:27:00.679987  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.618432 12598 consensus_queue.cc:237] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:00.683179  6112 raft_consensus.cc:2410] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 20 because replica has last-logged OpId of term: 19 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:27:00.693969  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.694621  6117 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:27:00.695149  6109 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
W20260709 12:27:00.685835 12768 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.697s	user 0.011s	sys 0.016s
W20260709 12:27:00.699187  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 88755us
W20260709 12:27:00.688963 12950 consensus_meta.cc:287] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 1.165s	user 0.013s	sys 0.004s
W20260709 12:27:00.682268  5964 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.612s	user 0.008s	sys 0.013s
I20260709 12:27:00.708024  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.692667  6038 raft_consensus.cc:2468] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:27:00.727852  6109 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
W20260709 12:27:00.728585  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 137132us
I20260709 12:27:00.681505 13021 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:00.742192 12951 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:27:00.742656 13019 log.cc:927] Time spent T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.063s	user 0.001s	sys 0.000s
I20260709 12:27:00.744709 13010 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:00.746886 12982 consensus_meta.cc:287] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.861s	user 0.004s	sys 0.007s
I20260709 12:27:00.747303 12982 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:00.749384 12982 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:00.668840 12724 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:00.693300  6041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6b70d6df693140769deef828413df1ba"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:42450
I20260709 12:27:00.750787  6118 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 19: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:00.751626 12724 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:00.752638 12898 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:27:00.750861  6041 raft_consensus.cc:606] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:00.753935  6041 raft_consensus.cc:614] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:00.730967  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:00.731241  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:00.712967 12768 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.724s	user 0.012s	sys 0.016s
I20260709 12:27:00.732802  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.763134  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:00.760150  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:00.763784  6037 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:00.763394  6112 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:27:00.764143  6038 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 22: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:00.764691  6115 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:27:00.768275  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.763456  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.766390  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:00.686805 12966 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.046s
W20260709 12:27:00.778107 12918 consensus_meta.cc:287] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.905s	user 0.010s	sys 0.001s
I20260709 12:27:00.778576 12918 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:00.781611  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:00.782325  6040 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: []
I20260709 12:27:00.782984  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.785020  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:00.783638  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:00.787521  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 56614.8us
I20260709 12:27:00.777652 12999 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:00.783639  6117 raft_consensus.cc:2376] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15. Re-sending same reply.
I20260709 12:27:00.770324 12833 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:00.803086  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.803140  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:00.811067  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.811645 13015 consensus_queue.cc:1059] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.022s
I20260709 12:27:00.812223  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:00.792397 12724 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:00.813552  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:00.813961 12724 raft_consensus.cc:697] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:00.813503  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.814855 12724 consensus_queue.cc:237] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:00.812275  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:00.803956  6112 raft_consensus.cc:2376] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20. Re-sending same reply.
I20260709 12:27:00.820092  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:00.766888 12951 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:00.823015  6109 raft_consensus.cc:2393] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 14: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:00.763659 13021 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:00.812486 13015 raft_consensus.cc:3055] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:27:00.795724 13010 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:00.819542 13031 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:00.841121  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 175114us
I20260709 12:27:00.837838 13015 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:00.863466 13015 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:00.865228 13015 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:00.867750 12681 raft_consensus.cc:3055] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:27:00.868211 12681 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:00.869005 12681 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:00.870003 12681 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:27:00.871073 13035 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
I20260709 12:27:00.873497 12951 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:00.876227 13021 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:00.807523 12999 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:27:00.887315  6009 leader_election.cc:336] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.870s (SENT)
I20260709 12:27:00.889243  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:00.887655  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 104100us
I20260709 12:27:00.831799 12919 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:00.892210  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:00.893067 13041 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:00.893862  6112 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:00.895215  6112 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 21. Current term is 22. Ops: [19.15-21.16]
I20260709 12:27:00.895533 13041 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:27:00.897154  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:00.895215  6109 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 21. Current term is 22. Ops: [19.11-21.12]
I20260709 12:27:00.900317  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:00.840726 12974 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:00.888391 13021 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:00.913897  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:00.908500 13034 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:27:00.920194 13030 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.084s	user 0.000s	sys 0.000s
I20260709 12:27:00.903609 13041 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:27:00.926672 13002 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:00.921597 13021 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:00.927150 13002 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:00.928030 13002 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:00.928834 13021 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:00.881021 13031 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:00.932471 13031 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:00.921342 12920 consensus_queue.cc:1059] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 11.6, Next index: 7, Last known committed idx: 6, Time since last communication: 0.012s
I20260709 12:27:00.934015 12920 raft_consensus.cc:3055] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:27:00.934378 12920 raft_consensus.cc:740] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:00.935323 12920 consensus_queue.cc:260] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 13.7, Last appended by leader: 7, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:00.936568 12920 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:00.939025 12918 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:00.939801  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 1.19338e+06us
I20260709 12:27:00.940562  6608 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:00.940677  6611 connection.cc:256] RPC call timeout handler was delayed by -1.1508622559999822s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1896s for a response
W20260709 12:27:00.941167  6611 connection.cc:256] RPC call timeout handler was delayed by -1.1158614480000324s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.17090000000000002s for a response
I20260709 12:27:00.915019 12999 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:00.942389 12759 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:00.942906 12944 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:27:00.943290 12944 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:00.943770 13023 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.944069 12959 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:00.904488 13010 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:00.944285 13023 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:00.946097  6650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 1653) took 1012 ms. Trace:
I20260709 12:27:00.946440  6650 rpcz_store.cc:276] 0709 12:26:59.933605 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.933853 (+   248us) service_pool.cc:224] Handling call
0709 12:26:59.944439 (+ 10586us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:00.945744 (+1001305us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.945772 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:00.945815 (+    43us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:00.945855 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.945916 (+    61us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:00.946040 (+   124us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":995261,"raft.queue_time_us":995378,"raft.run_cpu_time_us":109,"raft.run_wall_time_us":110}
I20260709 12:27:00.944185 12705 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:00.942837 12759 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:00.948591 12759 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:00.950551  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:00.951212  5961 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:00.953578  6044 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 23. Current term is 24. Ops: []
I20260709 12:27:00.963048  6044 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:42450
I20260709 12:27:00.963696  6044 raft_consensus.cc:606] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:00.964021  6044 raft_consensus.cc:614] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:00.965117 12945 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.965700 12945 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:00.966925 12948 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
W20260709 12:27:00.968703  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:00.969357  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.970799 12895 consensus_queue.cc:1059] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 18.11, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:00.971896 12791 raft_consensus.cc:3055] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:27:00.972247 12791 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:00.973135 12791 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 11, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:00.970841 12832 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.975003 12832 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:00.975055 12795 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:00.975898 13017 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.418s	user 0.003s	sys 0.000s
I20260709 12:27:00.979465 12951 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:00.986778  6043 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:42450
I20260709 12:27:00.987551  6043 raft_consensus.cc:606] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:00.987885  6043 raft_consensus.cc:614] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
W20260709 12:27:00.989373  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 1.05616e+06us
I20260709 12:27:00.989671  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
W20260709 12:27:00.997640  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:00.998695 12866 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.000597 12967 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.001574  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1611) took 1153 ms. Trace:
I20260709 12:27:01.002058  6110 rpcz_store.cc:276] 0709 12:26:59.848444 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.851636 (+  3192us) service_pool.cc:224] Handling call
0709 12:27:01.001352 (+1149716us) spinlock_profiling.cc:243] Waited 40.4 ms on lock 0x7b5400091ad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:01.001513 (+   161us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":92969344}
I20260709 12:27:01.003232 12986 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:01.004504  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:01.005292  6645 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 21: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:27:01.006618  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 153257us
I20260709 12:27:01.006265  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:01.008150 12880 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:00.999336 12866 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.008663 12880 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.001289 12967 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.010504  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:01.013540  6645 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 9.
I20260709 12:27:01.016280  6035 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:27:01.017057  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:01.011164  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:01.017632  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:01.018268  6647 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:01.006976  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:01.019022  6646 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:27:00.981941  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:27:01.010977  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 70496.2us
I20260709 12:27:01.024186  6035 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:27:01.022428  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:01.026895  6608 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:27:01.028127  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.028884  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:01.029827  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:01.032498  5961 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:27:01.031858  6645 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:27:01.034399  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:01.037556  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:01.038579  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:01.039438 12947 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:01.039973 12947 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:01.040822 12947 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.044519  6649 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 12.
I20260709 12:27:01.044556  6035 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 28 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:27:01.049016 12969 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.049263 13029 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 28 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.049563 12969 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.049821 13029 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 28 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.046757 12570 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:01.048818 12982 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:01.051975 13029 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:01.052716  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:01.052883 12832 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:01.053925 12880 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:01.070344  6647 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:01.035408 12875 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:27:01.055656 13002 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.051892 12969 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:01.127460  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:27:01.074618  6009 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 2.021s (SENT) [suppressed 33 similar messages]
W20260709 12:27:01.128334  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 53763.1us
I20260709 12:27:01.085723  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:01.127204  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 29 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:01.086439  5914 auto_rebalancer.cc:629] Failed to schedule move for tablet 382d3eda9eaa4b9c96393a12d9f2be5c: Illegal state: Replica 0557a7246c8945b99e5215c99d4ddf9c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 22 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:01.043721 12866 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:01.091758  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:01.094295  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1605) took 1370 ms. Trace:
I20260709 12:27:01.098836  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:01.077360 12944 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 23.12, Last appended by leader: 12, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:01.076109 12855 raft_consensus.cc:2764] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:27:01.107563 12791 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:01.108158 13010 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:01.076917 12795 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:01.108462 12979 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.109211  6118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1624) took 1221 ms. Trace:
I20260709 12:27:01.109472  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:01.111963  6113 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:01.113040  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:01.075942 12832 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.115782 12960 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:01.116366  6084 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:01.117486  5932 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:01.117992 12945 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:01.159054  6084 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:01.076473 12968 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:01.117501 13038 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.118924  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:01.198345  5959 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 28 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 28.
I20260709 12:27:01.118232 12875 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:01.120203 12967 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:01.124895  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:01.126314  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:01.076218 12959 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.127149  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:01.133049  6114 rpcz_store.cc:276] 0709 12:26:59.724315 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.743169 (+ 18854us) service_pool.cc:224] Handling call
0709 12:27:01.094071 (+1350902us) spinlock_profiling.cc:243] Waited 307 ms on lock 0x7b5400206054. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:01.094223 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":705193344}
W20260709 12:27:01.144308  6009 leader_election.cc:336] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 2.085s (SENT)
I20260709 12:27:01.208400  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:01.146942  5934 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:01.209246  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 62383.3us
I20260709 12:27:01.209920  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:01.149180  6113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RunLeaderElection from 127.0.0.1:42484 (request call id 1615) took 1296 ms. Trace:
I20260709 12:27:01.157384  6117 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:01.145473  6118 rpcz_store.cc:276] 0709 12:26:59.887389 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.940213 (+ 52824us) service_pool.cc:224] Handling call
0709 12:27:01.109017 (+1168804us) spinlock_profiling.cc:243] Waited 806 ms on lock 0x7b540020c454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:01.109152 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1853620480}
I20260709 12:27:01.179754 13042 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election won for term 13
W20260709 12:27:01.180853  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 63456.7us
W20260709 12:27:01.191816  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.215220  5932 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:27:01.215672  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.144714 12575 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:01.203088  6648 raft_consensus.cc:3055] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:27:01.218006  6648 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:01.145236 12768 consensus_queue.cc:1059] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.061s
I20260709 12:27:01.207612  6642 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:27:01.219048 12768 raft_consensus.cc:3055] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:27:01.218863  6648 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.219421 12575 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:01.219803  6648 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:01.220371 12575 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:01.221764 12916 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:01.219458 12768 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:01.223727 12768 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 16.11, Last appended by leader: 11, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:01.224822 12768 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:01.225261 12875 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 23.14, Last appended by leader: 14, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:01.213063  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:01.193833 12803 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.227692  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:01.228471  5959 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:01.211617  5934 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:01.161351 13010 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:01.214897  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:01.213905  6084 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:01.231513  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:01.231639  5932 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:01.232129  6114 raft_consensus.cc:2376] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15. Re-sending same reply.
I20260709 12:27:01.210677  6113 rpcz_store.cc:276] 0709 12:26:59.849719 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.889445 (+ 39726us) service_pool.cc:224] Handling call
0709 12:27:00.980812 (+1091367us) spinlock_profiling.cc:243] Waited 11.4 ms on lock 0x7b54002d4e54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482104ba3d 00007f482601bcd0 00007f481f5a0254 00007f481f5a01e2 00007f481f5a0111 00007f481f5a008c 00007f481f59f342 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:01.111303 (+130491us) spinlock_profiling.cc:243] Waited 45.4 ms on lock 0x7b4c00492180. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f320a20 00007f481f331a29 00007f481f33213f 00007f481f2f62ab 00007f481f323f3c 00007f481f3243fe 00007f481f5b188b 00007f4820fb0495 00007f482100130f 00007f482104ba55 00007f482601bcd0
0709 12:27:01.146015 (+ 34712us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":130634240}
I20260709 12:27:01.214417 12739 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:01.233609 12739 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:01.234068 12739 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:01.235719 12969 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:01.236148 12969 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.236469 12969 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:01.227566 13002 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:01.147568 13004 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:01.239241 13004 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:01.218278  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:01.240736  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:01.163172  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3539) took 1322 ms. Trace:
I20260709 12:27:01.147753 12951 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:27:01.228644  6648 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:27:01.228157 12803 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.201035 12948 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:01.198333 12930 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:27:01.246272  6084 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:01.247372  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:01.248208  6118 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:27:01.249522  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:01.246222  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:01.193511  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 198499us
I20260709 12:27:01.156360 12832 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:01.256036  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:01.209362 12795 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Leader pre-election won for term 9
I20260709 12:27:01.258678  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:01.269042  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:01.261729  6112 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 19: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:01.149279 12979 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.162397 12960 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.267616  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 21 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:01.251334 12920 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:01.270385  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:01.271642  6114 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:27:01.241466  6111 rpcz_store.cc:276] 0709 12:26:59.833038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.833165 (+   127us) service_pool.cc:224] Handling call
0709 12:26:59.871062 (+ 37897us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:26:59.871307 (+   245us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:27:00.964741 (+1093434us) spinlock_profiling.cc:243] Waited 3.32 ms on lock 0x7b18003e4940. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f4820bfc4bc 00007f481df4a48b 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df64455 00007f4824a4c3c7 00007f482105e9a7 00007f482106e0bf
0709 12:27:00.964908 (+   167us) log.cc:844] Serialized 14 byte log entry
0709 12:27:01.154823 (+189915us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:01.154937 (+   114us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:01.154981 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.155043 (+    62us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:01.155179 (+   136us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23330,"prepare.queue_time_us":84328,"prepare.run_cpu_time_us":49,"prepare.run_wall_time_us":49,"raft.queue_time_us":3039,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":36012,"spinlock_wait_cycles":7625984,"thread_start_us":282744,"threads_started":2}
I20260709 12:27:01.247399 12970 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:01.247228 12981 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:01.200901 12968 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:01.278646  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 149748us
I20260709 12:27:01.245483 13042 raft_consensus.cc:697] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:01.279502  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:01.288874  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:01.296344  6114 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 22.
I20260709 12:27:01.256367 12951 consensus_queue.cc:1243] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Peer 0557a7246c8945b99e5215c99d4ddf9c log is divergent from this leader: its last log entry 24.12 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 11
I20260709 12:27:01.207692 12759 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.214339 12959 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.265153 13002 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:27:01.271159 12848 consensus_meta.cc:287] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.713s	user 0.015s	sys 0.004s
I20260709 12:27:01.269382 12948 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:01.287072  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:01.286984  6647 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:27:01.291738  5959 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:01.292943  6081 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:01.280998  6112 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:01.298502  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:01.206315 13038 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:01.300232  6009 leader_election.cc:336] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 2.117s (SENT)
W20260709 12:27:01.301133  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.269182 12967 consensus_queue.cc:1059] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.037s
I20260709 12:27:01.271445 12795 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:01.301077  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:01.272596 13039 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.081s
I20260709 12:27:01.346545  6651 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:01.423875  5961 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:27:01.387100  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:01.412314  6117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1628) took 1477 ms. Trace:
I20260709 12:27:01.305020  6611 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:01.406917  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3546) took 1417 ms. Trace:
I20260709 12:27:01.273100 13029 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:27:01.445338  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.465574  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 160629us
I20260709 12:27:01.425220  6117 rpcz_store.cc:276] 0709 12:26:59.934709 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.816172 (+881463us) service_pool.cc:224] Handling call
0709 12:27:01.010241 (+194069us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.214184 (+203943us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.411470 (+197286us) spinlock_profiling.cc:243] Waited 142 ms on lock 0x7b5400091ad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:01.412095 (+   625us) spinlock_profiling.cc:243] Waited 194 ms on lock 0x7b5400091ad0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:01.412245 (+   150us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":772790016}
I20260709 12:27:01.463804  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:01.438910  6040 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:27:01.449888  6113 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:27:01.338588  6114 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
W20260709 12:27:01.450654  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.450835  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 158004us
I20260709 12:27:01.426299  6115 rpcz_store.cc:276] 0709 12:26:59.989484 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.819693 (+830209us) service_pool.cc:224] Handling call
0709 12:27:00.837507 (+ 17814us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:00.837928 (+   421us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:00.837957 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:00.886802 (+ 48845us) log.cc:844] Serialized 26 byte log entry
0709 12:27:01.260902 (+374100us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:01.260941 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.261011 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:01.406667 (+145656us) raft_consensus.cc:1685] finished
0709 12:27:01.406688 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:01.406850 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":91,"raft.run_cpu_time_us":189,"raft.run_wall_time_us":14341,"thread_start_us":344896,"threads_started":1,"wal-append.queue_time_us":478475}
I20260709 12:27:01.472548  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:01.480659  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 180448us
I20260709 12:27:01.482530  6114 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 13 index: 7. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
I20260709 12:27:01.472931  5934 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:01.359297 13026 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.060s	user 0.001s	sys 0.000s
W20260709 12:27:01.408141 13013 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 1.210s	user 0.000s	sys 0.002s
W20260709 12:27:01.418057 12681 consensus_meta.cc:287] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.548s	user 0.010s	sys 0.011s
W20260709 12:27:01.486020  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.435024 12795 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 8 FOLLOWER]: Advancing to term 9
I20260709 12:27:01.281484 12570 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:01.327701 12925 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 28 FOLLOWER]: Leader pre-election won for term 29
W20260709 12:27:01.491784  6009 leader_election.cc:336] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 2.182s (SENT)
I20260709 12:27:01.463881 13029 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:01.531184  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:01.532088  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 158996us
I20260709 12:27:01.399794 12759 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:01.415202 13004 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:01.536465  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.327037 12724 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:01.533154 12855 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:01.490248 13024 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.547217 12950 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:01.487075 13041 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:01.487535 12983 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:27:01.532168  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 59712.9us
I20260709 12:27:01.336934 12511 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.404197 12944 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:01.648850  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:01.494534  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:01.548023  6113 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 12:27:01.548803  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 80472.4us
I20260709 12:27:01.368350 12966 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:01.557091  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:01.550930  6109 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 12. (term mismatch)
I20260709 12:27:01.529461  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:01.550942  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:01.397907 12739 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.578332 12803 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:01.303689 12866 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.253s
I20260709 12:27:01.533051 13060 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 12:27:01.557428 12925 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 28 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.465974 12848 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.549506 13002 raft_consensus.cc:697] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:01.562937 13029 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:27:01.622766  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.547399 13015 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:01.638494  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:27:01.640583  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 78032.9us
I20260709 12:27:01.647249  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:01.571966 12981 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:01.648341  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:01.530059 13031 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:01.649484  6037 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:27:01.689010  6041 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:27:01.690699  6109 pending_rounds.cc:85] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 11
I20260709 12:27:01.697854 12866 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:01.699857  6611 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:01.697883 12966 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:01.529954 13042 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.779950  5968 raft_consensus.cc:2393] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 18: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:01.703510 12968 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:01.705972 13023 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:01.709575  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:01.781664  5964 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:27:01.710099 12832 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:01.751281 12925 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:01.689754 12511 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:01.711596 13059 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.144s	user 0.000s	sys 0.000s
W20260709 12:27:01.644460 13026 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:27:01.712318 12979 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:01.576156 12855 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:01.716068 13016 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 1.191s	user 0.003s	sys 0.000s
W20260709 12:27:01.719072 13018 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 1.122s	user 0.004s	sys 0.000s
I20260709 12:27:01.757263 13020 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.036s
I20260709 12:27:01.812484  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:01.812798  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3487) took 1876 ms. Trace:
I20260709 12:27:01.582540 12948 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.721959  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:01.785053 12968 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:01.725358 12969 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.726392  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:01.731875 12959 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:01.638525 12724 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.735549 13066 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.736230 13064 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:01.726341 12570 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.719511 12960 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:01.710422 13049 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.161s	user 0.000s	sys 0.000s
I20260709 12:27:01.740367 12930 consensus_queue.cc:1059] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:27:01.741236 12739 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:01.746650  5959 raft_consensus.cc:2393] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 15: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:01.748435  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:01.848871  6649 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
W20260709 12:27:01.751863  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.753475  6040 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:01.755818  6109 pending_rounds.cc:107] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 18.12
I20260709 12:27:01.850384  6109 raft_consensus.cc:2889] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:01.756559  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:01.776989  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 77185.7us
I20260709 12:27:01.781564 12866 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.758805 13015 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:01.758630 12803 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:01.870812  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.639189 13024 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.795876 12855 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:01.719599  6118 raft_consensus.cc:2410] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 17 because replica has last-logged OpId of term: 16 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 10.
I20260709 12:27:01.814245  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:01.720969 12791 consensus_meta.cc:287] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.569s	user 0.005s	sys 0.004s
I20260709 12:27:01.813561  6043 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:27:01.816804  5965 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: [18.12-18.12]
I20260709 12:27:01.817548  5967 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:27:01.724671  6111 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 20 index: 12. (index mismatch)
I20260709 12:27:01.815289  5962 rpcz_store.cc:276] 0709 12:26:59.936282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.936390 (+   108us) service_pool.cc:224] Handling call
0709 12:26:59.947069 (+ 10679us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:59.988301 (+ 41232us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.988329 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:59.994660 (+  6331us) log.cc:844] Serialized 26 byte log entry
0709 12:27:00.076373 (+ 81713us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:00.076408 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.076474 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:01.119798 (+1043324us) spinlock_profiling.cc:243] Waited 9.4 ms on lock 0x7b4800080058. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4825f7daa1 00007f4825f74b37 00007f4825f749ca 00007f482606c26f 00007f482606bf37 00007f482608055c 00007f4826080508 00007f4826080488 00007f4826080443 00007f482607f6ec 00007f4824fa9a96
0709 12:27:01.715412 (+595614us) spinlock_profiling.cc:243] Waited 28.7 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:27:01.812572 (+ 97160us) raft_consensus.cc:1685] finished
0709 12:27:01.812594 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:01.812727 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5927,"raft.queue_time_us":44686,"raft.run_cpu_time_us":11850,"raft.run_wall_time_us":1125029,"spinlock_wait_cycles":87630464,"thread_start_us":49503,"threads_started":1,"wal-append.queue_time_us":401636}
I20260709 12:27:01.820232  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3484) took 1889 ms. Trace:
I20260709 12:27:01.779554 13058 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.041s
I20260709 12:27:01.842730  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:01.843298  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:01.851446  6113 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:27:01.569317 12967 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.082s
I20260709 12:27:01.851851  6611 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:01.852172  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 370726us
I20260709 12:27:01.639412 12950 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.789685  6081 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:01.932664  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 143067us
I20260709 12:27:01.933540  5964 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 19: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:01.887240 12969 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:01.887813  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:01.888965  6109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3474) took 1251 ms. Trace:
I20260709 12:27:01.890563  5959 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:01.894587  5963 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 23. Current term is 24. Ops: [23.12-23.12]
I20260709 12:27:01.899928 12971 raft_consensus.cc:3055] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:27:01.903748 12966 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:01.942946 12803 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.906260  6651 raft_consensus.cc:1275] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:27:01.943522 12803 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.907733 12724 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:01.840066 12968 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:01.912484  5966 rpcz_store.cc:276] 0709 12:26:59.931180 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:59.931465 (+   285us) service_pool.cc:224] Handling call
0709 12:26:59.943006 (+ 11541us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:26:59.947903 (+  4897us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:26:59.947932 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:26:59.987178 (+ 39246us) log.cc:844] Serialized 26 byte log entry
0709 12:27:00.415157 (+427979us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:27:00.415202 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:00.415306 (+   104us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:01.577372 (+1162066us) spinlock_profiling.cc:243] Waited 4.2 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:27:01.814843 (+237471us) raft_consensus.cc:1685] finished
0709 12:27:01.814870 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:01.820162 (+  5292us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":45000,"raft.run_cpu_time_us":116,"raft.run_wall_time_us":5412,"spinlock_wait_cycles":9665408,"thread_start_us":376092,"threads_started":1,"wal-append.queue_time_us":543428}
W20260709 12:27:01.950604  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.924705  6040 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
W20260709 12:27:01.931725  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 79969.1us
I20260709 12:27:01.936964  6109 rpcz_store.cc:276] 0709 12:27:00.637397 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.414510 (+777113us) service_pool.cc:224] Handling call
0709 12:27:01.414892 (+   382us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.851086 (+436194us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.888744 (+ 37658us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b54000924d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:01.888908 (+   164us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":312068480}
I20260709 12:27:01.842356 13064 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:01.959959  5959 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:01.948460  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:01.929498 13049 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:01.858594 12795 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.951751  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3473) took 1330 ms. Trace:
I20260709 12:27:01.956033  5968 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: []
W20260709 12:27:01.940730 13010 consensus_meta.cc:287] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.693s	user 0.010s	sys 0.000s
I20260709 12:27:01.960852  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 29 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:01.960142  6611 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:01.957216 12999 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:01.987115 12999 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:01.987432  5959 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 28 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 28 index: 20. (index mismatch)
I20260709 12:27:01.987479 12999 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:01.989044  6611 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:01.961951  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3121) took 1681 ms. Trace:
I20260709 12:27:01.990784  5965 rpcz_store.cc:276] 0709 12:27:00.280539 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.398928 (+118389us) service_pool.cc:224] Handling call
0709 12:27:01.814130 (+1415202us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:01.910996 (+ 96866us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.961781 (+ 50785us) spinlock_profiling.cc:243] Waited 1.37 s on lock 0x7b5400036950. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:01.961902 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3148476288}
I20260709 12:27:01.992079 12967 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:01.990168  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:01.992591 12967 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:01.993039 12967 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:01.992988 12837 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:01.993600 12837 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:01.993976 12837 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:01.992022 12759 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:01.985394 12969 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:27:01.994830 12970 consensus_meta.cc:287] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.708s	user 0.009s	sys 0.000s
I20260709 12:27:01.995554 12759 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:01.996635 12950 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:01.996475 12759 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 16.17, Last appended by leader: 17, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.944828 13067 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:01.962842  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:01.940343 12971 raft_consensus.cc:740] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:01.964075  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:01.955334  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 196773us
I20260709 12:27:01.967231  6037 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:27:01.850632 13002 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.970000  6111 rpcz_store.cc:276] 0709 12:27:00.621486 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.367622 (+746136us) service_pool.cc:224] Handling call
0709 12:27:01.368632 (+  1010us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:01.911681 (+543049us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:01.951519 (+ 39838us) spinlock_profiling.cc:243] Waited 356 ms on lock 0x7b540020bf54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:01.951691 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":818003200}
I20260709 12:27:01.969022 12930 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.010s
I20260709 12:27:01.973589  6110 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 23 index: 12. Preceding OpId from leader: term: 24 index: 12. (term mismatch)
I20260709 12:27:02.024865  6110 pending_rounds.cc:85] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 11
I20260709 12:27:02.025152  6110 pending_rounds.cc:107] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 23.12
I20260709 12:27:02.025393  6110 raft_consensus.cc:2889] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:02.016418  6009 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:01.976137 12724 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:01.942848 12848 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:01.976862  5967 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: [16.11-16.11]
I20260709 12:27:01.983420 12968 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.039271 13038 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:02.003808 13010 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:01.930876 12983 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:01.966231  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:02.059285  6039 raft_consensus.cc:2393] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 16: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:01.843937 13066 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:01.964053  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:02.001968  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 227056us
I20260709 12:27:02.003098 12895 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:01.850486 12981 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 18.11, Last appended by leader: 11, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:02.009233 12855 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.011634 13024 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:02.013952  6611 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:01.995261 12970 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:02.031100  5961 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 9.
I20260709 12:27:02.072221  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:02.032720  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:01.985337 12803 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:02.040812  6042 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 11 index: 6. Preceding OpId from leader: term: 14 index: 8. (index mismatch)
W20260709 12:27:02.041704  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:01.995177 12969 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.009248 13015 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:02.029836 12575 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:02.077945  5960 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:27:02.078070  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:02.078253  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:02.080844  6041 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:27:02.082348  6644 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 12. Current term is 13. Ops: []
W20260709 12:27:02.081867  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 54780.7us
I20260709 12:27:02.085228  6009 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.086791  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:02.093484  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:02.093971  5965 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:02.042632 12724 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:02.088841  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:02.075090 13038 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.117355 12570 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election won for term 13
W20260709 12:27:02.122830  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 108939us
I20260709 12:27:02.123703  6609 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:02.123694  6611 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.128818  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.123978  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:02.133297  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:02.067734 12895 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:02.144484  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.141474  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.082269 13073 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.061s
I20260709 12:27:02.119391 13023 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:02.088192 12803 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:02.122900 12570 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:02.157842  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:02.156631  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:02.082131 12848 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:02.141932  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:02.159838  6118 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:02.166654 12848 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.167160 12848 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:02.155656  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:02.171468  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:02.172655  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:02.173686  6118 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:27:02.174922  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:02.146273 13064 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:02.176477 12930 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.150360 12947 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:02.201633 12930 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:02.152724 13077 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:02.202602 12837 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.150846 13023 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:02.204406 13023 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:02.203909 12969 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:02.205385 12837 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:02.207471  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37174 (request call id 1802) took 1161 ms. Trace:
W20260709 12:27:02.207808 13070 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:27:02.207875  5961 rpcz_store.cc:276] 0709 12:27:01.045879 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.465741 (+419862us) service_pool.cc:224] Handling call
0709 12:27:02.207286 (+741545us) spinlock_profiling.cc:243] Waited 340 ms on lock 0x7b5400035554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:02.207408 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":782807424}
I20260709 12:27:02.150399 12575 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:27:02.181897 12866 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:02.189687  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.140635 12959 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:02.133901 13058 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 18, Time since last communication: 0.054s
I20260709 12:27:02.197016  5959 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:02.121485 13029 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.203904 12930 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:02.180132 12724 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:02.213523  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:02.219853 12855 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:02.215339  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.190653 12570 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:02.217589  6611 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.151242 13031 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:02.216076  5961 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:27:02.137548 13038 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:02.264446  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.210412 12947 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:02.216579 12959 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.220345 12895 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:02.217255 12837 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:02.273414  5959 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 14 index: 10. (index mismatch)
I20260709 12:27:02.278263  6042 raft_consensus.cc:2393] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 19: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:02.282447  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:02.283486  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 59772.3us
I20260709 12:27:02.276216 12855 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:02.289353  6113 raft_consensus.cc:2410] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 20 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:27:02.290946  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3479) took 1556 ms. Trace:
I20260709 12:27:02.293316  6110 rpcz_store.cc:276] 0709 12:27:00.734829 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.416206 (+681377us) service_pool.cc:224] Handling call
0709 12:27:01.416555 (+   349us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.031960 (+615405us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.289358 (+257398us) spinlock_profiling.cc:243] Waited 557 ms on lock 0x7b54001031d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:02.290887 (+  1529us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1280339712}
I20260709 12:27:02.276368 12904 consensus_queue.cc:1059] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 7, Time since last communication: 0.025s
W20260709 12:27:02.417955  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 590899us
I20260709 12:27:02.288609 12959 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:02.297786  6037 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:27:02.285125 12947 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:02.302292  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3134) took 1205 ms. Trace:
I20260709 12:27:02.367223  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 3130) took 1319 ms. Trace:
I20260709 12:27:02.311528  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3136) took 1213 ms. Trace:
I20260709 12:27:02.313506  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:48350 (request call id 2) took 1043 ms. Trace:
I20260709 12:27:02.320823  5968 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:27:02.316088  6609 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:02.430794  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:02.436794  5966 rpcz_store.cc:276] 0709 12:27:01.097965 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.949764 (+851799us) service_pool.cc:224] Handling call
0709 12:27:01.965295 (+ 15531us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:01.965668 (+   373us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:01.965699 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.006486 (+ 40787us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.088575 (+ 82089us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:02.088617 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.088682 (+    65us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:02.311259 (+222577us) raft_consensus.cc:1685] finished
0709 12:27:02.311286 (+    27us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.311459 (+   173us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":10204,"raft.run_cpu_time_us":84,"raft.run_wall_time_us":84,"thread_start_us":26751,"threads_started":1,"wal-append.queue_time_us":277559}
I20260709 12:27:02.437983  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.351698  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.435994  5964 rpcz_store.cc:276] 0709 12:27:01.047958 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.794265 (+746307us) service_pool.cc:224] Handling call
0709 12:27:02.367017 (+572752us) spinlock_profiling.cc:243] Waited 54.4 ms on lock 0x7b5400277ed4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:02.367163 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":125162368}
W20260709 12:27:02.439900  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 123880us
I20260709 12:27:02.435568  5963 rpcz_store.cc:276] 0709 12:27:01.097093 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.938966 (+841873us) service_pool.cc:224] Handling call
0709 12:27:01.939280 (+   314us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.007117 (+ 67837us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:27:02.033966 (+ 26849us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.194919 (+160953us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.194986 (+    67us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:02.195039 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.302012 (+106973us) spinlock_profiling.cc:243] Waited 67.6 ms on lock 0x7b54002f1054. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:02.302064 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:02.302226 (+   162us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":27157,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":45,"raft.queue_time_us":41081,"raft.run_cpu_time_us":118,"raft.run_wall_time_us":13978,"spinlock_wait_cycles":155446656,"thread_start_us":121125,"threads_started":1,"wal-append.queue_time_us":256734}
I20260709 12:27:02.436077  5962 rpcz_store.cc:276] 0709 12:27:01.275257 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.291555 (+1016298us) service_pool.cc:224] Handling call
0709 12:27:02.313401 (+ 21846us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:02.453979 12855 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:27:02.303323 13076 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
W20260709 12:27:02.445402  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 93795.2us
I20260709 12:27:02.443336  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.311779 13029 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:02.419116 12848 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.471473  6041 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:02.369521 13038 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:02.365106 12598 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.404510 12570 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.371096 13023 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:02.413810 13052 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.629s	user 0.001s	sys 0.002s
W20260709 12:27:02.455528  5914 auto_rebalancer.cc:629] Failed to schedule move for tablet 06e81868728a4e2592f3ee289cff3431: Illegal state: Replica f1bb8e63c2b448cdafd51f05d277c741 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:02.459115 13002 consensus_queue.cc:1048] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:27:02.460541 12895 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:02.462777 12834 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:02.295156 12795 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:02.303503 12925 consensus_meta.cc:287] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.508s	user 0.009s	sys 0.000s
I20260709 12:27:02.464632  6644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1849) took 1446 ms. Trace:
I20260709 12:27:02.365182 12967 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.296003 13077 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:02.504874  6644 rpcz_store.cc:276] 0709 12:27:01.016404 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.017390 (+   986us) service_pool.cc:224] Handling call
0709 12:27:01.728756 (+711366us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.083843 (+355087us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.461690 (+377847us) spinlock_profiling.cc:243] Waited 353 ms on lock 0x7b54005569d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:02.463064 (+  1374us) spinlock_profiling.cc:243] Waited 684 ms on lock 0x7b54005569d0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:02.463205 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2386956800}
I20260709 12:27:02.318967 12768 raft_consensus.cc:3055] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:02.466621  6009 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.474385  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:02.475234  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:02.290612 12866 consensus_queue.cc:1059] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.173s
I20260709 12:27:02.398592 13066 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:02.444600 12930 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:27:02.464042 13058 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:02.444243 12837 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:02.486192 12848 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:02.470417 13041 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:02.470713 12797 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:02.491882  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.576426  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:02.306191 12999 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:02.500962  6041 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 23 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:27:02.508359  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:02.509434  6643 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 19. Current term is 20. Ops: []
I20260709 12:27:02.510078  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:02.579180  6648 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
I20260709 12:27:02.507882  6649 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:02.511505  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:02.512907  6037 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:02.514521  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:02.581146  6647 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:02.581604  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.520704  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:02.490356 12511 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:02.512526 12768 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:02.301113 12971 consensus_queue.cc:260] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.502173 12895 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:02.606611  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:02.480154 13075 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:27:02.529567  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:02.562476  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:02.563285  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:02.624313  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:02.546813  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:02.573469  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:27:02.628134  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 81406.6us
I20260709 12:27:02.298528 13031 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.588207  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:02.588662  6647 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:27:02.589407  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:02.504328 12834 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:02.592438  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:02.636025  6112 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:02.595098  6645 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:27:02.526628 12866 consensus_queue.cc:1243] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer 0069e2ba1f02412e8e1d6c20a1fb510f log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:27:02.597205  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 21 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:02.639838  5966 raft_consensus.cc:2410] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 25 because replica has last-logged OpId of term: 24 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 11.
I20260709 12:27:02.598089  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:02.482270 12598 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:02.608021  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:02.664525  6114 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:02.600073  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:02.527673 13058 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.624357 12895 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:02.633034 12837 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:02.624311  5959 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:27:02.627482  5964 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:27:02.611447  6608 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.545269 12832 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:27:02.697649  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 86270.2us
I20260709 12:27:02.632203  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:02.632480  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:02.546090 13066 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:02.512655 12925 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 29 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.638736  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:02.598820 12795 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:02.693321  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:02.707803  5961 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 9.
I20260709 12:27:02.638574 12834 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:27:02.693553  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.682313 13058 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:02.700145  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:02.688462 13053 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:27:02.598542 12797 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:02.706928  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:02.679783 12948 consensus_queue.cc:1059] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.024s
I20260709 12:27:02.699635 13060 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:02.720160  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:02.682974 13038 consensus_queue.cc:1059] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 17.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.026s
I20260709 12:27:02.721694  6044 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 29: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:02.711936 12795 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:02.723291 12832 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:02.735091 12832 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:02.735487 12832 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:02.733431  6112 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:27:02.609558  5934 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:02.748414  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 138912us
I20260709 12:27:02.751005  6114 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
W20260709 12:27:02.755813  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 289207us
I20260709 12:27:02.756724  6009 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.736148 12795 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:02.711462 13066 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.776117  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:02.797787  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:02.754010 12848 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:02.802089  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:02.802255  5961 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:02.805341 12598 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:02.805949 12598 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:02.812847  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:02.781996 13023 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:02.817260  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3504) took 1237 ms. Trace:
I20260709 12:27:02.821482  5965 rpcz_store.cc:276] 0709 12:27:01.579533 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.991678 (+412145us) service_pool.cc:224] Handling call
0709 12:27:01.991953 (+   275us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.122176 (+130223us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.817002 (+694826us) spinlock_profiling.cc:243] Waited 102 ms on lock 0x7b54000f7154. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:02.817199 (+   197us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":234096384}
I20260709 12:27:02.823750  5962 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
W20260709 12:27:02.825562 13090 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.001s
W20260709 12:27:02.828004  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 198535us
I20260709 12:27:02.857662  6112 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:27:02.859021  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:02.859735  6112 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 22: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:02.861194  6114 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:27:02.862143  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:02.862736  6114 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:02.863914  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:02.870335  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:02.871495  6117 raft_consensus.cc:2376] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 21. Re-sending same reply.
I20260709 12:27:02.872241  6114 raft_consensus.cc:1240] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 20. Current term is 21. Ops: []
W20260709 12:27:02.873231  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 154963us
I20260709 12:27:02.880481  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:02.810915 12570 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:02.806452 12598 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.858917 12920 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.844719 12999 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:02.893587  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:02.901533  6112 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:02.905984 12570 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:02.906656  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:02.908595  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:02.908941 12570 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:02.892130 13100 consensus_queue.cc:1059] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.026s
I20260709 12:27:02.911353  6611 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.912791 12570 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:27:02.913643 13066 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:02.893319 13034 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:02.916515  6611 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:02.917868  6611 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:02.916293 12947 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.919376  6117 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:02.918497 12570 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:02.858078 12974 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.051s
I20260709 12:27:02.938954  6646 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:02.939654 12948 consensus_queue.cc:1059] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:27:02.940940 12948 raft_consensus.cc:3055] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:02.941351 12948 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:02.935317 13108 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:02.946061 13108 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:02.946508 13108 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:27:02.951164 13094 log.cc:927] Time spent T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.148s	user 0.001s	sys 0.000s
I20260709 12:27:02.952615 13112 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.953329 13112 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:02.954686 13093 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.237s	user 0.000s	sys 0.001s
I20260709 12:27:02.935106 12855 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:27:02.958112 12855 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:02.959117 12855 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.964082 12598 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:02.966097 13099 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:02.966758 13099 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:02.967890  6044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 3131) took 1010 ms. Trace:
I20260709 12:27:02.968293  6044 rpcz_store.cc:276] 0709 12:27:01.957076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.957624 (+   548us) service_pool.cc:224] Handling call
0709 12:27:02.967672 (+1010048us) spinlock_profiling.cc:243] Waited 735 ms on lock 0x7b54001f2554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:02.967824 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1689636096}
I20260709 12:27:02.969223 13099 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:02.970198 12797 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:02.969487  6036 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 29 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 28. Current term is 29. Ops: [28.20-28.20]
I20260709 12:27:02.923182 12570 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:02.937362 12925 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 29 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:03.091198 13092 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.233s	user 0.003s	sys 0.000s
W20260709 12:27:03.095360 13097 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.276s	user 0.000s	sys 0.001s
I20260709 12:27:02.919427 12920 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.205057  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 3136) took 1243 ms. Trace:
I20260709 12:27:03.210278  6043 rpcz_store.cc:276] 0709 12:27:01.961573 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.279565 (+317992us) service_pool.cc:224] Handling call
0709 12:27:02.279923 (+   358us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.282540 (+  2617us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.282572 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.283068 (+   496us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.507174 (+224106us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:02.738386 (+231212us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.746942 (+  8556us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.747034 (+    92us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:03.204789 (+457755us) raft_consensus.cc:1685] finished
0709 12:27:03.204812 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.204984 (+   172us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2527,"prepare.queue_time_us":210823,"prepare.run_cpu_time_us":34,"prepare.run_wall_time_us":36,"raft.queue_time_us":123227,"raft.run_cpu_time_us":216,"raft.run_wall_time_us":15162,"thread_start_us":383069,"threads_started":2,"wal-append.queue_time_us":372311}
I20260709 12:27:02.937625 12968 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.249s
I20260709 12:27:03.130122 12570 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:02.942299 12948 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:03.227787  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 448790us
I20260709 12:27:03.235512  6646 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:27:03.202580 13060 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:03.229911 12960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.000s	sys 0.030s
I20260709 12:27:03.227955 12968 consensus_queue.cc:1243] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer 0069e2ba1f02412e8e1d6c20a1fb510f log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:27:03.263487  6109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3564) took 1172 ms. Trace:
W20260709 12:27:03.249198  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 473960us
W20260709 12:27:03.264262  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:03.266631  6081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.670s	user 0.028s	sys 0.023s
W20260709 12:27:03.277680  6081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.681s	user 0.028s	sys 0.023s
W20260709 12:27:03.278079  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 681856us
I20260709 12:27:03.244719 13069 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:03.270756  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 399847us
W20260709 12:27:03.274228  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 358236us
W20260709 12:27:03.263890  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 476544us
I20260709 12:27:03.277419  6109 rpcz_store.cc:276] 0709 12:27:02.090706 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.090948 (+   242us) service_pool.cc:224] Handling call
0709 12:27:02.135011 (+ 44063us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.135397 (+   386us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.135426 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.135950 (+   524us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.460149 (+324199us) spinlock_profiling.cc:243] Waited 1.19 ms on lock 0x7b1800474d60. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:27:02.639826 (+179677us) raft_consensus.cc:1645] Marking committed up to 7
0709 12:27:02.639870 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.639931 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:03.252916 (+612985us) raft_consensus.cc:1685] finished
0709 12:27:03.252938 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.263402 (+ 10464us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":3966,"raft.queue_time_us":177,"raft.run_cpu_time_us":147,"raft.run_wall_time_us":6509,"spinlock_wait_cycles":2732800,"thread_start_us":179505,"threads_started":1,"wal-append.queue_time_us":646894}
I20260709 12:27:03.263482 12797 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:03.260044 12848 raft_consensus.cc:697] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:03.285830  5934 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:03.249150 13060 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.279996 12948 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:03.287271  6006 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:03.290235  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:03.276916 12960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.000s	sys 0.031s
I20260709 12:27:03.315164  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:03.323292  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2402) took 1296 ms. Trace:
I20260709 12:27:03.324198  6035 rpcz_store.cc:276] 0709 12:27:02.027043 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.289918 (+262875us) service_pool.cc:224] Handling call
0709 12:27:02.290214 (+   296us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.290563 (+   349us) raft_consensus.cc:1534] Early marking committed up to index 12
0709 12:27:02.292592 (+  2029us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.316016 (+ 23424us) spinlock_profiling.cc:243] Waited 7.93 ms on lock 0x7b180048d3c0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf423a 00007f482105ea2a
0709 12:27:02.514782 (+198766us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.522889 (+  8107us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.523041 (+   152us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:27:02.523076 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.523143 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:02.952724 (+429581us) spinlock_profiling.cc:243] Waited 4.72 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:27:03.218876 (+266152us) spinlock_profiling.cc:243] Waited 1.51 ms on lock 0x7b180048d3c0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:27:03.312155 (+ 93279us) spinlock_profiling.cc:243] Waited 6.66 ms on lock 0x7b180048d3c0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df67522 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:27:03.323073 (+ 10918us) raft_consensus.cc:1685] finished
0709 12:27:03.323096 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.323224 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":702,"prepare.queue_time_us":2142,"prepare.run_cpu_time_us":59,"prepare.run_wall_time_us":64,"raft.queue_time_us":5082,"raft.run_cpu_time_us":280,"raft.run_wall_time_us":17462,"spinlock_wait_cycles":47874304,"thread_start_us":197941,"threads_started":1,"wal-append.queue_time_us":491679}
W20260709 12:27:03.330201  6042 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.735s	user 0.008s	sys 0.054s
W20260709 12:27:03.330734  6042 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.735s	user 0.009s	sys 0.054s
I20260709 12:27:03.325238 13112 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:03.337990  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2407) took 1201 ms. Trace:
I20260709 12:27:03.291021 13023 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.040s
I20260709 12:27:03.288370 13069 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.321957 12837 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:27:03.321719 13082 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:27:03.291590 12803 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.040s
I20260709 12:27:03.344369  6042 rpcz_store.cc:276] 0709 12:27:02.136808 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.323165 (+186357us) service_pool.cc:224] Handling call
0709 12:27:02.323446 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.323632 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:27:02.574157 (+250525us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.575039 (+   882us) log.cc:844] Serialized 14 byte log entry
0709 12:27:03.331069 (+756030us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:03.331136 (+    67us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:27:03.331197 (+    61us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.331274 (+    77us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:03.337888 (+  6614us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1280,"prepare.queue_time_us":388479,"raft.queue_time_us":264893,"raft.run_cpu_time_us":110,"raft.run_wall_time_us":12993,"spinlock_wait_cycles":21025536,"thread_start_us":985764,"threads_started":2}
I20260709 12:27:03.292338 12797 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:03.301533 12918 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.040s
I20260709 12:27:03.319778 13118 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:27:03.369207  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 81896.5us
I20260709 12:27:03.327809 12947 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:03.354264 13115 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.073s	user 0.000s	sys 0.001s
W20260709 12:27:03.356288 13109 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
W20260709 12:27:03.409153 12959 consensus_meta.cc:287] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.965s	user 0.009s	sys 0.000s
W20260709 12:27:03.410045 13123 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
W20260709 12:27:03.410926 13111 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.121s	user 0.000s	sys 0.000s
I20260709 12:27:03.327787 13015 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.074s
I20260709 12:27:03.413353 13108 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.419812 12797 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:02.504952  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:03.392628  6117 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:27:03.291064 12925 consensus_queue.cc:1059] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.110s
I20260709 12:27:03.373848 13066 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:03.451848  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 129332us
I20260709 12:27:03.360822 13122 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:03.399086 13118 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:03.356915 12968 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.079s
I20260709 12:27:03.409724 12959 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.454535  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:03.430867 12834 consensus_meta.cc:287] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.700s	user 0.005s	sys 0.002s
I20260709 12:27:03.368266 13124 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.099s
I20260709 12:27:03.354054 12916 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.118s
W20260709 12:27:03.471805  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 176482us
W20260709 12:27:03.501577  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 176694us
I20260709 12:27:03.462913 13023 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:03.475708  6081 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:03.466363  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 137822us
I20260709 12:27:03.436324 13117 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.044s
W20260709 12:27:03.506201  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 132369us
I20260709 12:27:03.507972  6081 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:03.360376 12848 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:03.465008 12832 consensus_meta.cc:287] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.695s	user 0.004s	sys 0.008s
I20260709 12:27:03.455525 13122 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:03.513535  6081 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:03.509769  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:03.516341  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:03.460013 13118 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:03.460481 13066 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:03.476881 13015 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:27:03.543295  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:03.603413  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 60215.2us
I20260709 12:27:03.536571  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:03.529202 12797 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.038s
I20260709 12:27:03.513499 13125 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:03.509516 12960 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:03.518924 13133 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.513619 13113 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:03.518810 12920 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:03.606712  5964 raft_consensus.cc:2368] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17.
I20260709 12:27:03.530148 12947 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:03.537824 13060 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:03.476194 12834 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:03.567885 13112 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:03.535959 13122 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:03.508015 12918 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.115s
W20260709 12:27:03.621488 13114 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.274s	user 0.001s	sys 0.001s
I20260709 12:27:03.628752 13116 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:03.634631 13135 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:03.661863 13120 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.234s	user 0.000s	sys 0.000s
I20260709 12:27:03.661840 13135 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:03.664441  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 161418us
I20260709 12:27:03.620677 13137 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:03.553658 12832 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.517721 13023 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:03.649688 13130 log.cc:927] Time spent T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
W20260709 12:27:03.672628  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 156488us
W20260709 12:27:03.649986 13058 consensus_meta.cc:287] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.927s	user 0.011s	sys 0.000s
I20260709 12:27:03.648090 12981 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:27:03.622896 13121 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 6, Time since last communication: 0.045s
W20260709 12:27:03.715265  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 237778us
I20260709 12:27:03.666061 13116 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:03.721616  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 211471us
W20260709 12:27:03.716639  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 206924us
I20260709 12:27:03.649186 13136 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.722965 13136 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:03.725171 13136 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:03.657527 13134 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:03.629647 12960 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.667737 13069 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:03.652531 13060 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.067s
W20260709 12:27:03.733963  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 197622us
I20260709 12:27:03.650653 12947 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.717097 13108 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:03.714960 12981 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:03.725834 13116 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:03.635351 13133 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.730422 13136 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.750147 12797 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.752835  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:03.731449 13113 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:03.756976  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:03.759531  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:03.760025  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:03.761011  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:03.762228  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:03.762439  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:03.763391  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:03.719885 12570 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.766673  6044 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:27:03.764561  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:03.764293  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:03.712759 13137 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.767661  6039 raft_consensus.cc:2393] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 16: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:03.721969 13058 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.761461  6042 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
I20260709 12:27:03.781668  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 29 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:03.770694  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:03.768445  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:03.772805 13138 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:03.774089  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:03.785425  5961 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:03.760679 13136 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.788031 12960 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:03.788519 13136 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:03.791175  6042 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 29 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 29: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:03.791942  5932 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:03.767728 13113 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:03.777271 12947 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:03.778802  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:03.782703  6039 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:27:03.771533  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:03.772827  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:03.782953  6037 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:27:03.755052 12959 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:03.796866  6643 raft_consensus.cc:2368] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:27:03.799363  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:03.804571  5961 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:03.806833  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:03.807884  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:03.808806  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:03.809288  5961 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:03.813640  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:03.814368  6039 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:27:03.814394  6041 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:03.815557  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:03.759974 12797 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:03.794014 13121 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:03.784754 13138 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:03.828187 13023 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:03.803169 12848 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:03.833190  5961 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:27:03.835297  5961 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: [14.10-14.10]
I20260709 12:27:03.818909 13135 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:03.822558 12834 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:03.841487  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 80562.2us
W20260709 12:27:03.834285 12895 consensus_meta.cc:287] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 1.125s	user 0.011s	sys 0.002s
I20260709 12:27:03.846015 12971 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:27:03.850612 13127 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.138s	user 0.001s	sys 0.000s
I20260709 12:27:03.853590 13118 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:03.839088 12948 consensus_meta.cc:287] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.539s	user 0.010s	sys 0.001s
I20260709 12:27:03.854882  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:03.856292  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 63333.3us
I20260709 12:27:03.857913  5932 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:27:03.840461 12795 consensus_meta.cc:287] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 1.035s	user 0.012s	sys 0.000s
I20260709 12:27:03.795197 12981 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.865535  5964 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:03.870867 12797 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:03.871604 12797 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:03.872130 13154 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:03.872730 13154 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:03.873099 12797 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:03.873687 12797 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:03.841040 13146 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Leader pre-election won for term 10
I20260709 12:27:03.875277  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:03.897142  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37174 (request call id 1816) took 1123 ms. Trace:
I20260709 12:27:03.868382 13138 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.877112 13146 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:03.910701  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 52859.7us
I20260709 12:27:03.898514  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:03.891801 13147 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:03.900370  5966 rpcz_store.cc:276] 0709 12:27:02.773643 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.812560 (+ 38917us) service_pool.cc:224] Handling call
0709 12:27:03.896807 (+1084247us) spinlock_profiling.cc:243] Waited 915 ms on lock 0x7b540008be54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:03.897067 (+   260us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2104225024}
I20260709 12:27:03.856369 12895 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:03.876492 12918 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:03.928627  5932 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:03.875375 12575 raft_consensus.cc:3055] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:03.862600 12795 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.881711 12848 raft_consensus.cc:697] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:03.938362  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:03.934384 13121 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:03.947315  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:03.948366  6114 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:03.931687 13023 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:03.876592 13142 consensus_queue.cc:1059] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.186s
I20260709 12:27:03.949831  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:03.878281 13143 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.188s
I20260709 12:27:03.931111 13146 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:03.934566 13138 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:03.934610 12575 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:03.945335 13058 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:03.958586 13149 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:27:03.959647 13113 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:03.959354 12848 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.943034 12918 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:03.950089 13137 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:03.953171 12570 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.060307  6112 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:04.050976  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1806) took 2579 ms. Trace:
I20260709 12:27:04.088686  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1656) took 1185 ms. Trace:
I20260709 12:27:04.088687  5968 rpcz_store.cc:276] 0709 12:27:01.472036 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.975294 (+503258us) service_pool.cc:224] Handling call
0709 12:27:02.320461 (+345167us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.436828 (+116367us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.050715 (+1613887us) spinlock_profiling.cc:243] Waited 345 ms on lock 0x7b5400197150. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:04.050891 (+   176us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":792992512}
I20260709 12:27:04.089846  6112 rpcz_store.cc:276] 0709 12:27:02.903187 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.903824 (+   637us) service_pool.cc:224] Handling call
0709 12:27:04.059822 (+1155998us) spinlock_profiling.cc:243] Waited 3.64 ms on lock 0x7b5800167d98. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482602dfc0 00007f4826018929 00007f48260183d2 00007f481f58fbd4
0709 12:27:04.060119 (+   297us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.088386 (+ 28267us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.088625 (+   239us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":8360832}
W20260709 12:27:04.092891  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:03.955319 13133 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.082617 13165 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election won for term 22
W20260709 12:27:04.073592 13098 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 1.138s	user 0.009s	sys 0.015s
W20260709 12:27:04.049198 13096 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 1.204s	user 0.000s	sys 0.004s
I20260709 12:27:04.066285 12895 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:04.083252 13168 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:04.106614  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.106954  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.117376  6648 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:27:04.059460 12575 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:04.119547  6642 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 19. Current term is 20. Ops: []
I20260709 12:27:04.121727 12832 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.122030  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2403) took 2087 ms. Trace:
I20260709 12:27:04.054096 12768 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.108114  6651 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:04.124186  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.124658  6040 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2400) took 2098 ms. Trace:
I20260709 12:27:04.116704  6645 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:27:04.066838 13066 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.085414 13118 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.160660  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.161110  6112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
 from {username='slave'} at 127.0.0.1:34280
I20260709 12:27:03.955192 13154 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.058768 13167 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:04.069880 12967 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.073709 12981 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:04.019901 13134 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:04.113618  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.065312 12795 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.146067  6608 leader_election.cc:400] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17.
I20260709 12:27:04.184864  6608 leader_election.cc:403] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:27:04.122417  6036 rpcz_store.cc:276] 0709 12:27:02.034261 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.314307 (+280046us) service_pool.cc:224] Handling call
0709 12:27:02.969241 (+654934us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.974382 (+  5141us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.121834 (+1147452us) spinlock_profiling.cc:243] Waited 654 ms on lock 0x7b54001f2550. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:04.121971 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1505159424}
I20260709 12:27:04.148236  6040 rpcz_store.cc:276] 0709 12:27:02.026564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.283368 (+256804us) service_pool.cc:224] Handling call
0709 12:27:02.293493 (+ 10125us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:02.295170 (+  1677us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:02.295204 (+    34us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:02.370934 (+ 75730us) log.cc:844] Serialized 26 byte log entry
0709 12:27:02.512894 (+141960us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:27:02.512941 (+    47us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:02.513013 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:03.890274 (+1377261us) spinlock_profiling.cc:243] Waited 12.1 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:27:04.124348 (+234074us) raft_consensus.cc:1685] finished
0709 12:27:04.124370 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.124592 (+   222us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":25392,"raft.queue_time_us":2764,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":121,"spinlock_wait_cycles":27755776,"thread_start_us":140785,"threads_started":1,"wal-append.queue_time_us":340022}
I20260709 12:27:04.148224  6110 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:04.109598 13067 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.133126 13173 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:04.125895 12895 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:03.957250 13023 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:04.123740 13162 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.086s	user 0.000s	sys 0.000s
I20260709 12:27:04.087281 13116 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.110155 13137 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:04.116421 13165 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:04.169634  6647 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:04.161948 13112 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:04.142573 13113 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:04.153169 12925 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:04.170336 12768 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:04.172062 12918 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:04.208675  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.145141 12968 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.123396 13168 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:04.215219 13168 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:04.192030 13167 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.212898 12968 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.108736 13122 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.218684  6645 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:04.174531 12575 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:04.164703 13121 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 16.17, Last appended by leader: 17, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.219332 13167 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.220134 13122 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.220947  6043 raft_consensus.cc:2393] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 16: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:04.178903  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.223446  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.224169  6648 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
W20260709 12:27:04.224488  6646 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50470 (request call id 1363) took 1615 ms (client timeout 1775 ms). Trace:
I20260709 12:27:04.225054  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.185902  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1651) took 1298 ms. Trace:
I20260709 12:27:04.186254  6112 raft_consensus.cc:606] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Received request to transfer leadership
I20260709 12:27:04.189491  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.225822  6110 rpcz_store.cc:276] 0709 12:27:02.887767 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.887904 (+   137us) service_pool.cc:224] Handling call
0709 12:27:04.124019 (+1236115us) spinlock_profiling.cc:243] Waited 6.49 ms on lock 0x7b5800167d98. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481df2fb71 00007f481df2fa22 00007f4826e488d9 00007f4825fa2ee0 00007f482606c0ab 00007f482606c131 00007f482601a0a0 00007f4826019984 00007f481f5946d4 00007f481f594662
0709 12:27:04.185841 (+ 61822us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":14918016}
I20260709 12:27:04.226797  6042 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:27:04.227183  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.195096  6036 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:04.228336  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.228930 12916 consensus_queue.cc:1059] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:04.229393  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.230157 12916 raft_consensus.cc:3055] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:27:04.230538 12916 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:04.231362 12916 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.232347  6084 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:04.192675 13067 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.141400 12797 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.212751  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 12 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:04.234000 12968 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.201335 13137 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.234197  6040 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:04.234339 13067 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.234592  6649 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:27:04.234910  6112 raft_consensus.cc:614] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:04.201751 13165 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:04.192847 12967 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17.
I20260709 12:27:04.194845  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.200328  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:04.214113 13128 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:04.200785  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.223464  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.239383  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.236595  6037 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:27:04.239311  6044 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:27:04.241140  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:27:04.224869  6646 rpcz_store.cc:269] 0709 12:27:02.609237 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.610070 (+   833us) service_pool.cc:224] Handling call
0709 12:27:04.224288 (+1614218us) spinlock_profiling.cc:243] Waited 236 ms on lock 0x7b5400468cd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:04.224402 (+   114us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":543333632}
I20260709 12:27:04.245853  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:04.232506 12916 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:04.240207  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.196472 12570 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 26.19, Next index: 20, Last known committed idx: 18, Time since last communication: 0.040s
I20260709 12:27:04.237212 13117 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:04.249001  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.211762 13138 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.192482 12895 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:04.247063  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.232245 13116 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.254714  6043 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:04.246227  6036 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:27:04.264613  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:04.269996  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.267092  6044 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:04.257627  6040 raft_consensus.cc:2468] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
W20260709 12:27:04.271935  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 324665us
I20260709 12:27:04.272877  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:04.282809  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:04.296171  6081 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:04.298029 13167 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:04.298525  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:04.291853 13159 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:04.207506 13112 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:04.301949  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.196321 13173 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:04.303607  6609 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:04.209849 13113 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.211345 12925 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.313670  6036 raft_consensus.cc:1240] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 13. Current term is 14. Ops: [13.11-13.11]
I20260709 12:27:04.315372  5967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3140) took 2572 ms. Trace:
I20260709 12:27:04.318969  6609 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:04.300616 13023 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.319839  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:04.320626  6609 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:04.321698  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.323994  6043 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 25.
I20260709 12:27:04.298566 13167 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:04.245134 13128 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:04.324786  6036 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:27:04.308303 12960 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:04.293941 13138 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.316025 12967 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:04.330430  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.310500 13158 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.301270 13122 consensus_queue.cc:1059] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 13.9, Next index: 10, Last known committed idx: 9, Time since last communication: 0.025s
I20260709 12:27:04.317600 13116 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.318365  5967 rpcz_store.cc:276] 0709 12:27:01.735139 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.033014 (+297875us) service_pool.cc:224] Handling call
0709 12:27:02.037973 (+  4959us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.144438 (+106465us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:27:02.156758 (+ 12320us) log.cc:844] Serialized 14 byte log entry
0709 12:27:02.286655 (+129897us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:02.286721 (+    66us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:02.286760 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:03.734997 (+1448237us) spinlock_profiling.cc:243] Waited 2.53 ms on lock 0x7b1800305da0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df352a6 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419
0709 12:27:04.307654 (+572657us) spinlock_profiling.cc:243] Waited 106 ms on lock 0x7b5400198054. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:04.307710 (+    56us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.307852 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":42689,"prepare.run_cpu_time_us":43,"prepare.run_wall_time_us":37,"raft.queue_time_us":1500,"raft.run_cpu_time_us":138,"raft.run_wall_time_us":5380,"spinlock_wait_cycles":250157184,"thread_start_us":129278,"threads_started":1,"wal-append.queue_time_us":257662,"wal-append.run_cpu_time_us":1021,"wal-append.run_wall_time_us":1001050}
I20260709 12:27:04.341359  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:04.342450  6609 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:04.328914 13141 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:04.329149 13067 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:04.329648 13167 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:04.342550  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:04.346441  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.346292  6648 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:27:04.328400 12971 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:04.403232  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.404667  5963 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:04.430213  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:04.430270  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 87901us
I20260709 12:27:04.433818  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.434626  6113 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:27:04.435190  6115 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 19 index: 12. (index mismatch)
I20260709 12:27:04.339636 12795 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:04.433881  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:04.342969 12866 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:04.351362 13141 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.444283  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:04.342839 13175 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:04.403425 13067 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.338019 12967 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:04.457476  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.458871  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.459015  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:04.340356 13158 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:04.349978 13143 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.104s
I20260709 12:27:04.436013 12570 raft_consensus.cc:2804] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:04.345661 13116 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.473155  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 26 candidate_status { last_received { term: 23 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.454591 13141 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:04.448316 12918 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:04.455919 13122 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:04.462626 13067 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:04.452963 13154 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:04.479588  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.448135 12795 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.501286 12795 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.503710 12967 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:04.504408 13146 consensus_meta.cc:287] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.540s	user 0.005s	sys 0.003s
I20260709 12:27:04.504845 13146 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.505306 12768 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:04.462911 13058 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 14.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.032s
I20260709 12:27:04.435899 12971 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.472579 13183 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:04.478788 13175 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.498319 13154 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.499518 13138 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.487183  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:04.507154  6035 raft_consensus.cc:2368] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:27:04.505884 12768 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.515386  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:04.492304 12918 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:04.481976 12570 raft_consensus.cc:697] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:04.477869 12960 consensus_queue.cc:1059] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
W20260709 12:27:04.525765  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 229658us
I20260709 12:27:04.592156  6081 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:04.493651 13137 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.510964 13183 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:04.491638 13122 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:04.568868  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:04.605744  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 160516us
W20260709 12:27:04.607971  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.589828 12895 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:04.597218 12511 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:27:04.604238 13112 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:04.606294 12960 consensus_queue.cc:1243] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer 0557a7246c8945b99e5215c99d4ddf9c log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:27:04.602375 12925 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.601219 13183 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:04.631665  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.642175  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3513) took 2078 ms. Trace:
I20260709 12:27:04.610126 13113 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.613714 13138 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.611765 13147 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:04.617976 12895 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.664793  5959 rpcz_store.cc:276] 0709 12:27:02.563873 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.696080 (+132207us) service_pool.cc:224] Handling call
0709 12:27:02.709456 (+ 13376us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:02.737218 (+ 27762us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:27:02.780352 (+ 43134us) log.cc:844] Serialized 14 byte log entry
0709 12:27:03.267823 (+487471us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:03.267887 (+    64us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:03.267940 (+    53us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.641930 (+1373990us) spinlock_profiling.cc:243] Waited 27.5 ms on lock 0x7b54000b9354. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:04.641977 (+    47us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.642117 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":45464,"prepare.run_cpu_time_us":44,"prepare.run_wall_time_us":45,"raft.queue_time_us":4305,"raft.run_cpu_time_us":113,"raft.run_wall_time_us":3003,"spinlock_wait_cycles":63296896,"thread_start_us":487066,"threads_started":1,"wal-append.queue_time_us":574022,"wal-append.run_wall_time_us":1307190}
W20260709 12:27:04.641286 13184 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.213s	user 0.002s	sys 0.000s
I20260709 12:27:04.614872 13173 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.677078  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.620937 13128 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:04.692984  6040 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:27:04.679235  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.645494 13134 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 29 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:04.683012 12971 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.653913 12768 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.683468  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:04.685060 13165 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:04.686425 13175 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.687280  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.686367  6039 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 22. Current term is 23. Ops: []
W20260709 12:27:04.640307 13177 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.177s	user 0.000s	sys 0.000s
I20260709 12:27:04.680704 13168 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.671972 13113 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.639839 12983 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 28 LEADER]: Stepping down as leader of term 28
I20260709 12:27:04.654662 13116 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.631958 13146 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.704149  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.621613 13178 consensus_queue.cc:1059] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 12.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.096s
I20260709 12:27:04.670486 13187 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:04.710386  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.692816 13002 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.712523  6040 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 29 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 28. Current term is 29. Ops: [28.20-28.20]
I20260709 12:27:04.722121  6646 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:27:04.711293  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:04.723325  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.724700  6646 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 20: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:04.726737  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 29 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:04.727955  5963 raft_consensus.cc:2393] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:04.688479 13138 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.729799  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:04.730326  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:04.707559 13158 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.738317  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.738677  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:04.682221 13067 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.731729  6040 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
W20260709 12:27:04.734119 12575 consensus_meta.cc:287] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.515s	user 0.006s	sys 0.002s
I20260709 12:27:04.661088 12570 consensus_queue.cc:237] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.10, Last appended by leader: 10, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.709173 13133 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:04.695910 12895 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.702752 12797 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.028s
I20260709 12:27:04.725112 12983 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 28 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:04.745905  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.746780  6036 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:27:04.691870 13147 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.752558  6644 raft_consensus.cc:2393] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 16: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:04.753508  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.754097  6646 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:04.755312  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:04.751597  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:04.759671  6037 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:04.730697 13187 raft_consensus.cc:697] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:04.712563 13113 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.764142  6646 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
W20260709 12:27:04.761449 13181 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:27:04.771955  6646 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:04.728219 13002 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.762921 13154 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:04.817775  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 225676us
I20260709 12:27:04.810153 12918 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:04.812633 12855 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.837s	user 0.008s	sys 0.032s
I20260709 12:27:04.826943  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:04.828078  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 85230.7us
W20260709 12:27:04.828224  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 120297us
I20260709 12:27:04.835211 12895 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.836334 13138 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.812723 12983 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 28, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.837843 13067 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.837952 12983 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 28 FOLLOWER]: Advancing to term 29
I20260709 12:27:04.840021 13002 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:04.825592 12855 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.863s	user 0.013s	sys 0.032s
I20260709 12:27:04.842300  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:04.854097  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:04.862974  5959 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:04.858647 13168 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.866539 13002 consensus_queue.cc:1059] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:27:04.871206 13183 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:04.880935 13113 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.827610 13187 consensus_queue.cc:237] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 13.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:04.882413  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1823) took 1016 ms. Trace:
I20260709 12:27:04.882848  5965 rpcz_store.cc:276] 0709 12:27:03.866564 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.949726 (+ 83162us) service_pool.cc:224] Handling call
0709 12:27:03.958159 (+  8433us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:03.989108 (+ 30949us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:03.989137 (+    29us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:04.096658 (+107521us) log.cc:844] Serialized 26 byte log entry
0709 12:27:04.611606 (+514948us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:27:04.611654 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.611817 (+   163us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:04.882200 (+270383us) raft_consensus.cc:1685] finished
0709 12:27:04.882218 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:04.882355 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":44092,"raft.queue_time_us":120658,"raft.run_cpu_time_us":120,"raft.run_wall_time_us":122,"thread_start_us":456719,"threads_started":1,"wal-append.queue_time_us":707800}
I20260709 12:27:04.883874  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.884539  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:04.873687 13165 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.886564  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:04.887538  5965 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 9 FOLLOWER]: Advancing to term 10
I20260709 12:27:04.884917 13183 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:04.889307 13141 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.890506  6647 raft_consensus.cc:2393] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 17: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:04.891256 13175 raft_consensus.cc:3055] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:27:04.891623 13175 raft_consensus.cc:740] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:04.884768  6645 raft_consensus.cc:2410] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:27:04.893757  5959 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:27:04.891471 13141 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:04.899693  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.898761 13167 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:04.902715  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.904081  5968 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 19. Current term is 20. Ops: []
W20260709 12:27:04.906100  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.898651 13175 consensus_queue.cc:260] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.907124 13167 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:04.914757  5965 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 10.
I20260709 12:27:04.916128 13183 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.916273 13175 raft_consensus.cc:3060] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:04.910286 13038 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:04.916978 13183 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.918780  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.919314 13183 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.909353 12999 raft_consensus.cc:3055] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:04.920177 12999 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:04.921175  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:04.921028 12999 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.919479 13075 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:27:04.917044 13038 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.922636 13075 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:04.923445 13075 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.924279 13038 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.924855  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3582) took 1998 ms. Trace:
I20260709 12:27:04.925230  6114 rpcz_store.cc:276] 0709 12:27:02.926041 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.974765 (+ 48724us) service_pool.cc:224] Handling call
0709 12:27:02.987316 (+ 12551us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.951292 (+963976us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:04.924644 (+973352us) spinlock_profiling.cc:243] Waited 961 ms on lock 0x7b5400206a54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:04.924801 (+   157us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2209780992}
I20260709 12:27:04.919355  6645 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:04.921795  5959 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:04.929226  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:04.929358  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.929793  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.924758 13075 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:04.932149  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.933022  6111 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 16: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:04.933943  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:04.931830  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.935135  6110 raft_consensus.cc:2410] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 17 because replica has last-logged OpId of term: 16 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:27:04.933969  6117 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:04.932210  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.936789  6115 raft_consensus.cc:2393] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 19: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:04.937605  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:04.938117  6117 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:04.938217  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:04.940999  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.941843  6115 raft_consensus.cc:2410] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 20 because replica has last-logged OpId of term: 18 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 10.
I20260709 12:27:04.942638  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.943361  6115 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:04.943825  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.944401  6642 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:27:04.944043  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.946255  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.948166  6084 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:04.927584 13041 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:04.950388  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.931246  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.955637  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.957019  6112 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:27:04.958015  6112 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:04.928561  6006 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:04.959565 12511 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:04.960093 12511 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:04.960963 12511 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:04.962167 13147 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:04.963570 12983 consensus_queue.cc:1059] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:27:04.964239  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:04.965286  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.967217  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.951335  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.954653  6117 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 23.
I20260709 12:27:04.969585  6117 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:04.970854  6117 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:27:04.952036  6642 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:04.965616  5932 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:04.975528  6650 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:04.975288 13167 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:27:04.942274 13197 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.116s	user 0.001s	sys 0.000s
I20260709 12:27:04.984515  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.984939  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:04.930276  6645 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
W20260709 12:27:04.981948  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:04.922111 12999 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:04.967166  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:04.987897  6009 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 29 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:04.964565 12983 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:04.996506  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:04.994096  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.994282  6115 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:27:04.976680 13126 raft_consensus.cc:3055] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:04.993767  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:04.999687  6117 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:27:04.998775  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:05.000443  6112 raft_consensus.cc:2368] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17.
I20260709 12:27:05.001407  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:05.002744  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.001256  6042 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:05.004710  6112 raft_consensus.cc:2368] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17.
W20260709 12:27:05.005981  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 57893.4us
I20260709 12:27:05.005520  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:05.006865  6084 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:05.007572  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:05.008350  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:04.984161 13100 raft_consensus.cc:3055] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:27:05.010293  6118 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:04.977445 13113 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:04.986253 13031 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:05.010924  6117 pending_rounds.cc:85] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 13
I20260709 12:27:05.000038 13126 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:05.018193  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:05.021332  5959 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
I20260709 12:27:04.997023 13154 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:05.013844  6084 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:05.017841  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:04.995925 12983 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:05.022454  6036 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:05.025666  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:05.030145  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:05.005520 12575 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 29 FOLLOWER]: Leader election lost for term 29. Reason: could not achieve majority
I20260709 12:27:05.010299 12930 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.032966  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:04.951897 13041 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:05.033566  6084 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:05.005368 13002 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.005414 13194 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.012555 13100 raft_consensus.cc:740] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:05.016112 13031 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.035125  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:05.016279  6117 pending_rounds.cc:107] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:27:05.051947  6117 raft_consensus.cc:2889] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:05.038807  6084 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:05.012566 13116 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:27:05.040361  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:05.034368  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:05.031921 12768 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:05.046882  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:05.019353 13183 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:05.049057  6114 raft_consensus.cc:2410] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 12:27:05.059019  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:05.024022 13154 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:05.012907 13139 consensus_queue.cc:1059] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.037s
I20260709 12:27:05.068747 13146 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
W20260709 12:27:05.108487  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 68192.1us
I20260709 12:27:05.109665  6009 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:05.019650 13113 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:05.042919 12930 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:05.042897 13038 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:05.111239 13038 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.111624 13038 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:05.112424 13113 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:05.110870  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:05.114387  6115 raft_consensus.cc:606] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:05.114830  6115 raft_consensus.cc:614] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:05.108536  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:05.049850 13173 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:05.058120 13031 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:05.056973 12768 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:05.126596  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 66354.1us
I20260709 12:27:05.127188 13122 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:05.036337 13157 consensus_queue.cc:1059] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:27:05.134366  6009 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:05.065668 13187 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:05.136534  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:05.067708 13154 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:05.067879 13112 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:05.141448  6040 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 19: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:05.145484  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:05.146750  6611 leader_election.cc:400] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17.
I20260709 12:27:05.147253  6611 leader_election.cc:403] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:27:05.148387  6611 leader_election.cc:400] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17.
W20260709 12:27:05.132404 13203 log.cc:927] Time spent T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.133s	user 0.000s	sys 0.001s
I20260709 12:27:05.139263 12511 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:05.049613 13002 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.155310  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:05.066217 13128 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.075s
I20260709 12:27:05.159040  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:05.130244 12768 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:05.057313 13194 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.141804 13187 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.162364  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:05.165655  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:05.146663 13112 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.206943 13112 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:05.180749 12930 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:05.208640  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.215698  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:05.216440 13023 raft_consensus.cc:3055] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:27:05.216897 13023 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:05.217650 13023 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 14.10, Last appended by leader: 10, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:05.219465  6643 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50470 (request call id 1360) took 2630 ms (client timeout 2103 ms). Trace:
I20260709 12:27:05.220196  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3521) took 1468 ms. Trace:
W20260709 12:27:05.219950  6643 rpcz_store.cc:269] 0709 12:27:02.588996 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:02.589172 (+   176us) service_pool.cc:224] Handling call
0709 12:27:05.219239 (+2630067us) spinlock_profiling.cc:243] Waited 1.16 s on lock 0x7b540053fa54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:05.219367 (+   128us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2672500096}
I20260709 12:27:05.125604 12983 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 17.18, Last appended by leader: 18, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.192144 13002 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:05.193073 13194 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:05.181811  5863 catalog_manager.cc:5697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 18 to 19, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 19 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:05.161823 12904 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:05.196594 13075 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.200335 13041 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:05.168545 13187 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:05.201716 13122 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:27:05.201315  6009 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:05.205520 12768 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.220630  5964 rpcz_store.cc:276] 0709 12:27:03.751625 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.751729 (+   104us) service_pool.cc:224] Handling call
0709 12:27:03.752027 (+   298us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:03.866042 (+114015us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.219945 (+1353903us) spinlock_profiling.cc:243] Waited 113 ms on lock 0x7b540008b954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:05.220128 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":260586240}
I20260709 12:27:05.221652  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:05.222450  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:05.224198  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.236912  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:05.156790 12855 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17.
I20260709 12:27:05.228468  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:05.196362  6113 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
W20260709 12:27:05.227959 13207 log.cc:927] Time spent T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.089s	user 0.001s	sys 0.000s
I20260709 12:27:05.243993  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:05.158842 12950 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 20.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.077s
I20260709 12:27:05.254676  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:05.259692  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:05.240139 13023 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:05.260390  6111 raft_consensus.cc:2376] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13. Re-sending same reply.
I20260709 12:27:05.281972  5960 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:05.282765  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:05.252044 12983 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:05.240912 12511 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:05.245290 13174 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:27:05.260320 13110 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 2.309s	user 0.027s	sys 0.004s
I20260709 12:27:05.295315  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:05.320492  6039 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:05.297415  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:05.320832  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:05.318945  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:05.321444  6040 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:05.301470  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:27:05.325593  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.326174  6644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50454 (request call id 1677) took 1028 ms. Trace:
W20260709 12:27:05.326263  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 169569us
I20260709 12:27:05.326985  6651 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:05.326655  6644 rpcz_store.cc:276] 0709 12:27:04.297897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.458627 (+160730us) service_pool.cc:224] Handling call
0709 12:27:05.325961 (+867334us) spinlock_profiling.cc:243] Waited 289 ms on lock 0x7b54006167d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:05.326116 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":664826112}
I20260709 12:27:05.328747  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:05.321480  6113 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:27:05.302819  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 9 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:05.329798  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:05.303761 13140 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.002s
I20260709 12:27:05.313539  5861 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 220) took 6799 ms. Trace:
I20260709 12:27:05.314087  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:05.314971  5863 catalog_manager.cc:5697] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 19 to 22, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 22 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:05.260811 13139 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:05.323231  6084 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:05.331509  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:05.330237  6113 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 21.
I20260709 12:27:05.363965  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:05.364667  6113 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:05.365538  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:05.246532 13075 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:05.433174  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 105476us
I20260709 12:27:05.447252  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:05.447949  6110 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:05.448733  6611 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:05.449716  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:05.363113  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:05.450402  6044 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 13.
W20260709 12:27:05.450924  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 87894.6us
I20260709 12:27:05.330499  5861 rpcz_store.cc:276] 0709 12:26:58.514791 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:26:58.515025 (+   234us) service_pool.cc:224] Handling call
0709 12:27:05.313468 (+6798443us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:26:59.149178 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:26:59.149850 (+   672us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:26:59.149895 (+    45us) write_op.cc:435] Acquired schema lock
0709 12:26:59.149913 (+    18us) tablet.cc:662] Decoding operations
0709 12:26:59.275792 (+125879us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:26:59.275887 (+    95us) write_op.cc:641] Partition lock acquired for write op
0709 12:26:59.275914 (+    27us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:26:59.277006 (+  1092us) tablet.cc:701] Row locks acquired
0709 12:26:59.277056 (+    50us) write_op.cc:260] PREPARE: finished
0709 12:26:59.277226 (+   170us) write_op.cc:270] Start()
0709 12:26:59.277393 (+   167us) write_op.cc:276] Timestamp: P: 1783600019277157 usec, L: 0
0709 12:26:59.277414 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:26:59.278086 (+   672us) log.cc:844] Serialized 4334 byte log entry
0709 12:26:59.407342 (+129256us) spinlock_profiling.cc:243] Waited 10.8 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f481df4a0ac 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b
0709 12:27:00.687550 (+1280208us) op_driver.cc:464] REPLICATION: finished
0709 12:27:00.862709 (+175159us) write_op.cc:301] APPLY: starting
0709 12:27:00.862846 (+   137us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:00.957437 (+ 94591us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:00.957475 (+    38us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:01.706666 (+749191us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:01.707014 (+   348us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:27:01.707059 (+    45us) write_op.cc:312] APPLY: finished
0709 12:27:01.707459 (+   400us) log.cc:844] Serialized 105 byte log entry
0709 12:27:01.969708 (+262249us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:02.004290 (+ 34582us) write_op.cc:454] Released schema lock
0709 12:27:02.030091 (+ 25801us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:02.119046 (+ 88955us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:02.121555 (+  2509us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":4607,"reported_tablets":25,"child_traces":[["op",{"apply.queue_time_us":123407,"apply.run_cpu_time_us":48947,"apply.run_wall_time_us":1236595,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50129,"mutex_wait_us":41212,"num_ops":11,"prepare.queue_time_us":191799,"prepare.run_cpu_time_us":29240,"prepare.run_wall_time_us":485126,"raft.queue_time_us":358129,"raft.run_cpu_time_us":8695,"raft.run_wall_time_us":152597,"replication_time_us":1382614,"spinlock_wait_cycles":24886144,"thread_start_us":828111,"threads_started":5,"wal-append.queue_time_us":644635,"wal-append.run_cpu_time_us":71976,"wal-append.run_wall_time_us":3049771}]]}
I20260709 12:27:05.451437  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:05.435320  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 121345us
W20260709 12:27:05.331007 13110 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 2.379s	user 0.028s	sys 0.004s
I20260709 12:27:05.464754  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:05.283159 13122 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:27:05.363073  5863 catalog_manager.cc:5697] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 20 to 21, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 21 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:05.452605  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:05.287372 13173 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:05.435062  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:05.471752  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:05.473611  5934 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:05.461417  6644 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:27:05.478814  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:05.285244 12916 consensus_queue.cc:1059] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.170s
I20260709 12:27:05.466998  5863 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: config changed from index 11 to 13, term changed from 18 to 19, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to <none>, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 19 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:05.285531 13157 consensus_queue.cc:1059] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.169s
I20260709 12:27:05.488207  6040 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 22.
I20260709 12:27:05.481640  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:05.442394 13194 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:05.484306  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:05.287317 13146 consensus_queue.cc:1059] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.181s
I20260709 12:27:05.486774  6039 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
I20260709 12:27:05.435006 13139 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:05.490010  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:05.481395  5863 catalog_manager.cc:5697] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:05.487331 13159 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:05.490075 13175 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:05.495198  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:05.465688 13136 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:05.499478 13170 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:05.502278 13122 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:27:05.509403 13209 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.392s	user 0.005s	sys 0.003s
W20260709 12:27:05.510365 13214 log.cc:927] Time spent T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.068s	user 0.000s	sys 0.000s
I20260709 12:27:05.540122  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:05.518631  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 216085us
I20260709 12:27:05.452482 12930 consensus_queue.cc:1059] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.044s
I20260709 12:27:05.525835  5863 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 15, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 15 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:05.492581 13194 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.495358 13118 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:05.445035 13166 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:05.526885 13139 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:05.542027  5863 catalog_manager.cc:5697] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 10 to 12, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 12 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:05.480062  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:05.483245 13154 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.545308  5863 catalog_manager.cc:5697] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 16 to 18, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 18 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:05.547289  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:05.531147 13136 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.548877  5863 catalog_manager.cc:5697] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 16 to 17, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 17 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:05.545674  6644 raft_consensus.cc:2376] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17. Re-sending same reply.
I20260709 12:27:05.532784 12768 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:05.544600  5932 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:05.533452 13170 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:05.563536 13170 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:05.564400 13154 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:05.565546 13075 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:05.555401  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:05.567281 13175 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:05.567811 13175 raft_consensus.cc:697] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:05.568676 13175 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.556401  5863 catalog_manager.cc:5697] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 16, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 16 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:05.543687 13118 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:05.543610 13194 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:05.563068 13166 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:05.570400  6036 raft_consensus.cc:2410] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 19 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 14.
I20260709 12:27:05.571395  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:05.571425  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:05.574626  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:05.561880 13112 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:05.570683  5863 catalog_manager.cc:5697] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 16 to 18, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 18 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:05.553037 13136 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:05.535648 13038 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.594749  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:05.594624 13122 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 22.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.595667 13112 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:05.596237  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:05.598170 12904 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:05.577236 12768 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:05.598811 12768 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.575865 12930 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:05.572422 13118 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:05.587702 13166 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:05.615425 12930 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.628468 12930 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:05.630003 12768 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:05.631330  6035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 3142) took 1869 ms (client timeout 2103 ms). Trace:
W20260709 12:27:05.631747  6035 rpcz_store.cc:269] 0709 12:27:03.761837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:03.761985 (+   148us) service_pool.cc:224] Handling call
0709 12:27:05.631141 (+1869156us) spinlock_profiling.cc:243] Waited 744 ms on lock 0x7b540025a654. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:05.631272 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1711388928}
W20260709 12:27:05.639112  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 190442us
I20260709 12:27:05.640146  6611 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:05.622892 12916 consensus_queue.cc:1243] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer 0069e2ba1f02412e8e1d6c20a1fb510f log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:27:05.636706  6644 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:27:05.646677  6009 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:05.646911 13110 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:05.648087  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:05.649960  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:05.651089  6644 raft_consensus.cc:2393] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 16: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:05.652379  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:05.653120 13194 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.654274  6113 raft_consensus.cc:2368] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17.
I20260709 12:27:05.653993  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:27:05.654946 13031 consensus_meta.cc:287] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.514s	user 0.007s	sys 0.003s
I20260709 12:27:05.655426 13031 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:05.655970 13133 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:05.656423 13133 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:05.657480 13031 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:05.658252  5959 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 14: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:05.658828  6649 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50470 (request call id 1369) took 1551 ms. Trace:
I20260709 12:27:05.659348  6644 raft_consensus.cc:2393] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 13: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:05.659940  6642 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:05.660406  6648 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:27:05.661710  6648 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:27:05.662810  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 3528) took 1184 ms. Trace:
I20260709 12:27:05.663190  5963 rpcz_store.cc:276] 0709 12:27:04.483661 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.486888 (+  3227us) service_pool.cc:224] Handling call
0709 12:27:05.662645 (+1175757us) spinlock_profiling.cc:243] Waited 207 ms on lock 0x7b5400277254. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:05.662758 (+   113us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":476552064}
I20260709 12:27:05.664896  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:05.666006  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:05.659192  6649 rpcz_store.cc:276] 0709 12:27:04.107418 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.113302 (+  5884us) service_pool.cc:224] Handling call
0709 12:27:05.658673 (+1545371us) spinlock_profiling.cc:243] Waited 49.9 ms on lock 0x7b54004b8cd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:05.658775 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":114764160}
I20260709 12:27:05.667074  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:05.668174  6649 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:05.668805 13038 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:05.668852  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:05.669616  6117 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:27:05.670688  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:05.672124  6117 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: [15.14-17.15]
I20260709 12:27:05.673218  6117 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:05.674431  6117 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:27:05.675585  6117 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:05.680131  5967 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 13 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:27:05.680974 13170 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.682042 12904 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:05.682334  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:05.676937 13166 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:05.680047  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:05.684557  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.663112 13187 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.688040  6111 raft_consensus.cc:2368] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14.
I20260709 12:27:05.688983  6644 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 17 index: 18. Preceding OpId from leader: term: 18 index: 18. (term mismatch)
I20260709 12:27:05.681062  6112 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:05.689379  6644 pending_rounds.cc:85] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 17
I20260709 12:27:05.689909  6644 pending_rounds.cc:107] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 17.18
I20260709 12:27:05.690203  6645 raft_consensus.cc:3055] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:05.689145  5962 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:05.690208  6644 raft_consensus.cc:2889] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:05.690759  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:05.693246  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 201449us
I20260709 12:27:05.694017  5934 leader_election.cc:400] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:27:05.690670  6645 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:05.695721  6651 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1873) took 1490 ms. Trace:
I20260709 12:27:05.697703  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:05.697988  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:05.698709  5934 leader_election.cc:403] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 9 election: Cancelling election due to peer responding with higher term
I20260709 12:27:05.699128  6039 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:05.699254  6035 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:27:05.667685 13126 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.666987 12768 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.036s
I20260709 12:27:05.686244 13077 consensus_queue.cc:1059] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 12.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.017s
I20260709 12:27:05.697844  6651 rpcz_store.cc:276] 0709 12:27:04.205408 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.768033 (+562625us) service_pool.cc:224] Handling call
0709 12:27:05.326805 (+558772us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.327394 (+   589us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.695594 (+368200us) spinlock_profiling.cc:243] Waited 558 ms on lock 0x7b54006167d0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:05.695679 (+    85us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1284450048}
I20260709 12:27:05.709434  6646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50472 (request call id 1874) took 1498 ms. Trace:
I20260709 12:27:05.744048  6646 rpcz_store.cc:276] 0709 12:27:04.210926 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.778577 (+567651us) service_pool.cc:224] Handling call
0709 12:27:04.778954 (+   377us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.779177 (+   223us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:27:04.791695 (+ 12518us) log.cc:844] Serialized 14 byte log entry
0709 12:27:05.305015 (+513320us) spinlock_profiling.cc:243] Waited 14 ms on lock 0x7b18002df460. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf423a 00007f482105ea2a
0709 12:27:05.709083 (+404068us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:05.709139 (+    56us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:05.709190 (+    51us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.709253 (+    63us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:05.709374 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":120332,"prepare.queue_time_us":12309,"prepare.run_cpu_time_us":57,"prepare.run_wall_time_us":1142,"raft.queue_time_us":121029,"spinlock_wait_cycles":32293248,"thread_start_us":283476,"threads_started":1,"wal-append.queue_time_us":843381}
W20260709 12:27:05.702908  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.746289  6609 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:05.748399  6609 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:27:05.701828  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 61789.1us
I20260709 12:27:05.749620  6611 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:05.702984  6038 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:05.696980  6645 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.751605  6645 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:05.752648  6609 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:05.753556  6611 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 4 responses out of 4 voters: 3 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:27:05.754058  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 60272.9us
I20260709 12:27:05.754771  5934 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:05.756796  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:05.757416  5962 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:27:05.757483  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:05.703155 12759 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:05.799564 13136 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.801537  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 10 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:05.802243  6039 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
W20260709 12:27:05.798300  5914 auto_rebalancer.cc:893] Removing replace marker failed: Replica 0069e2ba1f02412e8e1d6c20a1fb510f is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 19 committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:27:05.803941  5914 auto_rebalancer.cc:901] Could not move replica: Illegal state: not currently leader
I20260709 12:27:05.702214 12968 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:05.797164  5962 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:05.707237 13194 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:05.701017 12904 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:05.744180 12855 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:27:05.775410 13058 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:05.756537 13137 raft_consensus.cc:3055] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:05.781622 13140 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:05.756671 13159 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election lost for term 9. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 9. Current term is 10.
I20260709 12:27:05.782925 13170 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:05.810863  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:05.822208  6039 raft_consensus.cc:2393] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 18: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:05.811952  6035 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: [16.14-16.14]
I20260709 12:27:05.802369  6081 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:05.774842 12950 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:27:05.775566 13067 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:05.756968 13138 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:05.820767  6041 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 18. Current term is 19. Ops: []
W20260709 12:27:05.804245  5914 auto_rebalancer.cc:330] scheduled replica move failed to complete: Illegal state: not currently leader
I20260709 12:27:05.822572  6110 raft_consensus.cc:2368] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 21. Current term is 22.
I20260709 12:27:05.828065  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:05.830396  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:05.813325 12968 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.777925 13226 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 22.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.070s
I20260709 12:27:05.798692 12983 consensus_queue.cc:1059] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:27:05.864167  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:05.815068 12855 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:05.866709  6006 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:05.867249  6043 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:05.834630 13175 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:27:05.815235 13137 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:05.822372 13225 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Leader election won for term 10
I20260709 12:27:05.863178 12968 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:05.847098 13002 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:27:05.876672  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 119268us
I20260709 12:27:05.846330 13067 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:05.845300 13138 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:05.930560  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:05.869696 13170 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:05.931030  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:05.873122 13112 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 21.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:27:05.928974  6081 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:05.819763 13140 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:05.822081 12759 raft_consensus.cc:697] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:05.877455 12575 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
W20260709 12:27:05.932641  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 114394us
I20260709 12:27:05.871074 13227 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:05.831693 13194 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:27:05.933310  6647 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50454 (request call id 1665) took 1757 ms (client timeout 2255 ms). Trace:
I20260709 12:27:05.935256  6642 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: []
I20260709 12:27:05.925540 12983 consensus_queue.cc:1243] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer 0557a7246c8945b99e5215c99d4ddf9c log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:27:05.924770 13117 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:05.939129  6609 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:27:05.942211  6647 rpcz_store.cc:269] 0709 12:27:04.175835 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.739993 (+564158us) service_pool.cc:224] Handling call
0709 12:27:05.933106 (+1193113us) spinlock_profiling.cc:243] Waited 136 ms on lock 0x7b540060d6d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:05.933252 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":313143552}
I20260709 12:27:05.939857  5934 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:05.931217 13067 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:05.848301 13122 consensus_queue.cc:1059] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.089s
I20260709 12:27:05.876439 12768 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.061s
I20260709 12:27:05.943668 13159 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:05.930434 13138 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:05.875069 13175 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 12:27:05.951409  5934 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:05.937569 13041 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:05.938304 13140 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:05.966297  6043 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:27:05.929244 13148 consensus_queue.cc:1059] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.019s
I20260709 12:27:05.940961 13225 raft_consensus.cc:697] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:05.934049 13226 consensus_queue.cc:1059] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 10.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.016s
I20260709 12:27:05.946635 13227 raft_consensus.cc:697] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:05.936964 13170 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.990808  6118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3491) took 1060 ms. Trace:
I20260709 12:27:05.955338 13075 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:05.948547 13117 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:27:05.983747 13228 log.cc:927] Time spent T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.110s	user 0.000s	sys 0.000s
W20260709 12:27:05.988623  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.001006  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:05.988158 13118 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.947600 13194 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:06.014725 13194 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:05.991218  6118 rpcz_store.cc:276] 0709 12:27:04.930648 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.930775 (+   127us) service_pool.cc:224] Handling call
0709 12:27:04.950887 (+ 20112us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.010785 (+ 59898us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:05.990563 (+979778us) spinlock_profiling.cc:243] Waited 59.2 ms on lock 0x7b54002396d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:05.990744 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":136114432}
I20260709 12:27:05.992066  6645 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:27:06.020498  6645 pending_rounds.cc:85] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 12
I20260709 12:27:06.020805  6645 pending_rounds.cc:107] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:27:06.021051  6645 raft_consensus.cc:2889] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:05.950109 13058 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:27:06.023015 13235 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:27:06.022756 13058 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.935184 12904 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:05.950079 13187 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:06.008029 13100 consensus_queue.cc:260] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.027223 13100 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:27:06.030563 13229 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.204s	user 0.001s	sys 0.001s
I20260709 12:27:06.031708  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3161) took 1639 ms. Trace:
I20260709 12:27:06.032115  5968 rpcz_store.cc:276] 0709 12:27:04.392016 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.392163 (+   147us) service_pool.cc:224] Handling call
0709 12:27:04.435614 (+ 43451us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:04.904640 (+469026us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.031468 (+1126828us) spinlock_profiling.cc:243] Waited 468 ms on lock 0x7b540008c354. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:06.031645 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1076960000}
I20260709 12:27:06.034315 13170 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:06.037533 13110 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:06.038169 12759 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.009470 13167 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:05.969846 12855 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.16, Last appended by leader: 16, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.043092 12855 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:05.991205 13041 raft_consensus.cc:697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:05.969646 13139 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.048410 13122 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:06.049400 13139 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:06.050632  6040 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:06.051192 13038 consensus_queue.cc:1059] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.047s
W20260709 12:27:06.053292 13233 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.114s	user 0.000s	sys 0.000s
I20260709 12:27:06.053552  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:06.054095  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:06.054970  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:06.055272  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:06.055613  6647 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:27:06.055812  6649 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:06.056183  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:06.056555  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:06.055785  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:06.057106  6647 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:06.057927  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:06.058440  6645 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:06.058916 13227 consensus_queue.cc:237] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:06.060536  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.056725  6643 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:27:05.998075 13230 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.167s	user 0.001s	sys 0.001s
I20260709 12:27:06.065176  6649 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:27:06.070835  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:06.047147 13041 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.065793  6036 raft_consensus.cc:1275] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 10. Preceding OpId from leader: term: 14 index: 11. (index mismatch)
I20260709 12:27:06.077947  6084 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:06.080061  6645 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:27:05.995265 13238 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:27:06.064945 13203 log.cc:927] Time spent T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.083s	user 0.000s	sys 0.000s
W20260709 12:27:06.092521  6608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.948s (SENT) [suppressed 25 similar messages]
I20260709 12:27:06.069595 13170 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.111191  6116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3502) took 1174 ms. Trace:
W20260709 12:27:06.072501  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 242812us
I20260709 12:27:06.074571  6647 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:06.077909 13075 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:06.103588  6643 raft_consensus.cc:2468] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:27:06.084115 13136 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:06.120142  5932 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:06.128261  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 50380.3us
I20260709 12:27:06.129417  6084 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:06.111816  6116 rpcz_store.cc:276] 0709 12:27:04.936688 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.936795 (+   107us) service_pool.cc:224] Handling call
0709 12:27:04.937108 (+   313us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:04.973090 (+ 35982us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:04.973122 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:04.973644 (+   522us) log.cc:844] Serialized 26 byte log entry
0709 12:27:05.503635 (+529991us) spinlock_profiling.cc:243] Waited 6.44 ms on lock 0x7b48000b0c58. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4825f7daa1 00007f4825f74b37 00007f4825f749ca 00007f482606c26f 00007f482606bf37 00007f482608055c 00007f4826080508 00007f4826080488 00007f4826080443 00007f482607f6ec 00007f4824fa9a96
0709 12:27:05.671097 (+167462us) spinlock_profiling.cc:243] Waited 1.02 ms on lock 0x7b1800481d80. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:27:05.791173 (+120076us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:27:06.072267 (+281094us) log.cc:844] Serialized 14 byte log entry
0709 12:27:06.110744 (+ 38477us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.110830 (+    86us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:06.110872 (+    42us) raft_consensus.cc:1685] finished
0709 12:27:06.110884 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:06.111124 (+   240us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":73020,"prepare.queue_time_us":312483,"prepare.run_cpu_time_us":42,"prepare.run_wall_time_us":44,"raft.queue_time_us":55526,"raft.run_cpu_time_us":29641,"raft.run_wall_time_us":507647,"spinlock_wait_cycles":17209856,"thread_start_us":370659,"threads_started":2,"wal-append.queue_time_us":870445}
I20260709 12:27:06.139935 13136 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:06.140893 13136 raft_consensus.cc:697] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:27:06.142784  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.142100 13136 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.138866  6084 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:06.174242  6084 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:06.092574 13226 consensus_queue.cc:1048] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:27:06.180289  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:27:06.181617  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 61589.5us
I20260709 12:27:06.132393 13100 raft_consensus.cc:3055] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:06.171743 13176 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:06.171162 12925 raft_consensus.cc:3055] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Stepping down as leader of term 12
I20260709 12:27:06.094842 13067 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.171908 13148 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:06.194976  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 3490) took 1264 ms. Trace:
I20260709 12:27:06.196338  6114 rpcz_store.cc:276] 0709 12:27:04.930210 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:04.930344 (+   134us) service_pool.cc:224] Handling call
0709 12:27:06.194748 (+1264404us) spinlock_profiling.cc:243] Waited 96 ms on lock 0x7b5400385254. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:06.194883 (+   135us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":220714880}
I20260709 12:27:06.171404 13225 consensus_queue.cc:237] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 8.9, Last appended by leader: 9, Current term: 10, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.198982 13159 raft_consensus.cc:3055] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:27:06.199397 13159 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:06.200279 13159 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.201282 13159 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:06.202266 13240 raft_consensus.cc:3055] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:06.202736 13240 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:06.203200  5962 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:27:06.203557 13240 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.204257  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:06.204841  5965 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
W20260709 12:27:06.205204 13232 log.cc:927] Time spent T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.257s	user 0.000s	sys 0.003s
I20260709 12:27:06.123204 13170 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.182312 13038 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election won for term 14
I20260709 12:27:06.183531 13099 raft_consensus.cc:2804] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:06.125681 13238 consensus_queue.cc:1059] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.068s
W20260709 12:27:06.219698  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 127205us
W20260709 12:27:06.220189  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:06.227903  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 158874us
I20260709 12:27:06.189247 13100 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:06.230548  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:06.194698 12925 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:06.231693  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:06.235796  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:06.240046  5965 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:27:06.215090 13148 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:27:06.180997  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 229637us
I20260709 12:27:06.258136  6082 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:06.217123 12895 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.035s
I20260709 12:27:06.229063 13077 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:27:06.265988  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.232082 13038 raft_consensus.cc:697] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:06.234513 13099 raft_consensus.cc:697] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:06.231336 13154 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:06.250764 13002 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:06.250211 13148 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:06.280146  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:06.257086 13240 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:06.292626  6037 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:27:06.281992 13176 raft_consensus.cc:697] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:06.260612 13215 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:06.265383 13183 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:06.228484 13075 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.284453 13226 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:06.294360 12759 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.292932 13118 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:06.278611 13077 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:06.291222 13154 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.317977 12895 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:27:06.348088  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 63566.4us
W20260709 12:27:06.353039  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 116315us
W20260709 12:27:06.378240  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:06.386205  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:06.399044  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.294396 13100 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:06.421670  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 175917us
I20260709 12:27:06.330653 13226 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:06.429464 13257 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:27:06.510537  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:06.513305  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:06.331072 12759 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.317216 12925 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 12.12, Last appended by leader: 12, Current term: 12, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.519547 12925 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
W20260709 12:27:06.520246 13251 log.cc:927] Time spent T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.189s	user 0.000s	sys 0.004s
W20260709 12:27:06.487507  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.522085 13157 raft_consensus.cc:3055] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:06.522501 13157 raft_consensus.cc:740] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:06.523104 12511 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:06.523285 13157 consensus_queue.cc:260] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:06.523628 12511 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:06.525645  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:06.525534 13175 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
W20260709 12:27:06.515872 13140 consensus_meta.cc:287] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.521s	user 0.003s	sys 0.009s
I20260709 12:27:06.527127 13140 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:06.529403  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.531713 13137 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.532881 13137 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:06.536401 13170 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:06.537016 13170 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:06.537355 13170 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:06.537698 13170 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:06.547647  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 3514) took 1104 ms. Trace:
I20260709 12:27:06.550721 13258 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:27:06.552166 12575 raft_consensus.cc:3055] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:27:06.552635 12575 raft_consensus.cc:740] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:06.553525 12575 consensus_queue.cc:260] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:06.512053 13247 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.242s	user 0.002s	sys 0.002s
W20260709 12:27:06.555238 13220 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 1.018s	user 0.008s	sys 0.013s
I20260709 12:27:06.556903 13226 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:06.557346 12759 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:06.557507 13226 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:27:06.558159 12855 consensus_meta.cc:287] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.515s	user 0.000s	sys 0.015s
I20260709 12:27:06.295763 13227 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:06.375687 13031 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.590351  6643 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 22 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:27:06.345945 13038 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 12.11, Last appended by leader: 11, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.507469  6043 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:06.434929 13176 consensus_queue.cc:237] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 12.8, Last appended by leader: 8, Current term: 14, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:06.430285 13244 log.cc:927] Time spent T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.178s	user 0.001s	sys 0.000s
W20260709 12:27:06.514708  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 138740us
I20260709 12:27:06.515178  5959 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:06.517220 13252 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:06.511757 13100 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:27:06.518527 13259 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.095s	user 0.000s	sys 0.004s
W20260709 12:27:06.516217 13138 consensus_meta.cc:287] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.533s	user 0.008s	sys 0.004s
I20260709 12:27:06.558928 12575 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:06.559239 13140 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:06.560602 13126 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:06.561797  6642 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50470 (request call id 1381) took 1239 ms. Trace:
I20260709 12:27:06.562757  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:06.562489 13148 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.563474  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:06.564172  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:27:06.564846  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.565064  6648 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:06.614573 13138 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.624042 13173 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:27:06.625169 13138 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:06.626773  6647 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 22: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:06.627043  6649 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 12:27:06.627969 12968 consensus_meta.cc:287] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.693s	user 0.008s	sys 0.007s
I20260709 12:27:06.628377 12968 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:06.629396  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.630291 13261 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:06.630878 13261 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:06.631979 13077 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:06.633373  6646 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 19. Ops: []
I20260709 12:27:06.606115 13252 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:06.639727  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:06.640354  6041 raft_consensus.cc:3060] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:27:06.639611  6035 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:27:06.566879 13067 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:06.564882 13198 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:27:06.641749 13198 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:06.642742 13198 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:06.643868 13198 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:06.570399  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:06.645244  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:06.645799  6037 raft_consensus.cc:2393] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 19: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:06.349431 13099 consensus_queue.cc:237] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.571648 13104 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:06.574865  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:06.650307  6040 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 29.
I20260709 12:27:06.548123  6110 rpcz_store.cc:276] 0709 12:27:05.443126 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.595966 (+152840us) service_pool.cc:224] Handling call
0709 12:27:06.547388 (+951422us) spinlock_profiling.cc:243] Waited 226 ms on lock 0x7b5400164754. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:06.547577 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":518741248}
W20260709 12:27:06.565737 13133 consensus_meta.cc:287] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.909s	user 0.006s	sys 0.013s
I20260709 12:27:06.576917 13157 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:27:06.582535 13117 consensus_meta.cc:287] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.572s	user 0.012s	sys 0.005s
I20260709 12:27:06.583695 13118 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:06.584722  6038 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: [17.13-17.13]
I20260709 12:27:06.585420  5960 raft_consensus.cc:1240] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 21. Current term is 22. Ops: []
W20260709 12:27:06.586248 13194 consensus_meta.cc:287] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.571s	user 0.016s	sys 0.001s
I20260709 12:27:06.674091 13194 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.676132 13194 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:06.677430  6044 raft_consensus.cc:2410] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:27:06.603889 12855 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.047s
I20260709 12:27:06.587061  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:06.678732  6114 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:06.588560  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:06.588994 13167 consensus_meta.cc:287] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.549s	user 0.014s	sys 0.001s
I20260709 12:27:06.642648 12968 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:06.313055 13245 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:27:06.599054  5968 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:06.599933 12511 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:06.593406 13110 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.719372 13110 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.592361 13227 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:06.610565  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:06.613677  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:06.771291  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 160898us
I20260709 12:27:06.616743  6642 rpcz_store.cc:276] 0709 12:27:05.322188 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.661729 (+339541us) service_pool.cc:224] Handling call
0709 12:27:05.933395 (+271666us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:05.942750 (+  9355us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:06.561572 (+618822us) spinlock_profiling.cc:243] Waited 271 ms on lock 0x7b540060d6d0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:06.561728 (+   156us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":624083200}
I20260709 12:27:06.640297 13252 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:06.576017 13226 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:06.653417  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:06.654654  6650 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:27:06.661865  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:06.667243  5966 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 8 index: 9. Preceding OpId from leader: term: 10 index: 10. (index mismatch)
I20260709 12:27:06.682905  6116 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 22: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:06.687301  6114 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:27:06.590147 13031 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.691134  6041 raft_consensus.cc:2468] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 22.
I20260709 12:27:06.633018 13261 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:06.799420  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:06.705441 13154 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:06.707084 13148 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:06.672546 13133 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:06.711270 13170 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.692380 13167 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:06.672020 13225 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 12:27:06.689791 13117 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.723436  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:06.725840 13100 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:06.728638 13126 consensus_queue.cc:1059] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 11.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:06.725981  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:27:06.741700  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.735412 13227 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:06.735514 13242 raft_consensus.cc:3055] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:27:06.748883  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:06.750727 13255 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.418s	user 0.003s	sys 0.001s
I20260709 12:27:06.752269  6647 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
W20260709 12:27:06.734508 13248 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.321s	user 0.000s	sys 0.004s
I20260709 12:27:06.817663 13242 raft_consensus.cc:740] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:06.755733 13176 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:06.756229  5934 connection.cc:256] RPC call timeout handler was delayed by -1.3113845030002267s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.15100000000000002s for a response
I20260709 12:27:06.819370 13242 consensus_queue.cc:260] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:06.821945 13117 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:06.822549 13137 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.823083 13137 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.824628 13075 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:06.826129 13126 raft_consensus.cc:3055] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:06.763664 13136 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Stepping down as leader of term 19
W20260709 12:27:06.756143  6044 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 3046) took 1308 ms (client timeout 1500 ms). Trace:
W20260709 12:27:06.767704  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.826560 13100 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.825107 13137 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:27:06.826514 13126 raft_consensus.cc:740] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:06.615918  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:06.828466  6036 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:06.828656 13100 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:06.828423 13126 consensus_queue.cc:260] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.828991  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:06.829824  5962 raft_consensus.cc:2410] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:27:06.830534 13136 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:06.772318  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:06.789983  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:06.819403 13176 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.832185  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:06.683877 13139 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.692488 13122 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.810011 13270 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.815207 13253 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:06.865476  5934 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:06.873796  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:06.874523  6647 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:06.816942  6646 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 20: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:06.817611  5967 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 19. Current term is 20. Ops: []
W20260709 12:27:06.833774  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 61623.8us
I20260709 12:27:06.876994  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:06.831068  6609 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:27:06.834319  6044 rpcz_store.cc:269] 0709 12:27:05.447679 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:05.451175 (+  3496us) service_pool.cc:224] Handling call
0709 12:27:06.755956 (+1304781us) spinlock_profiling.cc:243] Waited 1.22 s on lock 0x7b540028fad4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:06.756086 (+   130us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2817379072}
I20260709 12:27:06.842060  6645 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:27:06.862171  5963 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 25. Current term is 26. Ops: []
I20260709 12:27:06.862722  5968 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 19. Current term is 20. Ops: []
W20260709 12:27:06.877997  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 47568us
I20260709 12:27:06.850032  6118 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
I20260709 12:27:06.799093 13112 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:06.872507  5959 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:06.879561  6609 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:27:06.881464  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 45961.7us
I20260709 12:27:06.881544  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:06.882810  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:06.798611 13226 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:06.806227 13266 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:06.879328  6084 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:06.885507  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:06.923597  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 44117.3us
I20260709 12:27:06.941004  5959 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:06.942296  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:06.941462  5962 raft_consensus.cc:2410] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 17 because replica has last-logged OpId of term: 16 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
W20260709 12:27:06.944510  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 67627.7us
I20260709 12:27:06.945221  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:06.945636  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:06.935122  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:06.947786  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 68575.5us
I20260709 12:27:06.947847  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:06.811672 13154 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:06.957450  5934 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:06.974363  5934 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:06.975378  6647 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:06.975935  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:06.961194  5959 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:06.982045  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:06.983753  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:06.924016 13237 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:06.863101 13148 raft_consensus.cc:2764] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election decision vote started in defunct term 13: won
I20260709 12:27:06.976733  5967 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:06.865540 13176 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:06.989629  6084 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:06.849090 13157 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:27:06.990917  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:06.923520 13137 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:27:06.952276 12968 raft_consensus.cc:2804] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:06.991407  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:06.993387  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:06.987520  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 295988us
I20260709 12:27:07.002723  6041 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 22.
I20260709 12:27:06.954939 13038 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:07.004264  5967 raft_consensus.cc:2393] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:06.987884  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:06.980553  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:06.924288 13245 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.070s
I20260709 12:27:06.985848  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 10 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:06.865722 13261 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.135s
I20260709 12:27:07.028215  5959 raft_consensus.cc:2393] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 10: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:06.950619 13099 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:06.950785 12768 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:06.952558 12855 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.049s
I20260709 12:27:06.954155 13194 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.071s
I20260709 12:27:07.029851  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:07.030817  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:07.030172  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:07.031956  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:07.032505  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:06.995720  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:06.883800 13122 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:06.884045 13139 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:07.038259  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:07.038596  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:07.027072  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:06.992398 13112 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:06.998759 13137 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:07.041199  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:07.042423  6044 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 19: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:27:07.041770  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 67514.3us
I20260709 12:27:07.003846 13041 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:06.984810 13264 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:07.037532 13038 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:07.044201  6611 leader_election.cc:400] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14.
I20260709 12:27:07.059906  6611 leader_election.cc:403] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 13 election: Cancelling election due to peer responding with higher term
I20260709 12:27:06.994125 13237 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:07.045312  6041 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 22: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:07.045300  5962 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:06.886650 13270 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:07.066700 13237 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:07.068600 13270 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:07.045697  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:07.069564  6039 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 15: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:07.070503  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:07.071242  6039 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:07.046283  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:07.074525  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:07.075138 13031 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:07.047096 12895 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:07.044644 13225 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:07.002698 13176 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:27:07.088061 13276 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.086s	user 0.000s	sys 0.001s
I20260709 12:27:07.088454 13100 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:07.089403 13100 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:07.060923 13110 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:07.092371 12570 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14.
W20260709 12:27:07.091976  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 47882.6us
I20260709 12:27:06.952385 13266 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:06.985394 13154 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:07.096307 13266 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:07.096415 13154 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:07.037475 12968 raft_consensus.cc:697] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 22 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:07.098899 13225 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:07.100188  6116 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 22. Current term is 23. Ops: [22.16-22.16]
I20260709 12:27:07.050415  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:07.048103  5959 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 29.
I20260709 12:27:07.611384  6118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3601) took 1022 ms. Trace:
I20260709 12:27:07.611810  6118 rpcz_store.cc:276] 0709 12:27:06.589239 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.591027 (+  1788us) service_pool.cc:224] Handling call
0709 12:27:06.591418 (+   391us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.881627 (+290209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.610881 (+729254us) spinlock_profiling.cc:243] Waited 258 ms on lock 0x7b54001ea854. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:07.611185 (+   304us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":593847168}
I20260709 12:27:07.613504  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:07.052826  5961 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:07.617861  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:07.048676  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:07.632014  5967 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 20: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:27:07.444578  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.054703  5934 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:07.053263  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:08.393501  5960 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 21.
I20260709 12:27:08.394114  5960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37174 (request call id 1825) took 1573 ms. Trace:
I20260709 12:27:08.394443  5960 rpcz_store.cc:276] 0709 12:27:06.820213 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.053041 (+232828us) service_pool.cc:224] Handling call
0709 12:27:08.394009 (+1340968us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.396036  5960 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:08.396620  5960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1828) took 1575 ms. Trace:
I20260709 12:27:08.396934  5960 rpcz_store.cc:276] 0709 12:27:06.821111 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.395394 (+1574283us) service_pool.cc:224] Handling call
0709 12:27:08.395755 (+   361us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.396370 (+   615us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.396551 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:07.383637  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.048735  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.047372  6035 raft_consensus.cc:2410] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 18 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:27:08.400367  5960 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 29 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 28. Current term is 29. Ops: []
W20260709 12:27:08.410646  6035 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 3055) took 1381 ms (client timeout 1802 ms). Trace:
I20260709 12:27:08.410971  5960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1829) took 1589 ms. Trace:
I20260709 12:27:07.517299  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3190) took 1317 ms. Trace:
I20260709 12:27:07.519748  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:08.411509  5960 rpcz_store.cc:276] 0709 12:27:06.821369 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.397852 (+1576483us) service_pool.cc:224] Handling call
0709 12:27:08.398232 (+   380us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.410669 (+ 12437us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.410895 (+   226us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.412457  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 3064) took 1360 ms. Trace:
I20260709 12:27:08.412897  6036 rpcz_store.cc:276] 0709 12:27:07.051792 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.518948 (+467156us) service_pool.cc:224] Handling call
0709 12:27:08.412348 (+893400us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.413700  5960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1836) took 1590 ms. Trace:
I20260709 12:27:07.046659  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:08.417925  6037 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 22: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:08.418493  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 3059) took 1385 ms. Trace:
I20260709 12:27:07.524464  6038 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:07.061585  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:08.425267 13304 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.425732  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 3063) took 1375 ms. Trace:
I20260709 12:27:07.075321  6042 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 15: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:07.050104  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:07.548974  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:08.445204  6044 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:08.445806  6044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 3062) took 1397 ms. Trace:
I20260709 12:27:08.446097  6044 rpcz_store.cc:276] 0709 12:27:07.048026 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.080968 (+ 32942us) service_pool.cc:224] Handling call
0709 12:27:08.445721 (+1364753us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.447244  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:08.447412 13315 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:08.448304 13315 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.449553  6044 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 10. Preceding OpId from leader: term: 15 index: 10. (term mismatch)
I20260709 12:27:08.449972  6044 pending_rounds.cc:85] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 9
I20260709 12:27:08.450202  6044 pending_rounds.cc:107] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 14.10
I20260709 12:27:07.550657  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:08.451191  6111 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 22: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:08.452508  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:07.551205  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:07.557199  5966 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:08.431169 13314 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.455229 13314 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:08.455757  5966 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 3199) took 1664 ms (client timeout 1629 ms). Trace:
W20260709 12:27:08.456231  5966 rpcz_store.cc:269] 0709 12:27:06.791682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.799106 (+  7424us) service_pool.cc:224] Handling call
0709 12:27:08.455478 (+1656372us) spinlock_profiling.cc:243] Waited 270 ms on lock 0x7b54000f7654. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:08.455647 (+   169us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":620704512}
I20260709 12:27:07.599107  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:08.458479  6116 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:27:08.459625  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:08.460536  6116 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:27:07.601346  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:07.601025  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.605962  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:07.607239  6117 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 12 index: 12. Preceding OpId from leader: term: 13 index: 13. (index mismatch)
I20260709 12:27:08.463215  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:08.463393  6112 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:08.464174  6114 raft_consensus.cc:2410] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 23 because replica has last-logged OpId of term: 22 index: 17, which is greater than that of the candidate, which has last-logged OpId of term: 21 index: 16.
I20260709 12:27:08.464241  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:08.465066  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:08.465833  6114 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 22.
I20260709 12:27:07.621596  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:07.610311  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:08.467803  5959 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
W20260709 12:27:08.468274  5959 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 3208) took 1197 ms (client timeout 1590 ms). Trace:
W20260709 12:27:08.468662  5959 rpcz_store.cc:269] 0709 12:27:07.271254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.609658 (+338404us) service_pool.cc:224] Handling call
0709 12:27:08.468215 (+858557us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.643784  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:07.644994  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:08.471853  6118 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:08.472739  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:08.473433  6118 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:27:07.646241  5961 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:08.474911  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1827) took 1654 ms. Trace:
I20260709 12:27:08.475232  5961 rpcz_store.cc:276] 0709 12:27:06.820877 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.645460 (+824583us) service_pool.cc:224] Handling call
0709 12:27:07.645951 (+   491us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.474666 (+828715us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.474855 (+   189us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:07.664145  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:07.665248  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:07.665555  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:07.117007  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.388162  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:07.210896  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:07.361608  6650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5744a277c5a3409b95831573168daf3f"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:27:07.077879 12895 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:07.664410 12925 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.490532 12925 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:07.156946 13100 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:07.551090 12948 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.022s
I20260709 12:27:07.097846 12968 consensus_queue.cc:237] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.500125  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:08.501760 13302 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:27:07.093439 13038 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.503301 13314 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:07.101868 13041 raft_consensus.cc:697] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:08.508597 13041 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:07.154913 13122 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:07.054778 13137 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:07.044435 13138 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.034s
I20260709 12:27:07.397351 13139 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:07.056587 13148 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:08.515352 13148 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.502009  6114 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 12. Current term is 13. Ops: []
I20260709 12:27:08.516516  6110 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:07.005323 13157 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:08.521039 13157 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:07.404417 13166 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.523007 13166 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.525305 13166 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.526083  6040 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:27:07.101749 13225 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:07.160789 13237 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:07.385560 13167 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.202404  6644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:50454 (request call id 1690) took 1201 ms. Trace:
I20260709 12:27:08.531059 13237 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:07.047437 13240 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:27:07.439908 13133 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 26 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:07.215502 13136 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:07.647805 13058 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.404865 13252 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:07.713513 13226 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:07.734448  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3193) took 1220 ms. Trace:
I20260709 12:27:08.047782  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1824) took 1226 ms. Trace:
W20260709 12:27:08.049022  6039 consensus_meta.cc:287] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.977s	user 0.021s	sys 0.005s
I20260709 12:27:08.049240 13303 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:08.070598  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.095830 13176 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.108764  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:08.111887 13305 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:08.227002  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 1.17216e+06us
I20260709 12:27:08.229197 12916 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:08.239797 13307 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:08.305567 13175 consensus_queue.cc:1175] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" responder_term: 19 status { last_received { term: 18 index: 12 } last_committed_idx: 12 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 18. Current term is 19. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:08.314106 13308 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.336194 13118 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:08.342406 13113 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.362857 13132 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:08.355090 13309 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:08.380146 13258 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:08.381284 13311 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.382417 13269 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:08.384948 13227 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:27:08.399401  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.414146 13126 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:08.415009  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:08.411060  6035 rpcz_store.cc:269] 0709 12:27:07.029451 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.029576 (+   125us) service_pool.cc:224] Handling call
0709 12:27:08.410436 (+1380860us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.415078  5963 rpcz_store.cc:276] 0709 12:27:06.199896 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.200029 (+   133us) service_pool.cc:224] Handling call
0709 12:27:06.200323 (+   294us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.878125 (+677802us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.516575 (+638450us) spinlock_profiling.cc:243] Waited 662 ms on lock 0x7b54000f6c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:07.516986 (+   411us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1521698176}
I20260709 12:27:08.418823  6037 rpcz_store.cc:276] 0709 12:27:07.032588 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.046417 (+ 13829us) service_pool.cc:224] Handling call
0709 12:27:08.418398 (+1371981us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.419950  6038 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 3060) took 1378 ms. Trace:
I20260709 12:27:08.414163  5960 rpcz_store.cc:276] 0709 12:27:06.823254 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.412369 (+1589115us) service_pool.cc:224] Handling call
0709 12:27:08.412773 (+   404us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.413281 (+   508us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:27:08.413307 (+    26us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.413392 (+    85us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:08.413433 (+    41us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.413492 (+    59us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.413634 (+   142us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.426195  6041 rpcz_store.cc:276] 0709 12:27:07.050127 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.061326 (+ 11199us) service_pool.cc:224] Handling call
0709 12:27:08.425545 (+1364219us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.426131 13304 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.431123 13312 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:08.542320 13067 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.548699 13067 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.549201 13227 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.550629 13136 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:08.551026  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:08.551798 13132 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:08.552968  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 3066) took 1492 ms. Trace:
I20260709 12:27:08.553331  6035 rpcz_store.cc:276] 0709 12:27:07.060585 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.552026 (+1491441us) service_pool.cc:224] Handling call
0709 12:27:08.552411 (+   385us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.552624 (+   213us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.552647 (+    23us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.552711 (+    64us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:08.552744 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.552792 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.552896 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.554777 13312 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.555346 13307 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.556281 13252 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:08.557152 13312 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.557488 13307 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:08.558490  6041 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:08.559156  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2453) took 1056 ms. Trace:
I20260709 12:27:08.559514  6041 rpcz_store.cc:276] 0709 12:27:07.503594 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.557918 (+1054324us) service_pool.cc:224] Handling call
0709 12:27:08.558209 (+   291us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.558898 (+   689us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.559089 (+   191us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.560086 13225 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:08.560250 13067 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:08.558370 13252 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:08.561474 13252 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.562214 13252 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.562733 12916 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.564216 13304 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.565090 13252 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.436542  5865 catalog_manager.cc:5697] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:08.443604  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 3065) took 1387 ms. Trace:
W20260709 12:27:08.444041  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.569562  6109 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:08.566491  6038 rpcz_store.cc:276] 0709 12:27:07.041923 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.523230 (+481307us) service_pool.cc:224] Handling call
0709 12:27:07.523879 (+   649us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.419571 (+895692us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.419886 (+   315us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.571030  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:08.570797 13118 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:08.572533  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:08.573227 13118 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:08.573797  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:08.574563  6039 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:08.548352 13258 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:08.575204  6039 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 3067) took 1512 ms (client timeout 1578 ms). Trace:
W20260709 12:27:08.575598  6039 rpcz_store.cc:269] 0709 12:27:07.062476 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.070174 (+  7698us) service_pool.cc:224] Handling call
0709 12:27:08.575123 (+1504949us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.565968 13269 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:08.576565 13176 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.554260 13113 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.580456 13242 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:08.581491  6009 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:08.583655 13252 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:08.560740 13225 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:08.562242 13308 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.548811 13311 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.574115 13226 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:08.551441 13227 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.554085  6110 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:08.578346 13269 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:08.481628  6608 connection.cc:256] RPC call timeout handler was delayed by -1.3321340510001392s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1757s for a response
I20260709 12:27:08.553902 13132 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:08.585151  6009 leader_election.cc:400] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 21. Current term is 22.
I20260709 12:27:08.599534 13113 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:08.599946  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.587910 13303 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:08.600837  6608 connection.cc:256] RPC call timeout handler was delayed by -1.1669946100000743s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.31170000000000003s for a response
I20260709 12:27:08.601629 12866 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:08.588146 13305 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.531478  6644 rpcz_store.cc:276] 0709 12:27:06.000623 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.000760 (+   137us) service_pool.cc:224] Handling call
0709 12:27:07.202142 (+1201382us) spinlock_profiling.cc:243] Waited 805 ms on lock 0x7b540060d6d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:07.202325 (+   183us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1852253056}
I20260709 12:27:08.497517  5863 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 341) took 6520 ms. Trace:
I20260709 12:27:08.497835 12948 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:08.592813  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.461773  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:07.094439 13112 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.654824 13112 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.655251  6116 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:08.657537 13112 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.660326 12866 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.644304 12948 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:08.665056 12948 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:08.665620  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.511225  6082 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:08.666958  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 155903us
I20260709 12:27:08.668025  6082 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:08.670358 13138 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:08.671066 13138 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.657243  6116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35596 (request call id 3525) took 1096 ms. Trace:
I20260709 12:27:08.590170 13308 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:07.124508 13170 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.686621 13174 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.687243  5914 placement_policy_util.cc:248] tablet a0b00ef9114f441baff2557bc164b4d7: not considering replicas for movement since the tablet's status is 'UNAVAILABLE'
W20260709 12:27:08.684911  6139 debug-util.cc:398] Leaking SignalData structure 0x7b08003688c0 after lost signal to thread 4824
I20260709 12:27:08.527410 12925 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:08.689342  6139 debug-util.cc:398] Leaking SignalData structure 0x7b0800367c40 after lost signal to thread 5900
I20260709 12:27:08.517809 13148 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:08.690606  6139 debug-util.cc:398] Leaking SignalData structure 0x7b08001d0720 after lost signal to thread 5992
W20260709 12:27:08.690891  6139 debug-util.cc:398] Leaking SignalData structure 0x7b08001e5d40 after lost signal to thread 5993
I20260709 12:27:08.528762 12895 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:08.530022 13167 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:08.691962  6139 debug-util.cc:398] Leaking SignalData structure 0x7b08001f9ac0 after lost signal to thread 6068
W20260709 12:27:08.692220  6139 debug-util.cc:398] Leaking SignalData structure 0x7b08000ba0a0 after lost signal to thread 6069
I20260709 12:27:08.693065 13167 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.502305 13302 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:08.687215 13174 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.694321 13302 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.695384 13302 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:08.539893 13058 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.561744  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:08.696560  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 134991us
I20260709 12:27:08.591215  5967 raft_consensus.cc:2410] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:27:08.697266 13058 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:08.698016  5967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 3568) took 1294 ms. Trace:
I20260709 12:27:08.698113  5961 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:08.698416  5967 rpcz_store.cc:276] 0709 12:27:07.403969 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.643365 (+239396us) service_pool.cc:224] Handling call
0709 12:27:08.697814 (+1054449us) spinlock_profiling.cc:243] Waited 98.6 ms on lock 0x7b540008a554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:08.697963 (+   149us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":226776960}
I20260709 12:27:08.699417  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1840) took 1875 ms. Trace:
I20260709 12:27:08.699550  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:08.699723 13167 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election lost for term 13. Reason: could not achieve majority
I20260709 12:27:08.699784  5961 rpcz_store.cc:276] 0709 12:27:06.824214 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.475956 (+1651742us) service_pool.cc:224] Handling call
0709 12:27:08.697954 (+221998us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.698535 (+   581us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.699230 (+   695us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b540008a550. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:08.699352 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509651712}
I20260709 12:27:08.700949 13174 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.701609  5961 raft_consensus.cc:3055] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:08.701983  5961 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:08.700254  6650 raft_consensus.cc:606] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:27:08.693316  6139 debug-util.cc:398] Leaking SignalData structure 0x7b080022c060 after lost signal to thread 6142
W20260709 12:27:08.705097  6139 debug-util.cc:398] Leaking SignalData structure 0x7b0800401de0 after lost signal to thread 6143
I20260709 12:27:08.596176  6043 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:08.677954 13112 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:08.603502  6111 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:08.561057  6041 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:27:08.591511  5968 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:08.568193  6042 rpcz_store.cc:276] 0709 12:27:07.055754 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.074250 (+ 18496us) service_pool.cc:224] Handling call
0709 12:27:08.443420 (+1369170us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.637468  6009 leader_election.cc:403] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:08.638988  6112 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:08.591917  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2455) took 1087 ms. Trace:
I20260709 12:27:08.603504  6117 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:08.591725  5960 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 22.
I20260709 12:27:08.566586  5965 rpcz_store.cc:276] 0709 12:27:06.513631 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:06.513750 (+   119us) service_pool.cc:224] Handling call
0709 12:27:06.514026 (+   276us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:06.735790 (+221764us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:06.735836 (+    46us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:06.735879 (+    43us) raft_consensus.cc:1645] Marking committed up to 10
0709 12:27:06.735919 (+    40us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.733906 (+997987us) spinlock_profiling.cc:243] Waited 222 ms on lock 0x7b5400198a54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:07.733984 (+    78us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:07.734263 (+   279us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":509532416}
I20260709 12:27:08.587576 13225 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:08.602980 13321 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.598927  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1682) took 1051 ms. Trace:
I20260709 12:27:08.646087 13303 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.640527 13307 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:08.647703  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1684) took 1099 ms. Trace:
I20260709 12:27:08.652522 13306 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:27:08.707165  6110 rpcz_store.cc:276] 0709 12:27:07.547676 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.658810 (+111134us) service_pool.cc:224] Handling call
0709 12:27:07.659309 (+   499us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.596774 (+937465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.598697 (+  1923us) spinlock_profiling.cc:243] Waited 857 ms on lock 0x7b5400101dd4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:08.598872 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1970839936}
I20260709 12:27:08.587523 13315 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.665472  6109 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:08.510960  6044 raft_consensus.cc:2889] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:08.672935  6116 rpcz_store.cc:276] 0709 12:27:07.561151 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.461367 (+900216us) service_pool.cc:224] Handling call
0709 12:27:08.657006 (+195639us) spinlock_profiling.cc:243] Waited 16.2 ms on lock 0x7b54000929d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:08.657137 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":37174016}
I20260709 12:27:08.674921  5966 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:27:08.542574 13240 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.595466 13311 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.592970 13175 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:08.714882  6110 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:27:08.714681 13321 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.715677  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3522) took 1155 ms. Trace:
I20260709 12:27:08.715555 13240 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.716078  6110 rpcz_store.cc:276] 0709 12:27:07.559789 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.714095 (+1154306us) service_pool.cc:224] Handling call
0709 12:27:08.714431 (+   336us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.715393 (+   962us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.715594 (+   201us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.716988 13321 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:08.717756 13240 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:08.717885  6110 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3523) took 1157 ms. Trace:
I20260709 12:27:08.718127  6117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1689) took 1163 ms. Trace:
I20260709 12:27:08.718725  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:08.719463  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1690) took 1163 ms. Trace:
I20260709 12:27:08.709271 13306 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:08.719833  6111 rpcz_store.cc:276] 0709 12:27:07.555682 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.452149 (+896467us) service_pool.cc:224] Handling call
0709 12:27:08.719258 (+267109us) spinlock_profiling.cc:243] Waited 150 ms on lock 0x7b5400205b54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:08.719384 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":345619200}
I20260709 12:27:08.720624 13306 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.721643  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3524) took 1161 ms. Trace:
I20260709 12:27:08.722066 13306 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:08.709805  5961 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.592214  5865 catalog_manager.cc:5697] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:08.596467 13258 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.517930  6114 raft_consensus.cc:1217] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Deduplicated request from leader. Original: 13.9->[15.10-17.11]   Dedup: 15.10->[17.11-17.11]
I20260709 12:27:08.596617 13176 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.679095  6082 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:08.677107 13137 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.684998  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:08.680738  6608 leader_election.cc:336] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.537s (SENT)
I20260709 12:27:08.685472 13138 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:08.527964  6040 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 3053) took 1499 ms (client timeout 1687 ms). Trace:
I20260709 12:27:08.590639  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:37174 (request call id 1832) took 1768 ms. Trace:
I20260709 12:27:08.678330 12948 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:08.706488  6037 rpcz_store.cc:276] 0709 12:27:07.504370 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.561534 (+1057164us) service_pool.cc:224] Handling call
0709 12:27:08.561896 (+   362us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.562257 (+   361us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.562284 (+    27us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.562351 (+    67us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:08.562381 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.562429 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.591834 (+ 29405us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.595500 12916 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.704262  6650 raft_consensus.cc:614] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:08.677066 13067 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:08.710944  6044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 3061) took 1665 ms. Trace:
I20260709 12:27:08.719483  5965 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 12.
I20260709 12:27:08.772460  6044 rpcz_store.cc:276] 0709 12:27:07.045331 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.448594 (+1403263us) service_pool.cc:224] Handling call
0709 12:27:08.449016 (+   422us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.710649 (+261633us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.710867 (+   218us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.707396  6115 rpcz_store.cc:276] 0709 12:27:07.548862 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.665141 (+116279us) service_pool.cc:224] Handling call
0709 12:27:08.647329 (+982188us) spinlock_profiling.cc:243] Waited 167 ms on lock 0x7b54002cd654. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:08.647626 (+   297us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":384357248}
I20260709 12:27:08.712165  6041 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2454) took 1202 ms. Trace:
I20260709 12:27:08.712225  6112 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1688) took 1155 ms. Trace:
I20260709 12:27:08.567716  5964 rpcz_store.cc:276] 0709 12:27:06.819934 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.077207 (+257273us) service_pool.cc:224] Handling call
0709 12:27:07.624281 (+547074us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:07.629381 (+  5100us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:07.629411 (+    30us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:07.630406 (+   995us) log.cc:844] Serialized 52 byte log entry
0709 12:27:07.648484 (+ 18078us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:07.648530 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:07.648929 (+   399us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:07.661147 (+ 12218us) raft_consensus.cc:1685] finished
0709 12:27:07.661170 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.041922 (+380752us) spinlock_profiling.cc:243] Waited 543 ms on lock 0x7b5400277ed0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210538ad 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:08.046726 (+  4804us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":3420,"raft.run_cpu_time_us":406,"raft.run_wall_time_us":11356,"spinlock_wait_cycles":1248353536,"thread_start_us":17550,"threads_started":1,"wal-append.queue_time_us":19819}
I20260709 12:27:08.769728  5962 rpcz_store.cc:276] 0709 12:27:06.822207 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.062071 (+239864us) service_pool.cc:224] Handling call
0709 12:27:08.590560 (+1528489us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.713443 13307 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:08.709438  5968 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 3207) took 1438 ms (client timeout 1525 ms). Trace:
W20260709 12:27:08.722688  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.769640  6040 rpcz_store.cc:269] 0709 12:27:07.028881 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.029909 (+  1028us) service_pool.cc:224] Handling call
0709 12:27:08.527739 (+1497830us) spinlock_profiling.cc:243] Waited 1.48 s on lock 0x7b54000d6e54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:08.527904 (+   165us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":3405465984}
I20260709 12:27:08.722029  6111 rpcz_store.cc:276] 0709 12:27:07.560516 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.720652 (+1160136us) service_pool.cc:224] Handling call
0709 12:27:08.721000 (+   348us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.721286 (+   286us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.721311 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.721358 (+    47us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:08.721402 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.721454 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.721571 (+   117us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.714974  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1837) took 1891 ms. Trace:
W20260709 12:27:08.707912  6139 debug-util.cc:398] Leaking SignalData structure 0x7b08003d5dc0 after lost signal to thread 6675
I20260709 12:27:08.723426  6651 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:27:08.765730  6114 raft_consensus.cc:1240] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 18. Ops: [15.10-17.11]
I20260709 12:27:08.766285  6110 rpcz_store.cc:276] 0709 12:27:07.560121 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.716843 (+1156722us) service_pool.cc:224] Handling call
0709 12:27:08.717242 (+   399us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.717555 (+   313us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.717586 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.717644 (+    58us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:27:08.717673 (+    29us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.717724 (+    51us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.717830 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:08.723789  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 138945us
I20260709 12:27:08.718544  6117 rpcz_store.cc:276] 0709 12:27:07.554991 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.463954 (+908963us) service_pool.cc:224] Handling call
0709 12:27:08.717976 (+254022us) spinlock_profiling.cc:243] Waited 139 ms on lock 0x7b54000613d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:08.718075 (+    99us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":318758144}
I20260709 12:27:08.713181  6109 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:42484 (request call id 1685) took 1164 ms. Trace:
I20260709 12:27:08.682132 12866 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:08.723992 13315 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 21. Current term is 22.
I20260709 12:27:08.773792  6112 rpcz_store.cc:276] 0709 12:27:07.552848 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.605180 (+ 52332us) service_pool.cc:224] Handling call
0709 12:27:08.706309 (+1101129us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.781867  5966 rpcz_store.cc:276] 0709 12:27:06.823496 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.457184 (+1633688us) service_pool.cc:224] Handling call
0709 12:27:08.457704 (+   520us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:08.714145 (+256441us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.714725 (+   580us) spinlock_profiling.cc:243] Waited 146 ms on lock 0x7b5400197154. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:08.714921 (+   196us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":336312704}
I20260709 12:27:08.773522  6041 rpcz_store.cc:276] 0709 12:27:07.504030 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.560329 (+1056299us) service_pool.cc:224] Handling call
0709 12:27:08.560698 (+   369us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.705753 (+145055us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.706309 (+   556us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:08.780072  5968 rpcz_store.cc:269] 0709 12:27:07.270902 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.521775 (+250873us) service_pool.cc:224] Handling call
0709 12:27:08.709270 (+1187495us) spinlock_profiling.cc:243] Waited 137 ms on lock 0x7b5400036954. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:08.709386 (+   116us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":314911488}
I20260709 12:27:08.784936  6109 rpcz_store.cc:276] 0709 12:27:07.549295 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.663647 (+114352us) service_pool.cc:224] Handling call
0709 12:27:08.711749 (+1048102us) spinlock_profiling.cc:243] Waited 92.8 ms on lock 0x7b5400206554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:08.711861 (+   112us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":213449472}
I20260709 12:27:08.779778  5934 leader_election.cc:400] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17.
I20260709 12:27:08.787864  6113 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1692) took 1224 ms. Trace:
I20260709 12:27:08.790241  5934 leader_election.cc:403] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:08.790326  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3520) took 1225 ms. Trace:
I20260709 12:27:08.771510 12948 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:08.792158 13311 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:08.604682  5863 rpcz_store.cc:276] 0709 12:27:01.976849 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.977086 (+   237us) service_pool.cc:224] Handling call
0709 12:27:08.497198 (+6520112us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:05.948795 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:05.989411 (+ 40616us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:05.989453 (+    42us) write_op.cc:435] Acquired schema lock
0709 12:27:05.989471 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:06.212162 (+222691us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:06.212216 (+    54us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:06.212247 (+    31us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:27:06.213149 (+   902us) tablet.cc:701] Row locks acquired
0709 12:27:06.213167 (+    18us) write_op.cc:260] PREPARE: finished
0709 12:27:06.213307 (+   140us) write_op.cc:270] Start()
0709 12:27:06.213418 (+   111us) write_op.cc:276] Timestamp: P: 1783600026213260 usec, L: 0
0709 12:27:06.213437 (+    19us) op_driver.cc:348] REPLICATION: starting
0709 12:27:06.214106 (+   669us) log.cc:844] Serialized 4408 byte log entry
0709 12:27:07.047740 (+833634us) op_driver.cc:464] REPLICATION: finished
0709 12:27:07.154643 (+106903us) write_op.cc:301] APPLY: starting
0709 12:27:07.154763 (+   120us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:07.177643 (+ 22880us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:07.177764 (+   121us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:07.184623 (+  6859us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:07.184880 (+   257us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:27:07.184926 (+    46us) write_op.cc:312] APPLY: finished
0709 12:27:07.185252 (+   326us) log.cc:844] Serialized 105 byte log entry
0709 12:27:07.185625 (+   373us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:07.185779 (+   154us) write_op.cc:454] Released schema lock
0709 12:27:07.185825 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:07.186259 (+   434us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:07.186287 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":362526,"reported_tablets":23,"child_traces":[["op",{"apply.queue_time_us":102171,"apply.run_cpu_time_us":16091,"apply.run_wall_time_us":32399,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50129,"num_ops":11,"prepare.queue_time_us":284597,"prepare.run_cpu_time_us":13936,"prepare.run_wall_time_us":354983,"raft.queue_time_us":376809,"raft.run_cpu_time_us":10962,"raft.run_wall_time_us":153878,"replication_time_us":811189,"thread_start_us":574540,"threads_started":4,"wal-append.queue_time_us":124391,"wal-append.run_cpu_time_us":88423,"wal-append.run_wall_time_us":2045524}]]}
I20260709 12:27:08.794853  6646 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:27:08.792218 12948 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:08.796222  5963 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:08.796864  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3566) took 1393 ms. Trace:
I20260709 12:27:08.797447 13303 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17.
I20260709 12:27:08.798480  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3564) took 1552 ms. Trace:
I20260709 12:27:08.798899  5964 rpcz_store.cc:276] 0709 12:27:07.245581 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.783236 (+1537655us) service_pool.cc:224] Handling call
0709 12:27:08.797952 (+ 14716us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.798138 (+   186us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.798166 (+    28us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.798205 (+    39us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:27:08.798239 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.798289 (+    50us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.798411 (+   122us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.800680  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3569) took 1393 ms. Trace:
I20260709 12:27:08.767884 13167 consensus_queue.cc:1059] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.036s
I20260709 12:27:08.802608 13175 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:08.797183  5963 rpcz_store.cc:276] 0709 12:27:07.403371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.795617 (+1392246us) service_pool.cc:224] Handling call
0709 12:27:08.796001 (+   384us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.796623 (+   622us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.796808 (+   185us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.801020  5964 rpcz_store.cc:276] 0709 12:27:07.406993 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.799824 (+1392831us) service_pool.cc:224] Handling call
0709 12:27:08.800144 (+   320us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.800340 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.800375 (+    35us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.800434 (+    59us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:27:08.800462 (+    28us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.800510 (+    48us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.800608 (+    98us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.791028  6114 rpcz_store.cc:276] 0709 12:27:07.559023 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.517064 (+958041us) service_pool.cc:224] Handling call
0709 12:27:08.517464 (+   400us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:08.783855 (+266391us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.784079 (+   224us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.724189 13305 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:08.819051  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 3068) took 1254 ms. Trace:
I20260709 12:27:08.819540  6036 rpcz_store.cc:276] 0709 12:27:07.564627 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.565258 (+1000631us) service_pool.cc:224] Handling call
0709 12:27:08.565591 (+   333us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.565926 (+   335us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:27:08.676989 (+111063us) log.cc:844] Serialized 14 byte log entry
0709 12:27:08.818660 (+141671us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.818719 (+    59us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:27:08.818787 (+    68us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.818851 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.818989 (+   138us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":118493,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":115,"raft.run_cpu_time_us":236,"raft.run_wall_time_us":236,"thread_start_us":215045,"threads_started":2}
W20260709 12:27:08.824373  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.790835  6113 rpcz_store.cc:276] 0709 12:27:07.557492 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.477359 (+919867us) service_pool.cc:224] Handling call
0709 12:27:08.477693 (+   334us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.478017 (+   324us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:27:08.711073 (+233056us) log.cc:844] Serialized 14 byte log entry
0709 12:27:08.781281 (+ 70208us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.781341 (+    60us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:08.781389 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.781460 (+    71us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.781591 (+   131us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":233083,"prepare.run_cpu_time_us":40,"prepare.run_wall_time_us":41,"raft.queue_time_us":21475,"raft.run_cpu_time_us":171,"raft.run_wall_time_us":172,"thread_start_us":288503,"threads_started":2}
W20260709 12:27:08.825632  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 149048us
I20260709 12:27:08.827920  5965 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3563) took 1578 ms. Trace:
I20260709 12:27:08.828702  5965 rpcz_store.cc:276] 0709 12:27:07.245335 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.781668 (+1536333us) service_pool.cc:224] Handling call
0709 12:27:08.788553 (+  6885us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.823102 (+ 34549us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.823133 (+    31us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.823183 (+    50us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:08.823217 (+    34us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.823286 (+    69us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.823397 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:08.828567  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 125170us
I20260709 12:27:08.833289  6650 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.LeaderStepDown from 127.0.0.1:60902 (request call id 32) took 1472 ms. Trace:
W20260709 12:27:08.834007  6608 leader_election.cc:336] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.753s (SENT)
I20260709 12:27:08.833652  6650 rpcz_store.cc:276] 0709 12:27:07.360859 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.361441 (+   582us) service_pool.cc:224] Handling call
0709 12:27:08.833051 (+1471610us) spinlock_profiling.cc:243] Waited 214 ms on lock 0x7b54006167d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482104e853 00007f482601c60a 00007f481f5a27d4 00007f481f5a2762 00007f481f5a2691 00007f481f5a260c 00007f481f5a18c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:08.833171 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":492683136}
I20260709 12:27:08.834481  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:08.836532  6608 leader_election.cc:336] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.805s (SENT)
I20260709 12:27:08.836809 13323 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:08.836539  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1839) took 2012 ms. Trace:
I20260709 12:27:08.722856 13170 consensus_queue.cc:1059] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.102s
I20260709 12:27:08.837852  5959 rpcz_store.cc:276] 0709 12:27:06.823968 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.469413 (+1645445us) service_pool.cc:224] Handling call
0709 12:27:08.469849 (+   436us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:08.470185 (+   336us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.470211 (+    26us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:08.487697 (+ 17486us) log.cc:844] Serialized 26 byte log entry
0709 12:27:08.785304 (+297607us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:27:08.785337 (+    33us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.785397 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:08.836298 (+ 50901us) raft_consensus.cc:1685] finished
0709 12:27:08.836319 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.836466 (+   147us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":297154,"threads_started":1,"wal-append.queue_time_us":346791}
I20260709 12:27:08.847081  5964 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:08.829798  5865 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 19 to 18, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 18 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:08.845839  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3570) took 1438 ms. Trace:
I20260709 12:27:08.829355 13137 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 30 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:08.847777  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3565) took 1600 ms. Trace:
I20260709 12:27:08.849938  6006 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:08.850731  6647 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 18 index: 14. (index mismatch)
I20260709 12:27:08.848206  5963 rpcz_store.cc:276] 0709 12:27:07.407282 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.803882 (+1396600us) service_pool.cc:224] Handling call
0709 12:27:08.804247 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.804443 (+   196us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:27:08.820932 (+ 16489us) log.cc:844] Serialized 14 byte log entry
0709 12:27:08.845538 (+ 24606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.845584 (+    46us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:08.845623 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.845688 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.845789 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":21781,"prepare.run_cpu_time_us":53,"prepare.run_wall_time_us":55,"raft.queue_time_us":2178,"thread_start_us":37949,"threads_started":2}
I20260709 12:27:08.852455  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:08.853873  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:08.854837  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:08.855530  6651 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 18: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:08.854704  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:08.855636  6646 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:27:08.856734  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:08.857978  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:08.858687  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 188234us
I20260709 12:27:08.861773 13240 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.862309 13240 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.864537 13240 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:08.850028 13226 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:08.849488  5962 rpcz_store.cc:276] 0709 12:27:07.245850 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.787507 (+1541657us) service_pool.cc:224] Handling call
0709 12:27:08.839046 (+ 51539us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.843427 (+  4381us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.843452 (+    25us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:08.843492 (+    40us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:27:08.845708 (+  2216us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.845760 (+    52us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.845854 (+    94us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.867094  5964 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3571) took 1291 ms. Trace:
I20260709 12:27:08.868083  6043 raft_consensus.cc:2410] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 20 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:27:08.858610  6645 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:27:08.858928  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:08.869524 13307 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:08.870090  6608 leader_election.cc:336] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.948s (SENT)
W20260709 12:27:08.871309  6611 leader_election.cc:336] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.805s (SENT)
I20260709 12:27:08.873673  6109 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 15 index: 13. (index mismatch)
I20260709 12:27:08.873669  6113 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:08.874346 13170 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:08.845321 13067 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.882534 12916 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:08.882961 12916 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.883313 12916 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:08.883731 13067 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:08.884399  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:08.885027  6041 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:27:08.884907 13311 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:08.878314  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:08.876232  5964 rpcz_store.cc:276] 0709 12:27:07.556634 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.830540 (+1273906us) service_pool.cc:224] Handling call
0709 12:27:08.846141 (+ 15601us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.847982 (+  1841us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.848169 (+   187us) inbound_call.cc:177] Queueing success response
Metrics: {}
I20260709 12:27:08.864989 13321 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:08.880816 13315 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.000s
I20260709 12:27:08.879499 13226 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.881736  6649 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:27:08.902251  6646 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 11 index: 12. (index mismatch)
I20260709 12:27:08.901813  6608 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 10 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:08.881893 13175 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:08.845713 13323 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:08.890405  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:08.890973  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:08.886149  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:08.891677  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:08.892225 13176 raft_consensus.cc:3055] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:08.918568 13176 raft_consensus.cc:740] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:08.919622 13176 consensus_queue.cc:260] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.920996 13176 raft_consensus.cc:3060] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:08.892788 13137 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:08.894595  6009 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:08.924316  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:08.924952  6112 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:27:08.895035  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:08.926373  6113 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 16 index: 17. Preceding OpId from leader: term: 18 index: 18. (index mismatch)
I20260709 12:27:08.886720  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:08.883900  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:08.927192  6039 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:08.906075  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:08.908336  5966 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 11. Preceding OpId from leader: term: 14 index: 12. (index mismatch)
I20260709 12:27:08.914947 13323 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.916028  6041 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:08.916313  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:08.916612  6042 raft_consensus.cc:2410] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:27:08.911479  6037 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:27:08.904706 12866 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:08.930899  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.932819  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3209) took 1540 ms. Trace:
I20260709 12:27:08.939325  5966 rpcz_store.cc:276] 0709 12:27:07.392106 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.807500 (+1415394us) service_pool.cc:224] Handling call
0709 12:27:08.844260 (+ 36760us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.927897 (+ 83637us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.932696 (+  4799us) inbound_call.cc:177] Queueing success response
Metrics: {}
W20260709 12:27:08.933969  6043 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36260 (request call id 3056) took 1904 ms (client timeout 1511 ms). Trace:
I20260709 12:27:08.956981  5961 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:27:08.957834  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:08.940304  6043 rpcz_store.cc:269] 0709 12:27:07.029722 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:07.031273 (+  1551us) service_pool.cc:224] Handling call
0709 12:27:08.914259 (+1882986us) spinlock_profiling.cc:243] Waited 151 ms on lock 0x7b5400312ed4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:08.933890 (+ 19631us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":348167936}
I20260709 12:27:08.959774  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:08.960062  6035 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:27:08.961621  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:08.960670 12895 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:08.908588 13067 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:08.963681  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:08.931846 13305 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.033s
I20260709 12:27:08.970639 13318 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.044s
W20260709 12:27:08.970942  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 1.34965e+06us
W20260709 12:27:08.975018  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 105014us
I20260709 12:27:08.980237  5960 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34558 (request call id 3562) took 1936 ms. Trace:
I20260709 12:27:08.922173 13137 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.984413  5865 catalog_manager.cc:5697] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:08.985693  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 53222us
W20260709 12:27:09.048157  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 119510us
I20260709 12:27:09.017860  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:09.047969  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:08.994429  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:08.993839  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.053310  6037 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:27:09.065757  6647 raft_consensus.cc:2410] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 23 because replica has last-logged OpId of term: 21 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 20 index: 15.
I20260709 12:27:08.988060  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.051275  6084 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:27:09.073467  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.077780  6043 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 29 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 29.
W20260709 12:27:09.079011  6608 leader_election.cc:336] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 2.038s (SENT)
I20260709 12:27:09.049628  5960 rpcz_store.cc:276] 0709 12:27:07.043927 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.724312 (+1680385us) service_pool.cc:224] Handling call
0709 12:27:08.724780 (+   468us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:08.725210 (+   430us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.725270 (+    60us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:08.725802 (+   532us) log.cc:844] Serialized 26 byte log entry
0709 12:27:08.827539 (+101737us) raft_consensus.cc:1645] Marking committed up to 9
0709 12:27:08.827574 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:08.827622 (+    48us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:08.980000 (+152378us) raft_consensus.cc:1685] finished
0709 12:27:08.980019 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:08.980158 (+   139us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1204,"raft.run_cpu_time_us":200,"raft.run_wall_time_us":14398,"thread_start_us":101320,"threads_started":1,"wal-append.queue_time_us":173288}
W20260709 12:27:09.081102  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 120119us
I20260709 12:27:08.956161 13126 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election won for term 13
I20260709 12:27:09.078892  6609 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:08.989941 13226 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:09.118796  6643 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:27:09.094329  6040 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:27:09.120728  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:08.988265 13225 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:09.092759  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.090771  6038 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
W20260709 12:27:09.094673  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.094818  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.096223  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.094219  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.099380  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.100246  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.103889  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:08.989390 12916 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:08.991695 13323 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:09.106619 13321 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:09.153730  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:09.113071 13126 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:08.992076 13307 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader election lost for term 10. Reason: could not achieve majority
I20260709 12:27:09.086246 13302 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:09.118211 13137 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:09.122247  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:09.106488  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.143132  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.144915  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.145381 12916 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:09.146549 13314 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 15.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:09.171571  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.150600  6648 raft_consensus.cc:2410] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 19 because replica has last-logged OpId of term: 17 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:27:09.111537  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:08.992278 12866 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.173611  6084 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:09.115330  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:08.994849 12948 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:09.168432  6039 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:27:09.177414  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:08.935796 13112 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.201s
I20260709 12:27:09.158545 13321 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.150166 13315 consensus_queue.cc:1059] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.016s
W20260709 12:27:09.179713  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.180780  6041 raft_consensus.cc:2368] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 22. Current term is 23.
I20260709 12:27:09.154821  6609 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:09.179363  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.181568  6037 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:27:09.183102  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.181854  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:09.157838 13126 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:09.183224  6084 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:09.165302 13302 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.186278  6651 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:27:09.186254  6649 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 19: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:09.189371  6043 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:27:09.190330  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.194382  5961 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:27:09.197716  6642 raft_consensus.cc:1240] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:27:09.201282  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.202013  6643 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:27:09.202149  6114 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23. Ops: []
I20260709 12:27:09.196219  5961 pending_rounds.cc:85] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 13
I20260709 12:27:09.204162  5961 pending_rounds.cc:107] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:27:09.204419  5961 raft_consensus.cc:2889] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:09.206846  6038 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 19. Current term is 20. Ops: []
I20260709 12:27:09.203603  6609 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:09.205446  6118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1691) took 1648 ms. Trace:
I20260709 12:27:09.184183 13305 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:09.209654 13100 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:09.211159  6035 raft_consensus.cc:1240] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:09.179554 13321 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:09.212880  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.213546  6647 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:27:09.209695 13305 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:09.214807 13305 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:09.218264  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:09.219043  6112 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 20.
I20260709 12:27:09.220587  6117 raft_consensus.cc:1240] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 19. Current term is 20. Ops: [19.12-19.12]
I20260709 12:27:09.222856  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:09.223270  6111 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 14 index: 9. (index mismatch)
I20260709 12:27:09.223891  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.224341  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:09.224565  6650 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 20.
I20260709 12:27:09.225469  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.209344  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.200615 13307 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:09.226997 13307 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:09.227403 13307 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:09.234087  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:09.236369  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.233572  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.239615  6647 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 30: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:27:09.238750  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 151145us
I20260709 12:27:09.239789 12948 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:09.238765  5914 auto_rebalancer.cc:629] Failed to schedule move for tablet 382d3eda9eaa4b9c96393a12d9f2be5c: Illegal state: Replica 0557a7246c8945b99e5215c99d4ddf9c is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 22 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:09.240868  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:09.242022  6117 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:09.189502 13148 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:09.198871 13302 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:09.251431  6109 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 20.
I20260709 12:27:09.208317  6118 rpcz_store.cc:276] 0709 12:27:07.557156 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.473993 (+916837us) service_pool.cc:224] Handling call
0709 12:27:08.474361 (+   368us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.493481 (+ 19120us) raft_consensus.cc:1534] Early marking committed up to index 15
0709 12:27:08.771020 (+277539us) log.cc:844] Serialized 14 byte log entry
0709 12:27:09.184585 (+413565us) log.cc:844] Serialized 14 byte log entry
0709 12:27:09.205078 (+ 20493us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:09.205132 (+    54us) raft_consensus.cc:1645] Marking committed up to 15
0709 12:27:09.205180 (+    48us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.205250 (+    70us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.205382 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":5266,"prepare.queue_time_us":220267,"prepare.run_cpu_time_us":62,"prepare.run_wall_time_us":64,"raft.queue_time_us":2419,"raft.run_wall_time_us":12310,"spinlock_wait_cycles":108369024,"thread_start_us":642210,"threads_started":2}
I20260709 12:27:09.267710  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:09.270004  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.270316  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:09.271121  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:09.271865  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.272145 13126 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.272686  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:09.186575 13137 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:09.276876  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.277105  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.277557  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.316555  6649 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:27:09.277722  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 8 index: 9 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.278424 12895 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:09.278924 13306 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:27:09.283082  6009 connection.cc:256] RPC call timeout handler was delayed by -2.0606591060000028s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16310000000000002s for a response
W20260709 12:27:09.323446  6009 connection.cc:256] RPC call timeout handler was delayed by -1.874625362000188s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1767s for a response
I20260709 12:27:09.284358  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:09.273658 13148 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:09.291307  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50534.4us
I20260709 12:27:09.291888 13318 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
W20260709 12:27:09.291914  5914 auto_rebalancer.cc:629] Failed to schedule move for tablet 06e81868728a4e2592f3ee289cff3431: Illegal state: Replica f1bb8e63c2b448cdafd51f05d277c741 is not leader of this config. Role: FOLLOWER. Consensus state: current_term: 17 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
W20260709 12:27:09.292299  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 213426us
W20260709 12:27:09.275731  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 79219.7us
I20260709 12:27:09.350095  6609 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:09.350924 12866 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:09.351635 12866 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:09.351986 12866 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.352317 12866 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:09.300967  5961 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3205) took 2322 ms. Trace:
I20260709 12:27:09.353615  5961 rpcz_store.cc:276] 0709 12:27:06.978742 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.701123 (+1722381us) service_pool.cc:224] Handling call
0709 12:27:08.701488 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:08.903535 (+202047us) spinlock_profiling.cc:243] Waited 36.8 ms on lock 0x7b54001a2aa0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fc9a1d 00007f4820fb01a4 00007f4821032447 00007f482104afe7 00007f482104c7de 00007f4821056b49 00007f4821057416 00007f4821053d8f 00007f482105383e 00007f4826018419
0709 12:27:09.300640 (+397105us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.300894 (+   254us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":84549376}
I20260709 12:27:09.317644 13137 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.355060 13137 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:09.304486  6115 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 24.
I20260709 12:27:09.356796  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.358493  6035 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:27:09.320719 12895 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.359187 12895 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:09.306437  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:09.314644  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.316166  6644 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
I20260709 12:27:09.294072 13305 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:09.363775 13067 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.364493 13305 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:09.364382 13067 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.365314  6112 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 19. Current term is 20. Ops: []
I20260709 12:27:09.322865  6650 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 10.
I20260709 12:27:09.322958 13306 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:09.367432 13306 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:09.329516 13148 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:09.344309 13126 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:09.369752  6009 connection.cc:256] RPC call timeout handler was delayed by -1.6649428929999885s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.1519s for a response
W20260709 12:27:09.370332  6609 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:09.374760  6611 leader_election.cc:336] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.757s (SENT)
W20260709 12:27:09.348629  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:09.376133  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.378050  5967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3206) took 2133 ms. Trace:
W20260709 12:27:09.375903  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:09.388250  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.380164 13157 raft_consensus.cc:3055] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:09.400112 13157 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:09.400246  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 12 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:09.401077 13157 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:09.401516  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:09.402429 13157 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:09.386234  5967 rpcz_store.cc:276] 0709 12:27:07.245010 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:08.780151 (+1535141us) service_pool.cc:224] Handling call
0709 12:27:08.837103 (+ 56952us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:08.837428 (+   325us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:08.837456 (+    28us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:08.838016 (+   560us) log.cc:844] Serialized 26 byte log entry
0709 12:27:09.170085 (+332069us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:09.170121 (+    36us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:09.170184 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:09.377824 (+207640us) raft_consensus.cc:1685] finished
0709 12:27:09.377842 (+    18us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:09.377994 (+   152us) inbound_call.cc:177] Queueing success response
Metrics: {"thread_start_us":331691,"threads_started":1,"wal-append.queue_time_us":538064}
I20260709 12:27:09.414937  6115 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 18.11, Last appended by leader: 10, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:27:09.410730 13126 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:09.422942 13126 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:09.425118 13126 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:09.403318 13305 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:09.426913 13100 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:09.410687 13067 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:09.406844  6009 connection.cc:256] RPC call timeout handler was delayed by -1.0030014549997759s: this may be due to a process-wide pause such as swapping, logging-related delays, or allocator lock contention. Will allow extra 0.16010000000000002s for a response
I20260709 12:27:09.427407 13100 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:09.431285 13321 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.440061  6648 raft_consensus.cc:2393] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 12: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:27:09.458293  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 56873.1us
I20260709 12:27:09.460903  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:09.461738  6642 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:27:09.407025 13302 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:09.461037  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 137249us
I20260709 12:27:09.428092 12916 raft_consensus.cc:3055] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:09.468948  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:09.475348  6609 leader_election.cc:400] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 22. Current term is 23.
I20260709 12:27:09.476049  6609 leader_election.cc:403] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:09.459509 13176 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader election lost for term 12. Reason: could not achieve majority
I20260709 12:27:09.478345 12895 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.480778 12895 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:09.486091  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 337613us
I20260709 12:27:09.491299  6082 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:09.468952 13321 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:09.469854 12916 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:09.481879 13100 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.482080 13302 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:09.527773  5934 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:09.507135 13323 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.025s
W20260709 12:27:09.537010  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 266888us
W20260709 12:27:09.539964  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 57480.1us
W20260709 12:27:09.546217  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.518314 13176 consensus_queue.cc:1059] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 12:27:09.527426 12895 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:27:09.534255 13306 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.555203 13306 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:09.531939 13307 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.520380 12866 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.569893  6645 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:09.568934  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:09.568765 12895 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.011s
I20260709 12:27:09.563603 13100 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:09.584789 13148 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.585819 12866 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:09.563815 12916 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.588217 12916 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:09.558380 13137 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.595953  6643 raft_consensus.cc:2393] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 19: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:27:09.599203  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.600191 13137 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:09.607700  6642 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 23.
I20260709 12:27:09.613722 13067 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 22. Current term is 23.
W20260709 12:27:09.630815  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.616948 12895 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:09.643499  6081 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:09.641927 13148 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:09.642737 12895 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:09.674700 13305 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:27:09.676079  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 107239us
W20260709 12:27:09.677577  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 496815us
I20260709 12:27:09.673511 12895 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:27:09.701849  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 58464.7us
W20260709 12:27:09.697762  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 198852us
I20260709 12:27:09.702950 13307 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:09.712690  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:09.713335  6044 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:09.715619  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:09.716291  6039 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:09.722703  6044 raft_consensus.cc:2468] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:27:09.724860  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:09.725576  6038 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:09.728065  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:09.728230  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:09.728861  6036 raft_consensus.cc:2368] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13.
I20260709 12:27:09.729048  6040 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:27:09.738775  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 265066us
W20260709 12:27:09.740187  6009 leader_election.cc:336] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.662s (SENT)
I20260709 12:27:09.740558  6009 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:09.742748  6039 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:27:09.744590  6040 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:09.699180 13305 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:09.709996  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:09.746779  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 43950us
I20260709 12:27:09.751264  6038 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
W20260709 12:27:09.753386  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.753708  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:09.755759  6081 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:09.755262  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:09.770413  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:09.771128  6644 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:09.765796  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:09.772782  6649 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:27:09.777127  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:09.777644  5932 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.787007  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:09.787746  5967 raft_consensus.cc:3060] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:27:09.788758  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 270418us
I20260709 12:27:09.789717  6642 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:09.787503  6646 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEARNER]: Advancing to term 18
I20260709 12:27:09.764873 12925 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:09.765106 13112 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:27:09.792382  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:09.793848  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:09.796612  5961 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:09.801919  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:09.807365  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 103175us
I20260709 12:27:09.813954  5961 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
W20260709 12:27:09.815215  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 75068.2us
I20260709 12:27:09.816305  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.818169 13226 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:27:09.820955 13356 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:27:09.823273  6646 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:27:09.824554  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.827214  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.830018 13226 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:09.830490 13305 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.834844  6042 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:09.838979  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:09.842519  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:09.824570  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:09.847690 13176 raft_consensus.cc:3055] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Stepping down as leader of term 17
W20260709 12:27:09.848392  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:09.849467 13368 log.cc:927] Time spent T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.055s	user 0.001s	sys 0.000s
W20260709 12:27:09.915498  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.916428  6609 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:27:09.916877  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 123129us
I20260709 12:27:09.918641 13367 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:27:09.919409 13367 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:27:09.922612  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 173946us
I20260709 12:27:09.921689  5934 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:09.924116  6609 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:09.925026  6609 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:09.925707 13137 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:09.926251 13137 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:09.926636 13307 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:09.927205 13307 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:09.928056 13307 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.927207 13137 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 14.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.927397 12866 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:09.931020 12866 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:27:09.931620 13358 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:27:09.932041 12866 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:09.936019 13318 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:09.936473 13318 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:09.936868 13318 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:09.848173 13176 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:09.926349  6609 leader_election.cc:400] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13.
I20260709 12:27:09.938616  6609 leader_election.cc:403] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Cancelling election due to peer responding with higher term
W20260709 12:27:09.943149  6009 leader_election.cc:336] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.767s (SENT)
I20260709 12:27:09.943672  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:09.944448 12916 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:09.944402 12895 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:09.937884  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 162794us
I20260709 12:27:09.937359  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:09.947464  6644 raft_consensus.cc:2468] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:27:09.949527  5967 raft_consensus.cc:2468] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 23.
W20260709 12:27:09.953563  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:09.954137  6609 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:09.952983  6009 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:09.938174 13370 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:09.978545  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:09.966147 13067 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Advancing to term 13
I20260709 12:27:09.992241  6009 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:09.993307  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 70010.3us
I20260709 12:27:09.994501  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.002919  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.022861  6114 raft_consensus.cc:2393] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 19: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:09.976774 13240 raft_consensus.cc:2804] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:10.025914  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 14 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.026175  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:10.022729  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 56347.1us
W20260709 12:27:10.027626  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 187340us
I20260709 12:27:10.028596  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.029340  6109 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:27:09.974385 13174 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:10.032452  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.030573  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.034770  6116 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:27:10.030879  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.035820  6111 raft_consensus.cc:2393] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 20: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:10.028193  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.002547 13308 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.002336 12925 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:10.020565 13305 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:10.037627  6112 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 16. (index mismatch)
W20260709 12:27:10.083508  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 146246us
W20260709 12:27:10.089586  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 61663us
I20260709 12:27:10.038429  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.024108 12916 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:10.093631  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.093865  6084 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:10.084033  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.093796  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.094787  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.090799  6114 raft_consensus.cc:2393] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 19: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:10.089474  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:10.092763  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:10.093087 13375 log.cc:927] Time spent T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.070s	user 0.000s	sys 0.000s
I20260709 12:27:10.089138 13308 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.093472 13157 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:10.003410 13311 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.031255 12895 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:10.102125  6649 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:10.019063 13370 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.032351 13302 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.101296  6009 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:10.095961  6113 raft_consensus.cc:2376] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18. Re-sending same reply.
I20260709 12:27:10.109167  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.002148 13373 consensus_queue.cc:1059] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.111s
I20260709 12:27:10.074584 12925 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.077066 12948 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:10.087182 13240 raft_consensus.cc:697] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:10.112777  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.114217  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.127159  6109 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 13.
I20260709 12:27:10.108860  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:10.128281  6114 raft_consensus.cc:2393] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 22: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:10.083426 13112 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.037s
I20260709 12:27:10.119827  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.133040  6110 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:27:10.123958  6111 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 23.
I20260709 12:27:10.020442 13369 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.108s
W20260709 12:27:10.118230  6611 leader_election.cc:336] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.750s (SENT)
I20260709 12:27:10.140825 13383 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:27:10.140436  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.140105 13353 raft_consensus.cc:2804] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:10.033859 13176 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.111842 13157 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:10.099102 13100 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.030s
I20260709 12:27:10.161628  6611 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:10.125422 13252 raft_consensus.cc:2804] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:27:10.097437 13305 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.125648 12925 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:10.090404 13352 consensus_queue.cc:1059] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 25.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.072s
W20260709 12:27:10.171120  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 82074us
W20260709 12:27:10.180873  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 155511us
W20260709 12:27:10.185350  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 78898.6us
I20260709 12:27:10.128403 12948 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:10.131098 13311 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:10.211783  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 93580.1us
I20260709 12:27:10.212438  6115 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:27:10.164412 12866 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.213811  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:10.162243 13302 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.188391 13112 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:10.161285 13382 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:10.185010 13306 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:10.186517 13353 raft_consensus.cc:697] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:27:10.211887 13372 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
I20260709 12:27:10.189944 13252 raft_consensus.cc:697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:27:10.221846  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 131604us
W20260709 12:27:10.219537 13371 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.082s	user 0.001s	sys 0.000s
I20260709 12:27:10.218482  6081 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:10.212873 13100 consensus_queue.cc:1243] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer 24012af7747d4c4ea89c3da2ff950099 log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 10
I20260709 12:27:10.243419  6118 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:27:10.220602 13307 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:27:10.221817 13176 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:10.221827 13112 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:10.240628 13382 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.246309  6084 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:10.256129  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:10.259436 13382 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:10.243918 13306 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.238646 13240 consensus_queue.cc:237] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 10.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.261173 13112 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.14, Last appended by leader: 14, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.263356 13112 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:27:10.261153  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 46453.7us
I20260709 12:27:10.261318 13370 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:10.236176 12866 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.263247 13306 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:10.265164 13364 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.333s	user 0.002s	sys 0.002s
I20260709 12:27:10.257728 13369 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:10.280987  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 92789.6us
I20260709 12:27:10.265056 12895 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:10.269644 13352 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:10.286067 13308 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:10.286522 13354 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.300s	user 0.000s	sys 0.002s
I20260709 12:27:10.287626 13373 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:10.287957  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:10.269271 13392 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:27:10.287565 13379 log.cc:927] Time spent T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.091s	user 0.001s	sys 0.000s
I20260709 12:27:10.282740 13370 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:10.287529 13305 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:10.315644  5932 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:10.312564  5934 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:10.323001  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.317381 12866 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:10.295403 12895 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:10.312603 13370 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:10.328426  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 62412.7us
I20260709 12:27:10.307369 13373 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:10.330495  5934 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:10.311302 13352 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:10.285089 13369 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.316751 13383 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:10.329679 13370 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:27:10.329914 13386 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.070s	user 0.001s	sys 0.000s
I20260709 12:27:10.330138 12895 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:10.334024 13373 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:10.342303  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.342921 13311 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:10.343068  5967 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 14. (term mismatch)
I20260709 12:27:10.339437 13383 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:10.339104 13393 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Leader pre-election won for term 11
I20260709 12:27:10.329159 13305 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.012s
I20260709 12:27:10.337601 13391 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 29 FOLLOWER]: Leader pre-election won for term 30
I20260709 12:27:10.295326 13252 consensus_queue.cc:237] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.348172 13387 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:27:10.326711 13392 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.361340  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.362080  5961 raft_consensus.cc:2368] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13.
I20260709 12:27:10.362452  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.363226  5962 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 20: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:10.363054  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.363662  5963 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:10.298250 13353 consensus_queue.cc:237] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.364638  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:10.367383 13365 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.453s	user 0.002s	sys 0.002s
I20260709 12:27:10.351395  5967 pending_rounds.cc:85] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 13
I20260709 12:27:10.368161  5967 pending_rounds.cc:107] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:27:10.368432  5967 raft_consensus.cc:2889] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:10.337797 13398 raft_consensus.cc:2764] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election decision vote started in defunct term 22: won
I20260709 12:27:10.371757  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.363546 13384 raft_consensus.cc:3055] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:27:10.378106  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 46580.1us
I20260709 12:27:10.357590 13383 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:10.379851  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:10.382189  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.358374 13391 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 29 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.357302 13393 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:10.390424 13391 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:10.411222  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:10.370719 13387 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:10.381107 13384 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:10.383749 13302 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:10.419631 13393 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:10.427618  5960 raft_consensus.cc:2368] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20.
I20260709 12:27:10.421056 13369 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:10.421780  5932 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:10.421630 12925 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.379747 13352 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.13, Last appended by leader: 13, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.380219 13311 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.422044 13402 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.005s
I20260709 12:27:10.458938  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:10.458295  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.466933  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:10.459862  5932 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:10.451212 13067 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader election lost for term 12. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13.
I20260709 12:27:10.474258  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.472090  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.478824  5962 raft_consensus.cc:2410] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 18 because replica has last-logged OpId of term: 17 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 11.
W20260709 12:27:10.479734  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 211021us
I20260709 12:27:10.457438 13311 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:10.482640  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.487439  5963 raft_consensus.cc:2368] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 22. Current term is 23.
W20260709 12:27:10.473479 13137 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.536s	user 0.008s	sys 0.016s
W20260709 12:27:10.489223  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.457999 13395 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:10.492159  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.492439  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.495646  5962 raft_consensus.cc:2410] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
W20260709 12:27:10.489812 13137 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.009s	sys 0.016s
I20260709 12:27:10.527688 13398 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:10.528249 13398 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:10.528606 13398 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:27:10.532280 13367 consensus_meta.cc:287] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.612s	user 0.005s	sys 0.005s
I20260709 12:27:10.532680 13367 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:10.537775  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.540046  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.549273  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:10.554910 13318 consensus_meta.cc:287] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.618s	user 0.011s	sys 0.001s
I20260709 12:27:10.555414 13318 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:10.542783 13387 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:10.558446  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:10.559149  6649 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:27:10.560720  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:10.561208  6117 raft_consensus.cc:1275] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 22 index: 16. (index mismatch)
I20260709 12:27:10.554756  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:10.562477  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.563324  5964 raft_consensus.cc:2410] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 15 because replica has last-logged OpId of term: 12 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 11 index: 10.
I20260709 12:27:10.564109  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:10.564877  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:10.565531  5968 raft_consensus.cc:2368] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13.
I20260709 12:27:10.566708  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.566991  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.567597  5966 raft_consensus.cc:2393] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 16: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:10.568255  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.568399  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.568944  6115 raft_consensus.cc:2393] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:10.569092  5966 raft_consensus.cc:2393] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 16: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:10.494709 13302 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.067s
I20260709 12:27:10.545317 12948 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:10.564693  6109 raft_consensus.cc:2376] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19. Re-sending same reply.
I20260709 12:27:10.542006  6112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:27:10.569882  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.566313  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.570417  5967 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:10.575344  5962 pending_rounds.cc:85] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 10
I20260709 12:27:10.575542  6112 raft_consensus.cc:606] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:10.578016  5962 pending_rounds.cc:107] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 13.11
I20260709 12:27:10.578176  6112 raft_consensus.cc:614] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:10.575793  5966 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:10.578845  6608 leader_election.cc:400] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13.
I20260709 12:27:10.572603  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:10.566725  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:10.579869  6110 raft_consensus.cc:2410] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 12:27:10.572306  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.579746  6116 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:27:10.581769  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:10.583669  6608 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:10.584700 13058 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:10.586679 13388 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:10.588090  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.576910  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.590106  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:10.590660  6117 raft_consensus.cc:2393] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 20: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:10.594023  6650 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:10.594971  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.596495  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.597131  6113 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:10.597893  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.599154  5964 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:27:10.603204 13406 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.067s	user 0.000s	sys 0.000s
I20260709 12:27:10.604909 13392 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:10.606525 12925 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:10.607522 13311 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:10.609688  6611 leader_election.cc:336] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Timed out: RequestConsensusVote RPC to 127.4.181.67:39787 timed out after 1.656s (SENT)
I20260709 12:27:10.610101  6611 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:10.610657 13384 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:10.611902 13384 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:27:10.614534  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.615484  6608 leader_election.cc:400] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20.
I20260709 12:27:10.616730  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:10.619923  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:10.623224  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:10.624269  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.580910  5962 raft_consensus.cc:2889] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:10.628875  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:10.630638  6649 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: [11.12-11.12]
I20260709 12:27:10.632790  6116 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:10.633658  5964 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:27:10.634503  6608 leader_election.cc:400] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 22. Current term is 23.
I20260709 12:27:10.635510  6608 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:10.637130 13252 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:27:10.638417  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 178633us
I20260709 12:27:10.639791  5932 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:10.653512  6608 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:10.655822  5932 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:10.657532  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:10.658248  6118 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20. Ops: []
I20260709 12:27:10.661166 13226 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:10.634065 13314 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.647373 13388 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:10.632647 12866 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.038s
I20260709 12:27:10.681514  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.656107 13321 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:10.622272 13370 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.685122  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.685884  6116 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 22.
I20260709 12:27:10.688774 13415 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:10.673123 13418 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.669128 13369 raft_consensus.cc:2764] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 18: won
I20260709 12:27:10.689356 13415 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:10.733875  5959 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 21: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:27:10.735702  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.715806 13389 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:10.736865  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 81144.9us
I20260709 12:27:10.694288 13318 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:10.680580 13314 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:10.742403 13402 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:10.715991 12895 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:10.746589  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.747551  6118 raft_consensus.cc:2410] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:27:10.738917 13369 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:10.749184  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 14 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:10.787257  6113 raft_consensus.cc:2410] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 16 because replica has last-logged OpId of term: 15 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 13.
I20260709 12:27:10.750200  6116 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:10.750136 13419 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:10.752230 13058 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:10.740382 13418 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:10.756011  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:10.756320 13362 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:10.758029 13415 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:10.759311  6611 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:10.760610  6039 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:27:10.818711  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:10.819927  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:10.820441  6039 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 22.
I20260709 12:27:10.821209  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:10.761339  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:10.822412  6035 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:10.811187 13369 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:10.827605 13382 consensus_meta.cc:287] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.555s	user 0.007s	sys 0.000s
I20260709 12:27:10.762805  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:10.828262  6042 raft_consensus.cc:2368] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19.
I20260709 12:27:10.763464  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:10.828851  6039 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:27:10.829188  6044 raft_consensus.cc:2393] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 17: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:10.764158  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:10.830032  6038 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:10.764868  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:10.765308 13176 consensus_queue.cc:1059] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:10.831283 13176 raft_consensus.cc:3055] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:27:10.831601 13176 raft_consensus.cc:740] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:10.832077  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.765890  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:10.832623 13382 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.833367  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.834111  5961 raft_consensus.cc:2393] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 19: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:10.767647 13393 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.888049 13393 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:10.778748  5967 raft_consensus.cc:1275] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:27:10.888609  5967 pending_rounds.cc:85] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 13
I20260709 12:27:10.888859  5967 pending_rounds.cc:107] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:27:10.889071  5967 raft_consensus.cc:2889] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:10.890264  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:10.891396  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.780664  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.780913  5966 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 22.
I20260709 12:27:10.895179  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.896394  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:10.897439  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:10.781522  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.898977  5964 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 18: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:10.899847  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:10.900544  5964 raft_consensus.cc:2393] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 19: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:10.900404 13323 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:10.901113 13323 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.901377  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.782055  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:10.783964  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.745496 13402 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:10.785081  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.903643 13402 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:10.904176  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.904399  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.904938 13384 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.905443 13384 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.905997  5959 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:27:10.741878 13389 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:10.907887  5959 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 20. Current term is 21. Ops: []
I20260709 12:27:10.908725 13384 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:10.806520 13314 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:10.816596  6043 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:27:10.816781  5968 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 19. Current term is 20. Ops: []
I20260709 12:27:10.903301 13323 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:10.762091  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:10.893155  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:10.816977 13383 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.773864 13391 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 30 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.778002 13373 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:10.857090  6035 raft_consensus.cc:2468] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:10.857661 12895 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:10.858603 13382 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:10.832510 13176 consensus_queue.cc:260] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:10.856987 13398 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.760696 13370 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:10.814265 13367 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:10.868858 13418 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:10.813760 13419 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:10.836634  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 77408.6us
I20260709 12:27:10.828936 13369 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:10.855724 13058 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:10.870834  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:10.871655 13157 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:10.873409  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:10.874809  6647 pending_rounds.cc:85] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 10
I20260709 12:27:10.875927  6649 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:27:10.876482  6084 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:10.944628  5961 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
W20260709 12:27:10.945950  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 69549.5us
I20260709 12:27:10.877327 13387 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:10.956108 13402 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:10.959043 13305 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:10.880962  6037 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:10.884704  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:10.961493 13419 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:10.961897  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:10.778308  6036 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:27:10.962200 13403 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:10.914760  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:10.903095  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 121107us
I20260709 12:27:10.958191 13373 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:10.964497  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:10.964825 13058 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:10.915225  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:10.965723 13058 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.912200  5960 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:27:10.923738  5968 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:27:10.978615 13425 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 7, Time since last communication: 0.001s
I20260709 12:27:10.933518  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:10.984354 13391 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 30 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:10.908051 13389 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:10.941915  5965 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 30: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:27:10.944267  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 231335us
I20260709 12:27:10.945147  6647 pending_rounds.cc:107] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted CHANGE_CONFIG_OP operation due to leader change: 16.11
I20260709 12:27:10.947223 13176 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:10.943827 13367 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:10.948480  6611 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:10.951155  5865 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 322) took 9991 ms. Trace:
I20260709 12:27:10.947285 13308 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:10.951854 13398 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:10.952674  6643 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:27:10.955464  6649 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 12:27:10.994210  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 45797.2us
I20260709 12:27:10.879884  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:10.898418  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:10.968426  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:10.969182 13240 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:10.995707  6611 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:10.969591 13383 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:10.971572 13403 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:10.970016 13362 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:10.924511 13323 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:27:10.976061  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:10.976622 13369 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:10.977332 13395 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:27:10.978863  5866 catalog_manager.cc:5697] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 17 to 20, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 20 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:10.990756  6647 raft_consensus.cc:2917] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEARNER]: Aborting config change with OpId 16.11: Aborted: Op aborted by new leader
I20260709 12:27:10.990317  5968 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:10.991286  5964 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 25. Current term is 26. Ops: []
W20260709 12:27:10.934476  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 308354us
I20260709 12:27:10.996017  6082 leader_election.cc:400] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19.
I20260709 12:27:11.000339  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:11.001036  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:11.000385  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 120584us
I20260709 12:27:11.012847  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:11.015913  6611 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:11.018329  6082 leader_election.cc:403] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:10.993782 13308 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.019176  6647 raft_consensus.cc:2889] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 18 NON_PARTICIPANT]: CHANGE_CONFIG_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:11.020242  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:11.000665 13307 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:11.010878 13252 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader election won for term 13
I20260709 12:27:11.015057 13362 consensus_queue.cc:1243] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer 0557a7246c8945b99e5215c99d4ddf9c log is divergent from this leader: its last log entry 16.13 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 12
I20260709 12:27:10.992679  5865 rpcz_store.cc:276] 0709 12:27:00.960080 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:00.960324 (+   244us) service_pool.cc:224] Handling call
0709 12:27:10.951071 (+9990747us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:09.675379 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:09.809027 (+133648us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:09.809073 (+    46us) write_op.cc:435] Acquired schema lock
0709 12:27:09.809090 (+    17us) tablet.cc:662] Decoding operations
0709 12:27:09.809763 (+   673us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:09.809867 (+   104us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:09.809897 (+    30us) tablet.cc:685] Acquiring locks for 4 operations
0709 12:27:09.810381 (+   484us) tablet.cc:701] Row locks acquired
0709 12:27:09.810432 (+    51us) write_op.cc:260] PREPARE: finished
0709 12:27:09.810623 (+   191us) write_op.cc:270] Start()
0709 12:27:09.810762 (+   139us) write_op.cc:276] Timestamp: P: 1783600029810563 usec, L: 0
0709 12:27:09.810797 (+    35us) op_driver.cc:348] REPLICATION: starting
0709 12:27:09.811432 (+   635us) log.cc:844] Serialized 1751 byte log entry
0709 12:27:10.219345 (+407913us) op_driver.cc:464] REPLICATION: finished
0709 12:27:10.377905 (+158560us) write_op.cc:301] APPLY: starting
0709 12:27:10.395966 (+ 18061us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:10.553791 (+157825us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:10.553900 (+   109us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:10.570405 (+ 16505us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:10.570724 (+   319us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=8,key_file_lookups=8,delta_file_lookups=8,mrs_lookups=0
0709 12:27:10.570800 (+    76us) write_op.cc:312] APPLY: finished
0709 12:27:10.571171 (+   371us) log.cc:844] Serialized 49 byte log entry
0709 12:27:10.593189 (+ 22018us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:10.595196 (+  2007us) write_op.cc:454] Released schema lock
0709 12:27:10.595256 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:10.595700 (+   444us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:10.595728 (+    28us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":452859,"reported_tablets":34,"child_traces":[["op",{"apply.queue_time_us":129689,"apply.run_cpu_time_us":8955,"apply.run_wall_time_us":238326,"cfile_cache_hit":18,"cfile_cache_hit_bytes":20855,"num_ops":4,"prepare.queue_time_us":408046,"prepare.run_cpu_time_us":11729,"prepare.run_wall_time_us":270754,"raft.queue_time_us":168737,"raft.run_cpu_time_us":11384,"raft.run_wall_time_us":167062,"replication_time_us":377157,"thread_start_us":448135,"threads_started":4,"wal-append.queue_time_us":140596}]]}
I20260709 12:27:11.000852 12866 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:11.000514 13100 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:11.013609 13398 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:11.038679  5866 catalog_manager.cc:5697] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 8 to 11, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 11 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:11.040766  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.041234  5866 catalog_manager.cc:5697] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 18 to 19, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 19 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.022046 13308 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:11.041975 13318 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:11.043704 13148 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.010s
I20260709 12:27:11.047147 13252 raft_consensus.cc:697] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:11.048103 13252 consensus_queue.cc:237] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 11.10, Last appended by leader: 10, Current term: 13, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.049352  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:11.052309  5967 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:27:11.053498  6082 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:11.054842  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:11.059170  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 54112.8us
I20260709 12:27:11.058730  5866 catalog_manager.cc:5697] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 14 to 17, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 17 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.058415 12916 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:11.061812 12916 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.056715 13305 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:11.063971 13240 consensus_queue.cc:1048] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:11.048650 13367 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:11.034755 13388 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:11.065217 13388 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:11.024986 13400 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19.
I20260709 12:27:11.028863 13391 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:11.027266 13402 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:11.059859  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 47092.8us
I20260709 12:27:11.067859  6611 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:11.027532 12895 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.056s
I20260709 12:27:11.095055  6043 pending_rounds.cc:85] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 12
I20260709 12:27:11.095443  6043 pending_rounds.cc:107] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 16.13
I20260709 12:27:11.095685  6043 raft_consensus.cc:2889] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:11.085628  5934 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:11.098533  5934 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:11.056738 13100 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:11.099515  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:11.060274 13148 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:11.098744  5866 catalog_manager.cc:5697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.060990  6082 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:11.062187 12916 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:11.060570 13318 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:11.083933 13314 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.103782  6115 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21. Ops: []
W20260709 12:27:11.104784  6608 leader_election.cc:336] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.757s (SENT)
I20260709 12:27:11.107024  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:11.094732 13387 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:11.110970  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:11.116099  6116 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 26.
I20260709 12:27:11.117444  5934 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:11.097400 13391 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:11.122617  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:11.100440 13240 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:11.123665  5866 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 18 to 21, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 21 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.132328  6113 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:11.100519 13100 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:11.127276  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:11.102806 13395 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:11.105183 13419 raft_consensus.cc:2804] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:11.133916  6109 raft_consensus.cc:2368] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19.
I20260709 12:27:11.134971  6611 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:11.104625 13318 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.091241 13431 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.042s
I20260709 12:27:11.066145 13388 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:11.254798  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:11.278584  6608 leader_election.cc:336] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.930s (SENT)
I20260709 12:27:11.110409 13323 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:11.240170  5866 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 20 to 21, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 21 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.122105 13367 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:27:11.155336  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:11.154342 13321 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:11.168067  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:11.129246 13369 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader pre-election won for term 25
W20260709 12:27:11.529515  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 366721us
W20260709 12:27:11.533723  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.529016  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:11.209030  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 218601us
I20260709 12:27:11.196080  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:11.551908  6115 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 23: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:27:11.545832  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 267278us
W20260709 12:27:11.221290 13434 log.cc:927] Time spent T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
W20260709 12:27:11.244068 13430 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.185s	user 0.003s	sys 0.000s
I20260709 12:27:11.548259  6038 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 14.
I20260709 12:27:11.484405 13394 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 29 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:11.549554  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 326117us
I20260709 12:27:11.547410  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:11.593106  6116 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:11.549506  5965 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: []
W20260709 12:27:11.550254  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 415352us
W20260709 12:27:11.530514  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 403932us
W20260709 12:27:11.552613  6608 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.694s (SENT) [suppressed 38 similar messages]
I20260709 12:27:11.567297 13100 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:11.537482 12895 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.132794 13240 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:11.531160 13318 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:11.602200  6611 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:11.552547  5866 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 15 to 16, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 16 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:11.166963 13252 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.163924 13433 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 19.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.463s
I20260709 12:27:11.595567  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:11.578927 13352 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.123147 13314 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.599092 13387 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.599805  6009 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:11.155709 13067 consensus_queue.cc:1059] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.424s
I20260709 12:27:11.547672 13419 raft_consensus.cc:697] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:11.135670 13383 consensus_queue.cc:1059] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 22.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.444s
I20260709 12:27:11.249961 13308 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.554260 13398 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:11.613605  5965 raft_consensus.cc:3055] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Stepping down as leader of term 11
I20260709 12:27:11.613981  5967 raft_consensus.cc:1240] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:27:11.614207  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:11.614584  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:11.537124 13403 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.594678 13306 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:11.615828  6109 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 23.
I20260709 12:27:11.553489 13369 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:11.607134 13240 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:11.624353  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:11.291592 13391 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.630432  5965 raft_consensus.cc:740] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:11.637095 12925 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.004s
I20260709 12:27:11.606799 12895 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:11.638370  5960 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 30: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:11.624296 13367 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:11.637321  5962 raft_consensus.cc:2393] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 11: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:11.639559 13226 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:11.615155 13394 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 29 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.634581 13306 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.638127 13369 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:11.653939  5934 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:11.623759 13352 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.621310 13252 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:11.626389 13387 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:11.634058 13398 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:11.652285  5965 consensus_queue.cc:260] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.12, Last appended by leader: 12, Current term: 11, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.659060  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:11.660389  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1711) took 1104 ms. Trace:
I20260709 12:27:11.663187  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:11.642719 13433 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:11.657613 13306 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:11.667433  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:11.636704 13403 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.659463 13431 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:11.684302  5965 raft_consensus.cc:3060] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:11.685065  6647 raft_consensus.cc:2393] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 19: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:11.686410  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:11.686992  6647 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:11.685559 13100 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:11.692144  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:11.691000 13314 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:11.693838 13403 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:11.686157 12925 raft_consensus.cc:3055] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:27:11.695909 12925 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:11.656121 13367 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.661952 13383 consensus_queue.cc:1059] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:27:11.665897  6114 rpcz_store.cc:276] 0709 12:27:10.552741 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.570517 (+ 17776us) service_pool.cc:224] Handling call
0709 12:27:10.570865 (+   348us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:10.593355 (+ 22490us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:10.593385 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:10.671741 (+ 78356us) log.cc:844] Serialized 26 byte log entry
0709 12:27:10.930294 (+258553us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:10.941619 (+ 11325us) log.cc:844] Serialized 14 byte log entry
0709 12:27:10.941879 (+   260us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:10.941956 (+    77us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:10.962129 (+ 20173us) spinlock_profiling.cc:243] Waited 2.88 ms on lock 0x7b180049f480. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df67522 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:27:11.243634 (+281505us) spinlock_profiling.cc:243] Waited 1.83 ms on lock 0x7b240020b4d8. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481dded9c4 00007f481ddebacb 00007f481dfa6dc9 00007f481dfa6a55 00007f481dfa609d 00007f4820bd810e 00007f4820bef88c 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221
0709 12:27:11.656657 (+413023us) raft_consensus.cc:1685] finished
0709 12:27:11.656678 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:11.656818 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":4687,"prepare.queue_time_us":8328,"prepare.run_cpu_time_us":60,"prepare.run_wall_time_us":937,"raft.queue_time_us":24535,"raft.run_cpu_time_us":144,"raft.run_wall_time_us":2517,"spinlock_wait_cycles":10832128,"thread_start_us":213803,"threads_started":1,"wal-append.queue_time_us":307712}
I20260709 12:27:11.703982  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:27:11.691290 13443 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.059s	user 0.000s	sys 0.001s
I20260709 12:27:11.712015  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:11.712751  6650 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:27:11.713817  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 162472us
W20260709 12:27:11.717275  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 117540us
I20260709 12:27:11.718129  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:11.719568  6009 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:11.690730 13308 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:11.720237  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 100768us
I20260709 12:27:11.741884  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:11.744094  5967 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:27:11.745118  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:11.745726  5964 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:27:11.746078  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:11.745736 13387 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:11.746682  5966 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:27:11.747189 13314 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:11.747959  6645 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:27:11.749622  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:11.750379  6643 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 30 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 30: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:11.738263  6647 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 11.
W20260709 12:27:11.720932  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 118811us
I20260709 12:27:11.727068  6081 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:11.721405  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 168813us
W20260709 12:27:11.723991  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.727559 13403 consensus_queue.cc:1048] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:27:11.746300 13444 log.cc:927] Time spent T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.077s	user 0.000s	sys 0.000s
I20260709 12:27:11.729456 13459 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:11.724116  6082 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:11.668526 13419 consensus_queue.cc:237] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:11.766716  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 30 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:11.703977 13448 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:11.696765 12925 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:11.732474 13445 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:27:11.735077  6009 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:11.754931  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 95761.2us
W20260709 12:27:11.755406  6608 leader_election.cc:336] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.500s (SENT)
W20260709 12:27:11.777128  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 157647us
W20260709 12:27:11.766286 13436 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.105s	user 0.001s	sys 0.000s
I20260709 12:27:11.765420  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:11.686386 13389 consensus_queue.cc:1175] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "24012af7747d4c4ea89c3da2ff950099" responder_term: 12 status { last_received { term: 12 index: 12 } last_committed_idx: 11 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: [11.12-11.12]" } } last_received_current_leader { term: 0 index: 0 } }
I20260709 12:27:11.758054  6037 raft_consensus.cc:2955] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 11 to 13, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:11.773685  5966 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 30: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:11.760641  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:11.775784  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:11.784371  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:11.785301  6081 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:11.786651  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51654.4us
I20260709 12:27:11.787423  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:11.778429  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:11.762355  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:11.794940  6118 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 14. (term mismatch)
I20260709 12:27:11.795334  6118 pending_rounds.cc:85] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 13
I20260709 12:27:11.795542  6118 pending_rounds.cc:107] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 15.14
I20260709 12:27:11.795773  6118 raft_consensus.cc:2889] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:11.780462  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:11.754062 13252 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:11.810046  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:11.810501  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:11.774168 13308 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:11.812366  6081 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:11.774645 13453 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:11.819557  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:11.820660  6111 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 20.
I20260709 12:27:11.822609  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:11.822927  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:11.831866  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:11.825938  5934 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 11 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:11.771600 13456 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.060s
I20260709 12:27:11.809635 13448 raft_consensus.cc:3055] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:11.840282  6611 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:11.811746 13174 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election won for term 20
W20260709 12:27:11.834542  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 73983.1us
I20260709 12:27:11.813911 12925 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:11.821354 13252 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:11.817384 13308 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:11.813777 13100 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:27:11.775715 13306 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.778182 13449 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.060s
I20260709 12:27:11.817739 13400 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:11.817525 13148 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:27:11.845268  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:11.860078  6116 raft_consensus.cc:1240] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: [15.13-15.13]
I20260709 12:27:11.849167 13174 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.830950 13314 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:11.853416  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:11.854584  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:11.835515 13452 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:11.861083  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:11.837642 13448 raft_consensus.cc:740] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:11.856887 13308 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:11.864288  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 12 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:11.872884  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:11.864835  6643 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:11.865530  6646 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
W20260709 12:27:11.866492  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 88109.7us
W20260709 12:27:11.849133  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 61212.8us
W20260709 12:27:11.867036  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.867159  6116 raft_consensus.cc:1240] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 18. Current term is 19. Ops: [18.18-18.18]
I20260709 12:27:11.869129  6109 raft_consensus.cc:2393] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:11.855190 13252 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.871062  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:11.877089  6038 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:11.876727  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:11.871690  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:11.873940  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:11.878420  6044 raft_consensus.cc:2393] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 17: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:11.875764  6608 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:11.874646  6009 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:11.865748 13174 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:11.865994 13431 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:11.896766 13431 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:11.897217 13431 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:11.897600 13448 consensus_queue.cc:260] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.883430  6041 raft_consensus.cc:2410] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 21 because replica has last-logged OpId of term: 19 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 11.
I20260709 12:27:11.876362 13352 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:11.898922 13448 raft_consensus.cc:3060] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:11.903631 13176 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:27:11.904098 13176 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:11.904839 13176 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:11.905978 13176 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:11.883697 13252 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:11.884231  6043 raft_consensus.cc:2410] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 19 because replica has last-logged OpId of term: 17 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 11.
I20260709 12:27:11.842945 13454 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.032s
I20260709 12:27:11.915459  6109 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23. Ops: []
I20260709 12:27:11.915795  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:11.884744  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 62951.9us
I20260709 12:27:11.885095 13100 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.887524 13398 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:11.888116 13367 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:11.873100 12895 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:11.921892 13465 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:11.922318 13465 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:11.922686 13465 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:11.868088 13314 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:11.924743 13314 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:11.926582 13388 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:11.926975 13388 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:11.896258 13306 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:11.934723  6038 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 23.
I20260709 12:27:11.918774 13456 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:11.940168 13456 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.931134 13100 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.942394 13456 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:11.944474 13100 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:11.948987  6650 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:27:11.918313 13321 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:11.909652 13468 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:11.953795 13252 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.937093 13388 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:11.956107 13252 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:11.956426 13465 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:11.926983 12916 consensus_meta.cc:287] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Time spent flushing consensus metadata: real 0.804s	user 0.011s	sys 0.003s
I20260709 12:27:11.886530  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:11.965987  6643 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
W20260709 12:27:11.977200  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.976007  6608 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 30 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:11.969544 13469 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:11.980283 13469 consensus_queue.cc:1059] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:11.981290 13469 raft_consensus.cc:3055] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:11.981647 13469 raft_consensus.cc:740] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:11.983860 13469 consensus_queue.cc:260] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:11.984948 13469 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:11.985968 13394 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 30 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:11.986748 13396 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:27:11.987798  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 101359us
I20260709 12:27:11.988633  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:11.988582  5965 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 11 index: 12. Preceding OpId from leader: term: 12 index: 12. (term mismatch)
I20260709 12:27:11.991124  5965 pending_rounds.cc:85] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 11
I20260709 12:27:11.991357  5965 pending_rounds.cc:107] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 11.12
I20260709 12:27:11.991570  5965 raft_consensus.cc:2889] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:11.996097 13460 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Leader election won for term 11
I20260709 12:27:11.996676 13460 raft_consensus.cc:697] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:11.997598 13460 consensus_queue.cc:237] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 11, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.000085  6608 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 11 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:11.944692 13314 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:12.011960  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:11.976483 13465 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:12.010829  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 190416us
W20260709 12:27:12.011621  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 171381us
I20260709 12:27:11.966921 12916 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:11.959360 13452 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.049s
I20260709 12:27:12.006633 13323 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 30 FOLLOWER]: Leader election lost for term 30. Reason: could not achieve majority
I20260709 12:27:12.021916  6081 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:11.975822 13456 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:27:12.021071  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:12.029393  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 203502us
I20260709 12:27:12.031752  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:12.033389  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:12.062995 13465 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 11. Reason: could not achieve majority
I20260709 12:27:12.063993  6118 raft_consensus.cc:2393] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 21: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:12.061513 13157 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:12.020385 13396 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:27:12.069866  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 48029.6us
W20260709 12:27:12.086268  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.010176 13308 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.021023 13403 consensus_queue.cc:1059] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.062s
W20260709 12:27:12.107062 13472 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.169s	user 0.001s	sys 0.000s
W20260709 12:27:12.108825 13473 log.cc:927] Time spent T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.097s	user 0.001s	sys 0.000s
I20260709 12:27:12.113746 13457 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:12.114291 13457 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.114674 13457 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:12.071834 13157 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:12.119196 13157 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:12.033962 13252 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.063s
I20260709 12:27:12.126801 13465 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:27:12.131744  6116 raft_consensus.cc:1240] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:12.143308 12916 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:12.079116  6081 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:12.140731 13252 consensus_queue.cc:1243] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer 0069e2ba1f02412e8e1d6c20a1fb510f log is divergent from this leader: its last log entry 16.14 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 13
I20260709 12:27:12.144680 13100 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:12.145133 13100 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.145503 13100 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:27:12.144863  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 65880.3us
I20260709 12:27:12.161906  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:12.138196 13389 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:12.071450 13477 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:27:12.131191 13318 consensus_meta.cc:287] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.509s	user 0.012s	sys 0.001s
W20260709 12:27:12.179442  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 146145us
I20260709 12:27:12.180986  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:12.181396  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:12.182137  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:12.182812  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 251801us
I20260709 12:27:12.194818  5968 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:12.195804  5959 raft_consensus.cc:2368] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13.
I20260709 12:27:12.188782  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:12.222790  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:12.225755  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 63963.6us
I20260709 12:27:12.228683  5965 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:12.131371 13433 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:12.222959  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:12.237283  6038 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17. Ops: []
I20260709 12:27:12.174961 13240 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.302564  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:12.182518  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:12.304530  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:12.305246  5965 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:27:12.306670  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 124240us
I20260709 12:27:12.307826  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:12.312412  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:12.256067 13441 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.609s	user 0.008s	sys 0.007s
I20260709 12:27:12.197395 13459 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:12.308561  5966 raft_consensus.cc:3060] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:12.249780 13431 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.248338 13481 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.115s
I20260709 12:27:12.140250 13388 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.355595 13388 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:12.357630 13240 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:12.357805  5966 raft_consensus.cc:2468] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:12.333417 13157 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.369061 13157 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:12.373771  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 150879us
I20260709 12:27:12.375368  6009 leader_election.cc:400] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19.
I20260709 12:27:12.375691  6009 leader_election.cc:403] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:27:12.301757 13176 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.382856 13176 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.385232 13176 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:12.388890 13176 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.389437 13176 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.335757  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:12.310065  5968 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 23.
I20260709 12:27:12.263000 13314 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:12.394026 13314 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19.
I20260709 12:27:12.395153 13176 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:12.393514  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 57849us
I20260709 12:27:12.338368 13433 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:27:12.252148 13308 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:12.396682  5934 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:12.398066 13450 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.667s	user 0.007s	sys 0.011s
I20260709 12:27:12.340101 13321 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:12.233162 13468 consensus_queue.cc:1059] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 20.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.109s
I20260709 12:27:12.331754 13449 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:12.330956 13448 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:27:12.393347 13391 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:12.265138 13457 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.397908  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:12.341598 13174 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.400059  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:12.429059  6647 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
I20260709 12:27:12.401862  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:12.402172  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:12.376729  6009 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:12.162256 13100 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.410019 13433 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:12.430264  6006 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:12.423424 13449 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:12.446103  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:12.446973  5966 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:27:12.268873 13478 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
I20260709 12:27:12.222658 13318 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.188669 13389 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.419699  5965 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
W20260709 12:27:12.424593  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 377799us
I20260709 12:27:12.249603 13395 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:27:12.426664  5963 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3236) took 1567 ms. Trace:
I20260709 12:27:12.431769 13431 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:12.453119  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:12.433360  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:12.259877 13369 consensus_meta.cc:287] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.591s	user 0.009s	sys 0.000s
I20260709 12:27:12.457417  5966 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:27:12.438403 13433 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:12.466675  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 90009.5us
I20260709 12:27:12.458910  6113 raft_consensus.cc:2393] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 20: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:12.459707  5963 rpcz_store.cc:276] 0709 12:27:10.859462 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:10.930645 (+ 71183us) service_pool.cc:224] Handling call
0709 12:27:10.931083 (+   438us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:11.017487 (+ 86404us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:27:11.366173 (+348686us) log.cc:844] Serialized 14 byte log entry
0709 12:27:11.782356 (+416183us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:11.797841 (+ 15485us) log.cc:844] Serialized 26 byte log entry
0709 12:27:11.798581 (+   740us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:27:11.800040 (+  1459us) log.cc:844] Serialized 14 byte log entry
0709 12:27:11.990304 (+190264us) spinlock_profiling.cc:243] Waited 1.57 ms on lock 0x7b180018a720. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481dee1c0a 00007f4827621219 00007f481df69a40 00007f481df644e4 00007f481df64455 00007f482104c060 00007f482105e716 00007f482106f287 00007f482106f208
0709 12:27:11.992769 (+  2465us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.426305 (+433536us) spinlock_profiling.cc:243] Waited 84.1 ms on lock 0x7b54001df454. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:12.426364 (+    59us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.426413 (+    49us) raft_consensus.cc:1685] finished
0709 12:27:12.426425 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.426600 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":76215,"prepare.queue_time_us":38601,"prepare.run_cpu_time_us":63,"prepare.run_wall_time_us":64,"raft.queue_time_us":234478,"raft.run_cpu_time_us":345,"raft.run_wall_time_us":7715,"spinlock_wait_cycles":197033088,"thread_start_us":618175,"threads_started":3,"wal-append.queue_time_us":185914}
I20260709 12:27:12.467413  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:12.442013 13383 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:12.514693  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2503) took 1414 ms. Trace:
W20260709 12:27:12.518026  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 49274.1us
I20260709 12:27:12.515213  6036 rpcz_store.cc:276] 0709 12:27:11.052323 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.052439 (+   116us) service_pool.cc:224] Handling call
0709 12:27:11.062891 (+ 10452us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:11.063237 (+   346us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:11.063269 (+    32us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:11.063714 (+   445us) log.cc:844] Serialized 26 byte log entry
0709 12:27:11.130208 (+ 66494us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:11.130247 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:11.130310 (+    63us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.255289 (+1124979us) spinlock_profiling.cc:243] Waited 4.86 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:27:12.464800 (+209511us) raft_consensus.cc:1685] finished
0709 12:27:12.464824 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.466547 (+  1723us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":1264,"raft.run_cpu_time_us":51,"raft.run_wall_time_us":51,"spinlock_wait_cycles":11171712,"thread_start_us":66147,"threads_started":1,"wal-append.queue_time_us":558909}
I20260709 12:27:12.517127  6006 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:12.447064 13449 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:12.524904  6040 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
W20260709 12:27:12.525295  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.526074  6608 leader_election.cc:400] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 12. Current term is 13.
I20260709 12:27:12.459514 13395 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:27:12.527748  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.522647  6009 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:12.450862 12925 raft_consensus.cc:2804] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:12.458066 13479 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.530755  6608 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:12.468847 13433 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:27:12.539444 13067 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.905s	user 0.008s	sys 0.022s
I20260709 12:27:12.517570 13369 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.520987 13314 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:27:12.549813  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 70423.2us
I20260709 12:27:12.464952 13448 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:12.544950  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:12.465735 13468 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:12.531982 13431 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:27:12.538518 13226 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.774s	user 0.012s	sys 0.027s
W20260709 12:27:12.548584 13067 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.919s	user 0.009s	sys 0.022s
W20260709 12:27:12.569713  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 93439.5us
I20260709 12:27:12.571754  6044 raft_consensus.cc:1240] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 11. Current term is 12. Ops: []
I20260709 12:27:12.572993  6044 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: []
I20260709 12:27:12.546911 13479 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.548794 13252 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:12.550486 12925 raft_consensus.cc:697] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:12.574725  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:12.567782 13226 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.816s	user 0.012s	sys 0.028s
I20260709 12:27:12.466187 13176 consensus_queue.cc:1059] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 16.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.087s
I20260709 12:27:12.530232 13398 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.036s
I20260709 12:27:12.592274  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:12.573871 13484 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:27:12.579105  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:12.595414  6039 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 14. Current term is 15. Ops: [14.9-14.9]
I20260709 12:27:12.596300  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:12.598076  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:12.609092  5963 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:12.604471  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:12.571110 13318 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:12.570170 13468 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:12.621165  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:12.626623  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:12.594808  5934 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:12.637434  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:12.596436 13431 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:27:12.639669  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 44950us
I20260709 12:27:12.580996 13252 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:27:12.642118  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 63103.7us
I20260709 12:27:12.641851  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:12.621063 13482 raft_consensus.cc:3055] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:27:12.649493  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:12.642232  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:12.594266 13388 consensus_queue.cc:1059] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.046s
I20260709 12:27:12.637809 13467 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:12.638594 13484 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 23 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:12.646338 13176 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:12.647689 13252 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:12.672276  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:12.592095 13395 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.655164 13058 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:12.675068  6646 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:27:12.649950 13482 raft_consensus.cc:740] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:12.676306  6039 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 20: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:12.661737 13100 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:12.678346  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:12.679065  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:12.679881  6643 raft_consensus.cc:1240] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:12.680562  6647 raft_consensus.cc:1240] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 10. Current term is 11. Ops: []
I20260709 12:27:12.657871 13174 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:12.681578  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:12.691238  6644 raft_consensus.cc:2393] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 17: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:12.648931 12925 consensus_queue.cc:237] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.684356 13468 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.669289 13460 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:12.695354 13460 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:12.695830 13460 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:12.701530  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:12.703483  6644 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 23. Current term is 24. Ops: []
I20260709 12:27:12.706697  6645 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17. Ops: []
I20260709 12:27:12.710794 12916 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:12.711165  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 11 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:12.711623 12916 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.712561  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:12.713980 12916 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:12.714319  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:12.717177 13176 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:12.719822  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:12.683633 13389 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:12.720544  6039 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 20.
I20260709 12:27:12.724324  6038 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:27:12.719846  6644 raft_consensus.cc:1275] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:27:12.705830 13395 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:12.735693  6647 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 11 index: 10. Preceding OpId from leader: term: 13 index: 11. (index mismatch)
I20260709 12:27:12.740010  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:12.740134  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 30 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:12.740644  6647 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:12.741644  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 30 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:12.742389  6643 raft_consensus.cc:2393] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 30 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 30: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:12.740648  6039 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 29 FOLLOWER]: Advancing to term 30
I20260709 12:27:12.729818  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:12.743198  6035 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:27:12.743083  6038 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23. Ops: []
I20260709 12:27:12.745648  6035 raft_consensus.cc:3055] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Stepping down as leader of term 10
I20260709 12:27:12.745994  6035 raft_consensus.cc:740] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:12.728967 13389 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.754542  6647 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:27:12.752130  6035 consensus_queue.cc:260] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 10.10, Last appended by leader: 10, Current term: 10, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.758527  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:12.759322 13479 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:12.759590 13396 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
W20260709 12:27:12.760502 13489 log.cc:927] Time spent T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.099s	user 0.000s	sys 0.000s
I20260709 12:27:12.760680 13387 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:27:12.761612 13502 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:12.764328 13352 raft_consensus.cc:3055] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:27:12.764716 13352 raft_consensus.cc:740] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:12.765468 13352 consensus_queue.cc:260] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.708235 13431 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.766660  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:27:12.767223  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 370102us
W20260709 12:27:12.768056  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.768518  6009 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 30 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:12.760514  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 533290us
W20260709 12:27:12.762388  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 494455us
I20260709 12:27:12.777834  6035 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 10 FOLLOWER]: Advancing to term 11
I20260709 12:27:12.780318  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:12.784605  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:12.785351  6116 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:27:12.745033 13369 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 25 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:12.784793  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:12.769745 13487 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.149s	user 0.001s	sys 0.000s
I20260709 12:27:12.760402 13112 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:27:12.787073  6109 raft_consensus.cc:2393] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 17: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:12.735394 13383 consensus_queue.cc:1059] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 16.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.035s
I20260709 12:27:12.782361  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:12.787335  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:12.794875  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:12.789256  6116 raft_consensus.cc:1240] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 19. Current term is 20. Ops: []
I20260709 12:27:12.796181  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:12.796721  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:12.797317  6116 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:27:12.797590  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:12.798702  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:12.799254  6115 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 20.
I20260709 12:27:12.800088  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:12.798637 13510 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:27:12.801625  6037 raft_consensus.cc:2410] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 20 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:27:12.801924  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:12.802526  6110 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:27:12.803473  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:12.804890  6110 pending_rounds.cc:85] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 13
I20260709 12:27:12.805123  6110 pending_rounds.cc:107] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 16.14
I20260709 12:27:12.805346  6110 raft_consensus.cc:2889] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:12.806603  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:12.808769  6112 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23. Ops: []
I20260709 12:27:12.809827  6035 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:27:12.811873  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:12.797247  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:12.791158  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 81132.4us
I20260709 12:27:12.769197  6084 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:12.766409 13352 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:12.801132  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:12.821267  6115 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:27:12.821553  6039 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 30 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 30.
I20260709 12:27:12.814817  5932 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:12.815572  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:12.814306  5963 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:12.760521 13396 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:27:12.822760  6081 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:12.824396  6645 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 10 index: 10. Preceding OpId from leader: term: 11 index: 11. (index mismatch)
I20260709 12:27:12.826761  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:12.828738  6118 raft_consensus.cc:2393] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 20: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:12.778520 13174 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:27:12.801052 13383 raft_consensus.cc:3055] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:27:12.829981  6112 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
W20260709 12:27:12.830623 13492 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
I20260709 12:27:12.744740 13484 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.834808  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:12.770749 13389 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.826993 13509 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:12.838673 13389 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:12.755705 13482 consensus_queue.cc:260] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 18.18, Last appended by leader: 18, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.840104 13482 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:12.840371 13448 raft_consensus.cc:3055] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:27:12.840794 13448 raft_consensus.cc:740] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:12.842651 13506 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 30 FOLLOWER]: Leader pre-election lost for term 30. Reason: could not achieve majority
W20260709 12:27:12.846895 13494 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.054s	user 0.000s	sys 0.001s
I20260709 12:27:12.826992 13387 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:27:12.848264  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3635) took 1026 ms. Trace:
I20260709 12:27:12.829941 13383 raft_consensus.cc:740] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:12.852470  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:12.846232 12866 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:27:12.868878  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:12.771056 12916 consensus_queue.cc:1059] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.055s
W20260709 12:27:12.870762 13507 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
I20260709 12:27:12.870873  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:12.851521  6111 rpcz_store.cc:276] 0709 12:27:11.821974 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.822099 (+   125us) service_pool.cc:224] Handling call
0709 12:27:11.836423 (+ 14324us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:11.858703 (+ 22280us) raft_consensus.cc:1534] Early marking committed up to index 8
0709 12:27:11.970436 (+111733us) log.cc:844] Serialized 14 byte log entry
0709 12:27:12.769583 (+799147us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:12.793670 (+ 24087us) log.cc:844] Serialized 26 byte log entry
0709 12:27:12.793823 (+   153us) raft_consensus.cc:1645] Marking committed up to 8
0709 12:27:12.793854 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.793915 (+    61us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:12.848065 (+ 54150us) raft_consensus.cc:1685] finished
0709 12:27:12.848085 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:12.848210 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":314913,"prepare.queue_time_us":111583,"prepare.run_cpu_time_us":35,"prepare.run_wall_time_us":36,"raft.queue_time_us":343075,"raft.run_cpu_time_us":223,"raft.run_wall_time_us":12525,"thread_start_us":552798,"threads_started":2,"wal-append.queue_time_us":547150}
I20260709 12:27:12.871889 13467 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:12.872555  6111 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:12.873785  6111 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:27:12.874524 13433 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.875555 13514 consensus_queue.cc:1059] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 14.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.001s
I20260709 12:27:12.876660 13433 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:12.876888  6118 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20. Ops: []
I20260709 12:27:12.877473 13369 consensus_queue.cc:1059] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 12.8, Next index: 9, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:12.878047 12916 raft_consensus.cc:3055] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:27:12.878494 12916 raft_consensus.cc:740] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:12.863322 13176 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.879310 12916 consensus_queue.cc:260] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.880460 12916 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:12.868891  5932 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:12.872097  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:12.870568 13383 consensus_queue.cc:260] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 16.10, Last appended by leader: 10, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:12.882134  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 112992us
W20260709 12:27:12.885260  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 62588.9us
I20260709 12:27:12.882438  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:12.874960  6082 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:12.886437  5932 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:12.825206 13396 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:12.885488  6084 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:12.883937  6112 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:12.878693 13509 raft_consensus.cc:3055] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Stepping down as leader of term 14
W20260709 12:27:12.888888  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 62738.8us
I20260709 12:27:12.878278 13369 raft_consensus.cc:3055] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:27:12.893460  5932 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:12.894506  6117 raft_consensus.cc:1240] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17. Ops: []
I20260709 12:27:12.890085  5934 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:12.896930  5932 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:12.827121 13100 consensus_queue.cc:1059] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 13.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.063s
I20260709 12:27:12.882526 12866 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:12.888355 13308 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:27:12.889533 13318 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:12.914862  6115 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:27:12.889330 13509 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:12.906214  5934 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:12.893898 13433 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:27:12.892872 13369 raft_consensus.cc:740] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:12.918872  5934 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:12.899957 13403 raft_consensus.cc:2804] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:27:12.898099 13510 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:27:12.925653 13509 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.927155 13509 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:12.905539 13512 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:12.930833 13512 raft_consensus.cc:2764] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election decision vote started in defunct term 19: won
I20260709 12:27:12.931129 13396 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.932595 13396 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:12.934933 12866 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.936139 12866 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:12.940596 13252 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.917860 13318 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.943245 13318 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:12.947520  6044 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 20.
I20260709 12:27:12.948508 13419 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:12.914599 13383 raft_consensus.cc:3060] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:12.909543 13389 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:12.951321 13389 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:12.951697 13389 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:12.970605  6112 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 23.
I20260709 12:27:12.971202 13500 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:12.971371 12895 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:12.988509 12895 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.971966 13419 raft_consensus.cc:697] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:12.991446 13419 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:12.972397 13403 raft_consensus.cc:697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:12.994879 13403 consensus_queue.cc:237] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.974027 13454 raft_consensus.cc:2955] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:27:12.976759 13459 raft_consensus.cc:3055] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:27:12.978704 13252 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:12.980640 13391 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:27:12.982973 13369 consensus_queue.cc:260] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.984449 13449 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:12.985909 13456 raft_consensus.cc:3055] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Stepping down as leader of term 16
W20260709 12:27:13.020133  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.016045  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.051360  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.015509 13459 raft_consensus.cc:740] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:13.072804  6036 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 26: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:13.062681 12895 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:13.060724 13456 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:27:13.075111  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 174903us
W20260709 12:27:13.080389  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 163070us
I20260709 12:27:13.080749  5932 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:13.062005 13389 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:13.096148  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 177352us
I20260709 12:27:13.084142  6084 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:13.103648  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 210931us
I20260709 12:27:13.109232  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:13.110323  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:13.110615  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:13.110738 12916 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:13.111546 12916 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:13.111982 12916 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:27:13.116868  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.117362  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.119663  6611 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:13.130070  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:13.130951  6111 raft_consensus.cc:2368] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21.
I20260709 12:27:13.135648 13389 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:13.136508  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:13.137274  6112 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 21: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:13.099915 13395 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:13.100523 13500 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:13.074908 13460 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.144539  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:13.156561  6009 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:13.160459 12925 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:27:13.162846  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:13.149119  6043 raft_consensus.cc:2955] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:27:13.112764 13523 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:13.167459  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:13.107273 13398 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.056s
I20260709 12:27:13.174844  6112 raft_consensus.cc:1240] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21. Ops: []
W20260709 12:27:13.169955  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 85902.6us
I20260709 12:27:13.180533  6084 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:13.177774 13469 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:13.151333 13362 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
W20260709 12:27:13.196825  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.174294 13395 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:13.229067 13395 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:13.231873 13530 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:13.153662 13174 consensus_queue.cc:1059] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 19.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:27:13.162081 13307 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:27:13.179958 13314 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:27:13.176350 13389 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.023s
I20260709 12:27:13.162971 13058 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.035s
I20260709 12:27:13.232472 12916 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.169219 13176 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:13.127991 13459 consensus_queue.cc:260] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:13.141155 13456 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:13.240556  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 67441us
W20260709 12:27:13.242651  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 54670.3us
I20260709 12:27:13.263379  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:13.278851  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.237918 13449 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:13.295449  6009 leader_election.cc:400] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21.
I20260709 12:27:13.295928  6009 leader_election.cc:403] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Cancelling election due to peer responding with higher term
I20260709 12:27:13.192327 13469 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.234448 13318 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:13.310854  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 130310us
I20260709 12:27:13.315330  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:13.291764 13451 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:27:13.326651  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 219717us
I20260709 12:27:13.327550  5932 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 30 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:13.312546 13485 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:27:13.333273  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.264780 13176 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.336627  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:13.337245  6118 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:27:13.337890  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.344843  5932 leader_election.cc:336] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Timed out: RequestConsensusVote RPC to 127.4.181.66:45473 timed out after 1.949s (SENT)
I20260709 12:27:13.322124 13459 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:13.348348  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:13.340281  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:13.339387  6006 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:13.342645  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:13.350322  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:13.351923 13525 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 9, Time since last communication: 0.005s
W20260709 12:27:13.353142 13532 log.cc:927] Time spent T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.118s	user 0.000s	sys 0.001s
I20260709 12:27:13.335287 13449 raft_consensus.cc:3055] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:27:13.354755  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:13.334892 13174 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:27:13.335431 13522 log.cc:927] Time spent T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.153s	user 0.001s	sys 0.000s
I20260709 12:27:13.368996  6112 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 26.
I20260709 12:27:13.369554  6035 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:13.373135  6118 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
I20260709 12:27:13.375025  6009 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:13.333057 13314 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:27:13.382230  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:13.384529  5934 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:13.386685 13509 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
W20260709 12:27:13.387159 13533 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.000s
I20260709 12:27:13.391690 13539 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:13.391826 13538 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:13.347818 13528 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.392262 13539 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:13.392722 13528 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:13.329466 13461 consensus_queue.cc:1059] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.212s
I20260709 12:27:13.387342 13509 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:27:13.394816 13509 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:13.395684 13509 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:13.396104 13318 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:13.398411 13469 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:13.347687 13398 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 30 FOLLOWER]: Leader election won for term 30
I20260709 12:27:13.402976 13398 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 30 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:13.405714  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:13.407636  5934 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:13.408210  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:13.410804  6035 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
I20260709 12:27:13.416209  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:13.416976  5965 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
W20260709 12:27:13.421900  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 77105.3us
I20260709 12:27:13.425140  5959 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 13. Preceding OpId from leader: term: 19 index: 14. (index mismatch)
I20260709 12:27:13.426265  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:13.427179  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:13.428144  5964 raft_consensus.cc:2410] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 16 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:27:13.373172 13449 raft_consensus.cc:740] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:27:13.432471  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 57525.6us
I20260709 12:27:13.435009  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:13.327549 13451 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.429791  6112 raft_consensus.cc:1240] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:27:13.431272  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:13.432170  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 92858.6us
I20260709 12:27:13.440045  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:13.383018 13460 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:13.442030  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:13.443003  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 18 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:13.444010  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:13.444829  5963 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 21: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:13.446167  5964 raft_consensus.cc:2393] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 20: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:13.447865  5962 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 23: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:13.447388  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:13.449676  5965 raft_consensus.cc:1275] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 13. (term mismatch)
I20260709 12:27:13.449923  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:13.450814  5964 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 26.
I20260709 12:27:13.452059  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:13.450058  5965 pending_rounds.cc:85] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 12
I20260709 12:27:13.454747  5965 pending_rounds.cc:107] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 15.13
I20260709 12:27:13.455020  5965 raft_consensus.cc:2889] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:13.460705  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 16 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:13.432163 13383 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:13.462690  5964 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:13.468551  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:13.470034  5964 raft_consensus.cc:2368] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21.
I20260709 12:27:13.472280  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:13.450834 13396 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:13.473119  5961 raft_consensus.cc:2410] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 15 because replica has last-logged OpId of term: 14 index: 9, which is greater than that of the candidate, which has last-logged OpId of term: 12 index: 8.
W20260709 12:27:13.480034 13511 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.546s	user 0.000s	sys 0.006s
I20260709 12:27:13.429678 13538 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.482640 13545 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:13.485450 13456 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:27:13.485611 13534 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.121s	user 0.003s	sys 0.000s
I20260709 12:27:13.486521  5960 raft_consensus.cc:1240] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 20. Current term is 21. Ops: [20.16-20.16]
I20260709 12:27:13.464457 13546 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:27:13.442605 13461 consensus_queue.cc:1059] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.030s
I20260709 12:27:13.498761  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:13.499603  5932 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:13.493937  5964 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:27:13.428865 13398 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 28.20, Last appended by leader: 20, Current term: 30, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.534121  5932 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:13.534986  5961 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:13.542656  6081 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:13.537914 13509 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:27:13.551625 13509 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:13.553906  6081 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:13.541760 13526 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.068s	user 0.001s	sys 0.002s
I20260709 12:27:13.556337  6081 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:13.538564 13461 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:27:13.584524  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:13.494724 13449 consensus_queue.cc:260] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:13.588316  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 89647.4us
I20260709 12:27:13.554468 13544 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:13.554482 13454 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.BulkChangeConfig from 127.0.0.1:34290 (request call id 1) took 4129 ms. Trace:
I20260709 12:27:13.549201 13451 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:13.525058 13545 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.606848  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:13.598539 13454 rpcz_store.cc:276] 0709 12:27:09.411557 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.412253 (+   696us) service_pool.cc:224] Handling call
0709 12:27:09.421571 (+  9318us) log.cc:844] Serialized 499 byte log entry
0709 12:27:09.691019 (+269448us) spinlock_profiling.cc:243] Waited 1.58 ms on lock 0x7b180037dbc0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:27:09.795351 (+104332us) spinlock_profiling.cc:243] Waited 12.3 ms on lock 0x7b540014ba20. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4820fcd142 00007f4820fadeaa 00007f4820fb4d53 00007f4820fb4cd9 00007f4820fb4c69 00007f4820fb4c31 00007f4820fb3dfd 0000000000388634 0000000000388479 00007f481df67475
0709 12:27:13.540712 (+3745361us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":275384,"raft.queue_time_us":10085,"raft.run_cpu_time_us":6050,"raft.run_wall_time_us":350268,"spinlock_wait_cycles":33220480,"thread_start_us":198705,"threads_started":1,"wal-append.queue_time_us":352596,"wal-append.run_cpu_time_us":1886,"wal-append.run_wall_time_us":1028985}
I20260709 12:27:13.608237 13551 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:27:13.551672 13549 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 12:27:13.611824 13538 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:13.612183 13457 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:13.613001 13457 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:13.613369 13457 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:13.613739 13457 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:13.616568  6044 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 3226) took 1043 ms. Trace:
I20260709 12:27:13.616959  6044 rpcz_store.cc:276] 0709 12:27:12.573475 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.649256 (+ 75781us) service_pool.cc:224] Handling call
0709 12:27:13.616403 (+967147us) spinlock_profiling.cc:243] Waited 297 ms on lock 0x7b540030f2d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:13.616507 (+   104us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":682029312}
I20260709 12:27:13.621347 13528 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:13.623054 13545 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:13.550561 13391 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:27:13.632016  6006 leader_election.cc:400] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21.
W20260709 12:27:13.636181  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 79964.9us
I20260709 12:27:13.645170  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:13.653458  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:13.656311  5914 auto_rebalancer.cc:629] Failed to schedule move for tablet 465414d7b00f409684b7f69cfbcfad77: Illegal state: Leader has not yet committed an operation in its own term
I20260709 12:27:13.656899  6081 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:13.635201 13396 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:27:13.665100  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 169448us
I20260709 12:27:13.646808 13551 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:27:13.647058 13546 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:13.662050 13352 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:13.698895 13352 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.699318 13352 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:13.715355  6644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 1734) took 1006 ms. Trace:
I20260709 12:27:13.715793  6644 rpcz_store.cc:276] 0709 12:27:12.709057 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.709245 (+   188us) service_pool.cc:224] Handling call
0709 12:27:12.709610 (+   365us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:12.725345 (+ 15735us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.715128 (+989783us) spinlock_profiling.cc:243] Waited 8.96 ms on lock 0x7b5400580554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:13.715291 (+   163us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":20601088}
I20260709 12:27:13.670539 13549 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:13.678912  5966 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1892) took 1006 ms. Trace:
W20260709 12:27:13.679136  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.696709 13519 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.548s	user 0.000s	sys 0.002s
I20260709 12:27:13.726011  5966 rpcz_store.cc:276] 0709 12:27:12.672197 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.672311 (+   114us) service_pool.cc:224] Handling call
0709 12:27:12.672606 (+   295us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:12.672805 (+   199us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:12.672841 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:13.482585 (+809744us) spinlock_profiling.cc:243] Waited 1.86 ms on lock 0x7b2c0001d508. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481f94da11 00007f481f95d372 00007f482108fa01 00007f482105443a 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2
0709 12:27:13.483045 (+   460us) log.cc:844] Serialized 26 byte log entry
0709 12:27:13.524130 (+ 41085us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:13.524169 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.524241 (+    72us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:13.671019 (+146778us) raft_consensus.cc:1685] finished
0709 12:27:13.671041 (+    22us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:13.678835 (+  7794us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":4276992,"thread_start_us":40698,"threads_started":1,"wal-append.queue_time_us":119544}
I20260709 12:27:13.697906 13560 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.661784 13523 consensus_queue.cc:1048] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.066s
I20260709 12:27:13.727878 13509 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.730144 13369 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:13.727901 13560 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.732929 13560 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:13.736101 13546 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:13.738194  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.739969  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:13.658996 13567 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 16, Time since last communication: 0.088s
I20260709 12:27:13.741425 13567 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:27:13.741760 13567 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:13.742522 13567 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.743700 13567 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:13.725502 13176 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:13.750993 13461 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.751349  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:13.752380 13461 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.755885 13509 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:13.755343 13461 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:13.778442  6113 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:35586 (request call id 3632) took 1984 ms (client timeout 2028 ms). Trace:
I20260709 12:27:13.783186 13174 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election lost for term 20. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21.
I20260709 12:27:13.786674  6042 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23. Ops: []
I20260709 12:27:13.788120 13396 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:13.788936  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 3218) took 1217 ms. Trace:
W20260709 12:27:13.791363  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.794930  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 240719us
W20260709 12:27:13.791723  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.795069  6036 rpcz_store.cc:276] 0709 12:27:12.571429 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.574386 (+  2957us) service_pool.cc:224] Handling call
0709 12:27:13.788732 (+1214346us) spinlock_profiling.cc:243] Waited 475 ms on lock 0x7b540028f0d4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:13.788878 (+   146us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1092231936}
I20260709 12:27:13.662130 13544 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:13.662403 13449 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:27:13.794787  6113 rpcz_store.cc:269] 0709 12:27:11.793839 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.794004 (+   165us) service_pool.cc:224] Handling call
0709 12:27:13.778217 (+1984213us) spinlock_profiling.cc:243] Waited 626 ms on lock 0x7b5400206a54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:13.778376 (+   159us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1439832320}
W20260709 12:27:13.797860  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 127474us
I20260709 12:27:13.801893  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:13.809062  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:13.809201 13551 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:13.809998  5964 raft_consensus.cc:2393] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 26: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:13.799906 13457 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:13.810796  5963 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:27:13.811380  5965 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:27:13.809868 13112 raft_consensus.cc:3055] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:27:13.815768 13112 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:13.816838 13112 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:13.817860 13112 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:13.825505  6006 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:13.827592  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:13.829667  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:13.830328  5963 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:27:13.831200  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:13.831755  5963 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
W20260709 12:27:13.835966  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:13.838207  6040 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:27:13.838441  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:13.839900  6036 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:27:13.845199  5961 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:13.848230  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:13.853487  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:13.841895 13459 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:27:13.838045 13545 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:13.846729 13560 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:27:13.837744 13568 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:27:13.863507 13403 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.673s	user 0.036s	sys 0.004s
I20260709 12:27:13.855731 13454 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:13.835543 13174 consensus_queue.cc:1048] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.025s
I20260709 12:27:13.848914 13176 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:13.846335 13252 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
W20260709 12:27:13.866539 13403 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.688s	user 0.037s	sys 0.004s
I20260709 12:27:13.859527 13523 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:13.892410  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:13.868368 13454 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:13.901090  6115 raft_consensus.cc:1240] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23. Ops: []
W20260709 12:27:13.881609 13471 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 1.047s	user 0.007s	sys 0.019s
I20260709 12:27:13.869243 13524 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.024s
I20260709 12:27:13.885752 13523 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:13.863355 13352 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:13.906201 13479 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:27:13.903883 13471 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 1.072s	user 0.008s	sys 0.020s
I20260709 12:27:13.913076 13523 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:13.869465 13568 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.900985 13565 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:13.903591 13454 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:13.917357 13100 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.921872 13100 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:13.923972 13100 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:13.884320 13176 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.925987  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:13.928005  5965 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:13.928061  6044 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
I20260709 12:27:13.914433 13458 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:13.918713 13479 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.930677 13565 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.934562 13458 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.935995 13565 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:13.933704 13479 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:13.936497  6042 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36266 (request call id 3221) took 1364 ms. Trace:
I20260709 12:27:13.936829  6042 rpcz_store.cc:276] 0709 12:27:12.572236 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.572355 (+   119us) service_pool.cc:224] Handling call
0709 12:27:12.572595 (+   240us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.796388 (+1223793us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:13.936265 (+139877us) spinlock_profiling.cc:243] Waited 1.21 s on lock 0x7b540030ded4. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:13.936439 (+   174us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2791658240}
I20260709 12:27:13.937978 13458 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:13.938261 13481 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:13.928555 13240 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:13.938771 13481 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.929971  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:13.950009  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:13.950837  5965 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:13.948613 13174 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:13.933632 13568 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:13.939190 13240 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.959499 13240 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:13.961205 13556 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.409s	user 0.000s	sys 0.003s
I20260709 12:27:13.968039 13481 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:13.968643 13539 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:13.974607 13457 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:13.975721  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:13.976539 13521 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 1.018s	user 0.005s	sys 0.000s
I20260709 12:27:13.979573  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1891) took 1307 ms. Trace:
I20260709 12:27:13.979965  5968 rpcz_store.cc:276] 0709 12:27:12.671868 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.672257 (+   389us) service_pool.cc:224] Handling call
0709 12:27:12.672634 (+   377us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:12.672922 (+   288us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:27:12.791865 (+118943us) log.cc:844] Serialized 14 byte log entry
0709 12:27:12.919637 (+127772us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:12.922368 (+  2731us) log.cc:844] Serialized 26 byte log entry
0709 12:27:12.922529 (+   161us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:12.964811 (+ 42282us) log.cc:844] Serialized 14 byte log entry
0709 12:27:12.965003 (+   192us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:12.965083 (+    80us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:13.966234 (+1001151us) spinlock_profiling.cc:243] Waited 3.76 ms on lock 0x7b18004b89e0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:27:13.975964 (+  9730us) spinlock_profiling.cc:243] Waited 5.03 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:27:13.979305 (+  3341us) raft_consensus.cc:1685] finished
0709 12:27:13.979328 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:13.979509 (+   181us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":74689,"prepare.run_cpu_time_us":67,"prepare.run_wall_time_us":3217,"raft.queue_time_us":79388,"raft.run_cpu_time_us":434,"raft.run_wall_time_us":14120,"spinlock_wait_cycles":24798208,"thread_start_us":175528,"threads_started":3,"wal-append.queue_time_us":133025}
I20260709 12:27:13.981880 12916 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:13.983062  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:13.984310 13174 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:13.984661  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:13.985460  6645 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:27:13.989121 13448 consensus_queue.cc:260] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:13.995312 13523 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:13.985350 13174 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:13.982023  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:14.000300  5968 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:14.005455  6645 raft_consensus.cc:1240] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:14.008248  6009 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:14.011559  5959 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:27:14.003708  6644 raft_consensus.cc:2955] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEARNER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:27:13.999130 13454 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.016474 13454 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.019438  6650 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:27:14.020843 13523 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.030877  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.031723  5965 raft_consensus.cc:2393] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:14.011464 13479 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 30 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.033751 13479 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 30 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.036375 13479 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 31 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.029158 13481 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:14.038653 13481 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.043656 13481 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:27:14.044456 13448 raft_consensus.cc:3060] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:14.052968  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:14.054832  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.055563  6650 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
W20260709 12:27:14.056800  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 48620.1us
I20260709 12:27:14.058089 13571 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:14.058430  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 11 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:14.058688 12916 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:14.059263 12916 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.060325 13457 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:14.060926 13457 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.061671 13571 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:14.062145 13571 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:14.063258 13457 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.063089 12916 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.067267  6036 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:14.073217  6043 raft_consensus.cc:2468] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:14.079051  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:14.081027  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:14.082824  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:14.087695 12916 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.088099 13252 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.088275 12916 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.088721 13252 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.089056  6041 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17. Ops: []
I20260709 12:27:14.090617  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:14.091367 12916 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.091626  6041 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 30 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 30.
I20260709 12:27:14.091413 13252 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:14.102659  6044 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17. Ops: []
I20260709 12:27:14.104386  6609 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:14.107326  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:27:14.120167 13570 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.341s	user 0.002s	sys 0.000s
I20260709 12:27:14.122656  5962 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 24. Current term is 25. Ops: []
I20260709 12:27:14.123657 13460 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:14.124364 13460 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.128176 13176 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.123698  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:14.138886 13535 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.818s	user 0.000s	sys 0.002s
I20260709 12:27:14.131572 13352 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 27 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.132238 13460 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.098233  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:14.145243  5968 raft_consensus.cc:2468] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 27.
I20260709 12:27:14.146961  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.163311  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.164615  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:14.165206  5968 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:14.166852  6645 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:14.171169  6043 raft_consensus.cc:1275] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 10 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:27:14.193567  6040 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 30 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 30 index: 21. (index mismatch)
I20260709 12:27:14.193519  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:14.195312  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.196859  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:14.199568  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 53537us
I20260709 12:27:14.200923  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:14.202330  6041 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
W20260709 12:27:14.212692  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.212881  6609 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:27:14.215744  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 110407us
I20260709 12:27:14.215132  6081 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:14.223800  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 10 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.222833 13530 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:14.226961  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.223819 13457 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.013s
I20260709 12:27:14.170925 13479 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.055s
I20260709 12:27:14.170642 13509 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.055s
I20260709 12:27:14.223367 13541 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:14.192477 13388 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:27:14.239125  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:14.240077  6609 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:14.241505  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:14.245560  6081 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:14.247788 13551 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:14.268275  6609 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 31 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:14.270378 13308 raft_consensus.cc:2804] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:27:14.243602 13571 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.274014 13308 raft_consensus.cc:697] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:14.274325  6037 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:14.272226 13457 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.274919 13308 consensus_queue.cc:237] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 15, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.275566 13457 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.270937 13551 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.277030 13551 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:14.277549 13457 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.265650 12916 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:27:14.272563 13458 consensus_queue.cc:1059] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.007s
I20260709 12:27:14.280376 13458 raft_consensus.cc:3055] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:27:14.280748 13458 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:14.281632 13458 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.262501 13539 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.282881 13539 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.285216 13539 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.256173 13514 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:27:14.269910 13541 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:14.287500 13583 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.288064 13583 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.250613 13530 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.272459 13481 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.291612 13481 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.292503 13530 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.294027 13481 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.294842 13449 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.295364 13449 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.297475 13449 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.303514 13530 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:14.304333 13530 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.306663 13530 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.309392 13539 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:14.310051 13539 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.312660 13539 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.254266 13369 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:14.244796 13240 raft_consensus.cc:2804] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:14.322638 13240 raft_consensus.cc:697] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:14.323948 13240 consensus_queue.cc:237] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 18.16, Last appended by leader: 16, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.229744 13471 consensus_queue.cc:1059] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 18.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.023s
I20260709 12:27:14.242698 13318 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:27:14.265053  6117 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3640) took 2393 ms. Trace:
I20260709 12:27:14.328169  6117 rpcz_store.cc:276] 0709 12:27:11.866025 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:11.866132 (+   107us) service_pool.cc:224] Handling call
0709 12:27:11.866413 (+   281us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:12.896591 (+1030178us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.259567 (+1362976us) spinlock_profiling.cc:243] Waited 1.03 s on lock 0x7b5400162e54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:14.259742 (+   175us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2361754880}
I20260709 12:27:14.328809 13395 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.329464 13525 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.329396 13395 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.330058 13525 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.331600 13395 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:14.333276  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.240758 13176 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 18, Time since last communication: 0.032s
I20260709 12:27:14.290252 13583 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.330186 13524 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:14.317790  6645 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:27:14.248320 13456 consensus_queue.cc:1059] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 13.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.024s
I20260709 12:27:14.320200  5962 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
W20260709 12:27:14.321223  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.317744 13479 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 30 FOLLOWER]: Leader pre-election won for term 31
I20260709 12:27:14.346269  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.347003  5962 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:27:14.266009  6009 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:14.321220 13458 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:14.348793  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.351002  5962 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 25: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:14.352763  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.354111  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.356386  5962 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
W20260709 12:27:14.356784  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 90884.1us
I20260709 12:27:14.357623  6009 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:14.358727  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 3113) took 1230 ms. Trace:
I20260709 12:27:14.360661  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.361466  6645 raft_consensus.cc:2393] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 24: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:14.243963  5968 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:27:14.364100  6084 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:14.371747  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.348961 13479 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 30 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.335055 13369 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.372350  6650 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:14.377378  5967 raft_consensus.cc:2468] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 23.
I20260709 12:27:14.377821  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.378201  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.382265  6649 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 24.
I20260709 12:27:14.379851  6084 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:27:14.388384  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.387240  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:14.358632 13468 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:14.369117 13252 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:14.371914 13467 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:14.379164 13471 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:27:14.422758  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.345002 13524 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.411291 13174 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:14.418181 13396 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:14.465111 13396 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:14.436086  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 167871us
I20260709 12:27:14.418351 13403 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:14.420336 12895 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:14.418066 13100 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:14.423164 13523 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:14.379410 13479 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:27:14.465575 13396 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:14.492118  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:14.493439  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.494416  6118 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 18 index: 11. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:27:14.494850  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:14.496613  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:14.498796  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:14.468538 12895 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.502499  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.503786  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.502686  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.428265 13468 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.508088  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:14.490217 13388 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.509845 13388 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.472627 13100 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:14.510686 13584 log.cc:927] Time spent T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.166s	user 0.001s	sys 0.000s
I20260709 12:27:14.511142  6645 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:27:14.512141 13388 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.512434 13100 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.483628 13523 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.515873 13523 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.486593 13403 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.519482 13403 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.472481 13456 consensus_queue.cc:1048] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.029s
I20260709 12:27:14.522830 13551 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.524118  6109 raft_consensus.cc:2393] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 21: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:14.525019 13551 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.507148 12895 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:14.483454 13174 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:14.527467 13590 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.055s	user 0.000s	sys 0.001s
I20260709 12:27:14.528447 13174 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:14.536923 13448 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.537266 12895 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.537462 13448 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.541986  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.542819  6118 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 22: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:14.543661  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.552007  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.553352  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.554217  6649 raft_consensus.cc:2410] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:27:14.556800  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:14.554746 13589 log.cc:927] Time spent T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.067s	user 0.000s	sys 0.001s
W20260709 12:27:14.555168 13588 log.cc:927] Time spent T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.123s	user 0.001s	sys 0.000s
W20260709 12:27:14.595069 13592 log.cc:927] Time spent T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.095s	user 0.000s	sys 0.000s
I20260709 12:27:14.598039 13448 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.599195 13369 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.600993 13524 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:14.603128 13595 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:27:14.563356 13479 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 31 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.605333 13479 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 31 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.631868 13240 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.641752 13240 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.644038 13240 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:14.644960 13352 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:14.645555 13352 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:14.657866  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 163779us
I20260709 12:27:14.660597  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:14.661768  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:14.664611  6042 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
W20260709 12:27:14.666560  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 122502us
I20260709 12:27:14.667213  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.668012  5963 raft_consensus.cc:2393] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 21: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:14.668689  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.666741  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.674405  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.675028  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 10 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.675472  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.669839 13471 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:14.679081  5960 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:27:14.681282  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:14.681815  6043 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:27:14.662516 13460 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
I20260709 12:27:14.683686  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:14.681137  6609 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:14.683050  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 18 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.684273  6036 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:27:14.684769  5961 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:14.686293  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.686861  5965 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:14.687564 13470 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:14.691164 13470 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.691542 13470 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:14.692222 13352 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.694557 13396 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.691190  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.696707 13396 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.698181 13352 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.698498  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:14.698678 13352 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.699608  6645 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:14.699049  6647 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:14.700676 13352 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.671089 13524 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.018s
I20260709 12:27:14.709654  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:14.709537 13369 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:14.713076  6647 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 25.
I20260709 12:27:14.710839 12895 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.710353  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 31 candidate_status { last_received { term: 28 index: 20 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:14.713769  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:14.715613  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:14.724491  6642 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 22
I20260709 12:27:14.687889 13523 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:14.710274 13612 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:14.724548 13485 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:27:14.719306  6043 raft_consensus.cc:2468] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 31 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 31.
I20260709 12:27:14.726444  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:14.721035 13305 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.723971 13460 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:27:14.769848  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 43492.2us
W20260709 12:27:14.771481  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.772938  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.773753  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:14.775928  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.776782  6647 raft_consensus.cc:2410] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:27:14.779618  6113 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 16 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:27:14.780721  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.774567  6608 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:14.781454  6642 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 22.
I20260709 12:27:14.782970  6084 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:27:14.783291  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.784822 13525 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:14.768172 13485 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:14.790740  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:14.794085  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:14.779150 13433 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:14.796600  6113 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 23.
I20260709 12:27:14.797014  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:14.798972  6115 raft_consensus.cc:2393] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 20: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:14.798058  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:14.797255  6608 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:14.766351 13612 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.801211 13488 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:14.797394 13541 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.005s
I20260709 12:27:14.803113 13369 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:27:14.805408  5967 rpcz_store.cc:267] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 3248) took 1380 ms (client timeout 1639 ms). Trace:
W20260709 12:27:14.806655  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.797025 13460 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 9, Time since last communication: 0.015s
I20260709 12:27:14.812220  6084 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:14.815429 13531 raft_consensus.cc:3055] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Stepping down as leader of term 18
W20260709 12:27:14.823544  5967 rpcz_store.cc:269] 0709 12:27:13.424571 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.431010 (+  6439us) service_pool.cc:224] Handling call
0709 12:27:14.805186 (+1374176us) spinlock_profiling.cc:243] Waited 907 ms on lock 0x7b5400260554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:14.805341 (+   155us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":2086134144}
I20260709 12:27:14.819141 13388 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:14.819587 13600 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:14.820233 13451 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:14.789880 13308 raft_consensus.cc:2804] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:14.828585  6645 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:27:14.765031 13523 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.782224 13305 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.824625 13460 consensus_queue.cc:1243] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer 0069e2ba1f02412e8e1d6c20a1fb510f log is divergent from this leader: its last log entry 16.11 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 9
I20260709 12:27:14.778702 13471 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.828418 13388 raft_consensus.cc:493] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.830343 13600 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:14.830533 13477 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:14.826867 13531 raft_consensus.cc:740] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:27:14.846376  6611 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.837385 13112 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.853276 13305 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.847333 13485 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.862903 13112 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.865216 13112 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.866786 13523 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.867385  6645 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 31 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 30. Current term is 31. Ops: []
I20260709 12:27:14.869534  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.869123 13612 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:14.834964 13451 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.869282 13433 consensus_queue.cc:1059] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
I20260709 12:27:14.871641 13433 raft_consensus.cc:3055] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 30 LEADER]: Stepping down as leader of term 30
I20260709 12:27:14.872016 13433 raft_consensus.cc:740] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 30 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:14.872315 13451 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.872859 13433 consensus_queue.cc:260] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 30.21, Last appended by leader: 21, Current term: 30, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.873323 13531 consensus_queue.cc:260] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.874408 13433 raft_consensus.cc:3060] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 30 FOLLOWER]: Advancing to term 31
I20260709 12:27:14.841849 13308 raft_consensus.cc:697] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:14.875483 13308 consensus_queue.cc:237] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.847020 13388 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:14.854300 13477 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:14.882089 13477 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:14.882817 13571 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.883970 13510 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.884464 13510 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.888149  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:14.859375 13600 raft_consensus.cc:3060] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:14.891338 13470 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:14.893905 13576 log.cc:927] Time spent T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.972s	user 0.002s	sys 0.000s
I20260709 12:27:14.894119 13470 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:14.894201  6609 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:14.840687 13467 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.050s
I20260709 12:27:14.900398 13467 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:14.901134 13541 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:14.900946 13467 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:27:14.901605 13541 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.902001 13541 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:14.894704  6650 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:27:14.907361 13433 consensus_queue.cc:1059] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 16.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:27:14.908589 13460 raft_consensus.cc:3055] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:14.908985 13460 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:14.909801 13460 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.910799 13460 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:14.912631  6609 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 31 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:27:14.915524 13613 log.cc:927] Time spent T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.224s	user 0.002s	sys 0.000s
I20260709 12:27:14.918731 13240 raft_consensus.cc:2804] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 31 FOLLOWER]: Leader election won for term 31
I20260709 12:27:14.919317 13240 raft_consensus.cc:697] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 31 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:14.920349  5934 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:14.921100 13481 raft_consensus.cc:3055] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:27:14.921603  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:14.922503 13448 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:14.922899 13448 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:14.923326 13448 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:14.922796 13240 consensus_queue.cc:237] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 28.20, Last appended by leader: 20, Current term: 31, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.929220 13571 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.929812 13571 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.931318 13568 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:14.931900 13571 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:14.932241 13174 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:14.932760 13174 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.921650 13481 raft_consensus.cc:740] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:14.935070 13481 consensus_queue.cc:260] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.931859 13568 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.938668 13568 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:14.939440 13604 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.269s	user 0.001s	sys 0.000s
I20260709 12:27:14.941413  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.939327 13448 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.944984  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34550 (request call id 3253) took 1519 ms. Trace:
I20260709 12:27:14.945421  5959 rpcz_store.cc:276] 0709 12:27:13.425861 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.426031 (+   170us) service_pool.cc:224] Handling call
0709 12:27:14.944822 (+1518791us) spinlock_profiling.cc:243] Waited 525 ms on lock 0x7b5400197b54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:14.944927 (+   105us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1206674816}
I20260709 12:27:14.936214 13174 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:14.947685  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.947703 13174 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:14.949231 13174 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:14.952162 13174 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:14.359196  6039 rpcz_store.cc:276] 0709 12:27:13.128799 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:13.128932 (+   133us) service_pool.cc:224] Handling call
0709 12:27:13.162515 (+ 33583us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:13.162719 (+   204us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:27:13.178696 (+ 15977us) log.cc:844] Serialized 14 byte log entry
0709 12:27:14.199979 (+1021283us) spinlock_profiling.cc:243] Waited 3.34 ms on lock 0x7b18003c64c0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf423a 00007f482105ea2a
0709 12:27:14.358371 (+158392us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:14.358423 (+    52us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:14.358492 (+    69us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:14.358568 (+    76us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:14.358670 (+   102us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2804,"prepare.queue_time_us":15849,"prepare.run_cpu_time_us":52,"prepare.run_wall_time_us":54,"raft.queue_time_us":2977,"spinlock_wait_cycles":7688064,"thread_start_us":155338,"threads_started":1}
I20260709 12:27:14.956662  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:14.957507  6116 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:14.958633  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:14.960326  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:14.961120  6039 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 22.
I20260709 12:27:14.874588 13531 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:14.966876  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:14.969005  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 171813us
I20260709 12:27:14.970934  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:14.971604  6037 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:14.972424 13176 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:14.973014 13176 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.961731 13542 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:14.975220 13176 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.921162 13433 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:14.971280  6116 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 24.
I20260709 12:27:14.989390  6609 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:14.993096  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:14.974975 13542 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:14.979297  6039 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:27:14.994046  5934 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:14.982656  6037 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
W20260709 12:27:14.988234  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:14.990237  6042 raft_consensus.cc:1240] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:14.990350  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:14.991170  6115 raft_consensus.cc:1217] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Deduplicated request from leader. Original: 13.9->[15.10-18.12]   Dedup: 15.10->[17.11-18.12]
I20260709 12:27:14.998716  6115 pending_rounds.cc:85] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 10
I20260709 12:27:14.998656  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:14.999119  6115 pending_rounds.cc:107] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 16.11
I20260709 12:27:14.999446  6115 raft_consensus.cc:2889] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:14.999692  5967 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 21.
I20260709 12:27:15.002187  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.002907  6117 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 14.
I20260709 12:27:14.887065 13510 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:14.999588  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:15.006450  5959 raft_consensus.cc:2410] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 13.
I20260709 12:27:14.936671 13481 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:14.961710 13174 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:14.962030 13460 raft_consensus.cc:3060] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:15.019027  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:15.019938  5965 raft_consensus.cc:2393] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 22: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:14.971598 13468 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:14.960388 13448 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:15.023694  5934 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:15.010996 13176 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:27:15.038877 13571 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.041467 13488 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:15.058809 13456 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:15.051923 13433 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:15.057961 13176 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:15.039896 13174 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.087543  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.089191  6040 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:27:15.093304 13176 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 22.11, Last appended by leader: 11, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.111701  6042 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 15: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:15.081357 13542 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:15.088068 13456 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:15.094935 13485 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:15.096848 13602 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.442s	user 0.003s	sys 0.000s
I20260709 12:27:15.097174 13549 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:15.071815 13571 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.098609  5934 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:15.098804 13467 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:15.106949  6037 raft_consensus.cc:1275] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:27:15.113606  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.114281  6113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:27:15.086534 13433 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.116161  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:27:15.079010 13599 log.cc:927] Time spent T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.416s	user 0.005s	sys 0.000s
I20260709 12:27:15.126362  6042 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 15: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:15.117861  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:15.122279  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 27 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:15.125204 13510 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:15.115904 13419 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:15.131807  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.112963 13471 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:15.124511  6113 raft_consensus.cc:606] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:15.133091  6113 raft_consensus.cc:614] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:15.129477  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.117425 13456 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:15.115020 13388 raft_consensus.cc:515] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.082835 13488 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.130829  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:15.138388  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 144611us
I20260709 12:27:15.141566  6037 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:27:15.139200  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.127611 13433 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:15.154079  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.151818 13609 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:15.156503  6109 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:27:15.156884  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.156710 13609 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:15.157987  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.159291  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.159582  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.160619 13609 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:15.161818  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 18 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.162648  6110 raft_consensus.cc:2393] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 19: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:15.163035  6112 raft_consensus.cc:3060] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:15.164398  6044 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 17: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:15.164904  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.154968  6609 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:15.163451  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.165691  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.166392  6039 raft_consensus.cc:2393] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 19: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:15.139681 13157 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:27:15.168226  6110 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 21: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:15.169796  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.120707 13485 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.134613 13623 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:15.179587  6645 raft_consensus.cc:2368] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19.
I20260709 12:27:15.185240  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.186048  6037 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 23.
I20260709 12:27:15.188268  6040 raft_consensus.cc:1240] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 31 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 30. Current term is 31. Ops: [28.20-30.21]
I20260709 12:27:15.189771  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:15.175316  6113 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:27:15.187335  6042 raft_consensus.cc:1240] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:27:15.194077  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:15.196026  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.196967  6042 raft_consensus.cc:2410] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 19 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:27:15.191819  6081 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:15.197868  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.172665 13157 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:15.201174 13157 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.202275 13157 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:15.202740  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:15.203544  6111 raft_consensus.cc:2368] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21.
I20260709 12:27:15.205647 13541 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.206358 13388 leader_election.cc:290] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:15.128501 13549 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.168018 13448 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:15.167804 13318 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:15.213032  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:15.274608  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 61670.9us
I20260709 12:27:15.274708  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:27:15.214258 13605 log.cc:927] Time spent T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.523s	user 0.002s	sys 0.000s
I20260709 12:27:15.217381 13477 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.297143 13369 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:15.297814 13369 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.298909 13477 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:15.219142  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.299724  6038 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
I20260709 12:27:15.300024 13369 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:15.219916 13485 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:15.221203  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.300904  6111 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:27:15.301146  6116 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17. Ops: []
I20260709 12:27:15.301842  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.303018  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.303668  6111 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 15: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:15.226049 13510 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:15.222297  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:15.304508  6043 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:15.228927  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:15.306934 13625 log.cc:927] Time spent T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.186s	user 0.000s	sys 0.000s
W20260709 12:27:15.177409 13601 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.500s	user 0.000s	sys 0.003s
I20260709 12:27:15.261579  6112 raft_consensus.cc:1275] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 17. (index mismatch)
I20260709 12:27:15.308347  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.308733 13451 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.309463  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.309284 13451 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.262959  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:15.265172  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.207552 13571 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:15.136063 13419 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.139890 13471 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:15.311088  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48212.2us
I20260709 12:27:15.312175  6009 leader_election.cc:400] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21.
I20260709 12:27:15.312908  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:15.313234 13471 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:15.313799 13318 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.303723  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.314615 13485 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:15.315096  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.315207  6113 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:27:15.315847 13157 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:15.198010 13387 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:15.316831 13387 raft_consensus.cc:697] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:15.316262  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.317341  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.316277 13157 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:15.317919  6116 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 23.
I20260709 12:27:15.317714 13387 consensus_queue.cc:237] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.9, Last appended by leader: 9, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.318264 13157 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:15.318866  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.319695  6116 raft_consensus.cc:2410] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 20 because replica has last-logged OpId of term: 19 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 17 index: 14.
I20260709 12:27:15.282732 13448 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.286911 13488 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:15.287364 13514 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:15.296376 13541 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:15.303509  6611 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:15.193974  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 14 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.232360 13631 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:15.338768  6036 raft_consensus.cc:2393] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 14: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:15.259572 13454 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:15.308359  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:15.321043  6112 raft_consensus.cc:2393] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 24: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:15.324926  6009 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:15.349844  6111 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Advancing to term 25
I20260709 12:27:15.337984 13541 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:15.351917  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.354102  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:15.355345  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:15.348815  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.347898 13514 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:15.320427  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.358240  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:15.333194  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.315907 13318 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:15.335276 13629 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:15.335657 13419 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:15.311012 13571 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:15.358448 13631 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:15.336391  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:15.365406 13631 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.365939  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:15.337960 13448 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:15.316623  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.370069  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.339603  6109 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
W20260709 12:27:15.276587 13624 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.126s	user 0.000s	sys 0.001s
W20260709 12:27:15.236457 13583 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.766s	user 0.005s	sys 0.019s
I20260709 12:27:15.351524 13454 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.364197  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.371182  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.372450  6113 raft_consensus.cc:2393] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 20: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:15.173276 13621 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.166s
I20260709 12:27:15.363665 13485 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:15.375068  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:15.399894  6113 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:27:15.331247  6043 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 24.
W20260709 12:27:15.387406  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.348167 13510 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:15.400867  6113 raft_consensus.cc:606] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:15.367672 13467 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:15.357219 12925 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:15.365415 13479 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:15.374135 13583 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.907s	user 0.006s	sys 0.020s
I20260709 12:27:15.372143 13571 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:15.373375 13466 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:15.415868  6043 raft_consensus.cc:3055] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:27:15.416270  6043 raft_consensus.cc:740] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:15.397897 13454 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:15.420570  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.421324  6036 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:15.417025  6043 consensus_queue.cc:260] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 26.16, Last appended by leader: 16, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.422781  6043 raft_consensus.cc:3060] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:15.425096  6116 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:15.399557 13485 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:15.369235 13514 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.410873 13457 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:15.441272  6043 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 26 index: 16. Preceding OpId from leader: term: 27 index: 16. (term mismatch)
I20260709 12:27:15.443917  6043 pending_rounds.cc:85] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 15
I20260709 12:27:15.444941  6043 pending_rounds.cc:107] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 26.16
I20260709 12:27:15.445845  6043 raft_consensus.cc:2889] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:15.450495  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.447510  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:15.410104 13388 consensus_queue.cc:1048] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.029s
I20260709 12:27:15.459352  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.433092 13485 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:15.470870 13448 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.471462 13448 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.473542 13448 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:15.474977 13626 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.063s	user 0.000s	sys 0.000s
I20260709 12:27:15.476058 13456 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.452819 13174 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:15.480803 13433 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.431674 13460 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:15.410089 13157 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.484439  5961 raft_consensus.cc:1240] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:15.410291 13510 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.456493 13369 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.485534 13369 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.486326  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:15.487597 13369 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:15.485438  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:15.488734  5965 raft_consensus.cc:2393] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 18: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:15.489455  5960 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21. Ops: []
I20260709 12:27:15.491688  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.491888 13510 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:15.492461 13510 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.492918 13510 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:15.495019 13600 consensus_meta.cc:287] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.605s	user 0.010s	sys 0.000s
I20260709 12:27:15.495460 13600 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.495811  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.497565  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.497946 13600 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981)
I20260709 12:27:15.498309  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:15.499061 13451 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:15.490327  5967 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 24. Current term is 25. Ops: []
I20260709 12:27:15.488833  5964 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:27:15.500764 13514 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:15.501259  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.501941  6113 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:27:15.462914 13549 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:15.504279  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.505429  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.505996  6109 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 24.
I20260709 12:27:15.497874  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.507157  5966 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:27:15.485183  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:15.507836  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.492372  6112 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:27:15.508445  5959 raft_consensus.cc:2393] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 15: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:15.509024  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.499070  6037 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 17: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:15.499199  6038 raft_consensus.cc:1275] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:27:15.509230  5934 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:15.511175  6009 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:15.478247 13456 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:15.518260  5934 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:15.485194 13157 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:15.488080 13369 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:15.528093 13369 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:27:15.528714  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:15.529614  6109 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:15.530980 13433 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:15.531597 13433 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:15.519115  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.531962 13433 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.532316 13433 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:15.534006  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:15.534641  5964 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:27:15.535804  5960 raft_consensus.cc:2955] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Committing config change with OpId 18.12: config changed from index -1 to 12, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:27:15.537993  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:15.515364 13457 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:15.539597 13457 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.541649 13457 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:15.528014  6116 raft_consensus.cc:1275] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:27:15.542582 12895 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:15.543046  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.543718 13510 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:15.544200  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:15.544755  6116 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:15.546895  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:15.548239  5963 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:27:15.548954  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:15.549583  5968 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
W20260709 12:27:15.527972 13481 consensus_meta.cc:287] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.510s	user 0.007s	sys 0.002s
I20260709 12:27:15.523506  6112 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:27:15.524899  6113 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:15.526335  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:15.551236  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:15.551004  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 384047us
I20260709 12:27:15.515129 13460 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:15.556974  6111 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 25.
I20260709 12:27:15.559755  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:15.570227  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.570505  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:15.566331  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:15.568526  5966 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:27:15.570912  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:15.570987  6111 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
I20260709 12:27:15.572319  5934 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:15.572834  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:15.573407  6037 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17. Ops: []
I20260709 12:27:15.573887  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:15.551772 13547 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:15.530388 13369 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:15.554131 13448 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:15.574836  6040 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:15.576015  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:15.567613  6112 raft_consensus.cc:606] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:15.628438  6109 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:27:15.631405  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:15.632000  6608 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.010s	sys 0.018s
W20260709 12:27:15.598476  5933 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.583796  6111 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21. Ops: []
I20260709 12:27:15.633965  6116 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
W20260709 12:27:15.634414  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 58468.1us
W20260709 12:27:15.632340  6608 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.631s	user 0.010s	sys 0.018s
W20260709 12:27:15.641212  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 639676us
I20260709 12:27:15.641901  6082 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:15.641949  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:15.645459  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:15.646144  6038 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:15.550385 13454 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.647249  6082 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:15.580348 13530 raft_consensus.cc:1064] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:27:15.579270 13583 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:15.644877 13448 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.656461  6112 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17. Ops: []
I20260709 12:27:15.656338  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:15.583050 13514 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:15.658628  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7df97235d12b46dd8e54f8f1d6ed40bd" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:15.676247  5963 raft_consensus.cc:3060] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:15.580027 13635 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:15.659624  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:15.580650 13547 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:15.662503  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:15.664788  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:15.669744 13514 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.678845  5967 raft_consensus.cc:2393] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 22: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:15.680446 13547 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:15.582242 13240 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:15.580209 13460 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.651208 13549 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:15.654383 13544 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:15.669387 13448 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:15.671077  6114 raft_consensus.cc:2393] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 22: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:15.671200  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 18 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:15.650929 13540 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:15.651120 13451 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:15.675334  5964 raft_consensus.cc:2468] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 22.
I20260709 12:27:15.734148  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:15.678735 13514 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:15.682535  6038 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:15.563545 13539 consensus_queue.cc:1048] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.089s
W20260709 12:27:15.685633  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.685739  5934 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:15.736858  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51195.7us
I20260709 12:27:15.692732 13583 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:15.734163  6608 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:15.741269  5963 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:15.688572  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:15.762823  5962 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:15.764150 13530 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 10, Current term: 18, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.690172  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:15.693183  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:27:15.700461  6040 raft_consensus.cc:2468] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:15.708930  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.769048  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.769412  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:15.769687  6111 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:15.711072  6082 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:27:15.684020  6118 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.730s	user 0.028s	sys 0.012s
I20260709 12:27:15.771008  5963 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:27:15.730654  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 15 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:15.687862  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:15.748243  5934 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.748448  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 18 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:15.749287  5964 raft_consensus.cc:1275] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 27 index: 16. (index mismatch)
I20260709 12:27:15.773422  5966 raft_consensus.cc:2410] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 18 because replica has last-logged OpId of term: 17 index: 14, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 13.
I20260709 12:27:15.749706 13541 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:15.754411  5863 catalog_manager.cc:5697] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 21 to 22, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 22 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.774510  5966 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:27:15.774840  6608 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:15.772944  5968 raft_consensus.cc:2376] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15. Re-sending same reply.
I20260709 12:27:15.757450 13460 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:15.696518 13240 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.753643  5961 raft_consensus.cc:2468] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
W20260709 12:27:15.758838  5866 rpcz_store.cc:267] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 330) took 13860 ms (client timeout 15000 ms). Trace:
I20260709 12:27:15.729537 12895 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:15.785445 12895 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.787552 12895 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:15.789407 13240 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:15.772434  6118 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.818s	user 0.028s	sys 0.012s
I20260709 12:27:15.690358  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:15.772935  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 61966.8us
I20260709 12:27:15.776541  5863 catalog_manager.cc:5697] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:15.779975  6114 raft_consensus.cc:2393] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 19: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:15.792621  6082 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:15.792484  5863 catalog_manager.cc:5697] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 13 to 17, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 17 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:15.693703 13470 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.082s
I20260709 12:27:15.736613 13451 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:15.799448  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:15.799742  6611 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:15.800026  6039 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:15.793859  5863 catalog_manager.cc:5697] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 15, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 15 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:15.796787  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 106513us
I20260709 12:27:15.800810 13583 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:15.759511 13369 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:15.759363 13454 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:15.805414  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:15.805866  5863 catalog_manager.cc:5697] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 8 to 10, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 10 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:15.807293  5863 catalog_manager.cc:5697] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 13 to 14, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 14 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:15.809644  5932 leader_election.cc:304] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:15.811630  5863 catalog_manager.cc:5697] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 12 to 14, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 14 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.813064  6039 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 22.
I20260709 12:27:15.803380 13540 consensus_queue.cc:1048] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.011s
I20260709 12:27:15.815070  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:15.823016  6042 raft_consensus.cc:2368] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18.
W20260709 12:27:15.823397  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:15.782622 13318 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:15.801894 13460 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:15.783020  5866 rpcz_store.cc:269] 0709 12:27:01.898940 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:01.899340 (+   400us) service_pool.cc:224] Handling call
0709 12:27:15.758770 (+13859430us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:11.872313 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:11.899653 (+ 27340us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:11.899696 (+    43us) write_op.cc:435] Acquired schema lock
0709 12:27:11.899715 (+    19us) tablet.cc:662] Decoding operations
0709 12:27:11.900687 (+   972us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:11.900744 (+    57us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:11.900773 (+    29us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:27:11.901396 (+   623us) tablet.cc:701] Row locks acquired
0709 12:27:11.901415 (+    19us) write_op.cc:260] PREPARE: finished
0709 12:27:11.901552 (+   137us) write_op.cc:270] Start()
0709 12:27:11.901660 (+   108us) write_op.cc:276] Timestamp: P: 1783600031901509 usec, L: 0
0709 12:27:11.901683 (+    23us) op_driver.cc:348] REPLICATION: starting
0709 12:27:11.902310 (+   627us) log.cc:844] Serialized 3209 byte log entry
0709 12:27:12.703173 (+800863us) op_driver.cc:464] REPLICATION: finished
0709 12:27:12.870778 (+167605us) write_op.cc:301] APPLY: starting
0709 12:27:12.870858 (+    80us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:12.925717 (+ 54859us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:12.925843 (+   126us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:13.098527 (+172684us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:13.132948 (+ 34421us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:27:13.133002 (+    54us) write_op.cc:312] APPLY: finished
0709 12:27:13.133272 (+   270us) log.cc:844] Serialized 81 byte log entry
0709 12:27:13.133450 (+   178us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:13.133567 (+   117us) write_op.cc:454] Released schema lock
0709 12:27:13.133613 (+    46us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:13.134023 (+   410us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:13.134053 (+    30us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":591271,"reported_tablets":28,"child_traces":[["op",{"apply.queue_time_us":164002,"apply.run_cpu_time_us":12859,"apply.run_wall_time_us":263230,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37583,"num_ops":8,"prepare.queue_time_us":196502,"prepare.run_cpu_time_us":20546,"prepare.run_wall_time_us":154549,"raft.queue_time_us":206839,"raft.run_cpu_time_us":13741,"raft.run_wall_time_us":168666,"replication_time_us":772309,"thread_start_us":407676,"threads_started":4,"wal-append.queue_time_us":191056,"wal-append.run_cpu_time_us":33819,"wal-append.run_wall_time_us":2131380}]]}
W20260709 12:27:15.827605  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 51937.3us
I20260709 12:27:15.828691  6609 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:15.831646  5863 catalog_manager.cc:5697] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 21 to 22, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 22 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:15.833524  5863 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 16 to 18, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 18 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.835645  5863 catalog_manager.cc:5697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 15 to 19, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 19 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:15.836956  5863 catalog_manager.cc:5697] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 18 to 19, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 19 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.802624 13451 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:15.802918 12895 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:15.838629  5863 catalog_manager.cc:5697] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 12 to 14, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 14 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:15.839978  6036 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 22.
I20260709 12:27:15.846891  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:15.843231  6609 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:15.790540 13485 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.771863 13547 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.842638  5863 catalog_manager.cc:5697] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 10 to 11, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 11 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:15.825730 13318 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:27:15.854935  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 80181.3us
W20260709 12:27:15.854161  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 54490.6us
I20260709 12:27:15.856177  6608 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:15.846172 13460 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:15.866863  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:15.857511 13458 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:15.857837 13318 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:15.860504 13629 raft_consensus.cc:2804] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:15.857404  5863 catalog_manager.cc:5697] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 23 to 24, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 24 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:15.861295 13600 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:15.929270  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:15.863966 13488 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:15.932075  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:15.889146 12866 raft_consensus.cc:2804] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:15.890617  5863 catalog_manager.cc:5697] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 13 to 15, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 15 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:15.954222 13635 raft_consensus.cc:993] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:27:15.935009 13458 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:15.954900 13635 raft_consensus.cc:1081] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:27:15.955775 13458 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.928093 13600 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:15.958442 13600 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:15.935257 13622 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:15.959308 13622 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.959633 13547 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:15.961378 13622 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:15.962518  6645 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
W20260709 12:27:15.966099 13638 log.cc:927] Time spent T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.074s	user 0.000s	sys 0.000s
W20260709 12:27:15.968566 13639 log.cc:927] Time spent T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.115s	user 0.000s	sys 0.000s
I20260709 12:27:15.968815  6118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3667) took 1016 ms. Trace:
I20260709 12:27:15.968981  6115 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3668) took 1016 ms. Trace:
I20260709 12:27:15.969419 13629 raft_consensus.cc:697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:15.973188 12866 raft_consensus.cc:697] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:15.974201 12866 consensus_queue.cc:237] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 18.18, Last appended by leader: 18, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.970373 13629 consensus_queue.cc:237] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.954367 13485 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:15.969246  6118 rpcz_store.cc:276] 0709 12:27:14.952071 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.952528 (+   457us) service_pool.cc:224] Handling call
0709 12:27:14.952863 (+   335us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:14.953225 (+   362us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:14.953253 (+    28us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:14.953864 (+   611us) log.cc:844] Serialized 52 byte log entry
0709 12:27:15.790826 (+836962us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:27:15.814858 (+ 24032us) log.cc:844] Serialized 14 byte log entry
0709 12:27:15.815160 (+   302us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.815242 (+    82us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:15.952675 (+137433us) spinlock_profiling.cc:243] Waited 3.92 ms on lock 0x7b1800414040. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:27:15.962665 (+  9990us) raft_consensus.cc:1685] finished
0709 12:27:15.968614 (+  5949us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:15.968755 (+   141us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":30216,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":38,"raft.queue_time_us":7319,"raft.run_cpu_time_us":252,"raft.run_wall_time_us":18655,"spinlock_wait_cycles":9010048,"thread_start_us":836613,"threads_started":1,"wal-append.queue_time_us":982490}
I20260709 12:27:15.982120  6115 rpcz_store.cc:276] 0709 12:27:14.952412 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:14.954356 (+  1944us) service_pool.cc:224] Handling call
0709 12:27:14.990983 (+ 36627us) raft_consensus.cc:1471] Updating replica for 3 ops
0709 12:27:15.007622 (+ 16639us) raft_consensus.cc:1534] Early marking committed up to index 10
0709 12:27:15.140095 (+132473us) log.cc:844] Serialized 14 byte log entry
0709 12:27:15.646680 (+506585us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:15.647212 (+   532us) log.cc:844] Serialized 52 byte log entry
0709 12:27:15.647343 (+   131us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:15.694896 (+ 47553us) spinlock_profiling.cc:243] Waited 2.4 ms on lock 0x7b1800346660. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481dee1c0a 00007f4827621219 00007f481df69a40 00007f481df644e4 00007f481df64455 00007f4824a4c3c7 00007f482105e9a7 00007f482106e0bf 00007f482106e038
0709 12:27:15.695128 (+   232us) log.cc:844] Serialized 14 byte log entry
0709 12:27:15.695337 (+   209us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:15.695415 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:15.968773 (+273358us) raft_consensus.cc:1685] finished
0709 12:27:15.968808 (+    35us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:15.968929 (+   121us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":10203,"prepare.queue_time_us":206043,"prepare.run_cpu_time_us":94,"prepare.run_wall_time_us":1919,"raft.queue_time_us":37498,"raft.run_cpu_time_us":373,"raft.run_wall_time_us":18809,"spinlock_wait_cycles":5514496,"thread_start_us":577789,"threads_started":2,"wal-append.queue_time_us":680065}
I20260709 12:27:15.983707 13318 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.986306 13318 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:15.978060 13600 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:15.988240 13621 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:27:15.988777 13621 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:15.989713  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:15.990339  6115 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:15.863554 13541 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.070s
I20260709 12:27:15.963765  5863 catalog_manager.cc:5697] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 20 to 21, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 21 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:15.995574  5863 catalog_manager.cc:5697] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 16. New cstate: current_term: 16 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:15.997398  6115 raft_consensus.cc:2468] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:27:15.997908 13600 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:16.020205  6082 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:16.021930  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:16.022842  6115 raft_consensus.cc:2368] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 19. Current term is 20.
I20260709 12:27:16.035183  6082 leader_election.cc:400] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18.
I20260709 12:27:16.035622  6082 leader_election.cc:403] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:16.036387  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:16.038306 13454 raft_consensus.cc:2804] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:16.039022 13454 raft_consensus.cc:697] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:16.039223 13583 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:27:16.006261 13433 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:16.045248 13531 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.046336 13454 consensus_queue.cc:237] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 20.12, Last appended by leader: 12, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:15.963088 13488 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 22 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:16.056140  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:16.102772  6645 raft_consensus.cc:1275] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:27:16.049556 13531 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:16.063099 13631 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.571s	user 0.015s	sys 0.023s
I20260709 12:27:16.063144 13157 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.073041 13541 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.106568 13549 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:16.132709 13488 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:16.120317 13157 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:16.139128 13157 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:16.140177 13636 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.283s	user 0.000s	sys 0.001s
I20260709 12:27:16.142040 13433 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 26 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:16.143221 13433 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.144533 13539 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.145159 13539 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:16.149189 13539 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:16.149935 13544 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Leader pre-election lost for term 14. Reason: could not achieve majority
W20260709 12:27:16.112596 13631 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.620s	user 0.015s	sys 0.023s
I20260709 12:27:16.165259  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:16.168877  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:16.172386  6009 thread.cc:641] dns-resolver [worker] (thread pool) Time spent creating pthread: real 0.576s	user 0.016s	sys 0.024s
W20260709 12:27:16.172894  6009 thread.cc:608] dns-resolver [worker] (thread pool) Time spent starting thread: real 0.577s	user 0.016s	sys 0.024s
W20260709 12:27:16.173202  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 577543us
I20260709 12:27:16.175092  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:16.143754 13433 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:16.176329  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:16.178614  6115 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:27:16.128274 13541 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:16.181636  5959 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.502s	user 0.000s	sys 0.022s
W20260709 12:27:16.183271  5959 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.504s	user 0.000s	sys 0.022s
I20260709 12:27:16.198982  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:16.199919  6109 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
W20260709 12:27:16.208748  6009 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.220003 13621 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:16.221643 13621 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:16.222856  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:16.223616  6650 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
I20260709 12:27:16.232144  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
W20260709 12:27:16.235396  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.235705  6611 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:16.237330 13633 raft_consensus.cc:2804] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:16.237653  6037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36260
I20260709 12:27:16.237902 13633 raft_consensus.cc:697] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:16.238307  6037 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:16.238978  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:16.239631  6039 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:16.243981  6037 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:16.211313  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:16.281123  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:16.281994  6115 raft_consensus.cc:2368] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15.
I20260709 12:27:16.284034  6650 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 25 index: 18. (index mismatch)
I20260709 12:27:16.287226  6039 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:27:16.288759  6082 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:16.289604 13318 raft_consensus.cc:2804] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:27:16.290390  5960 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.534s	user 0.019s	sys 0.026s
W20260709 12:27:16.291381  5960 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.535s	user 0.019s	sys 0.026s
I20260709 12:27:16.292613  6643 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:27:16.292658  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:16.293874  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:27:16.309473 13457 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.508s	user 0.004s	sys 0.013s
I20260709 12:27:16.297176  6037 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting forced leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:16.264499 13647 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.298568  6041 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 12 index: 8. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:27:16.265143 13485 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election won for term 17
W20260709 12:27:16.300755  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 489935us
I20260709 12:27:16.329694  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:16.329795  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:16.304648  6006 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.297895 13318 raft_consensus.cc:697] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:16.238556 12925 consensus_queue.cc:1048] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.082s
W20260709 12:27:16.309126  6111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.537s	user 0.007s	sys 0.011s
W20260709 12:27:16.339705  6111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.568s	user 0.007s	sys 0.011s
I20260709 12:27:16.347636  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:16.316918  6116 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.625s	user 0.018s	sys 0.029s
I20260709 12:27:16.291148 13547 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.019s
W20260709 12:27:16.316882  5968 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.531s	user 0.008s	sys 0.008s
W20260709 12:27:16.365900  5968 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.580s	user 0.009s	sys 0.008s
I20260709 12:27:16.323427  6084 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:16.296727  5967 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.018s	sys 0.009s
I20260709 12:27:16.328159  6035 raft_consensus.cc:1240] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 20. Current term is 21. Ops: []
W20260709 12:27:16.381928  5967 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.018s	sys 0.009s
W20260709 12:27:16.316579  6040 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.527s	user 0.010s	sys 0.008s
W20260709 12:27:16.351438  6116 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.660s	user 0.018s	sys 0.029s
I20260709 12:27:16.321777 13583 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18.
I20260709 12:27:16.361447  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:16.309803  6112 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.000s	sys 0.017s
I20260709 12:27:16.328614  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:16.388419  6112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.000s	sys 0.017s
I20260709 12:27:16.388682  6644 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
W20260709 12:27:16.382414  6040 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.593s	user 0.010s	sys 0.008s
I20260709 12:27:16.386859  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:16.387220  6037 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:16.328568 13457 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.527s	user 0.004s	sys 0.013s
I20260709 12:27:16.391644  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:16.395406  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 72082.5us
W20260709 12:27:16.400602 13648 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.094s	user 0.000s	sys 0.000s
W20260709 12:27:16.399495 13571 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.540s	user 0.004s	sys 0.027s
I20260709 12:27:16.409379  6084 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:16.415247  6043 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.614s	user 0.008s	sys 0.009s
W20260709 12:27:16.415573  6043 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.622s	user 0.008s	sys 0.009s
W20260709 12:27:16.416726  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.399623 13452 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:16.340338 13647 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:16.423447  6037 raft_consensus.cc:1275] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 31 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 31 index: 21. (index mismatch)
W20260709 12:27:16.418447 13571 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.561s	user 0.005s	sys 0.027s
W20260709 12:27:16.424721  5934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.602s	user 0.007s	sys 0.011s
W20260709 12:27:16.413652 13514 consensus_meta.cc:287] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.642s	user 0.006s	sys 0.004s
W20260709 12:27:16.428984  5934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.607s	user 0.007s	sys 0.011s
I20260709 12:27:16.406612 12866 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:16.348342 13633 consensus_queue.cc:237] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:16.423925 13510 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.000s	sys 0.018s
I20260709 12:27:16.446765  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:16.448982  5962 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.683s	user 0.014s	sys 0.020s
W20260709 12:27:16.450433  5962 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.684s	user 0.014s	sys 0.020s
W20260709 12:27:16.446975 13510 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.632s	user 0.000s	sys 0.018s
I20260709 12:27:16.426043 12925 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.021s
W20260709 12:27:16.438665 13369 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.600s	user 0.008s	sys 0.012s
I20260709 12:27:16.459131  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:16.440084 13539 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:16.444957 13433 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:16.433194 13600 consensus_queue.cc:1048] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 18, Time since last communication: 0.024s
I20260709 12:27:16.435307 13514 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:16.458508 13448 consensus_meta.cc:287] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.722s	user 0.010s	sys 0.001s
I20260709 12:27:16.428010 13318 consensus_queue.cc:237] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 19.12, Last appended by leader: 12, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:16.457257 13541 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:16.440418 12866 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:16.481460  6036 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.529s	user 0.002s	sys 0.013s
I20260709 12:27:16.509284  6116 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3594) took 1185 ms. Trace:
W20260709 12:27:16.466293 13369 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.639s	user 0.009s	sys 0.012s
I20260709 12:27:16.509723  6116 rpcz_store.cc:276] 0709 12:27:15.324299 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.651474 (+327175us) service_pool.cc:224] Handling call
0709 12:27:15.651905 (+   431us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:15.652895 (+   990us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:15.652931 (+    36us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:15.653401 (+   470us) log.cc:844] Serialized 26 byte log entry
0709 12:27:15.891756 (+238355us) spinlock_profiling.cc:243] Waited 2.64 ms on lock 0x7b48000b0c58. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4825f7daa1 00007f4825f74b37 00007f4825f749ca 00007f482606c26f 00007f482606bf37 00007f482608055c 00007f4826080508 00007f4826080488 00007f4826080443 00007f482607f6ec 00007f4824fa9a96
0709 12:27:16.382652 (+490896us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:16.382698 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.382776 (+    78us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:16.508988 (+126212us) raft_consensus.cc:1685] finished
0709 12:27:16.509009 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.509209 (+   200us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":231,"raft.run_cpu_time_us":3795,"raft.run_wall_time_us":279197,"spinlock_wait_cycles":6061312,"thread_start_us":691178,"threads_started":1,"wal-append.queue_time_us":805025}
W20260709 12:27:16.468940 13458 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.507s	user 0.005s	sys 0.020s
I20260709 12:27:16.511584 13369 raft_consensus.cc:697] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:27:16.512248 13458 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.551s	user 0.006s	sys 0.020s
W20260709 12:27:16.513264 13649 log.cc:927] Time spent T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.126s	user 0.001s	sys 0.000s
W20260709 12:27:16.514891 13652 log.cc:927] Time spent T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
W20260709 12:27:16.520504 13646 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.188s	user 0.000s	sys 0.001s
I20260709 12:27:16.520843 13460 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:16.521119  6036 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.570s	user 0.003s	sys 0.014s
I20260709 12:27:16.513670 13369 consensus_queue.cc:237] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 13.10, Last appended by leader: 10, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:16.522725 13467 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.664s	user 0.034s	sys 0.043s
W20260709 12:27:16.507037 13651 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.113s	user 0.000s	sys 0.001s
I20260709 12:27:16.541923 13448 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:16.558518 13448 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:16.566269  6081 leader_election.cc:336] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.639s (SENT)
I20260709 12:27:16.583288  6037 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20. Ops: []
I20260709 12:27:16.479367 13662 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:16.522274 13433 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.477149 13530 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:16.594491  6116 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 16 index: 17. Preceding OpId from leader: term: 19 index: 19. (index mismatch)
I20260709 12:27:16.521373 13460 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:16.585918 13467 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.734s	user 0.035s	sys 0.044s
W20260709 12:27:16.613200  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 320593us
I20260709 12:27:16.614918  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:16.615505  6116 raft_consensus.cc:3055] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:27:16.615895  6116 raft_consensus.cc:740] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:27:16.603413 13176 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.531s	user 0.018s	sys 0.006s
I20260709 12:27:16.593190 13514 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:16.642728  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 233425us
I20260709 12:27:16.602057 13662 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.671205 13662 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
W20260709 12:27:16.671334  6081 proxy.cc:239] Call had error, refreshing address and retrying: Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.735s (SENT) [suppressed 7 similar messages]
I20260709 12:27:16.671370  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:16.673039 13544 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:16.674311  6084 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:16.675642 13544 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:16.676195 13544 raft_consensus.cc:697] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:16.677029 13544 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 16.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:16.679764  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 12 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:16.681680 13662 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:16.682317 13452 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:27:16.675709  6009 leader_election.cc:400] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19.
I20260709 12:27:16.693157  6009 leader_election.cc:403] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:27:16.693703 13671 raft_consensus.cc:2749] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 18. Current term is 19.
I20260709 12:27:16.686913  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:16.694859  6646 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:27:16.602283  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 272568us
I20260709 12:27:16.696914  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:16.616694  6116 consensus_queue.cc:260] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:16.608466 13448 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.699831 13448 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:16.705806  6646 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:27:16.699375  6116 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:16.707567 13672 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.708132 13672 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:16.711892  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1922) took 1035 ms. Trace:
I20260709 12:27:16.712107 13662 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:16.712994  6116 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:27:16.712339  5959 rpcz_store.cc:276] 0709 12:27:15.676037 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.676979 (+   942us) service_pool.cc:224] Handling call
0709 12:27:15.677272 (+   293us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.677617 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 20
0709 12:27:16.183687 (+506070us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.677478 (+493791us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.711588 (+ 34110us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.711633 (+    45us) raft_consensus.cc:1645] Marking committed up to 20
0709 12:27:16.711679 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.711739 (+    60us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.711840 (+   101us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83371,"prepare.queue_time_us":794604,"prepare.run_cpu_time_us":98,"prepare.run_wall_time_us":4641,"raft.queue_time_us":140672,"raft.run_cpu_time_us":277,"raft.run_wall_time_us":275,"thread_start_us":923667,"threads_started":2}
I20260709 12:27:16.706336 13448 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:16.541965 13485 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:16.713382 13662 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:16.714255 13662 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:16.713835 13672 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:16.715236 13662 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:16.714509 13485 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:16.664925 13651 log.cc:927] Time spent T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:27:16.629730 12866 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:16.746615 13661 log.cc:927] Time spent T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.056s	user 0.000s	sys 0.001s
I20260709 12:27:16.611034 13629 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 17, Time since last communication: 0.117s
I20260709 12:27:16.608228 13433 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:16.611734 13530 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:16.723086 13673 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:16.689582 13540 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.078s
I20260709 12:27:16.781821  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:16.782887  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:16.784004  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 14 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:16.770609 13488 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.634s	user 0.006s	sys 0.032s
I20260709 12:27:16.814810  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:16.815711  5964 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 15 index: 10. (index mismatch)
I20260709 12:27:16.815862  5960 raft_consensus.cc:3060] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:16.817214  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 16 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:16.818106  5964 raft_consensus.cc:2410] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 20 because replica has last-logged OpId of term: 18 index: 18, which is greater than that of the candidate, which has last-logged OpId of term: 16 index: 17.
I20260709 12:27:16.818755  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:16.819603  5962 raft_consensus.cc:2410] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:27:16.743680 13622 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.039s
I20260709 12:27:16.846058  5960 raft_consensus.cc:2468] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 22.
I20260709 12:27:16.848191  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:16.848858  5963 raft_consensus.cc:3060] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 21
W20260709 12:27:16.816844 13488 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.680s	user 0.006s	sys 0.033s
I20260709 12:27:16.846861 13448 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:16.850924 13448 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:16.855788  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:16.813665 13647 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:16.850850 13669 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.088s	user 0.001s	sys 0.000s
I20260709 12:27:16.847522 13673 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:16.861433  6044 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.517s	user 0.017s	sys 0.026s
W20260709 12:27:16.863878  6044 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.520s	user 0.017s	sys 0.026s
I20260709 12:27:16.872290  5963 raft_consensus.cc:2468] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:27:16.818775 13686 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.073s
I20260709 12:27:16.857916 12866 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:27:16.818614 13662 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:16.932677  5967 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.550s	user 0.018s	sys 0.018s
W20260709 12:27:16.934316  5967 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.552s	user 0.018s	sys 0.018s
I20260709 12:27:16.924566 13157 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:16.915022 13673 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:16.926343 12866 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:16.955873 13682 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:17.048152 13682 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:16.962091 13460 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:16.970008  5968 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:37174 (request call id 1923) took 1195 ms. Trace:
W20260709 12:27:16.977376  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:16.984094  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:17.052630  5963 raft_consensus.cc:3060] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:17.051386  5968 rpcz_store.cc:276] 0709 12:27:15.774371 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.775846 (+  1475us) service_pool.cc:224] Handling call
0709 12:27:15.780006 (+  4160us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.780179 (+   173us) raft_consensus.cc:1534] Early marking committed up to index 17
0709 12:27:16.390340 (+610161us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.856857 (+466517us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.969493 (+112636us) spinlock_profiling.cc:243] Waited 13.1 ms on lock 0x7b180043eac0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481dee1c0a 00007f4827621219 00007f481df69a40 00007f481df644e4 00007f481df64455 00007f482104c060 00007f482105e716 00007f482106f287 00007f482106f208
0709 12:27:16.969662 (+   169us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:16.969714 (+    52us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:27:16.969758 (+    44us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.969823 (+    65us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.969948 (+   125us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":51824,"prepare.queue_time_us":690210,"prepare.run_cpu_time_us":66,"prepare.run_wall_time_us":67,"raft.queue_time_us":429355,"raft.run_cpu_time_us":219,"raft.run_wall_time_us":219,"spinlock_wait_cycles":30159104,"thread_start_us":1039561,"threads_started":2}
I20260709 12:27:17.050352 13682 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:16.982625 13157 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:17.059167  6118 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
W20260709 12:27:16.987169 13670 log.cc:927] Time spent T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.131s	user 0.000s	sys 0.000s
W20260709 12:27:16.991712 13680 log.cc:927] Time spent T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.134s	user 0.000s	sys 0.000s
I20260709 12:27:16.994755  6043 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 3147) took 1203 ms. Trace:
I20260709 12:27:17.063659 13673 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:17.063834 13460 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:17.064391  5934 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.629s	user 0.005s	sys 0.024s
W20260709 12:27:17.064811  5934 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.629s	user 0.005s	sys 0.024s
I20260709 12:27:17.064359 13460 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:17.066021  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:17.016675  6036 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:17.074941 13683 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:17.014127  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.077546  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:17.066709 13460 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:17.067623 13711 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:17.025897 13174 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.054s
I20260709 12:27:17.080041  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:17.011751 13621 consensus_meta.cc:287] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.790s	user 0.009s	sys 0.004s
I20260709 12:27:17.028613 13531 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:17.081899  5934 leader_election.cc:400] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 19. Current term is 20.
I20260709 12:27:17.040311 13539 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:17.083098 13539 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.085421 13539 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:17.024214  6006 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:17.086927 13174 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:17.088832 13157 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:17.026023 13686 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.064s
I20260709 12:27:17.009176 13530 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:17.009196  5960 raft_consensus.cc:2410] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 21 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
W20260709 12:27:17.004460 13451 consensus_meta.cc:287] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 1.155s	user 0.011s	sys 0.000s
I20260709 12:27:17.079412 13683 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:17.091851 13451 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:17.044126  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 345674us
I20260709 12:27:17.093592  6645 raft_consensus.cc:2410] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 22 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:27:17.010017 13448 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:17.063337  6043 rpcz_store.cc:276] 0709 12:27:15.791494 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.793164 (+  1670us) service_pool.cc:224] Handling call
0709 12:27:15.793448 (+   284us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:16.415905 (+622457us) raft_consensus.cc:1534] Early marking committed up to index 13
0709 12:27:16.440995 (+ 25090us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.860350 (+419355us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:16.914869 (+ 54519us) log.cc:844] Serialized 26 byte log entry
0709 12:27:16.915028 (+   159us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:16.921710 (+  6682us) log.cc:844] Serialized 14 byte log entry
0709 12:27:16.924007 (+  2297us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:16.924107 (+   100us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:16.994533 (+ 70426us) raft_consensus.cc:1685] finished
0709 12:27:16.994554 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:16.994694 (+   140us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1967,"prepare.queue_time_us":27763,"prepare.run_cpu_time_us":154,"prepare.run_wall_time_us":10939,"raft.queue_time_us":169346,"raft.run_cpu_time_us":333,"raft.run_wall_time_us":56104,"thread_start_us":1018013,"threads_started":2,"wal-append.queue_time_us":536455}
I20260709 12:27:17.009835 13433 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:17.093668  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:17.011142 13662 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:17.097312  6009 leader_election.cc:400] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15.
I20260709 12:27:17.013216 13457 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:17.013870 12866 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:17.082248  5934 leader_election.cc:403] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:17.040457  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:16.987583 13664 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.146s	user 0.000s	sys 0.000s
I20260709 12:27:17.100737  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:17.101495  5964 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:27:17.103041 13433 raft_consensus.cc:3060] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:27:17.082129 13460 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:27:17.106576  6608 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.097854 13457 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.107999 13451 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:17.071702 13479 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:17.108880 13457 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:17.108887  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:17.111056  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:17.097572 13662 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
I20260709 12:27:17.113933  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:17.114805  5959 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 21.
I20260709 12:27:17.115720 12866 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:17.117314  5959 raft_consensus.cc:1275] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 18 index: 18. Preceding OpId from leader: term: 19 index: 19. (index mismatch)
I20260709 12:27:17.097612  6009 leader_election.cc:403] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 14 election: Cancelling election due to peer responding with higher term
I20260709 12:27:17.119464  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:17.120281  5959 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:27:17.119531 13457 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:17.125218 13174 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
W20260709 12:27:17.091037  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 66898.1us
I20260709 12:27:17.127115  6642 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:27:17.129817 13457 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election lost for term 14. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 14. Current term is 15.
I20260709 12:27:17.035458  5967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3302) took 1346 ms. Trace:
I20260709 12:27:17.137557  5959 raft_consensus.cc:1275] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:17.138131  6650 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:27:17.140779  5968 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 18 index: 14. (term mismatch)
I20260709 12:27:17.147347  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:17.150935  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:17.046607  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 375263us
I20260709 12:27:17.152766  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:17.119445  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:17.153599  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:17.154891  6110 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
I20260709 12:27:17.208775  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:17.156867  6608 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:17.158115  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:17.253798  6113 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:27:17.158898  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:17.255805  6116 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:17.259078  5934 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:17.161456  6035 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:27:17.165833  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:17.166316 13623 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:17.167081  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:17.168145  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:17.169202  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:17.172951  5962 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:27:17.173686  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:17.176710  5964 pending_rounds.cc:85] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 20
I20260709 12:27:17.179100 13673 raft_consensus.cc:493] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:17.271229  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 114433us
I20260709 12:27:17.190035 13433 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 19. Current term is 20.
I20260709 12:27:17.191001 13460 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:17.197202  5963 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:27:17.367926  5934 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:17.211637  6006 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:27:17.369095  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 157539us
I20260709 12:27:17.369874  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:17.212833  5967 rpcz_store.cc:276] 0709 12:27:15.689130 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:15.767019 (+ 77889us) service_pool.cc:224] Handling call
0709 12:27:15.767271 (+   252us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:15.767452 (+   181us) raft_consensus.cc:1534] Early marking committed up to index 11
0709 12:27:16.382412 (+614960us) log.cc:844] Serialized 14 byte log entry
0709 12:27:17.035095 (+652683us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:17.035152 (+    57us) raft_consensus.cc:1645] Marking committed up to 11
0709 12:27:17.035198 (+    46us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.035262 (+    64us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:17.035394 (+   132us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":98689,"prepare.queue_time_us":663389,"prepare.run_cpu_time_us":36,"prepare.run_wall_time_us":36,"raft.queue_time_us":98954,"raft.run_cpu_time_us":117,"raft.run_wall_time_us":117,"thread_start_us":1167669,"threads_started":2,"wal-append.queue_time_us":629345}
W20260709 12:27:17.236385 13544 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.556s	user 0.002s	sys 0.016s
I20260709 12:27:17.240986  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:17.239032  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:17.239106  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:17.238849  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 119469us
I20260709 12:27:17.372838  6009 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:17.373601  6081 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:17.242002  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:17.237957  5968 pending_rounds.cc:85] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 13
I20260709 12:27:17.374871  5968 pending_rounds.cc:107] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 17.14
I20260709 12:27:17.375200  5968 raft_consensus.cc:2889] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:16.953218 13547 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.549s	user 0.007s	sys 0.018s
W20260709 12:27:17.212899  6117 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.532s	user 0.006s	sys 0.011s
W20260709 12:27:17.377002  6117 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.696s	user 0.007s	sys 0.011s
W20260709 12:27:17.209086  6112 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.530s	user 0.000s	sys 0.016s
W20260709 12:27:17.378029  6112 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.699s	user 0.000s	sys 0.017s
I20260709 12:27:17.285429  6116 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 22.
I20260709 12:27:17.301666  6109 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:27:17.355192  6644 raft_consensus.cc:2410] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 18 because replica has last-logged OpId of term: 17 index: 15, which is greater than that of the candidate, which has last-logged OpId of term: 15 index: 14.
I20260709 12:27:17.353410  5964 pending_rounds.cc:107] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 30.21
I20260709 12:27:17.380071  5964 raft_consensus.cc:2889] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 31 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:17.358142  6111 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:27:17.374825  5961 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 21.
I20260709 12:27:17.385546  6114 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 21: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:17.388082  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:17.351430 13671 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.655s	user 0.009s	sys 0.004s
I20260709 12:27:17.300984 13689 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:27:17.388072  5934 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:17.384816 13544 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.705s	user 0.002s	sys 0.016s
I20260709 12:27:17.359441 13709 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:17.459714  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:17.358191 12866 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election won for term 16
W20260709 12:27:17.384493 13547 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.983s	user 0.008s	sys 0.019s
I20260709 12:27:17.394541  5960 raft_consensus.cc:1275] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:27:17.394387  6006 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:17.417680 13682 raft_consensus.cc:2804] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:27:17.403853  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:17.404211  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:17.405360  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:17.413589  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.414520  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.479418  6035 raft_consensus.cc:2368] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 20. Current term is 21.
I20260709 12:27:17.480371  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.480916  6035 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:27:17.481777  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.415244  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:17.413904  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.417181 13571 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:17.483201  6042 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 21.
I20260709 12:27:17.413322  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.359275 13690 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.102s
I20260709 12:27:17.416105  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:17.420331  5962 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:27:17.358038 13369 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:17.351850 13530 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:17.371562 13176 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:17.214087 13318 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.204s
I20260709 12:27:17.384274 13647 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:17.455315  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.411636  5934 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:17.455346  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:17.458353  5965 raft_consensus.cc:1275] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 20 index: 12. Preceding OpId from leader: term: 22 index: 13. (index mismatch)
I20260709 12:27:17.400956 13457 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:17.384563 13510 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:17.417438 13433 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:17.393821 13157 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:17.467842  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:17.400795 13711 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:27:17.401350 13662 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:17.401921 13671 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.706s	user 0.009s	sys 0.005s
W20260709 12:27:17.454679 13514 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.744s	user 0.040s	sys 0.029s
I20260709 12:27:17.390048 13676 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:27:17.473196  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 78881.1us
I20260709 12:27:17.402994  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:17.511960  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 124474us
I20260709 12:27:17.475244  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:17.393167 13688 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:17.477432  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:17.518007  6114 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:17.486143  6036 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 25.
I20260709 12:27:17.519328  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.519958  6036 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:27:17.520803  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.521770  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.488390  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:17.522905  6039 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:17.372215 13673 raft_consensus.cc:515] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.484035  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:17.493803 13682 raft_consensus.cc:697] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
W20260709 12:27:17.490916  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:17.471134 13681 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:27:17.459766 13709 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:17.393226 13621 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.092s
W20260709 12:27:17.492877  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 89093.2us
I20260709 12:27:17.496330  6647 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:17.490666  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:17.496414  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 84855.5us
I20260709 12:27:17.422163 13672 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.067s
I20260709 12:27:17.468757 12866 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:17.390633 13460 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:17.482391  6035 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 22.
I20260709 12:27:17.551240  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.497862 13457 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:17.485895 13706 raft_consensus.cc:2764] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election decision vote started in defunct term 21: won
I20260709 12:27:17.517596 13711 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:17.512060  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:17.499872 13622 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:17.500416 13687 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:17.487356 13685 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.022s
I20260709 12:27:17.498858 13451 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:27:17.508765 13514 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.798s	user 0.040s	sys 0.030s
I20260709 12:27:17.542925 13709 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:17.536379  6608 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:17.493012 13369 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.495787 13530 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.497591 13571 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.518374 13433 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:17.499377 13176 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:17.556741  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 44763.4us
I20260709 12:27:17.593433  6006 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:17.500994 13647 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:17.506774 13510 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:17.508469 13157 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.609141 13157 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:17.576305 13712 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.152s	user 0.002s	sys 0.000s
W20260709 12:27:17.577405 13713 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.100s	user 0.000s	sys 0.000s
I20260709 12:27:17.552758 12866 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:17.610306 13686 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:17.610755 13686 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:17.611171 13686 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:17.612154 13530 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:17.532459  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.555665 13457 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:17.584147  6039 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 22.
I20260709 12:27:17.562579 13662 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:17.530910 13688 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:17.595453  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:17.620827  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:17.563508 13687 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:17.594753  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:17.609361 13703 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.141s	user 0.000s	sys 0.001s
I20260709 12:27:17.601517 13460 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:17.607110 13176 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:17.609977 13716 log.cc:927] Time spent T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.091s	user 0.000s	sys 0.000s
I20260709 12:27:17.655387 13369 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:17.619213  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 82911.7us
I20260709 12:27:17.656072 13711 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 19.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.656759  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:27:17.657507 13714 log.cc:927] Time spent T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.065s	user 0.000s	sys 0.000s
I20260709 12:27:17.658982 13629 consensus_queue.cc:1048] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:27:17.660429 13629 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:17.660786 13629 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:17.661151 13629 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:17.661940  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:17.624668  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 111971us
I20260709 12:27:17.627409  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:17.598763  6647 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:27:17.610637 13647 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:17.666193  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:17.655443  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.665693  6081 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:17.668136  6113 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:27:17.669788  6041 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:27:17.670581  6036 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 15 index: 11. (index mismatch)
I20260709 12:27:17.645900  6044 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 22 index: 11. Preceding OpId from leader: term: 24 index: 12. (index mismatch)
W20260709 12:27:17.647782 13724 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.088s	user 0.000s	sys 0.000s
I20260709 12:27:17.650847 13571 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:17.665107 13510 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:17.675894  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.631141 13481 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:17.677397  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:17.696460 13481 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:17.696939 13481 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:17.697640  6081 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:17.635905 13706 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:27:17.586298 13451 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:17.627997 13672 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:17.636140 13687 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:17.702721 13672 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.686379 13688 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:17.704705 13672 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:17.705458 13539 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:17.706089 13539 consensus_queue.cc:1048] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:17.613462 13433 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 19.11, Last appended by leader: 11, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.707754 13539 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:17.708235 13539 raft_consensus.cc:697] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:17.686321  6608 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:17.709633 13530 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:17.711040 13530 consensus_queue.cc:1048] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:17.711542 13600 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:27:17.712113 13600 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:17.711930 13686 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.713074 13600 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:17.713965 13686 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:17.714627 13479 consensus_queue.cc:1048] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:17.715126 12866 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:17.715837  6114 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:27:17.716105  6642 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:17.686980 13466 consensus_queue.cc:1048] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:17.718614 13732 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.718778 13730 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.000s
I20260709 12:27:17.719116 13732 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:17.688545 13643 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:27:17.720069  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:17.689319 13388 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:17.691525 13673 leader_election.cc:290] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:17.669486 13682 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 14, Current term: 21, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:17.721411 13732 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:17.721846 13737 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:17.722215  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:17.672982 13454 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:17.723088 13747 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:17.723235  6041 raft_consensus.cc:1240] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:17.724975  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:17.702226 13451 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:17.728135  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:17.731776  6643 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:17.750129 13481 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:17.751703  6648 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:17.719713 13635 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:17.733815 13539 consensus_queue.cc:237] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 14.8, Last appended by leader: 8, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.709148 13457 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:27:17.768999 13457 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:17.746236 13629 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:17.772864 13629 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:17.761178 13635 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.776463 13635 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:17.783962 13687 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.789661 13687 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:17.615193  5932 leader_election.cc:400] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 20. Current term is 21.
I20260709 12:27:17.838403  5932 leader_election.cc:403] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
W20260709 12:27:17.840803  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 225705us
W20260709 12:27:17.843633  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 255720us
I20260709 12:27:17.842281  5932 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
W20260709 12:27:17.858014  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 230551us
I20260709 12:27:17.861901  6009 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:17.864869  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:17.866480  5960 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:27:17.877251  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.877595  6038 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 19: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:17.878257  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 26 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:17.879870  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:17.901872  6035 raft_consensus.cc:1275] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 19 index: 12. Preceding OpId from leader: term: 21 index: 13. (index mismatch)
I20260709 12:27:17.758025 12866 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:17.909546  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:17.909919  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:17.910879  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:17.911890  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:17.919183  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 194112us
W20260709 12:27:17.922945  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 193213us
I20260709 12:27:17.923856 13318 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:17.925299 13318 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:27:17.926967 13157 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:17.930944 13174 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:27:17.931424 13457 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:17.932101 13457 raft_consensus.cc:697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:17.932720  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:17.939970  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:17.941001 12925 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:27:17.941535 12925 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:17.930945 13387 consensus_queue.cc:1048] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.012s
I20260709 12:27:17.951419 12925 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.14, Last appended by leader: 14, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.938951  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:17.956849  6039 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: []
W20260709 12:27:17.967304  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 49168.6us
I20260709 12:27:17.968014 13448 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:17.968951 13448 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:17.953894 12925 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:17.926302  6084 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:17.933930 13457 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 13.13, Last appended by leader: 13, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:18.025533  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 55716.4us
I20260709 12:27:18.015372 13689 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:17.794260 13709 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:18.083837 13709 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:18.086547  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:18.088600  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:18.092741  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 96930.9us
I20260709 12:27:18.094661 13672 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 20. Current term is 21.
I20260709 12:27:18.096829 13685 consensus_queue.cc:1059] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 15.13, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:27:18.098624 13673 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:18.099707 13673 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:18.102802  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 232481us
I20260709 12:27:18.090080  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:18.134004  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 207964us
I20260709 12:27:18.141669  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:18.142628 13387 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:18.143251 13387 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.143715 13387 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:18.143625  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:18.098790 13662 raft_consensus.cc:3055] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:18.171584  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:18.173309 13629 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:18.174407 13629 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.177196 13629 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:18.177323 13673 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:18.178040  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:18.182494 13688 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:18.183391 13688 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.184001 13688 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:27:18.173425  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.174661 13539 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:18.154934 13662 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:18.197845 13549 consensus_queue.cc:1059] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.003s
I20260709 12:27:18.199149 13448 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:18.201838  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:18.205193  6109 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21. Ops: [20.14-20.14]
I20260709 12:27:18.205969  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:18.206574 13709 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:18.201896  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:18.202113  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:18.215116 13647 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.220170 13732 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:18.220989  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 84822us
I20260709 12:27:18.224131 13732 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.241919  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:18.252149  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:18.269246  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 99383.8us
I20260709 12:27:18.270345  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:18.270635  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:18.272943 13732 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:18.275458 13647 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:18.277966 13647 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:18.279738  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:18.283018  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:18.284518 13318 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:27:18.284832 13726 log.cc:927] Time spent T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.666s	user 0.000s	sys 0.002s
I20260709 12:27:18.268249  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:18.254890 13433 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Leader election lost for term 26. Reason: could not achieve majority
I20260709 12:27:18.302220  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:18.326227 13662 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.327710 13662 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:27:18.330829  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 161472us
I20260709 12:27:18.330834 13623 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:18.332585 13623 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:18.332999 13623 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:18.334167  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:18.334038  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:18.334672  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:18.342449  6038 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:18.267604 13539 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.363435 13514 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:18.374377  6082 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:18.382004  6040 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:27:18.383387  5932 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:18.387249 13514 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election lost for term 21. Reason: could not achieve majority
I20260709 12:27:18.397413 13481 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:18.413744  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:18.414534  6649 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 13.
W20260709 12:27:18.415679  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 72838.4us
I20260709 12:27:18.415695 13739 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:18.416663  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:18.417945  6647 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:18.418553 13730 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:18.416167  6650 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 17 index: 15. (index mismatch)
I20260709 12:27:18.400810 13539 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:18.421844 13711 raft_consensus.cc:3055] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:27:18.425225 13631 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.426004 13631 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.422339 13711 raft_consensus.cc:740] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:18.474216 13711 consensus_queue.cc:260] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.475461 13711 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:27:18.477015  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 93811.3us
I20260709 12:27:18.477952  5932 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:18.446833  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:18.478965 13676 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:18.453338  6650 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:27:18.479504 13631 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:18.455274  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:18.480279  6643 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:18.480592 13458 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.480863  5932 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:18.455456 13689 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
W20260709 12:27:18.481643  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.482071 13689 raft_consensus.cc:3055] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:18.482609 13458 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.456229 13685 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:18.465142 13732 consensus_queue.cc:1059] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 15.10, Next index: 11, Last known committed idx: 10, Time since last communication: 0.001s
I20260709 12:27:18.465710 13539 consensus_queue.cc:1048] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:27:18.453070  6645 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:18.484119  6646 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 1778) took 1079 ms. Trace:
I20260709 12:27:18.486867  6037 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:60122 (request call id 2578) took 1463 ms. Trace:
I20260709 12:27:18.482563 13689 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:18.487267  6037 rpcz_store.cc:276] 0709 12:27:17.023384 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.138640 (+115256us) service_pool.cc:224] Handling call
0709 12:27:17.139003 (+   363us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:17.139205 (+   202us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.139227 (+    22us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:17.139707 (+   480us) log.cc:844] Serialized 26 byte log entry
0709 12:27:17.460650 (+320943us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:17.460681 (+    31us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:17.460741 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.283676 (+822935us) spinlock_profiling.cc:243] Waited 3.04 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:27:18.486401 (+202725us) raft_consensus.cc:1685] finished
0709 12:27:18.486427 (+    26us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.486677 (+   250us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":6989184,"thread_start_us":320581,"threads_started":1,"wal-append.queue_time_us":415934}
I20260709 12:27:18.487205  6646 rpcz_store.cc:276] 0709 12:27:17.404454 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:17.404571 (+   117us) service_pool.cc:224] Handling call
0709 12:27:17.453538 (+ 48967us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:17.453883 (+   345us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:17.453914 (+    31us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:17.454360 (+   446us) log.cc:844] Serialized 26 byte log entry
0709 12:27:17.942612 (+488252us) spinlock_profiling.cc:243] Waited 1.99 ms on lock 0x7b1800230f20. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b 00007f4820bf3d23 00007f4820bf40d1 00007f482100fa0f
0709 12:27:18.178566 (+235954us) raft_consensus.cc:1645] Marking committed up to 17
0709 12:27:18.178651 (+    85us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:18.178756 (+   105us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:18.483605 (+304849us) raft_consensus.cc:1685] finished
0709 12:27:18.483626 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:18.483899 (+   273us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":75,"raft.run_cpu_time_us":130,"raft.run_wall_time_us":13460,"spinlock_wait_cycles":4566272,"thread_start_us":83629,"threads_started":1,"wal-append.queue_time_us":996781}
I20260709 12:27:18.490087  6644 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:18.489380 13458 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:18.491909 13766 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.085s	user 0.001s	sys 0.000s
I20260709 12:27:18.488220 13689 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.500370 13689 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:18.500998 13745 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:18.488849  5932 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:18.507361 13745 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:18.462184 13387 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.509305  6115 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 18. Ops: [17.15-17.15]
I20260709 12:27:18.513808  6084 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:27:18.526723  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 265002us
I20260709 12:27:18.518290 13539 raft_consensus.cc:3055] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:18.518383 13685 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 12:27:18.508970 13623 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.531914 13539 raft_consensus.cc:740] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:18.559672 13539 consensus_queue.cc:260] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:18.560563 13623 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:18.561152 13539 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:18.562175 13688 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:18.562965  6644 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:18.533738 13732 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:18.564057 13732 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:18.564481 13732 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:18.564690 13688 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:18.517849 13549 consensus_queue.cc:1059] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.014s
I20260709 12:27:18.569554 13549 raft_consensus.cc:3055] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:27:18.569948 13549 raft_consensus.cc:740] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:18.533068 13387 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:18.542897  6082 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:27:18.579630  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 44996.7us
W20260709 12:27:18.580125  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 53503.8us
I20260709 12:27:18.581825 13635 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:18.582266 13635 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:18.582653 13635 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:18.576920 13676 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:18.589188  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:18.591939  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 103219us
I20260709 12:27:18.608229  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:18.609048  6037 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:27:18.595791 13549 consensus_queue.cc:260] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.614615 13549 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:18.616252  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:18.638998 13688 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:18.639905 13688 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.640048  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:18.640516 13688 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.640942  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:18.641726  6044 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 20: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:18.635690  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
W20260709 12:27:18.615128 13691 consensus_queue.cc:1175] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "24012af7747d4c4ea89c3da2ff950099" responder_term: 18 status { last_received { term: 18 index: 13 } last_committed_idx: 12 last_received_current_leader { term: 18 index: 13 } }
I20260709 12:27:18.666911 13174 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:27:18.682066 13732 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.689419 13732 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:18.693810 13539 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.694442 13539 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:18.699080 13635 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:18.699385 13691 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:18.701504 13635 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:18.702085 13691 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.703202 13539 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:18.713107  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:18.724659  6115 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 22.
W20260709 12:27:18.727828 13779 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.145s	user 0.000s	sys 0.003s
I20260709 12:27:18.727907  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:18.766884  6110 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
W20260709 12:27:18.729733 13775 log.cc:927] Time spent T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.150s	user 0.001s	sys 0.000s
I20260709 12:27:18.730656  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:27:18.732874 13778 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.121s	user 0.003s	sys 0.000s
I20260709 12:27:18.736893 13514 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:18.770262 13514 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.739246 13688 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:18.739403 13676 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:18.751945 13539 consensus_queue.cc:1059] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 14.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.001s
I20260709 12:27:18.755141  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:18.775457 13514 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:18.755254  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:18.755944 13174 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:18.777072 13174 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:18.758867  6113 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:27:18.759472  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:18.764714  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:18.766026  6118 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:27:18.774354 13676 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:18.778136 13174 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.787192 13387 raft_consensus.cc:3055] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:27:18.787721 13387 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:18.788832 13387 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.789460 13676 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:18.775128 13774 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.262s	user 0.002s	sys 0.000s
I20260709 12:27:18.790660 13174 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:18.791347  5932 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:27:18.797134  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 213201us
I20260709 12:27:18.756485 13691 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:18.790390 13387 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:18.805974  6645 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:18.809508  6084 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:18.813441 13691 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:18.815312 13691 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:18.816346 13691 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.807161 13531 consensus_queue.cc:1059] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.285s
I20260709 12:27:18.805263 13514 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:18.839310  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:18.847911  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.848393  6042 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 14. (term mismatch)
I20260709 12:27:18.847930  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:18.850934  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:18.854583  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.848982  6042 pending_rounds.cc:85] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 13
I20260709 12:27:18.877895  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 23 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:18.848132  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:27:18.880106  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 43731.9us
I20260709 12:27:18.849256  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:18.851181  6082 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:18.884431 13514 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:18.888262 13514 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:18.889840  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.884322 13458 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:18.891697 13458 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:18.892055 13458 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:18.895135  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:18.896562  6038 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 15 index: 9. (index mismatch)
W20260709 12:27:18.898962  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 47856.3us
I20260709 12:27:18.879329  6042 pending_rounds.cc:107] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 20.14
I20260709 12:27:18.899796  6042 raft_consensus.cc:2889] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:18.900352  6035 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 20: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:27:18.897466  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50371.9us
W20260709 12:27:18.907498  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.909610 13514 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:18.911588  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.913476  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:18.915990  6118 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:27:18.917900  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:18.919742  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:18.924554  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:18.925264  6040 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:18.851966 13711 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:18.930372  6115 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:27:18.845537 13685 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.062s
I20260709 12:27:18.936210  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:18.948580 13784 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.113s	user 0.000s	sys 0.000s
I20260709 12:27:18.953063  6035 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 25.
I20260709 12:27:18.946204 13688 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:18.985236 13688 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:18.998410 13530 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:18.999065 13530 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:19.002133 13539 raft_consensus.cc:3055] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:19.002563 13539 raft_consensus.cc:740] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:19.003137  6648 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 13 index: 13. Preceding OpId from leader: term: 15 index: 14. (index mismatch)
I20260709 12:27:18.950687 13735 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:27:18.947448 13514 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:19.015338  6042 raft_consensus.cc:1240] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: [17.14-17.14]
I20260709 12:27:19.022168  6040 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:27:18.992722 13688 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:19.025693  6611 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:19.051797 13514 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:19.052852 13530 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:19.008401 13531 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.051s
I20260709 12:27:19.018507 13174 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.052s
I20260709 12:27:19.047739 13676 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 23 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:19.017573 13732 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.047s
I20260709 12:27:19.064836 12925 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:19.070660 13541 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:27:19.073942 13514 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:19.074610  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:19.059866 13539 consensus_queue.cc:260] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:19.070567 13547 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.012s
I20260709 12:27:19.092157 13629 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:19.087510 12925 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:19.110558 13539 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:19.146543 13531 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:19.159592 13458 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:19.155174 13745 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.544s	user 0.008s	sys 0.022s
W20260709 12:27:19.190970 13745 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.554s	user 0.008s	sys 0.022s
W20260709 12:27:19.201131  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 203610us
I20260709 12:27:19.204082 13458 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:19.191404 13531 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:19.202754 13739 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.595s	user 0.024s	sys 0.045s
I20260709 12:27:19.204082  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:19.213944 13711 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:19.215528  6082 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:27:19.224542  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 335656us
W20260709 12:27:19.212038 13739 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.614s	user 0.024s	sys 0.046s
I20260709 12:27:19.237607  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:19.212008 13530 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:27:19.239336  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:19.284833  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.219889 13711 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:19.307953  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:19.309002  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 68617.5us
I20260709 12:27:19.314167  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:19.227097 13735 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election won for term 16
W20260709 12:27:19.322227  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.237568 13531 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:19.335326  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 283466us
I20260709 12:27:19.336522  6611 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:19.346805  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:19.347631  5960 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 13.
I20260709 12:27:19.348762  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:19.349393  6040 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:19.307808 13647 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.036s
I20260709 12:27:19.316448 13711 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:19.325730 12925 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:19.385442  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 55128.7us
I20260709 12:27:19.405447 13745 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:19.409955 13745 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:19.412344 13745 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:19.419054  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:19.419880  5959 raft_consensus.cc:3060] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:19.422561  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:19.422703 12925 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.423333 12925 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:19.424672 13790 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.112s	user 0.000s	sys 0.000s
I20260709 12:27:19.425701 12925 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:19.429557 13688 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.430146 13688 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:19.432858 13688 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:19.332589 13530 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:19.423295  5962 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:19.389607 13735 raft_consensus.cc:697] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:19.451905 13783 raft_consensus.cc:2804] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:19.457985  6040 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 21.
I20260709 12:27:19.457055  5932 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:19.464927  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:19.476383  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.490360  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:19.485198 13783 raft_consensus.cc:697] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 22 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:19.501581  6082 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:19.502430  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.525969  5960 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:27:19.526505  5966 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:19.531008  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:19.543701  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.529313 13544 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:19.550372 13796 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:27:19.534888 13730 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:19.550472 13683 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:27:19.588392  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 100470us
I20260709 12:27:19.550416 13795 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:19.591729  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:19.529390 13735 consensus_queue.cc:237] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.11, Last appended by leader: 11, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:19.604343  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:19.643337  5965 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:27:19.605520 13803 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.113s	user 0.001s	sys 0.000s
W20260709 12:27:19.605969 13788 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.166s	user 0.000s	sys 0.001s
W20260709 12:27:19.606703 13798 log.cc:927] Time spent T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.121s	user 0.001s	sys 0.000s
W20260709 12:27:19.604379 13802 log.cc:927] Time spent T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.102s	user 0.000s	sys 0.001s
I20260709 12:27:19.613847  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:19.658353  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:19.659669  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:19.660825  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:19.661792  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:19.617101  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:19.663065 13530 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:19.620872  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "39cca9184e5b4b468627eb290d029f68" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 28 candidate_status { last_received { term: 25 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:19.664541  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 14 index: 8 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:19.608513  6040 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 20. Current term is 21. Ops: []
I20260709 12:27:19.665832  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:19.666909  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:19.667429 13530 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:19.668360 13530 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:27:19.668473  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:19.668749 13530 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:19.622136  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:19.622633  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:19.669795  6037 raft_consensus.cc:2393] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 16: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:19.663265  6039 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 3176) took 1045 ms. Trace:
I20260709 12:27:19.670912  6039 rpcz_store.cc:276] 0709 12:27:18.617897 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:18.618042 (+   145us) service_pool.cc:224] Handling call
0709 12:27:18.635628 (+ 17586us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:18.667027 (+ 31399us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:18.667057 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:18.685526 (+ 18469us) log.cc:844] Serialized 26 byte log entry
0709 12:27:19.164329 (+478803us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:27:19.164372 (+    43us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:19.164439 (+    67us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:19.663057 (+498618us) raft_consensus.cc:1685] finished
0709 12:27:19.663077 (+    20us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:19.663210 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":83641,"raft.queue_time_us":14034,"raft.run_cpu_time_us":188,"raft.run_wall_time_us":9106,"spinlock_wait_cycles":36224,"thread_start_us":478437,"threads_started":1,"wal-append.queue_time_us":653217}
I20260709 12:27:19.672315 13530 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.16, Last appended by leader: 16, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:19.673540 13530 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:19.630976 13795 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:19.677043 13795 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:19.639396  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 53699.1us
I20260709 12:27:19.640096 13647 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:19.617880  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:19.669140  5960 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 21.
I20260709 12:27:19.581151 13783 consensus_queue.cc:237] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.16, Last appended by leader: 16, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:19.704743 13801 log.cc:927] Time spent T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.205s	user 0.000s	sys 0.012s
I20260709 12:27:19.698292  5865 catalog_manager.cc:5697] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 12 to 16. New cstate: current_term: 16 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.710979  6041 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38df61ba407240499023581d9f885037"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:42450
I20260709 12:27:19.711848  6041 raft_consensus.cc:606] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:19.581732 13730 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:19.711036 13387 consensus_meta.cc:287] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.905s	user 0.006s	sys 0.006s
I20260709 12:27:19.570489 13544 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:19.715705 13544 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:19.716351  6042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:42450
I20260709 12:27:19.716919  6042 raft_consensus.cc:606] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:19.717260  6042 raft_consensus.cc:614] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:19.718757  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:19.721050  6041 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 22.
I20260709 12:27:19.720405  6042 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:42450
I20260709 12:27:19.722090  6042 raft_consensus.cc:606] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:19.722411  6042 raft_consensus.cc:614] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:19.721673  5865 catalog_manager.cc:5697] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 17 to 19, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 19 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.723349  5865 catalog_manager.cc:5697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:19.724370 13763 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:19.724362  6082 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:19.724911 13763 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:19.725104  5865 catalog_manager.cc:5697] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 20 to 22. New cstate: current_term: 22 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.725939 13387 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:19.726387 13387 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:19.726842 13387 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:19.728552  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:19.730221 13763 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:19.695080  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:19.732892  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:19.736675  6039 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
mode: GRACEFUL
new_leader_uuid: "24012af7747d4c4ea89c3da2ff950099"
 from {username='slave'} at 127.0.0.1:42450
I20260709 12:27:19.737321  6039 raft_consensus.cc:606] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Received request to transfer leadership to TS 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:19.737664  6039 raft_consensus.cc:614] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:19.738889 13647 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:19.665762  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:19.736694  5865 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:27:19.711932 13539 consensus_meta.cc:287] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.556s	user 0.010s	sys 0.000s
I20260709 12:27:19.749240  5959 raft_consensus.cc:2468] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 22.
I20260709 12:27:19.548025  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:19.801414  5965 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
W20260709 12:27:19.809154  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.743216 13387 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:19.741956  5863 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 342) took 10144 ms. Trace:
I20260709 12:27:19.814983  6042 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: [15.11-15.11]
I20260709 12:27:19.745760  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 4
W20260709 12:27:19.816254  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:19.823987  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 276032us
I20260709 12:27:19.743265 13647 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:19.826148 13647 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:19.826960  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:19.827253  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:19.825717  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:19.828358  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:19.830974  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:19.831350  6081 leader_election.cc:336] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.886s (SENT)
I20260709 12:27:19.831977  6081 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:19.832700  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:19.834357  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:19.835532  5865 catalog_manager.cc:5697] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 17 to 18, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 18 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.841014 13730 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:19.751463  6608 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:19.746881 13763 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:19.842444  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 91077.3us
I20260709 12:27:19.843494  6109 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:27:19.838160  5865 catalog_manager.cc:5697] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 15 to 18, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 18 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:19.855436  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:19.857915  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 522951us
I20260709 12:27:19.881896  5962 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:27:19.883613  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:19.885859  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:19.832324 12925 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.842486 13799 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Leader pre-election won for term 14
I20260709 12:27:19.891888  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:19.890980  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:19.857900 13539 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:19.893579  5966 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
W20260709 12:27:19.894035  6611 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.543s	user 0.023s	sys 0.043s
W20260709 12:27:19.899029  6611 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.548s	user 0.023s	sys 0.043s
W20260709 12:27:19.899379  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 562903us
I20260709 12:27:19.849615 13688 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:19.923106  5865 catalog_manager.cc:5697] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 11 to 14, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 14 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:27:19.889941 13676 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.776s	user 0.062s	sys 0.150s
W20260709 12:27:19.925098  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 66680.2us
I20260709 12:27:19.843143 13763 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:19.845448 13531 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:27:19.936792  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:19.865957 13732 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:19.892302 13799 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:19.925773 13676 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.812s	user 0.062s	sys 0.151s
W20260709 12:27:19.973347  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 142060us
I20260709 12:27:19.988312  5865 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 15 to 16, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 16 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:19.989113  6081 leader_election.cc:336] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Timed out: RequestConsensusVote RPC to 127.4.181.65:42981 timed out after 1.888s (SENT)
I20260709 12:27:19.898118 12925 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:19.967000 13799 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:19.962075 13174 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:20.019702  6112 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:20.006320 13676 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:19.979017 13688 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:19.967535 13531 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:20.034930  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.036532  5865 catalog_manager.cc:5697] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 12 to 13, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 13 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.021394 13547 raft_consensus.cc:493] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:20.044622  5865 catalog_manager.cc:5697] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 18 to 19, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 19 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:19.824554  5863 rpcz_store.cc:276] 0709 12:27:09.597253 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:09.597420 (+   167us) service_pool.cc:224] Handling call
0709 12:27:19.741683 (+10144263us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:16.666678 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:16.667317 (+   639us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:16.667351 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:27:16.667368 (+    17us) tablet.cc:662] Decoding operations
0709 12:27:16.668840 (+  1472us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:16.668902 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:16.668929 (+    27us) tablet.cc:685] Acquiring locks for 17 operations
0709 12:27:16.670271 (+  1342us) tablet.cc:701] Row locks acquired
0709 12:27:16.670292 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:27:16.670430 (+   138us) write_op.cc:270] Start()
0709 12:27:16.670568 (+   138us) write_op.cc:276] Timestamp: P: 1783600036670380 usec, L: 0
0709 12:27:16.670661 (+    93us) op_driver.cc:348] REPLICATION: starting
0709 12:27:16.678369 (+  7708us) log.cc:844] Serialized 6650 byte log entry
0709 12:27:17.574617 (+896248us) op_driver.cc:464] REPLICATION: finished
0709 12:27:17.796485 (+221868us) write_op.cc:301] APPLY: starting
0709 12:27:17.796797 (+   312us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:17.808050 (+ 11253us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:17.808165 (+   115us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:18.277742 (+469577us) spinlock_profiling.cc:243] Waited 35.2 ms on lock 0x7b54003a8c54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f482105132a 00007f4820fd6f14 00007f4820fd6ec3 00007f4820fd6e38 00007f4820fd6df3 00007f4820fd60dc 00007f4820fffe16 00007f4820fe7cbb 00007f4820fd239d 00007f4820fd5d75
0709 12:27:18.651211 (+373469us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:18.707126 (+ 55915us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=34,key_file_lookups=34,delta_file_lookups=34,mrs_lookups=0
0709 12:27:18.707187 (+    61us) write_op.cc:312] APPLY: finished
0709 12:27:18.707799 (+   612us) log.cc:844] Serialized 156 byte log entry
0709 12:27:18.752624 (+ 44825us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f481df4a0ac 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4820bee20b
0709 12:27:19.195932 (+443308us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:19.386138 (+190206us) write_op.cc:454] Released schema lock
0709 12:27:19.389076 (+  2938us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:19.415054 (+ 25978us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:19.415086 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":190712,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":220102,"apply.run_cpu_time_us":63629,"apply.run_wall_time_us":1619996,"cfile_cache_hit":70,"cfile_cache_hit_bytes":75221,"num_ops":17,"prepare.queue_time_us":654475,"prepare.run_cpu_time_us":41114,"prepare.run_wall_time_us":399971,"raft.queue_time_us":479183,"raft.run_cpu_time_us":31735,"raft.run_wall_time_us":748174,"replication_time_us":903800,"spinlock_wait_cycles":138477312,"thread_start_us":1793347,"threads_started":5,"wal-append.queue_time_us":974623,"wal-append.run_cpu_time_us":30340,"wal-append.run_wall_time_us":1427897}]]}
I20260709 12:27:20.013967 13174 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:20.043828 13711 consensus_meta.cc:287] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Time spent flushing consensus metadata: real 0.686s	user 0.009s	sys 0.002s
W20260709 12:27:20.056624  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 137955us
I20260709 12:27:20.056066  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:20.058642  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 160685us
I20260709 12:27:20.059629  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:20.055991  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:20.062173  5865 catalog_manager.cc:5697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:20.063817  5865 catalog_manager.cc:5697] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:27:20.065312  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 91276.5us
I20260709 12:27:20.063175  6609 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:20.067378  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:20.069595  5966 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 21: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:27:20.070263  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.052739 13745 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.072818  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:20.074404  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 148916us
I20260709 12:27:20.067152  5961 raft_consensus.cc:2376] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 22. Re-sending same reply.
W20260709 12:27:20.077018  6083 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.099799 13688 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:20.100222 13814 log.cc:927] Time spent T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.060s	user 0.000s	sys 0.000s
I20260709 12:27:20.052275 13547 raft_consensus.cc:515] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:20.101172 13812 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.092s	user 0.000s	sys 0.000s
I20260709 12:27:20.073904 13730 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:20.102692 13813 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.093s	user 0.001s	sys 0.000s
I20260709 12:27:20.102861 13730 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:20.105649 13730 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:20.068284 13732 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:20.106441 13732 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:20.108705 13732 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:20.111189  5961 raft_consensus.cc:1240] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 21. Current term is 22. Ops: [21.16-21.16]
I20260709 12:27:20.112234 13804 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.191s
I20260709 12:27:20.116811 13531 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.071522 13458 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:27:20.056677 13676 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:20.058902 13711 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:20.076203 13387 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:20.076567 13794 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
W20260709 12:27:20.176586  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 103831us
I20260709 12:27:20.153172 13796 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:20.185719  5961 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 22. Current term is 23. Ops: []
I20260709 12:27:20.101101 13647 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.186619  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.095717 13745 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.171422 13458 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:27:20.190377  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 119435us
I20260709 12:27:20.171330 13783 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:27:20.188227  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 91291.6us
I20260709 12:27:20.191877  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:20.191782  6111 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.609s	user 0.002s	sys 0.015s
W20260709 12:27:20.193332  6111 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.615s	user 0.002s	sys 0.015s
I20260709 12:27:20.177657 13547 leader_election.cc:290] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.159298 13810 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:20.196861  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:20.199149  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:20.223606  5960 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:27:20.226552  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.227701  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:20.228500  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.228852  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.229451  5965 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:27:20.230211  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.230476  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.231233  5963 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 26: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:20.231897  5965 raft_consensus.cc:1240] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:20.233035  5963 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 14. Current term is 15. Ops: []
I20260709 12:27:20.176234 13688 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.022s
I20260709 12:27:20.234361  5963 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 19 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
W20260709 12:27:20.209980 13683 consensus_meta.cc:287] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.616s	user 0.007s	sys 0.003s
I20260709 12:27:20.197567 13549 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:20.219151 13826 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:20.248986  6608 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:20.249856 13689 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:27:20.265086 13821 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.090s	user 0.000s	sys 0.000s
W20260709 12:27:20.249132 13819 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.098s	user 0.000s	sys 0.000s
I20260709 12:27:20.250352 13711 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 26 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:20.251029 13458 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.251554 13796 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:20.251969  6114 raft_consensus.cc:1240] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23. Ops: []
I20260709 12:27:20.209085 13732 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:20.263921  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.267738  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:20.275027  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.267074  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:20.240553 13810 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.243808 13763 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.211153 13783 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.261925 13826 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:20.260555 13683 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:20.279670  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.247711 13805 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:20.297250  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:20.301681  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.274570 13547 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:20.277995 13387 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.308043  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:20.308907  6081 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.265286 13689 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.312888  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.314070 13622 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:20.314635 13622 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.315416 13240 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:20.316007 13240 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.317407 13622 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:20.317999 13240 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:20.290128 13763 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.318744 13763 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:20.319096 13810 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:20.320816 13763 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:20.295324 13730 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.325140  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:20.319020  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:20.323041  5964 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 18: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:20.298038 13804 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:20.323830  5959 raft_consensus.cc:1240] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19. Ops: [18.13-18.13]
I20260709 12:27:20.328298  6035 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:27:20.327536  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.298246 13826 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:20.328707 13730 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.332412  6114 raft_consensus.cc:2410] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for term 21 because replica has last-logged OpId of term: 20 index: 16, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 15.
I20260709 12:27:20.336014  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.331986 13530 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:20.294104 13732 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.359674  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:20.365660  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:20.311780 13547 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:20.368331  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.313203 13387 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:20.371389  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:20.370796  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:20.332204 13831 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election won for term 15
W20260709 12:27:20.374531  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 125642us
I20260709 12:27:20.371534  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:20.383318  6041 raft_consensus.cc:2393] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 19: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:20.372961  5932 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:20.338853 13804 raft_consensus.cc:697] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:20.340034 13688 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.386170  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.364414 13676 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:20.313717 13805 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.397017  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.398082  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.399082  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 19 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.399595  5965 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:27:20.399798 13387 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:20.400408  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.401250  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:20.402379  5932 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:27:20.404956  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 213154us
I20260709 12:27:20.393679  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:20.394829 13732 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:20.395181 13834 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.094s	user 0.000s	sys 0.001s
I20260709 12:27:20.396720 13547 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:20.373894 13829 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:20.405969  6114 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:20.413475  5932 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:20.364809 13530 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:20.396744 13174 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.419275  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.431562  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.426349  5932 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:20.433845  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.435621  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:20.424358  6111 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3629) took 1200 ms. Trace:
I20260709 12:27:20.429682  5934 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:20.444895 13530 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:20.446784  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:20.451215  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:20.423723 13822 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.177s	user 0.000s	sys 0.001s
I20260709 12:27:20.423327  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.436232  5963 raft_consensus.cc:2376] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18. Re-sending same reply.
I20260709 12:27:20.437630  6111 rpcz_store.cc:276] 0709 12:27:19.223621 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.223720 (+    99us) service_pool.cc:224] Handling call
0709 12:27:19.240692 (+ 16972us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:19.503708 (+263016us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:19.503741 (+    33us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:19.536613 (+ 32872us) log.cc:844] Serialized 26 byte log entry
0709 12:27:20.193663 (+657050us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:20.193700 (+    37us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:20.194654 (+   954us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:20.424102 (+229448us) raft_consensus.cc:1685] finished
0709 12:27:20.424126 (+    24us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.424274 (+   148us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":72837,"raft.queue_time_us":111582,"raft.run_cpu_time_us":210,"raft.run_wall_time_us":40203,"thread_start_us":805015,"threads_started":2,"wal-append.queue_time_us":691538}
I20260709 12:27:20.466960  6608 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:20.457975 13622 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.012s
I20260709 12:27:20.470415  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.432717 13732 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.433385 13676 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:27:20.411175 13739 consensus_queue.cc:1059] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 14.9, Next index: 10, Last known committed idx: 8, Time since last communication: 0.037s
I20260709 12:27:20.473044  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.474092  5932 leader_election.cc:304] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:20.474529 13845 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:20.475049 13827 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:20.476697 13797 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:20.475061 13730 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.474565  5965 raft_consensus.cc:3055] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:20.517792  5965 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:20.478304  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.478376 13783 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:20.476931  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1b3ddf896ce40f5b9c2632735843215" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.478837  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.479243 13836 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:27:20.482538  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:20.444922 13804 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.487287 13689 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.422981 13846 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:20.422413 13805 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.495827  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:20.412132 13688 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:20.498574  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.519658  6113 raft_consensus.cc:2410] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 25 because replica has last-logged OpId of term: 24 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 22 index: 11.
I20260709 12:27:20.471657 13174 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.518953  6648 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:27:20.523062  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.471611 13745 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:20.527753  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 53772us
W20260709 12:27:20.528069  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.494225 13826 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.527980  5967 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:20.522878 13547 raft_consensus.cc:493] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:20.538728  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:20.544744 13547 raft_consensus.cc:515] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.545117  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.516206 13541 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:20.546754  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.546895 13547 leader_election.cc:290] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.547314  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.547895  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.524307 13797 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:20.539503 13823 log.cc:927] Time spent T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.165s	user 0.002s	sys 0.000s
I20260709 12:27:20.549913  6644 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:50454 (request call id 1796) took 1055 ms. Trace:
I20260709 12:27:20.550009  6113 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
I20260709 12:27:20.539471 13623 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:20.546218  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 19 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.531143 13843 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:20.534101 12925 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.538075 13826 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.532509  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:20.554443  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:20.554144  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:20.557662  6009 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:20.488711 13732 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.559927  5960 raft_consensus.cc:1240] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 20. Current term is 21. Ops: [20.13-20.13]
I20260709 12:27:20.551071  5965 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 15.11, Last appended by leader: 11, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:20.543597 13847 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.099s	user 0.002s	sys 0.000s
W20260709 12:27:20.559543  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 149729us
I20260709 12:27:20.550129 13797 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:20.551165  6644 rpcz_store.cc:276] 0709 12:27:19.494076 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:19.494221 (+   145us) service_pool.cc:224] Handling call
0709 12:27:19.494560 (+   339us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:19.532734 (+ 38174us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:19.532764 (+    30us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:19.543253 (+ 10489us) log.cc:844] Serialized 26 byte log entry
0709 12:27:20.004863 (+461610us) raft_consensus.cc:1645] Marking committed up to 13
0709 12:27:20.004908 (+    45us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:20.004978 (+    70us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:20.538962 (+533984us) spinlock_profiling.cc:243] Waited 1.97 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:27:20.549661 (+ 10699us) raft_consensus.cc:1685] finished
0709 12:27:20.549680 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:20.549860 (+   180us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":7270,"raft.queue_time_us":34489,"raft.run_cpu_time_us":106,"raft.run_wall_time_us":5291,"spinlock_wait_cycles":4519680,"thread_start_us":415357,"threads_started":1,"wal-append.queue_time_us":751307}
I20260709 12:27:20.633423  6081 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:20.541877 13688 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:20.629873  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 52882.4us
I20260709 12:27:20.631647  5967 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 18. Ops: [17.15-17.15]
W20260709 12:27:20.631711  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 99285us
I20260709 12:27:20.523262 13833 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:20.629837  5965 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:20.536636 13174 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.516412 13799 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.557276 13623 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:20.642127  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:20.557261 13547 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.644634  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:20.574342 13827 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:20.645040  6111 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:20.633927 13841 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:20.635564 13846 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:27:20.639604 13689 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:27:20.653760  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.653913  5932 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:20.651660  6113 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 18: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:20.655177  6645 raft_consensus.cc:1240] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 13. Current term is 14. Ops: []
I20260709 12:27:20.655930  5967 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:20.646600 13530 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:20.659294  6647 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 20. Current term is 21. Ops: []
I20260709 12:27:20.648655 12925 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.652762 13841 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.664963  5932 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:20.561515 13843 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.656656 13688 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:27:20.676898  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.665915 13841 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:20.677564  6651 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:20.678944  6084 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:20.679860 13807 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:20.680246 13807 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:20.680711 13807 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:27:20.683959 13848 log.cc:927] Time spent T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:27:20.685431  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:20.686582  5968 raft_consensus.cc:1240] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:20.687512 13530 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:20.688234 13530 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:20.695129 13799 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:20.680289  5967 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 21 index: 15. (index mismatch)
I20260709 12:27:20.698642  5961 raft_consensus.cc:1240] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:20.699872  5961 raft_consensus.cc:1275] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 22 index: 17. (index mismatch)
W20260709 12:27:20.701436  5931 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.653185 13831 raft_consensus.cc:697] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:20.675660 13732 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.641389 13833 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.659976 13806 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:20.655165 13547 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:20.706853  5965 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 11. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:27:20.663736 13745 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:20.702283 13855 consensus_queue.cc:1059] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 9, Last known committed idx: 8, Time since last communication: 0.038s
I20260709 12:27:20.708396  5932 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:20.714162  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:20.707409 13826 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:20.716974  5967 raft_consensus.cc:2393] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 14: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:20.720162 13833 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:20.721026 13852 log.cc:927] Time spent T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.276s	user 0.005s	sys 0.015s
I20260709 12:27:20.703747 13730 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.660823 13689 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.722738  6608 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:20.706130 13711 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:20.711951 13676 raft_consensus.cc:2749] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:20.664186 12925 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.717434 13846 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:27:20.733944  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:20.726109 13730 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.729259 13711 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.707136 13623 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.726203 13859 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:20.769181  5932 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:20.772011 13541 consensus_queue.cc:1059] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.002s
I20260709 12:27:20.782829  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.774245 13689 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.775381 13730 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.784456 13541 raft_consensus.cc:3055] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:27:20.775851 13811 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:20.778141 13711 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.770886 13833 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:20.786800 13833 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.788972 13833 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.789629 13807 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.791935 13807 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.793031  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:20.793637  6651 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 19
I20260709 12:27:20.794291 13841 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.796444 13841 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.779682 13843 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.780092 13622 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:20.781651  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.784840 13541 raft_consensus.cc:740] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:20.783643  5932 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:20.798656 13860 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:20.797281 13622 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.803488  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.804353  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.808832  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.808598 13541 consensus_queue.cc:260] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.809942 13541 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:20.810014  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.816125 13547 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:20.812348  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:20.807236 13846 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:20.812439  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:20.832389  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:20.813112  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.815516 13832 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:20.814965 13622 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:20.816468 13631 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:27:20.816540 13174 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.802127 13831 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 14.12, Last appended by leader: 12, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.815126 12925 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.811597  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:20.827083  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.832285  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.833336  6110 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:27:20.847168  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.847442  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.857177  6642 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:27:20.847239  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.854453  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 19 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.858176  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:20.858621  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.850732  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.859565  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:20.859706  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.851276  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.860169  6041 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:27:20.860806  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.860997  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.861395  5967 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:27:20.856643  6648 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:27:20.862339  5961 raft_consensus.cc:1240] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: [15.10-15.10]
I20260709 12:27:20.860081  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 13 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.864722  5963 raft_consensus.cc:2410] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 16 because replica has last-logged OpId of term: 15 index: 11, which is greater than that of the candidate, which has last-logged OpId of term: 13 index: 10.
I20260709 12:27:20.807459 13745 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:20.836994 13631 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:20.884404 13631 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.885169 13859 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:20.854346 13832 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:20.888293 13832 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:20.837152 13846 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:20.890828 13846 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:20.899876 13547 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:20.900506 13547 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.902606 13833 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:20.902755  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:20.903183 13833 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:20.905228 13833 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.906054 13547 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:20.906700  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:20.907406  5959 raft_consensus.cc:2393] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 26: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:20.910835  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:20.913722  6611 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:20.914561 13843 raft_consensus.cc:993] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
W20260709 12:27:20.924898 13844 log.cc:927] Time spent T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.481s	user 0.002s	sys 0.000s
I20260709 12:27:20.926873 13631 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:20.930305 13735 raft_consensus.cc:3055] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:20.931161  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:20.905973  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:20.969579  6042 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:27:20.965772  6036 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:20.971601  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:20.972669  6039 raft_consensus.cc:2393] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 18: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:20.974563  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.974905  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.973747  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 22 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.975519  5961 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 16.
I20260709 12:27:20.976295  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:20.940984  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:20.944633  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:20.945756  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:20.946795  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:20.963333 13810 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:20.948179  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:20.986783  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 13 candidate_status { last_received { term: 12 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.951741  6651 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:20.953392  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:20.954337  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:20.957211  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 43557.6us
W20260709 12:27:20.913767  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 60244.6us
I20260709 12:27:20.964947  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:20.988999  6035 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:20.990571  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:20.982959  6113 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:27:20.982950  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.984129  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:21.002239  5961 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:20.984254  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.984900  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:21.002537  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:20.968788 13832 raft_consensus.cc:1081] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:27:20.965451 13735 raft_consensus.cc:740] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:20.947052  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:21.002454  6044 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:27:20.989110 13807 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.002s
I20260709 12:27:20.990267  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:21.004590  6036 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 13 index: 10. Preceding OpId from leader: term: 16 index: 12. (index mismatch)
I20260709 12:27:21.006249  6115 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 22.
I20260709 12:27:21.006039  6081 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.009021  6035 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 26.
I20260709 12:27:21.023661  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:21.025241  6040 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 22.
I20260709 12:27:21.027823  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:21.029528  6117 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 16. (term mismatch)
I20260709 12:27:21.031824  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:21.033943  6035 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:27:21.029978  6117 pending_rounds.cc:85] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 15
I20260709 12:27:21.034816  6117 pending_rounds.cc:107] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 20.16
I20260709 12:27:21.034644  5964 raft_consensus.cc:1240] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 15. Current term is 16. Ops: [15.9-15.9]
I20260709 12:27:21.033584  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:21.035883  6042 raft_consensus.cc:3060] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:21.035322  6117 raft_consensus.cc:2889] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:21.037397  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:21.031131 13730 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:21.038128 13830 consensus_queue.cc:1048] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.033s
I20260709 12:27:21.039096 13739 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:21.039834  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:21.039623 13739 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.031939  6081 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:21.046260  6008 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.028827 13841 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:21.047994  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:21.050643  6006 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.052098  6036 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 22 index: 12. (index mismatch)
I20260709 12:27:21.053952  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:21.057775  6081 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.062150  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.069875  6006 leader_election.cc:304] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.071448 13846 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.069921  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:21.074190  5961 raft_consensus.cc:2468] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:27:21.075358  5966 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 16: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:21.050135 13841 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.077731  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:21.077912  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:21.078903  5961 raft_consensus.cc:2393] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 23: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:21.051910 13549 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:21.079051  6081 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.080458  6006 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.082619 13174 raft_consensus.cc:2749] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:21.083948  6084 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:21.056674 13691 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.087306 13691 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.079823 13799 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:27:21.089779 13691 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:21.091230  6609 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:21.094579  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:21.097085 13711 raft_consensus.cc:2804] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:21.097204 13796 consensus_queue.cc:1059] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 22.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:27:21.097698  6006 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.080444 13841 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:21.098294 13804 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:21.099134 13174 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:21.099567 13832 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:27:21.099977 13174 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:21.102828  6642 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:21.103245  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:21.099303  6006 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.105075  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:21.106943  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:21.050518 13735 consensus_queue.cc:260] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:21.075752 13539 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:21.109056  6009 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:21.076983 13838 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:21.115211  5961 raft_consensus.cc:1240] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20. Ops: []
I20260709 12:27:21.111279 13794 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.028s
I20260709 12:27:21.111101 13662 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:21.142176 13662 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:21.142844 13662 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:21.144797  6651 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 23.
I20260709 12:27:21.117727 13843 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:21.127985 13735 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:21.119300  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 19 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:21.114045 13174 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:21.155645 13174 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:21.156118 13174 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:21.160861  5934 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:21.162675 13745 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:21.174933  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:21.181854  5964 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:27:21.184362 13739 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:21.186444  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 77451.8us
I20260709 12:27:21.187495  6009 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:21.121210 13808 raft_consensus.cc:3055] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:21.125128  6609 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:21.102545 13796 raft_consensus.cc:3055] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:27:21.132503 13691 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:21.117225 13711 raft_consensus.cc:697] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:21.147377 12925 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:21.207160  6611 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:21.189904  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:21.203467  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:21.215319  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 90297.2us
I20260709 12:27:21.216373  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.115649  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:21.126560 13541 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election won for term 18
W20260709 12:27:21.230645  6007 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
W20260709 12:27:21.244340  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 145128us
I20260709 12:27:21.245635  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:21.244103  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:21.247375  6042 raft_consensus.cc:2468] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
W20260709 12:27:21.248224  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 44861.3us
W20260709 12:27:21.254789  6084 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.224568 13622 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:21.199852 13841 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.246616 13541 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:21.273030 13541 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:21.273974 13841 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:21.215018 13810 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.061s
I20260709 12:27:21.224946 13804 raft_consensus.cc:2764] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election decision vote started in defunct term 17: won
I20260709 12:27:21.279101 13711 consensus_queue.cc:237] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.250633 13838 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:21.288677  6039 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 16 index: 14. (index mismatch)
I20260709 12:27:21.289111 13174 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.246974 12925 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.292711 12925 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:21.295149  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 49597.5us
I20260709 12:27:21.207924 13808 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:21.301561 13808 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:21.206707 13689 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:21.303251 13689 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.303659 13689 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:21.303819  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.305152 13804 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:21.309233 13530 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:21.309676 13530 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.310024 13530 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:21.310251  6082 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.311474 13841 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:21.312403  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.312603  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3324) took 1202 ms. Trace:
I20260709 12:27:21.313051 13735 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:27:21.312973  5962 rpcz_store.cc:276] 0709 12:27:20.109759 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.109913 (+   154us) service_pool.cc:224] Handling call
0709 12:27:20.110366 (+   453us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:20.188979 (+ 78613us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:20.189013 (+    34us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:20.189580 (+   567us) log.cc:844] Serialized 52 byte log entry
0709 12:27:20.428185 (+238605us) raft_consensus.cc:1645] Marking committed up to 16
0709 12:27:20.458415 (+ 30230us) log.cc:844] Serialized 14 byte log entry
0709 12:27:20.458636 (+   221us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:20.720441 (+261805us) spinlock_profiling.cc:243] Waited 15.6 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:27:20.886664 (+166223us) spinlock_profiling.cc:243] Waited 6.72 ms on lock 0x7b18000c4900. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:27:21.312219 (+425555us) spinlock_profiling.cc:243] Waited 71.1 ms on lock 0x7b54000f7654. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:21.312279 (+    60us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:21.312334 (+    55us) raft_consensus.cc:1685] finished
0709 12:27:21.312346 (+    12us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:21.312523 (+   177us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":23398,"prepare.queue_time_us":35999,"prepare.run_cpu_time_us":39,"prepare.run_wall_time_us":39,"raft.queue_time_us":58336,"raft.run_cpu_time_us":233,"raft.run_wall_time_us":7899,"spinlock_wait_cycles":214854144,"thread_start_us":155374,"threads_started":1,"wal-append.queue_time_us":204579}
I20260709 12:27:21.316067  6006 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.317821 13843 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:27:21.300112 13541 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.270131 13833 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:21.323014  6006 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.199841 13796 raft_consensus.cc:740] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:21.319542 12925 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:21.329583 13843 consensus_queue.cc:1059] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 13.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:27:21.331542 13843 raft_consensus.cc:3055] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Stepping down as leader of term 13
I20260709 12:27:21.331938 13843 raft_consensus.cc:740] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:21.335873 13174 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:21.336865 13808 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:21.339156 13843 consensus_queue.cc:260] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 13, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.340493 13541 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:21.322563 13662 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.351511 13662 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:21.328799 13832 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:21.346947  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:21.354252  5934 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:21.347553 13843 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 13 FOLLOWER]: Advancing to term 14
I20260709 12:27:21.361459  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:21.362375  6040 raft_consensus.cc:2368] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19.
I20260709 12:27:21.362640 13745 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:27:21.363317 13745 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:21.363049 13796 consensus_queue.cc:260] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:21.364574 13796 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:21.366124  6609 leader_election.cc:400] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19.
W20260709 12:27:21.368923  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 253466us
I20260709 12:27:21.370702 13691 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:21.371183 13691 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:21.371532 13691 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
W20260709 12:27:21.374878  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 62588.1us
I20260709 12:27:21.375995  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:21.377192  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:21.381035 13730 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:21.381363  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:21.382104 13730 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:21.390864  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:21.391192 13647 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:21.381035  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:21.394325 13631 consensus_queue.cc:1059] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 19.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:21.395357 13631 raft_consensus.cc:3055] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:27:21.395671 13631 raft_consensus.cc:740] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:21.391089  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:21.396521 13631 consensus_queue.cc:260] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.383352 13531 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:21.385516  6118 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:42484 (request call id 1810) took 1051 ms. Trace:
I20260709 12:27:21.397419 13531 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:21.387259  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:21.398347 13838 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:21.398891 13846 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:21.400106 12925 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:21.400426 13631 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:21.400550 12925 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:21.387733 13807 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:21.388278  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:21.403385  6651 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:21.397519  6118 rpcz_store.cc:276] 0709 12:27:20.337495 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.337710 (+   215us) service_pool.cc:224] Handling call
0709 12:27:20.362628 (+ 24918us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:20.401299 (+ 38671us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:20.401340 (+    41us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:20.401382 (+    42us) raft_consensus.cc:1645] Marking committed up to 19
0709 12:27:20.401412 (+    30us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:21.385310 (+983898us) spinlock_profiling.cc:243] Waited 38.5 ms on lock 0x7b5400205b54. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f4821054e01 00007f482105383e 00007f4826018419 00007f481f58fbd4 00007f481f58fb62 00007f481f58fa91 00007f481f58fa0c 00007f481f58ecc2 00007f481f38f48c 00007f481f38e8c6
0709 12:27:21.385353 (+    43us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:21.385459 (+   106us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":88485248}
I20260709 12:27:21.405490  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 14 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:21.406243  6645 raft_consensus.cc:2393] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 14: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:21.407150  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:21.388593  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:21.382818  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:21.396948 13451 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.001s
I20260709 12:27:21.397877 13531 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:21.410604  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.415009  5934 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 14 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:21.416505  6651 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:27:21.417146  5960 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19. Ops: []
W20260709 12:27:21.420167  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 91964.3us
I20260709 12:27:21.368989  6609 leader_election.cc:403] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:27:21.423151  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:27:21.424206  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 58292us
I20260709 12:27:21.425920  6042 raft_consensus.cc:1240] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:21.437335  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:21.438099  6112 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:27:21.411069 13838 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:21.455624  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:21.442412  6006 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:21.457010  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.418498 13807 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:27:21.427055 13843 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:21.458113  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:21.424021 13647 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader election lost for term 14. Reason: could not achieve majority
I20260709 12:27:21.460812  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:21.463972  6116 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:21.431023 13811 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19.
I20260709 12:27:21.476562  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:21.478518  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:21.459491 13838 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:21.458388  6118 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38df61ba407240499023581d9f885037"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35596
I20260709 12:27:21.463734 13840 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:21.491210  6118 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:21.494205  6118 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:21.440126 13841 consensus_queue.cc:1059] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.043s
I20260709 12:27:21.468041 13794 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:21.440032 13541 consensus_queue.cc:1059] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.045s
I20260709 12:27:21.510739 13841 raft_consensus.cc:3055] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:21.511204 13841 raft_consensus.cc:740] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:21.511292 13805 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:21.453820 13174 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.037s
I20260709 12:27:21.520318 13833 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:21.523608 13530 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:21.529083  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:21.470204 13807 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:21.531149 13807 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:21.492270 13783 consensus_queue.cc:1059] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 18.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.042s
I20260709 12:27:21.535252 13541 raft_consensus.cc:3055] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:27:21.535660 13797 raft_consensus.cc:3055] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:27:21.536242 13797 raft_consensus.cc:740] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:21.537182 13797 consensus_queue.cc:260] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.16, Last appended by leader: 16, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.452028 13689 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:21.502926 13662 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:21.538632 13662 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:21.539005 13662 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:21.535768 13541 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:27:21.560530  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:21.568001  6036 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23. Ops: [22.12-22.12]
I20260709 12:27:21.571324 13541 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.572618 13541 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:21.526232 13530 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:21.579897  6116 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:27:21.578944  6118 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.494709 13840 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:21.586720  6113 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 25. Current term is 26. Ops: []
I20260709 12:27:21.574939 13842 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:21.617441  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 166897us
I20260709 12:27:21.591081 13840 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:21.616961  6118 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 26 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:21.631174  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 175628us
I20260709 12:27:21.591975 13843 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:21.635699  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:21.637921  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:21.638765  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 181830us
I20260709 12:27:21.640388  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.642452  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:21.645135  6006 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.598397 13689 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:21.648209  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:21.649688  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:21.650170  6651 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:21.652313  6006 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.655972 13805 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:21.659312  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.644078 13841 consensus_queue.cc:260] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:21.665627 13841 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:21.600275 13842 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:21.656446 13805 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:21.661394 13833 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
W20260709 12:27:21.686954 13880 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.087s	user 0.000s	sys 0.000s
I20260709 12:27:21.687114 13842 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:21.688982 13879 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.058s	user 0.001s	sys 0.000s
I20260709 12:27:21.689744 13691 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.691425 12925 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:21.691994  6647 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 20.
I20260709 12:27:21.676523 13174 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:21.697451  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:21.697911 13689 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:21.703748 12925 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:21.704993  6116 raft_consensus.cc:1240] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 15. Current term is 16. Ops: []
I20260709 12:27:21.708750 13838 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.700503 13891 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:27:21.731810  6651 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 26.
I20260709 12:27:21.694398 13889 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:21.738049 13847 log.cc:927] Time spent T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:21.740298  6084 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:21.677294 13895 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:27:21.741557 13846 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:21.841497 13691 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:21.733804 13843 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.843809 13838 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:21.759073 13531 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.848184 13846 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:21.891665  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 245040us
W20260709 12:27:21.894627 13893 log.cc:927] Time spent T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.052s	user 0.001s	sys 0.000s
W20260709 12:27:21.896277  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 172195us
W20260709 12:27:21.899356  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 156018us
W20260709 12:27:21.900228  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 183126us
I20260709 12:27:21.901996  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:21.902987 13735 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Leader election won for term 26
W20260709 12:27:21.903405  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 244206us
I20260709 12:27:21.904130  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:21.912988  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 264822us
I20260709 12:27:21.895913 13805 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:21.919617  6643 raft_consensus.cc:1240] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 26 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 25. Current term is 26. Ops: []
I20260709 12:27:21.919657  6039 raft_consensus.cc:1240] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19. Ops: []
I20260709 12:27:21.918814 13908 consensus_queue.cc:1059] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 25.18, Next index: 19, Last known committed idx: 18, Time since last communication: 0.002s
I20260709 12:27:21.928084 13908 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 LEADER]: Stepping down as leader of term 25
I20260709 12:27:21.928457 13908 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:21.929234 13908 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 25, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.930363 13908 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:27:21.926052 13796 consensus_meta.cc:287] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.561s	user 0.004s	sys 0.004s
I20260709 12:27:21.934974 13531 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:21.936233 13840 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.912000 13841 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:27:21.939404 13840 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:21.941063 13846 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:21.942956  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:21.945026 13805 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:21.955008 13662 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:21.956159  6038 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:21.959352  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:21.960636  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:21.961177  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:21.961838  6039 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 26.
I20260709 12:27:21.974987  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
W20260709 12:27:21.975795  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 71741.8us
I20260709 12:27:21.977604  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:21.981287  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:21.976823  6006 leader_election.cc:304] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 13 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:22.037283  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 140908us
W20260709 12:27:22.038337  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 61809.6us
I20260709 12:27:22.040614  6006 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:21.985880 13842 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Leader pre-election won for term 27
I20260709 12:27:22.044168  6006 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:21.982570 13846 consensus_queue.cc:1059] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 19.11, Next index: 12, Last known committed idx: 11, Time since last communication: 0.062s
I20260709 12:27:22.057641  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:22.059909  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:22.066368  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:22.067374  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:22.068591  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:22.069442  5961 raft_consensus.cc:2393] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 23: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:22.071823  5934 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:22.067191  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:22.039716 13735 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:22.042066 13838 raft_consensus.cc:2749] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader pre-election lost for term 13. Reason: could not achieve majority
I20260709 12:27:22.049450 13842 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.079300  6111 raft_consensus.cc:1240] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23. Ops: []
I20260709 12:27:22.047108 13906 raft_consensus.cc:2804] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:22.055327 13895 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:22.084152  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:22.086643  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:22.087670  6040 raft_consensus.cc:1240] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:22.093356  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:22.094146  6036 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:22.074236 13891 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:22.109654 13891 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.111393 13662 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:22.111913 13891 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:22.061918 13908 consensus_queue.cc:1059] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 18.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.035s
I20260709 12:27:22.088994 13842 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:22.086926 13688 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:22.107959 13735 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 25.18, Last appended by leader: 18, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:22.120388  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 26 candidate_status { last_received { term: 25 index: 18 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:22.085043 13892 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.122613  6643 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 23.
I20260709 12:27:22.127324 13843 raft_consensus.cc:3055] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Stepping down as leader of term 20
I20260709 12:27:22.127914 13843 raft_consensus.cc:740] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:22.129004 13843 consensus_queue.cc:260] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 20, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.131095 13688 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 20 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:27:22.131987 13910 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.059s	user 0.002s	sys 0.000s
I20260709 12:27:22.132308 13688 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:22.133738 13895 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:22.099485 13906 raft_consensus.cc:697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:22.135818 13906 consensus_queue.cc:237] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 17.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:22.141876 13892 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:22.146322 13892 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:22.147379 13913 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.062s	user 0.000s	sys 0.000s
I20260709 12:27:22.157897  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:22.161765  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:22.164188  6040 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 26.
I20260709 12:27:22.113960  6651 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:22.166745  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:22.168318  6038 raft_consensus.cc:2393] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 19: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:22.156798 13843 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:22.171818  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:22.171324  6006 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:22.170842  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:22.178431  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:22.179395  5966 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:22.181232  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:22.181459  6037 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 23: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:22.182646  6006 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:22.184520  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:22.197322 13796 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:22.197958 13796 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.199573 13797 raft_consensus.cc:3060] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:22.200116 13796 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:22.205252  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 133563us
I20260709 12:27:22.183825 13895 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election lost for term 17. Reason: could not achieve majority
I20260709 12:27:22.205416  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:22.212440 13745 raft_consensus.cc:3055] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:27:22.212894 13745 raft_consensus.cc:740] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:22.213651 13745 consensus_queue.cc:260] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.189550 13891 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:27:22.189004 13908 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:27:22.217976  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:22.218564 13539 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election lost for term 16. Reason: could not achieve majority
I20260709 12:27:22.221520 13846 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:22.222289 13387 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.225090 13745 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:22.239758  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:22.240866  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:22.243085  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:22.243777  6643 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:22.232635 13387 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.244999 13662 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:27:22.267490 13662 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:22.268630 13662 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 22.17, Last appended by leader: 17, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:22.275035  6082 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.278671  6039 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 16 index: 13. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:22.279938  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:22.280668  5968 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
W20260709 12:27:22.280166 13919 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.066s	user 0.000s	sys 0.001s
I20260709 12:27:22.281689 13842 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.282896  5960 raft_consensus.cc:1240] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 26. Current term is 27. Ops: []
I20260709 12:27:22.285518 13810 consensus_queue.cc:1059] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:22.286047  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:22.286743  6037 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:22.291221  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:22.291898  6040 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:22.292806  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:22.298789 13810 raft_consensus.cc:3055] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Stepping down as leader of term 15
I20260709 12:27:22.299223 13810 raft_consensus.cc:740] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 15 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:22.300087 13810 consensus_queue.cc:260] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 15, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:22.301304 13810 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:22.302626  6081 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:22.303799 13549 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:22.304184 13549 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.304525 13549 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:22.312018  6084 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:22.314916 13831 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 21.16, Next index: 17, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:27:22.318504 13539 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:22.319139 13539 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:22.319252 13629 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:27:22.319746 13629 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:22.320035 13539 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:22.320649 13629 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:22.322031 13629 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:22.327198  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cbdceec3ce444e7b812ac717eafb85ee" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:22.328513  6084 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:22.329408  5966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:27:22.330016  5966 raft_consensus.cc:606] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:22.332027  6039 raft_consensus.cc:1240] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 16. Current term is 17. Ops: []
I20260709 12:27:22.335772 13458 consensus_queue.cc:1059] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 16.14, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:22.336270 13796 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.336848 13796 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.336758 13458 raft_consensus.cc:3055] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:27:22.337670 13458 raft_consensus.cc:740] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:22.259048  6036 raft_consensus.cc:2468] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:22.338528 13458 consensus_queue.cc:260] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:22.341598 13458 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:22.248838  6647 raft_consensus.cc:1275] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:22.261901 13387 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:22.335778 13739 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:22.342871 13739 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.343243 13739 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:22.344687  5966 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "afdcf44718954edea3bd3aa8ada58035"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:27:22.345242  5966 raft_consensus.cc:606] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:22.345417 13735 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:22.345902 13735 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.347177 13842 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 27 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:22.348459 13735 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:22.349054 13735 consensus_queue.cc:1059] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:22.350037 13387 raft_consensus.cc:3055] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:27:22.350402 13387 raft_consensus.cc:740] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:22.342700  5934 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:22.351181 13387 consensus_queue.cc:260] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 26.13, Last appended by leader: 13, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.352213 13387 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:22.353443  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 27 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:22.353849 13745 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:22.355866 13796 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:22.357337  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:22.358067  6036 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:27:22.352110 13739 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:22.363703 13739 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:22.364282 13549 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.360975  5966 raft_consensus.cc:614] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:22.359337  5932 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:22.375384  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:22.376374  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:22.377131  5966 raft_consensus.cc:2393] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 18: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
W20260709 12:27:22.248070  6610 consensus_peers.cc:183] SignalRequest failed: Illegal state: peer closed
I20260709 12:27:22.368827  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:22.378342  6111 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:27:22.346282  6037 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 27.
I20260709 12:27:22.377585  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:22.379982  5932 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:22.380322  5960 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:22.387943  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:22.389701  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:22.389701  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:22.391312  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:22.391875  6648 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:22.393301  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:22.382300 13458 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.390659  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:22.410147  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:22.399380  5863 catalog_manager.cc:5697] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 20 to 22, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 22 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:22.398180 13796 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:22.397812 13842 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:27:22.419852  5863 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 16 to 18. New cstate: current_term: 18 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:22.428248  6082 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:22.431097  5863 catalog_manager.cc:5697] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 18 to 20, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 20 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.435252  5863 catalog_manager.cc:5697] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 11 to 13. New cstate: current_term: 13 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.473969  5863 catalog_manager.cc:5697] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 23 to 27. New cstate: current_term: 27 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:22.418550 13711 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:22.480978 13549 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:22.418715 13458 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:22.429965 13796 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.472121 13842 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 27 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:22.473173 13892 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:22.484381 13732 consensus_queue.cc:1059] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 17.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:22.486294  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:22.500710  5966 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:22.488978  5960 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:22.407047 13855 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.031s
I20260709 12:27:22.432588 13544 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:22.496850  5863 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 19 to 25. New cstate: current_term: 25 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.511397 13732 raft_consensus.cc:3055] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:22.511835 13732 raft_consensus.cc:740] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:22.512686 13732 consensus_queue.cc:260] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:22.514076 13732 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:22.494444  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:22.528513 13842 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.529111 13892 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election lost for term 23. Reason: could not achieve majority
I20260709 12:27:22.530510  5863 catalog_manager.cc:5697] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 16 to 17, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 17 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:22.533576  5865 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 221) took 9671 ms. Trace:
I20260709 12:27:22.539549  6109 raft_consensus.cc:2410] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 27 because replica has last-logged OpId of term: 26 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 24 index: 12.
I20260709 12:27:22.540096  5865 rpcz_store.cc:276] 0709 12:27:12.830372 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:12.838574 (+  8202us) service_pool.cc:224] Handling call
0709 12:27:22.501354 (+9662780us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:20.574194 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:20.689364 (+115170us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:20.689411 (+    47us) write_op.cc:435] Acquired schema lock
0709 12:27:20.689430 (+    19us) tablet.cc:662] Decoding operations
0709 12:27:20.690628 (+  1198us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:20.690722 (+    94us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:20.690748 (+    26us) tablet.cc:685] Acquiring locks for 13 operations
0709 12:27:20.691911 (+  1163us) tablet.cc:701] Row locks acquired
0709 12:27:20.691951 (+    40us) write_op.cc:260] PREPARE: finished
0709 12:27:20.692129 (+   178us) write_op.cc:270] Start()
0709 12:27:20.692270 (+   141us) write_op.cc:276] Timestamp: P: 1783600040692065 usec, L: 0
0709 12:27:20.692287 (+    17us) op_driver.cc:348] REPLICATION: starting
0709 12:27:20.692978 (+   691us) log.cc:844] Serialized 5156 byte log entry
0709 12:27:20.932570 (+239592us) spinlock_profiling.cc:243] Waited 3.22 ms on lock 0x7b18002a1cc0. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df673f3 00007f481df697c1 00007f481df69779 00007f481df69709 00007f481df696d1 00007f481df689cd 0000000000388634 0000000000388479 00007f481df4a83a
0709 12:27:21.063718 (+131148us) op_driver.cc:464] REPLICATION: finished
0709 12:27:21.316394 (+252676us) write_op.cc:301] APPLY: starting
0709 12:27:21.316492 (+    98us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:21.346008 (+ 29516us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:21.346044 (+    36us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:21.931615 (+585571us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:21.931893 (+   278us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=26,key_file_lookups=26,delta_file_lookups=26,mrs_lookups=0
0709 12:27:21.931941 (+    48us) write_op.cc:312] APPLY: finished
0709 12:27:21.932275 (+   334us) log.cc:844] Serialized 121 byte log entry
0709 12:27:21.933070 (+   795us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:21.933214 (+   144us) write_op.cc:454] Released schema lock
0709 12:27:21.933274 (+    60us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:22.039263 (+105989us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:22.042594 (+  3331us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":37154,"reported_tablets":31,"child_traces":[["op",{"apply.queue_time_us":252301,"apply.run_cpu_time_us":29829,"apply.run_wall_time_us":662740,"cfile_cache_hit":54,"cfile_cache_hit_bytes":58493,"num_ops":13,"prepare.queue_time_us":200071,"prepare.run_cpu_time_us":18707,"prepare.run_wall_time_us":196922,"raft.queue_time_us":127282,"raft.run_cpu_time_us":55450,"raft.run_wall_time_us":136239,"replication_time_us":371251,"spinlock_wait_cycles":7399680,"thread_start_us":362256,"threads_started":4,"wal-append.queue_time_us":87575}]]}
I20260709 12:27:22.498904 13796 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:22.550691  6082 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:22.548249  5863 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.553210  5863 catalog_manager.cc:5697] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 10 to 11, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 11 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:22.556602 13806 raft_consensus.cc:2804] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:22.558939 13806 raft_consensus.cc:697] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:22.559912 13806 consensus_queue.cc:237] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.563189 13745 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.567220  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:22.574115  6039 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:27:22.572948 13906 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:22.575575 13906 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.577651 13906 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:22.564452  5863 catalog_manager.cc:5697] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 19 to 21, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 21 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:22.568466  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:22.570017  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:22.579255  6040 raft_consensus.cc:3060] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:22.572505  6109 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:27:22.579454  6044 raft_consensus.cc:3060] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Advancing to term 17
I20260709 12:27:22.568163  6009 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:22.580575  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:22.581408  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:22.581820  5961 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:27:22.582731  5863 catalog_manager.cc:5697] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 14 to 15, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 15 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:22.582012  5964 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:22.585282  5863 catalog_manager.cc:5697] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 14 to 17, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 17 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:22.588058  6082 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:22.588454  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:22.590510  5966 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:22.590922  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 16 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:22.592552  6081 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:22.595415  6645 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:27:22.603456  6109 raft_consensus.cc:2368] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17.
I20260709 12:27:22.604700  6044 raft_consensus.cc:2468] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:22.608212  6044 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 21. Current term is 22. Ops: []
I20260709 12:27:22.589448  5863 catalog_manager.cc:5697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 12, term changed from 18 to 19, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to <none>, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 19 committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:27:22.609496  5863 catalog_manager.cc:5697] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:22.610754  5863 catalog_manager.cc:5697] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 22 to 23, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 23 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:22.612512  6040 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:22.612299  5863 catalog_manager.cc:5697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 13 to 15, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 15 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:22.574352 13711 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:22.614784  6009 leader_election.cc:400] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17.
I20260709 12:27:22.618162  6009 leader_election.cc:403] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 16 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:22.565958 13896 consensus_queue.cc:1048] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.042s
I20260709 12:27:22.632436  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:22.633302  6082 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 4 voters: 3 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:22.606451 13539 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:22.635859  5863 catalog_manager.cc:5697] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 18 to 20, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 20 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.615800 13843 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.017s
W20260709 12:27:22.665977  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 51321.8us
I20260709 12:27:22.668398  6648 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:22.585070 13745 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:22.606796 13662 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:22.617372 13387 raft_consensus.cc:2804] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:22.619208 13549 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.616165 13895 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader election lost for term 22. Reason: could not achieve majority
I20260709 12:27:22.670045  5863 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 20 to 21, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 21 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:22.642975 13531 raft_consensus.cc:2804] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:27:22.672365 13921 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:22.685621  5863 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 21 to 22, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 22 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:22.687435  5863 catalog_manager.cc:5697] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 11 to 12, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 12 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:22.650238 13539 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:22.689572  5863 catalog_manager.cc:5697] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:22.619298 13841 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 13, Time since last communication: 0.061s
I20260709 12:27:22.675074 13810 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:22.673868 13688 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:22.697352  5863 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 16 to 19, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 19 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:22.631603 13711 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:22.649736 13544 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 21.14, Next index: 15, Last known committed idx: 14, Time since last communication: 0.039s
I20260709 12:27:22.707082  5863 catalog_manager.cc:5697] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 17 to 18, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 18 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:22.715342 13662 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:27:22.693212 13906 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 16. Reason: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 16. Current term is 17.
I20260709 12:27:22.695258 13810 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:22.743587 13810 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:22.681172 13387 raft_consensus.cc:697] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:22.693802 13539 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:22.739751  5863 catalog_manager.cc:5697] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 24 to 31, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 31 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:22.750428  5863 catalog_manager.cc:5697] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 19 to 21. New cstate: current_term: 21 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:22.753130  5863 catalog_manager.cc:5697] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 16 to 18, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 18 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:22.755842  5863 catalog_manager.cc:5697] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:27:22.762622  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 84066us
I20260709 12:27:22.680744 13549 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.738103 13688 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.766709 13544 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:27:22.789435 13647 raft_consensus.cc:993] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: : Instructing follower 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
I20260709 12:27:22.789736 13544 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:22.815601  6040 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:22.822211  6044 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:27:22.827920  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:22.804236 13531 raft_consensus.cc:697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:22.839443  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:22.851090  6040 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:27:22.820441 13387 consensus_queue.cc:237] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 9, Committed index: 9, Last appended: 15.9, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:22.813797 13842 raft_consensus.cc:1081] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Signalling peer 0069e2ba1f02412e8e1d6c20a1fb510f to start an election
W20260709 12:27:23.018028  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 184870us
I20260709 12:27:22.853358 13928 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:23.022362 13928 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.024664 13928 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:22.861403 13745 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:23.046110  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 190540us
W20260709 12:27:23.056267 13796 consensus_meta.cc:287] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.510s	user 0.008s	sys 0.000s
I20260709 12:27:23.056789 13796 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.015686 13544 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.069229  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:23.070279  6040 raft_consensus.cc:2410] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 17 because replica has last-logged OpId of term: 15 index: 10, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 9.
I20260709 12:27:23.079214  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:23.079941  5961 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:27:23.082566  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:23.095956  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:23.096899  5960 raft_consensus.cc:2393] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 19: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:23.069895 13931 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:23.088512 13688 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:23.068994 13842 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.032s
I20260709 12:27:23.101908 13941 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.099238 13735 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:23.098001 13745 raft_consensus.cc:493] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:23.106719 13549 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:23.114662 13544 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:23.117276 13735 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.058993 13531 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.13, Last appended by leader: 13, Current term: 20, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.120293 13647 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:23.108002 13931 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:23.137029 13938 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.092s	user 0.001s	sys 0.000s
W20260709 12:27:23.174748 13924 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.083s	user 0.001s	sys 0.000s
I20260709 12:27:23.113740 13941 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.183634  5960 raft_consensus.cc:3060] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:23.184999 13941 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:23.159622 13647 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.128245 13796 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:23.134200 13735 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:23.122524 13745 raft_consensus.cc:515] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.196659  5960 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:27:23.207460 13647 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:23.219158  6651 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:23.219774  6647 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:27:23.219913  6651 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 23.
I20260709 12:27:23.221374  6648 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:27:23.221694 13797 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.222303 13711 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:23.224820 13539 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.225266  6651 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 26 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 25 index: 18. Preceding OpId from leader: term: 26 index: 19. (index mismatch)
I20260709 12:27:23.227936 13549 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:27:23.229429 13931 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:23.196707 13936 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.237703 13936 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.239884 13936 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:23.198431 13906 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.242435 13906 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.244889 13906 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:23.246080  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:23.246830  6037 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:27:23.248473  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:23.249097  6036 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
W20260709 12:27:23.250036 13810 consensus_meta.cc:287] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: Time spent flushing consensus metadata: real 0.506s	user 0.009s	sys 0.001s
I20260709 12:27:23.253041  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:23.253695  5962 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 23.
I20260709 12:27:23.253974  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:23.254128  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:23.254814  5964 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 21: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:23.255188  5959 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:27:23.250541 13810 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.256139  5963 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 14.
W20260709 12:27:23.258845 13942 log.cc:927] Time spent T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.137s	user 0.002s	sys 0.000s
I20260709 12:27:23.222244 13797 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.260913 13797 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:23.267225  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:23.268164  6118 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 23: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:23.273511 13935 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:23.248771 13745 leader_election.cc:290] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:23.203006 13940 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.079s	user 0.004s	sys 0.000s
I20260709 12:27:23.274967 13935 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.008s
I20260709 12:27:23.298523  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:23.299697  6044 raft_consensus.cc:1275] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:27:23.303622  5968 raft_consensus.cc:2368] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19.
I20260709 12:27:23.300781  6036 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 19 index: 16. (index mismatch)
I20260709 12:27:23.287969  6645 raft_consensus.cc:2368] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 19. Current term is 20.
I20260709 12:27:23.298199  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:23.307291  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 85000.2us
I20260709 12:27:23.308115  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:23.311064  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:23.311800  5962 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:27:23.316036  6081 leader_election.cc:400] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19.
I20260709 12:27:23.316962  6081 leader_election.cc:403] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Cancelling election due to peer responding with higher term
I20260709 12:27:23.283699 13842 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:23.323828  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 56472.5us
W20260709 12:27:23.326021  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 197190us
I20260709 12:27:23.331532  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:23.299916 13458 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:23.334645 13930 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:23.344774  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:23.345726  6044 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 14.
I20260709 12:27:23.316650 13745 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:23.316135 13840 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:23.351087  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:23.313357 13933 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.034s
I20260709 12:27:23.359863  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:23.358377  6082 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:23.369268  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:23.371145  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:23.370035  6039 raft_consensus.cc:2393] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 17: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:23.372478  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:23.351853 13745 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.352623 13539 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:23.332394 13928 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 16, Time since last communication: 0.031s
I20260709 12:27:23.376897  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:23.373925  6643 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 23 index: 18. (index mismatch)
I20260709 12:27:23.383236  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:23.355113 13840 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:23.377930  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:23.357781 13849 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.373579 13541 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:23.331990 13842 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.363432 13947 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.386226  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:23.386812  6111 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:35586
I20260709 12:27:23.386353  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:23.392047  6113 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:23.389885  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:23.361850 13927 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Leader pre-election won for term 15
I20260709 12:27:23.392091  6111 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:23.392777  5966 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:23.391315  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 14 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:23.393143  6111 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:23.372788 13905 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:23.396077 13905 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:23.396473 13905 raft_consensus.cc:3060] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:23.378906 13745 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:23.404435  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:23.407691  5966 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:27:23.385931 13840 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:23.410775  6042 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:27:23.390651 13541 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.414187  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:23.413530  6118 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 26 index: 13. Preceding OpId from leader: term: 27 index: 13. (term mismatch)
I20260709 12:27:23.416297  6118 pending_rounds.cc:85] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting all ops after (but not including) 12
I20260709 12:27:23.416553  6118 pending_rounds.cc:107] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Aborting uncommitted NO_OP operation due to leader change: 26.13
I20260709 12:27:23.416775  6118 raft_consensus.cc:2889] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:23.418821  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:23.420078  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1c1322bdafce4b389254f08a59254d2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 23 candidate_status { last_received { term: 22 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:23.392990 13849 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.422158 13849 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:23.425365  6611 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:23.429025 13887 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:23.394922 13927 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.431033 13927 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:27:23.432291 13945 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:27:23.443380  5934 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:23.448800 13943 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:23.407449 13935 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.036s
I20260709 12:27:23.398742 13947 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.452226 13947 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:23.455735 13943 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:23.458736  6084 leader_election.cc:400] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 19. Current term is 20.
I20260709 12:27:23.459084  6084 leader_election.cc:403] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:23.462586  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:23.399925 13531 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.047s
I20260709 12:27:23.471653 13842 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:23.472198 13927 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.475062 13745 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.477646  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:23.436218 13541 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:23.487787  5934 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:23.488530  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:23.482815  6111 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.496330  6118 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 23.
I20260709 12:27:23.498284  6117 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 24. Current term is 25. Ops: []
I20260709 12:27:23.500077  5934 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:23.501585  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 117597us
W20260709 12:27:23.502029  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 76743.1us
I20260709 12:27:23.476338 13810 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:23.476579 13841 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:23.511780  5960 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 12:27:23.523175  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:23.523947  6117 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:23.482241 13855 raft_consensus.cc:3060] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 20
I20260709 12:27:23.526221  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:23.535492  5968 raft_consensus.cc:3055] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Stepping down as leader of term 24
I20260709 12:27:23.536965  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:23.537647  6645 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:23.538779  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:23.539994  6111 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:23.501327 13950 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:23.535857  5968 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:23.542800  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:23.544625  5967 raft_consensus.cc:3060] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
W20260709 12:27:23.552203  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 129883us
I20260709 12:27:23.510090 13828 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:23.502974 13941 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:23.553736  6608 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:23.511363 13927 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:23.512674 13745 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:23.561015  6035 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 27 index: 13. (index mismatch)
I20260709 12:27:23.497994 13935 consensus_queue.cc:1048] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.051s
I20260709 12:27:23.564265  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:23.564023  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3fd6047b66ab4b4abc3fe659e8cff000" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 18 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:23.565853  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:23.568282  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:23.569514  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:23.486418 13905 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.544121 13950 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.590628 13950 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:23.543848 13930 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election lost for term 18. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 18. Current term is 19.
I20260709 12:27:23.498505 13735 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.573645  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:23.581184 13840 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.588642 13957 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:23.543566 13842 consensus_queue.cc:1059] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 24.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.031s
I20260709 12:27:23.588740  5967 raft_consensus.cc:2468] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 15.
I20260709 12:27:23.578289  5932 leader_election.cc:304] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:23.591953 13797 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:23.596113  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:23.530891 13841 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.563499 13949 raft_consensus.cc:2804] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:23.615096  6645 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 24.
W20260709 12:27:23.625258  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 47037.9us
I20260709 12:27:23.574936 13926 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.629365 13957 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.559367 13908 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.052s
I20260709 12:27:23.591921 13783 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:23.638996 13957 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:23.639787  6113 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:27:23.640915 13735 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:23.641707  6109 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 17: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:23.643448 13841 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:23.644109 13840 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:23.646381 13905 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:23.646934 13541 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.648278  6647 raft_consensus.cc:2393] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 15: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:23.649153 13541 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:23.564543 13828 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.651600  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:23.652347  5967 raft_consensus.cc:2393] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 15: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:23.653092  6035 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 23.
I20260709 12:27:23.629352 13647 raft_consensus.cc:2749] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:23.630796  6006 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:23.655628 13662 raft_consensus.cc:2804] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:23.656157 13662 raft_consensus.cc:697] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:23.656433 13926 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.656991 13662 consensus_queue.cc:237] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 13.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.658942 13926 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:23.639972  6650 raft_consensus.cc:1275] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 16. Preceding OpId from leader: term: 19 index: 16. (term mismatch)
I20260709 12:27:23.660712  6650 pending_rounds.cc:85] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Aborting all ops after (but not including) 15
I20260709 12:27:23.660979  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:23.660933  6650 pending_rounds.cc:107] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: Aborting uncommitted NO_OP operation due to leader change: 18.16
I20260709 12:27:23.661691  6650 raft_consensus.cc:2889] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:23.662492  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 15 candidate_status { last_received { term: 13 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:23.667209  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:23.667912  6044 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:23.667798  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:23.669946  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:23.670262  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 15 index: 10 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:23.670879  5963 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:23.671638  5962 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 8. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:27:23.670897  5966 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:23.673343  6115 raft_consensus.cc:2393] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 16: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:23.675372  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:23.675675  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:23.676676  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:23.677059  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:23.677438  6113 raft_consensus.cc:2393] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 23: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:23.677088  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:23.678403  6110 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:27:23.677670  5934 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:23.679630  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:23.682761  5963 raft_consensus.cc:2393] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 21: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:23.691829  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 15 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:23.693773 13810 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election lost for term 15. Reason: could not achieve majority
I20260709 12:27:23.696761  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:23.628474 13797 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.695230  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:23.705880  6044 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:23.652263 13828 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:23.709591  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:23.664220 13949 raft_consensus.cc:697] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:23.716406  5966 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 17.
I20260709 12:27:23.722834 13896 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:23.723443 13896 raft_consensus.cc:697] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:23.723686 13688 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:23.724296 13688 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:23.726786 13963 log.cc:927] Time spent T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.085s	user 0.003s	sys 0.000s
W20260709 12:27:23.729632 13956 log.cc:927] Time spent T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.096s	user 0.000s	sys 0.001s
I20260709 12:27:23.729647 13943 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.658877 13927 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.040s
I20260709 12:27:23.729423 13855 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 19. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 19. Current term is 20.
I20260709 12:27:23.690111 13745 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:23.689247 13926 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:23.695314 13840 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:23.742919  6006 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:23.707402 13961 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.208s	user 0.001s	sys 0.000s
I20260709 12:27:23.685127 13842 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.057s
I20260709 12:27:23.701781 13797 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:23.699422 13735 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 8, Time since last communication: 0.049s
I20260709 12:27:23.746510 13849 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:23.747874 13840 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.752204 13745 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
W20260709 12:27:23.774544 13968 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.064s	user 0.001s	sys 0.000s
W20260709 12:27:23.779078  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 101478us
I20260709 12:27:23.756160 13891 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:23.731678 13943 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.780946 13840 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:23.780661 13849 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.776347 13896 consensus_queue.cc:237] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 15.10, Last appended by leader: 10, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.835618 13745 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:23.847956  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 43572.6us
I20260709 12:27:23.790927 13949 consensus_queue.cc:237] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 18.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:23.867827  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:23.868583  6111 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 23.
I20260709 12:27:23.870203  5934 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:23.866341 13943 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:23.877521 13933 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:23.908644  5963 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:27:23.912838  6117 raft_consensus.cc:2468] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:27:23.881207 13783 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.919152  5968 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 24, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:23.897379 13859 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:23.931217  5968 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:23.916299 13846 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:24.022298  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:23.927897 13783 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.025938 13783 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:23.933847 13846 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:23.934911 13859 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.026684 13846 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:24.029738  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:24.030692  6648 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:27:23.921602 13933 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:24.053851 13969 consensus_queue.cc:1048] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:27:24.055089 13967 log.cc:927] Time spent T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.071s	user 0.000s	sys 0.000s
I20260709 12:27:24.060820  6041 raft_consensus.cc:2468] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:27:24.021867 13797 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.140429  6643 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 16.
I20260709 12:27:24.144867 13541 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.086983 13849 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.162022 13541 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.162981  6644 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 12:27:24.163688 13797 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.164203 13541 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:24.147753 13843 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.165709 13843 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:24.139703 13662 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.122309 13841 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.167788 13843 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.171006 13941 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.171553 13941 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:24.172574  5968 raft_consensus.cc:2468] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 25.
W20260709 12:27:24.180904  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 310765us
I20260709 12:27:24.185482  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 28 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:24.186523  6117 raft_consensus.cc:1240] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 24. Current term is 25. Ops: []
I20260709 12:27:24.191757  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.192485  6111 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 22.
I20260709 12:27:24.189810  5934 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:24.227065  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:24.227757  5968 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:27:24.193372 13943 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:24.181816 13662 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:24.234695  5934 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:24.226652 13937 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:27:24.261117 13937 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:24.261865  5934 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:24.260159 13950 consensus_meta.cc:287] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: Time spent flushing consensus metadata: real 0.669s	user 0.000s	sys 0.011s
I20260709 12:27:24.262573 13943 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.262665 13950 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:24.265000 13943 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:24.265154 13950 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.265661 13943 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:24.186575 13841 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:24.262203 13937 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 22.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.268283 13895 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:24.268680  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:24.266870  5967 raft_consensus.cc:2368] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 23. Current term is 24.
I20260709 12:27:24.266185 13950 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:24.277159 13688 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:24.283824  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:24.296312  6041 raft_consensus.cc:2393] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 17: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:24.287194  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:24.288429  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:24.288806  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:24.297901  6044 raft_consensus.cc:2410] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for term 22 because replica has last-logged OpId of term: 20 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 18 index: 12.
I20260709 12:27:24.289724  5960 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:27:24.289455  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:24.299927  6081 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:24.309402  6043 raft_consensus.cc:2393] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 22: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:24.322921  6036 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 23.
I20260709 12:27:24.262296 13662 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:24.333490  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 395211us
W20260709 12:27:24.322117 13964 thread.cc:641] apply [worker] (thread pool) Time spent creating pthread: real 0.686s	user 0.012s	sys 0.016s
I20260709 12:27:24.345005  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:24.346220 13964 thread.cc:608] apply [worker] (thread pool) Time spent starting thread: real 0.710s	user 0.012s	sys 0.016s
I20260709 12:27:24.346622  6038 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 22.
I20260709 12:27:24.345280  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:24.304771 13950 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:24.326650 13530 raft_consensus.cc:2804] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:27:24.351620  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:24.289594 13840 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.310566 13387 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.041s
W20260709 12:27:24.372350  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 110550us
I20260709 12:27:24.359899  6039 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:24.373225  6039 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:27:24.349828 13950 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:24.348184 13859 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.379791  6044 raft_consensus.cc:2368] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19.
I20260709 12:27:24.387274  6609 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:24.392515  5962 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:27:24.397192  6609 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:24.379359 13896 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.420612  6649 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 12:27:24.398823 13939 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:24.394951 13530 raft_consensus.cc:697] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:24.426358 13939 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.419828 13896 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.451128 13530 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 24.12, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:24.452343 13840 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:24.455049  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:24.469815  6646 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 19
W20260709 12:27:24.456589 13986 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.078s	user 0.000s	sys 0.000s
I20260709 12:27:24.417539 13982 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:24.510138 13982 raft_consensus.cc:493] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.510684 13982 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:24.417050 13838 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.031s
I20260709 12:27:24.466658 13846 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:24.467161  6649 raft_consensus.cc:1275] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 13 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:27:24.523429 13846 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.523797 13896 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:24.526731  6648 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:24.518868 13971 log.cc:927] Time spent T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.759s	user 0.005s	sys 0.008s
I20260709 12:27:24.468389 13939 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:24.557502  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:24.558320  6111 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:24.555096  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 28 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.562142  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:24.602972  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 17 candidate_status { last_received { term: 14 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:24.609740  5961 raft_consensus.cc:2410] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for term 17 because replica has last-logged OpId of term: 15 index: 13, which is greater than that of the candidate, which has last-logged OpId of term: 14 index: 12.
I20260709 12:27:24.609970  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.610659  6109 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 22.
I20260709 12:27:24.613531  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:24.615525  6111 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
W20260709 12:27:24.619577 13995 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.149s	user 0.000s	sys 0.000s
W20260709 12:27:24.623709 14003 log.cc:927] Time spent T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.064s	user 0.000s	sys 0.000s
I20260709 12:27:24.631501  5962 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 12:27:24.632994  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.633773  6111 raft_consensus.cc:2368] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19.
I20260709 12:27:24.609825 14004 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:24.613976 13974 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:24.679005  5959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:27:24.679726  5959 raft_consensus.cc:606] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:24.678150  6035 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:36266 (request call id 3358) took 1111 ms. Trace:
I20260709 12:27:24.680071  5959 raft_consensus.cc:614] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:24.681581  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 17 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:24.680217  6035 rpcz_store.cc:276] 0709 12:27:23.563938 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.564050 (+   112us) service_pool.cc:224] Handling call
0709 12:27:24.674211 (+1110161us) spinlock_profiling.cc:243] Waited 88.2 ms on lock 0x7b540025b554. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:24.674348 (+   137us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":202809728}
I20260709 12:27:24.683144 13974 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.681130 14004 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.686753 13662 consensus_queue.cc:1048] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.010s
W20260709 12:27:24.696419 13958 log.cc:927] Time spent T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.082s	user 0.000s	sys 0.000s
W20260709 12:27:24.697250 13977 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.054s	user 0.000s	sys 0.000s
I20260709 12:27:24.697542  5959 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
mode: GRACEFUL
new_leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
 from {username='slave'} at 127.0.0.1:56036
I20260709 12:27:24.691823 14010 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.012s
I20260709 12:27:24.699465  6040 raft_consensus.cc:3055] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:27:24.699875  6040 raft_consensus.cc:740] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:24.700373  5967 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.RequestConsensusVote from 127.0.0.1:34558 (request call id 3716) took 1030 ms. Trace:
I20260709 12:27:24.700588  6040 consensus_queue.cc:260] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.18, Last appended by leader: 18, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.698207  5959 raft_consensus.cc:606] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Received request to transfer leadership to TS 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:24.703840  5959 raft_consensus.cc:614] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:24.706670 13841 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.711057  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:27:24.712999  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:24.713865  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:24.716480 13974 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:24.722699 13841 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.723390 13841 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:24.727509  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:24.728137  5964 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 24: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:24.710935  5967 rpcz_store.cc:276] 0709 12:27:23.669624 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.669730 (+   106us) service_pool.cc:224] Handling call
0709 12:27:24.700186 (+1030456us) spinlock_profiling.cc:243] Waited 596 ms on lock 0x7b5400198054. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4820fbd571 00007f48210582fa 00007f4826019b17 00007f481f5946d4 00007f481f594662 00007f481f594591 00007f481f59450c 00007f481f5937c2 00007f481f38f48c 00007f481f38e8c6 00007f481f38e26f
0709 12:27:24.700319 (+   133us) inbound_call.cc:177] Queueing success response
Metrics: {"spinlock_wait_cycles":1371198336}
I20260709 12:27:24.736284  6646 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:27:24.732033 13905 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:24.737764  6009 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:24.737102 13892 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:24.739019 13905 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.739326 13892 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.740224 14004 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:24.741191 13905 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:24.741371  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.742337  6111 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 16.
I20260709 12:27:24.741351 13892 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:24.743404 14010 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:24.743911 14010 raft_consensus.cc:697] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:24.741904  6082 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:24.748399 13989 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:24.749213  6006 leader_election.cc:400] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 23. Current term is 24.
I20260709 12:27:24.748898 13989 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.748203 13838 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:24.750171 13838 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:24.751045 13989 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:24.751643 13905 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:24.749549  6006 leader_election.cc:403] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Cancelling election due to peer responding with higher term
I20260709 12:27:24.752198 13905 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.754330 14010 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 17.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.754550 13905 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:24.755590 13989 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:24.748188 13841 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.751304  6081 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:24.760457  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:24.761116  5961 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 15.
I20260709 12:27:24.761555  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 19 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.762346  6109 raft_consensus.cc:2410] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for term 24 because replica has last-logged OpId of term: 22 index: 12, which is greater than that of the candidate, which has last-logged OpId of term: 19 index: 11.
I20260709 12:27:24.768646 13939 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.770812 13892 raft_consensus.cc:2804] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:27:24.771574 13892 raft_consensus.cc:697] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:24.772720  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.772490 13892 consensus_queue.cc:237] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 20.13, Last appended by leader: 13, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:24.774322  6111 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:24.775864 13976 log.cc:927] Time spent T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.765s	user 0.002s	sys 0.000s
I20260709 12:27:24.777541  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35596 (request call id 3672) took 1179 ms. Trace:
I20260709 12:27:24.752281 13838 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.778913 13939 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.779230 13846 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:24.779510 13989 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader election lost for term 23. Reason: Vote denied by peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981) with higher term. Message: Invalid argument: T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c for earlier term 23. Current term is 24.
I20260709 12:27:24.702236 13982 raft_consensus.cc:515] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.784929 13982 leader_election.cc:290] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:24.783967  6114 rpcz_store.cc:276] 0709 12:27:23.598514 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:23.598648 (+   134us) service_pool.cc:224] Handling call
0709 12:27:23.598940 (+   292us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:23.601010 (+  2070us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:27:23.733826 (+132816us) spinlock_profiling.cc:243] Waited 25 ms on lock 0x7b1800280120. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f481df49e07 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df64455 00007f4824a4c3c7 00007f482105e9a7 00007f482106e0bf 00007f482106e038
0709 12:27:23.778638 (+ 44812us) log.cc:844] Serialized 14 byte log entry
0709 12:27:23.924971 (+146333us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:23.996476 (+ 71505us) log.cc:844] Serialized 52 byte log entry
0709 12:27:24.109079 (+112603us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:24.109141 (+    62us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:24.109228 (+    87us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:24.775189 (+665961us) spinlock_profiling.cc:243] Waited 22.3 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:27:24.777340 (+  2151us) raft_consensus.cc:1685] finished
0709 12:27:24.777363 (+    23us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:24.777489 (+   126us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":2098,"prepare.queue_time_us":172903,"prepare.run_cpu_time_us":37,"prepare.run_wall_time_us":38,"raft.queue_time_us":4867,"raft.run_cpu_time_us":196,"raft.run_wall_time_us":16179,"spinlock_wait_cycles":108783232,"thread_start_us":123521,"threads_started":2,"wal-append.queue_time_us":220349}
I20260709 12:27:24.786317  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.784089 13846 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.789458 13846 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:24.794093  6035 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:24.794395  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:24.795235  6035 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:24.795336  6109 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 23
I20260709 12:27:24.777202 13950 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:24.794122  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:24.796097  6044 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Advancing to term 23
W20260709 12:27:24.798930  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 47694.1us
I20260709 12:27:24.801137  6643 raft_consensus.cc:1240] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 19. Current term is 20. Ops: [19.16-19.16]
I20260709 12:27:24.802440  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:24.803485  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:24.804220  6645 raft_consensus.cc:2368] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 22. Current term is 23.
I20260709 12:27:24.805791  6044 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 23.
I20260709 12:27:24.799727  5934 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:24.808298  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:24.811189  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:24.812353  6609 leader_election.cc:400] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19.
I20260709 12:27:24.812608  6609 leader_election.cc:403] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:24.806351  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 15 index: 9 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:24.816872  6609 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:24.820531  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:24.760062 13992 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:24.822542  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:24.822921  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:24.823117  5964 raft_consensus.cc:3060] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 18
I20260709 12:27:24.829102 13629 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:24.829506  5961 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:27:24.829670 13629 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.818986 13841 consensus_queue.cc:1059] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.15, Next index: 16, Last known committed idx: 14, Time since last communication: 0.011s
I20260709 12:27:24.822139 13929 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 18. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19.
I20260709 12:27:24.831844 13629 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.837677  6109 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 23.
I20260709 12:27:24.817385 13846 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:24.843437  6084 leader_election.cc:400] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 22. Current term is 23.
I20260709 12:27:24.843770  6084 leader_election.cc:403] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:24.840520 13939 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:27:24.846987  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.847189  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 23 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.847635  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:24.848199  5968 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:27:24.848387  6117 raft_consensus.cc:2376] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 23. Re-sending same reply.
I20260709 12:27:24.813177 13926 consensus_queue.cc:1059] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 22.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.028s
I20260709 12:27:24.842896 13783 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:24.850447 13843 raft_consensus.cc:3055] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:27:24.851991 13926 consensus_queue.cc:1243] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Peer f1bb8e63c2b448cdafd51f05d277c741 log is divergent from this leader: its last log entry 24.18 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 16
I20260709 12:27:24.843837 13846 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:24.856076  6109 raft_consensus.cc:1275] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 18 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:27:24.853916 13855 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election lost for term 22. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 22. Current term is 23.
I20260709 12:27:24.854074 13783 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.853304  6084 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:24.866490  6009 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:24.852604 13843 raft_consensus.cc:740] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:24.867184  6041 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 9. Preceding OpId from leader: term: 17 index: 10. (index mismatch)
I20260709 12:27:24.869032 13783 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.854017 13939 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 23 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:24.870246 13939 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 21.16, Last appended by leader: 16, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.871395 13941 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.873569 13806 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:24.880633  6040 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:24.882911  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:24.883600  6116 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:24.883903  6117 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.884850  6115 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:24.863775 13846 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:24.885844  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.886831  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 19 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.887727  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 22 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:24.888285  6114 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:24.889492  6035 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:24.890740  5964 raft_consensus.cc:2468] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:24.894362  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:24.902261  6116 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 24.
I20260709 12:27:24.912096  6040 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 23 index: 18. Preceding OpId from leader: term: 24 index: 18. (term mismatch)
I20260709 12:27:24.912539  6040 pending_rounds.cc:85] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting all ops after (but not including) 17
I20260709 12:27:24.912766  6040 pending_rounds.cc:107] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: Aborting uncommitted NO_OP operation due to leader change: 23.18
I20260709 12:27:24.913000  6040 raft_consensus.cc:2889] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:24.907316  6009 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:24.914753  6009 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:24.919104  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.918018  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:24.923184  6009 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:24.918066  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:24.930696  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:24.931411  6044 raft_consensus.cc:2368] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 22. Current term is 23.
I20260709 12:27:24.931327  6038 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:27:24.930935  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:24.907101 13908 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:24.937386  6009 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:24.917193 13989 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:24.940850  5934 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:24.924523 13895 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:24.928467 13841 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:24.949414  6082 leader_election.cc:400] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 22. Current term is 23.
I20260709 12:27:24.949599  5934 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:24.940091 13989 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.942896 13959 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election won for term 17
I20260709 12:27:24.946292 13974 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:27:24.969321 13959 raft_consensus.cc:493] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:24.969604 13974 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:24.969972 13959 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:24.962139 13544 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.008s
I20260709 12:27:24.952306 13810 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.020s
I20260709 12:27:24.978595 13959 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.980636 13959 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.983127  6644 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 13. Preceding OpId from leader: term: 20 index: 14. (index mismatch)
I20260709 12:27:24.984772  6646 raft_consensus.cc:1240] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Rejecting Update request from peer 0557a7246c8945b99e5215c99d4ddf9c for earlier term 23. Current term is 24. Ops: [23.18-23.18]
I20260709 12:27:24.943661 13828 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.042s
I20260709 12:27:24.988108 13688 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:27:24.993225 13989 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:24.995934 13933 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:24.996198  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:24.952929 14004 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:24.942320 13935 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 10, Last known committed idx: 9, Time since last communication: 0.058s
I20260709 12:27:25.001103  6609 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:25.005858 13846 raft_consensus.cc:515] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:25.006279 13949 raft_consensus.cc:2804] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:24.939268 13843 consensus_queue.cc:260] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:25.010757 13949 raft_consensus.cc:697] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:25.011924 13846 leader_election.cc:290] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:25.011729 13949 consensus_queue.cc:237] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 16.14, Last appended by leader: 14, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:24.967583 13662 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:25.006013  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:25.014782  6040 raft_consensus.cc:2468] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:27:25.015571  6611 leader_election.cc:400] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Vote denied by peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787) with higher term. Message: Invalid argument: T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 for earlier term 18. Current term is 19.
I20260709 12:27:25.015902  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d0a77cc9656a4b88bc262752ad91e486" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:25.017603  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 19 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:25.022845  6114 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 24.
I20260709 12:27:25.026747  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:25.027539  6112 raft_consensus.cc:2393] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 16: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:25.027019 13974 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 22.12, Last appended by leader: 12, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:25.031119  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:27:25.032824  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 87450.1us
I20260709 12:27:25.035084  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:25.036001  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:25.036512  6644 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 17.
I20260709 12:27:25.037725  6040 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:25.040521  5934 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:25.041806  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:25.042404  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:25.044706  6647 raft_consensus.cc:2368] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17.
I20260709 12:27:25.047010  6643 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 22 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:27:25.043180  5968 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 14 index: 9. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:27:25.051381  5934 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:25.050920 14004 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:25.035609 13846 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:25.056197 13989 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:25.056265 13846 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:25.062621  5934 leader_election.cc:304] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:25.064190  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f
I20260709 12:27:25.065088  6040 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:25.065730  5934 leader_election.cc:400] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17.
I20260709 12:27:25.066112  5934 leader_election.cc:403] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 election: Cancelling election due to peer responding with higher term
I20260709 12:27:25.033577  6608 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:25.069998  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:25.075802  6009 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:25.051735 13982 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election lost for term 20. Reason: could not achieve majority
W20260709 12:27:25.078977  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 45479.5us
I20260709 12:27:25.083889  5968 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:25.051329 13943 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:27:25.072332 13933 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:25.068356 13996 raft_consensus.cc:2749] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:25.070885 14004 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:25.080229 13989 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:25.102799 13943 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:25.077239 13934 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 8, Time since last communication: 0.027s
I20260709 12:27:25.103816 13943 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.14, Last appended by leader: 14, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:25.077446 13688 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.028s
I20260709 12:27:25.106870 13933 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:25.107438 13933 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:25.077535 13828 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:25.073763 13941 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:25.100116 13988 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:25.079380 13960 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:25.118255 13960 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting leader election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:25.125368 13960 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:25.093977 13849 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:25.089003 13937 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.035s
W20260709 12:27:25.150638  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 63167.3us
I20260709 12:27:25.156570  5959 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:25.152504 14015 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.214s	user 0.001s	sys 0.000s
I20260709 12:27:25.142630 13908 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:25.165508  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 67834.5us
I20260709 12:27:25.144164 13849 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:25.195981 13843 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:25.201085  6084 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:25.202494 13960 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:25.209496  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
W20260709 12:27:25.210819  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 164218us
I20260709 12:27:25.211918 13960 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:25.212638 13960 consensus_queue.cc:1048] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:25.222026 13530 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:25.227294 13849 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:25.228530 13805 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.001s
W20260709 12:27:25.229051 14026 log.cc:927] Time spent T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.057s	user 0.000s	sys 0.000s
I20260709 12:27:25.171648 13908 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:25.232344 13933 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:25.232821  6647 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
W20260709 12:27:25.174634 13957 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 24 current term: 24 is higher.
I20260709 12:27:25.236454 13950 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:25.193585 13895 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:25.239620 13941 raft_consensus.cc:2749] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election lost for term 16. Reason: Vote denied by peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477) with higher term. Message: Invalid argument: T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 16. Current term is 17.
I20260709 12:27:25.240427 13933 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:25.241428  6647 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:25.243152 13711 consensus_queue.cc:1059] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: INVALID_TERM, Last received: 17.12, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:25.250795  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ad617c44395493f82e992b73a4295ad" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 17 candidate_status { last_received { term: 15 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:25.251111 13711 raft_consensus.cc:3055] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:25.251497 13711 raft_consensus.cc:740] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:25.252249 13711 consensus_queue.cc:260] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:25.253399 13711 raft_consensus.cc:3060] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:25.244623 13846 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:25.247705  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:25.232705 13908 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:25.249161  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:25.249408  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:25.249993  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:25.247705  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:25.259702  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 50836.5us
I20260709 12:27:25.264978  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:25.268306  6110 raft_consensus.cc:3060] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:25.270556  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:25.271440  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:25.273322  6039 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:27:25.274549  6042 raft_consensus.cc:3060] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:25.275166  6118 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 22.
I20260709 12:27:25.277032  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:25.281105  5964 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:27:25.290691  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:25.294267  6650 raft_consensus.cc:2393] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 in current term 18: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:25.294953  5965 raft_consensus.cc:1240] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 17. Current term is 18. Ops: []
I20260709 12:27:25.295567  6043 raft_consensus.cc:2368] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23.
I20260709 12:27:25.307874  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:25.308308  5959 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
W20260709 12:27:25.319300  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 50492.4us
I20260709 12:27:25.323357  6042 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 24 index: 12. Preceding OpId from leader: term: 25 index: 13. (index mismatch)
I20260709 12:27:25.329382  6611 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:25.337023  5934 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:25.338424 13806 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.006s
I20260709 12:27:25.345728 13950 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:25.342428  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:25.343575  5934 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:25.342734  6608 leader_election.cc:304] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:25.331770 13840 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.038s
I20260709 12:27:25.383955  5932 leader_election.cc:400] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader election vote request: Denying vote to candidate f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23.
I20260709 12:27:25.372694 13810 raft_consensus.cc:2804] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:25.372901 13849 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:25.372975 13950 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:25.400655  6110 raft_consensus.cc:2468] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 17.
I20260709 12:27:25.387168 13979 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election lost for term 18. Reason: could not achieve majority
I20260709 12:27:25.396020 14025 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:25.419190  5965 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:27:25.437314  6112 raft_consensus.cc:2468] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 18.
I20260709 12:27:25.442266 13934 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:25.444696  6649 raft_consensus.cc:2955] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:25.451290 13950 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:25.420861 13810 raft_consensus.cc:697] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:25.441460 13531 raft_consensus.cc:2955] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:25.459177 13810 consensus_queue.cc:237] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 15.13, Last appended by leader: 13, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:25.732859  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 151309us
I20260709 12:27:25.750556  6109 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 17 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:25.758028  6110 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:27:25.758065  6611 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:25.759667  6112 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:27:25.760154  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "22f53da618b548f89206b5390bbf5aec" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:25.740396 13895 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:25.764827  6113 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:25.765174 13895 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:25.768114 13895 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:25.774227  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:25.777832  6113 raft_consensus.cc:2468] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 23.
I20260709 12:27:25.778416  6038 raft_consensus.cc:1275] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 20 index: 13. Preceding OpId from leader: term: 21 index: 14. (index mismatch)
I20260709 12:27:25.780740  6611 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:25.787233  6038 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 19 index: 11. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 12:27:25.824029 14045 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.085s	user 0.000s	sys 0.000s
W20260709 12:27:25.826107 14043 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
I20260709 12:27:25.782882 14019 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:25.846072  5961 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
I20260709 12:27:25.828806 13859 raft_consensus.cc:2804] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:25.830191 13647 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.027s
I20260709 12:27:25.881624 13934 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
I20260709 12:27:25.882508 13930 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:25.884769 13930 consensus_queue.cc:1048] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:25.887044  6009 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:25.887974  6113 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:25.888434  6009 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:25.890604 13745 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:25.894531 13895 raft_consensus.cc:2804] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:27:25.895059 13895 raft_consensus.cc:697] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 23 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:25.895901 13895 consensus_queue.cc:237] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 21.14, Last appended by leader: 14, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:25.895912 14036 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.157s	user 0.001s	sys 0.000s
I20260709 12:27:25.893477 13843 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:25.948732  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 24 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:25.869875 13859 raft_consensus.cc:697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
W20260709 12:27:26.007434  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 57809.4us
W20260709 12:27:26.007226  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 56772.9us
W20260709 12:27:26.020186  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 49266.9us
I20260709 12:27:26.022181  6009 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:26.001385 13926 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.028s
I20260709 12:27:26.044029  6115 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 22 index: 12. Preceding OpId from leader: term: 24 index: 13. (index mismatch)
W20260709 12:27:26.047112  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 196980us
I20260709 12:27:26.047963 13846 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.030s
I20260709 12:27:26.089018  6041 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 23 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23. Ops: []
I20260709 12:27:26.118732  6041 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 22 index: 14. Preceding OpId from leader: term: 24 index: 15. (index mismatch)
I20260709 12:27:26.080930 14055 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.014s
I20260709 12:27:26.074700 13859 consensus_queue.cc:237] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 17.12, Last appended by leader: 12, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:26.134497 14004 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
I20260709 12:27:26.111393 13928 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:26.126204 13950 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
W20260709 12:27:26.158205 14050 log.cc:927] Time spent T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: Append to log took a long time: real 0.147s	user 0.000s	sys 0.004s
I20260709 12:27:26.148259 14052 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.004s
W20260709 12:27:26.146310 14051 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.089s	user 0.000s	sys 0.000s
W20260709 12:27:26.139117 14047 log.cc:927] Time spent T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.266s	user 0.000s	sys 0.001s
W20260709 12:27:26.174045  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 97632.3us
W20260709 12:27:26.140367  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 64560.2us
W20260709 12:27:26.123649  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 45944.6us
I20260709 12:27:26.185704 13662 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.186318 13950 consensus_queue.cc:1243] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Peer 0557a7246c8945b99e5215c99d4ddf9c log is divergent from this leader: its last log entry 23.15 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 14
W20260709 12:27:26.287775  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 149246us
W20260709 12:27:26.186652 14048 log.cc:927] Time spent T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.172s	user 0.000s	sys 0.001s
W20260709 12:27:26.298271  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 101686us
I20260709 12:27:26.302990  5961 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 15 index: 13. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:27:26.290745  5959 raft_consensus.cc:2955] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:27:26.310256  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 113218us
W20260709 12:27:26.348671  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 151807us
I20260709 12:27:26.357240  6035 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 21 index: 16. Preceding OpId from leader: term: 23 index: 17. (index mismatch)
I20260709 12:27:26.373386  6044 raft_consensus.cc:1275] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 16 index: 14. Preceding OpId from leader: term: 18 index: 15. (index mismatch)
W20260709 12:27:26.390192  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 72760.1us
I20260709 12:27:26.430737  6118 raft_consensus.cc:1275] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 14 index: 12. Preceding OpId from leader: term: 17 index: 14. (index mismatch)
I20260709 12:27:26.316532 13992 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:26.467851  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 161557us
W20260709 12:27:26.522858  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 131845us
I20260709 12:27:26.388831 14024 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:26.389204 13991 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:26.297737 13662 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:26.500830 13992 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:26.665195 14043 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.051s	user 0.000s	sys 0.000s
W20260709 12:27:26.677554  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 201873us
I20260709 12:27:26.666015 13539 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:26.678632  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 208736us
I20260709 12:27:26.603227 14024 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:26.608237 13991 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:26.803544  6038 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.621s	user 0.004s	sys 0.005s
W20260709 12:27:26.805734  6038 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.659s	user 0.004s	sys 0.005s
I20260709 12:27:26.775708 14059 raft_consensus.cc:493] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 31 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
W20260709 12:27:26.835515  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 128178us
I20260709 12:27:26.691743 13539 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:26.812896 14053 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:27:26.867403 14068 log.cc:927] Time spent T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.256s	user 0.001s	sys 0.000s
I20260709 12:27:26.870550 13991 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:26.843098 14059 raft_consensus.cc:515] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 31 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:26.876706 14059 leader_election.cc:290] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 32 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:26.878162 13846 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:26.878748 13846 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:26.879637 14076 log.cc:927] Time spent T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.187s	user 0.000s	sys 0.000s
I20260709 12:27:26.881310 13662 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:26.882490 14083 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.076s	user 0.000s	sys 0.000s
I20260709 12:27:26.890290 14024 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:26.894927 14082 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.110s	user 0.000s	sys 0.001s
I20260709 12:27:26.895749  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:26.861045 14053 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:26.898393 14053 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:26.928188 13996 raft_consensus.cc:3055] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Stepping down as leader of term 22
I20260709 12:27:26.928717 13996 raft_consensus.cc:740] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Becoming Follower/Learner. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:26.929533 13996 consensus_queue.cc:260] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 22.15, Last appended by leader: 15, Current term: 22, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:26.936578  6115 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23. Ops: []
I20260709 12:27:26.938782 13937 consensus_queue.cc:1059] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: INVALID_TERM, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:26.940351 13849 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:26.941004 13539 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:26.940930 13849 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:26.943872 13849 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:26.948803 13992 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:26.949843 13943 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:26.950165  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:26.953428 14041 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 1.211s	user 0.000s	sys 0.008s
I20260709 12:27:26.954600 14091 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:26.955451  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:26.956218 14091 consensus_queue.cc:1048] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:26.958336  6036 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:36260 (request call id 3286) took 1692 ms. Trace:
I20260709 12:27:26.959553  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:26.962654 13926 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:26.963093  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:26.963184 13926 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:26.963737  6649 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:26.964751 13988 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:26.965230 13988 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:26.967221 13988 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:26.969321 13943 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:26.971570 13943 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:26.972013  6043 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:26.958891  6036 rpcz_store.cc:276] 0709 12:27:25.265577 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.270032 (+  4455us) service_pool.cc:224] Handling call
0709 12:27:25.270555 (+   523us) raft_consensus.cc:1471] Updating replica for 2 ops
0709 12:27:25.271587 (+  1032us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:25.271614 (+    27us) raft_consensus.cc:1539] Triggering prepare for 2 ops
0709 12:27:25.310212 (+ 38598us) log.cc:844] Serialized 582 byte log entry
0709 12:27:25.496050 (+185838us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:27:25.496085 (+    35us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:25.496154 (+    69us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:26.952756 (+1456602us) spinlock_profiling.cc:243] Waited 29.9 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
0709 12:27:26.958033 (+  5277us) raft_consensus.cc:1685] finished
0709 12:27:26.958054 (+    21us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:26.958277 (+   223us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":1605,"raft.queue_time_us":30401,"raft.run_cpu_time_us":143,"raft.run_wall_time_us":16491,"spinlock_wait_cycles":68727552,"thread_start_us":149119,"threads_started":1,"wal-append.queue_time_us":231090}
I20260709 12:27:26.984944 13926 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:26.988947 13846 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:26.992038  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:26.981462  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
W20260709 12:27:26.996435  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 143784us
I20260709 12:27:27.000825  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.007387  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.012990  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.052735  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78c13bc0b46b40a3886a209b87dd6f98" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:27.054342  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.056560  5934 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:26.993217 13647 raft_consensus.cc:2749] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:27.050559 13908 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:27.054538 14063 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.030s
I20260709 12:27:27.096143  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.097038  6649 raft_consensus.cc:2393] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 20: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
I20260709 12:27:27.098968  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.101517  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.083359 13908 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:27.124667 13908 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:27.138450  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:27.141500 14019 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:27.143443  5966 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:27:27.144912 13996 raft_consensus.cc:3060] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:27.154970  6040 raft_consensus.cc:1240] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 23 LEADER]: Rejecting Update request from peer f1bb8e63c2b448cdafd51f05d277c741 for earlier term 22. Current term is 23. Ops: [22.15-22.15]
I20260709 12:27:27.163528  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "efdaf6941ab7409d90619a5e9f5c10c3" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:27.181663 13846 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:27.182335 13846 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.185253 13846 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:25.949138  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:27.229413  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:27.199584 13783 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.028s
W20260709 12:27:27.256378  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 67469.2us
I20260709 12:27:27.257371  5932 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:27.259907  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.272639  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:27.278550  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1d97a0d1272049469a8fe2111554686a" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 32 candidate_status { last_received { term: 31 index: 21 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:27.262745 13549 raft_consensus.cc:493] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:27.286743  6006 leader_election.cc:304] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 32 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:27.290143  5960 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 22 index: 15. Preceding OpId from leader: term: 23 index: 15. (term mismatch)
W20260709 12:27:27.290642  5959 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.886s	user 0.002s	sys 0.009s
W20260709 12:27:27.290964  5959 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.886s	user 0.002s	sys 0.009s
I20260709 12:27:27.290655  5960 pending_rounds.cc:85] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Aborting all ops after (but not including) 14
W20260709 12:27:27.291479  5962 thread.cc:641] prepare [worker] (thread pool) Time spent creating pthread: real 0.980s	user 0.006s	sys 0.005s
W20260709 12:27:27.291834  5962 thread.cc:608] prepare [worker] (thread pool) Time spent starting thread: real 0.995s	user 0.006s	sys 0.005s
I20260709 12:27:27.292156  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:27.292397  6114 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 1.119s	user 0.009s	sys 0.002s
W20260709 12:27:27.292845  6114 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 1.120s	user 0.009s	sys 0.002s
I20260709 12:27:27.291558  5960 pending_rounds.cc:107] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Aborting uncommitted NO_OP operation due to leader change: 22.15
I20260709 12:27:27.294181  5960 raft_consensus.cc:2889] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
W20260709 12:27:27.290369  6081 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.708s	user 0.009s	sys 0.001s
W20260709 12:27:27.294924  6081 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.712s	user 0.010s	sys 0.001s
I20260709 12:27:27.269016 14092 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:27:27.290076  6082 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.859s	user 0.000s	sys 0.011s
W20260709 12:27:27.295814  6082 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.865s	user 0.000s	sys 0.011s
I20260709 12:27:27.263589 14101 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:27.299691  6044 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:27.295213  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 712768us
I20260709 12:27:27.307703  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:27.309070  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:27.287055 14004 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:27.391587  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 99516.2us
W20260709 12:27:27.386533  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 84180.7us
I20260709 12:27:27.300673 14099 raft_consensus.cc:2749] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 31 FOLLOWER]: Leader pre-election lost for term 32. Reason: could not achieve majority
I20260709 12:27:27.411345 13943 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:27.418702 13943 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.420819 13943 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.423223 13950 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:27.423780 13950 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.425817 13950 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.427505  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:27.428117  5961 raft_consensus.cc:2468] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:27:27.428339  6114 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:35586 (request call id 3801) took 1257 ms. Trace:
I20260709 12:27:27.428797  6114 rpcz_store.cc:276] 0709 12:27:26.171162 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.171602 (+   440us) service_pool.cc:224] Handling call
0709 12:27:26.171943 (+   341us) raft_consensus.cc:1471] Updating replica for 1 ops
0709 12:27:26.172293 (+   350us) raft_consensus.cc:1534] Early marking committed up to index 0
0709 12:27:26.172320 (+    27us) raft_consensus.cc:1539] Triggering prepare for 1 ops
0709 12:27:26.172737 (+   417us) log.cc:844] Serialized 26 byte log entry
0709 12:27:27.293187 (+1120450us) raft_consensus.cc:1645] Marking committed up to 12
0709 12:27:27.293229 (+    42us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:27.293295 (+    66us) raft_consensus.cc:1668] Waiting on the replicates to finish logging
0709 12:27:27.428147 (+134852us) raft_consensus.cc:1685] finished
0709 12:27:27.428166 (+    19us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:27.428284 (+   118us) inbound_call.cc:177] Queueing success response
Metrics: {"raft.queue_time_us":859,"raft.run_cpu_time_us":148,"raft.run_wall_time_us":9758,"thread_start_us":1120165,"threads_started":1,"wal-append.queue_time_us":1114608}
I20260709 12:27:27.426286 13950 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:27.431161 13950 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.434149 13950 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.398943 14100 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Leader pre-election lost for term 15. Reason: could not achieve majority
I20260709 12:27:27.438169 14088 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:27.438797 14088 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.440840 14088 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:27.441763  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:27.307235 14101 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.443746  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:27.444506 14101 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.408026 13996 raft_consensus.cc:493] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:27.445847 13996 raft_consensus.cc:515] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:27.446784  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:27.447402  6114 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 23.
I20260709 12:27:27.447988 13996 leader_election.cc:290] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:27.417369 13831 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:27.449062 14105 raft_consensus.cc:493] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:27.449571 14105 raft_consensus.cc:515] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.450675 13980 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:27.451215 13980 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.451864 14064 raft_consensus.cc:493] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:27.452343  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 21 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:27.452356 14064 raft_consensus.cc:515] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.452971  6110 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 23.
I20260709 12:27:27.453207 13980 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.453837  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:27.454641 14064 leader_election.cc:290] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.457397  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:27.458796  5933 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.910s	user 0.005s	sys 0.009s
W20260709 12:27:27.460160 14083 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.061s	user 0.000s	sys 0.001s
I20260709 12:27:27.303727 13849 consensus_queue.cc:1048] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 12, Time since last communication: 0.106s
W20260709 12:27:27.412907 14089 log.cc:927] Time spent T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.105s	user 0.000s	sys 0.000s
I20260709 12:27:27.298606 13549 raft_consensus.cc:515] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.464720  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:27.452880 13531 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:27.449098 13831 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.465376  5960 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:27.466167  5959 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3470) took 1176 ms. Trace:
I20260709 12:27:27.467577  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:27.485226  5959 rpcz_store.cc:276] 0709 12:27:26.289894 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.290049 (+   155us) service_pool.cc:224] Handling call
0709 12:27:26.290394 (+   345us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.290618 (+   224us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:27:26.404662 (+114044us) log.cc:844] Serialized 14 byte log entry
0709 12:27:27.429305 (+1024643us) log.cc:844] Serialized 14 byte log entry
0709 12:27:27.465858 (+ 36553us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:27.465906 (+    48us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:27.465945 (+    39us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:27.466003 (+    58us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:27.466114 (+   111us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":173951,"prepare.queue_time_us":234,"prepare.run_cpu_time_us":32,"prepare.run_wall_time_us":32,"raft.queue_time_us":144232,"raft.run_cpu_time_us":195,"raft.run_wall_time_us":2384,"thread_start_us":886370,"threads_started":1,"wal-append.queue_time_us":1006304}
W20260709 12:27:27.488219  6644 thread.cc:641] wal-append [worker] (thread pool) Time spent creating pthread: real 0.569s	user 0.016s	sys 0.015s
I20260709 12:27:27.471804  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 19 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:27.472424  5933 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 1.092s	user 0.005s	sys 0.010s
I20260709 12:27:27.472546  6113 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:27:27.473412  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:27.452476 13991 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:27.466569 14095 raft_consensus.cc:493] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:27.506742 14095 raft_consensus.cc:515] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.508948 14095 leader_election.cc:290] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.510315 13991 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.512564 13991 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.518790  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1138b447c084c17ab4b465255e54118" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:27.519587 14105 leader_election.cc:290] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.522687 14058 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:27.523494 13908 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:27.524391 14109 log.cc:927] Time spent T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.105s	user 0.000s	sys 0.001s
I20260709 12:27:27.524770  6044 raft_consensus.cc:2368] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 20. Current term is 21.
I20260709 12:27:27.525739 13908 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.526737 13846 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:27.527145 13846 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:27.527532 13846 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Advancing to term 24
W20260709 12:27:27.490558  6644 thread.cc:608] wal-append [worker] (thread pool) Time spent starting thread: real 0.572s	user 0.017s	sys 0.015s
I20260709 12:27:27.467495  6114 raft_consensus.cc:1275] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 21 index: 14. Preceding OpId from leader: term: 23 index: 15. (index mismatch)
I20260709 12:27:27.505535 13549 leader_election.cc:290] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.487176 13531 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.552057 13531 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:27.545535 14102 log.cc:927] Time spent T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.056s	user 0.000s	sys 0.000s
I20260709 12:27:27.558375 13831 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:27.558475 14058 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:27.559923 14058 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.559419  5932 leader_election.cc:304] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:27.565750 13974 raft_consensus.cc:2749] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:27:27.570417 14106 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.154s	user 0.000s	sys 0.000s
W20260709 12:27:27.571429  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 95034.1us
W20260709 12:27:27.577720  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 83993.9us
I20260709 12:27:27.562273 14058 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.581033  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:27.582369  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:27.583026  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:27.587380  6082 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 4 responses out of 4 voters: 2 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:27.589059  6082 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
W20260709 12:27:27.592836 14110 log.cc:927] Time spent T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.174s	user 0.002s	sys 0.000s
I20260709 12:27:27.601432 13980 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:27.602658 13992 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:27.604151  6082 leader_election.cc:400] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 20. Current term is 21.
I20260709 12:27:27.604521  6082 leader_election.cc:403] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:27:27.605072 13549 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 21
I20260709 12:27:27.602560  5861 catalog_manager.cc:5697] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 19 to 22, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 22 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:27.611974  5861 catalog_manager.cc:5697] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 18 to 20, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 20 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:27.613014 13549 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election lost for term 20. Reason: Vote denied by peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473) with higher term. Message: Invalid argument: T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 20. Current term is 21.
I20260709 12:27:27.625844  5863 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 331) took 7362 ms. Trace:
I20260709 12:27:27.626320  5863 rpcz_store.cc:276] 0709 12:27:20.263837 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.279393 (+ 15556us) service_pool.cc:224] Handling call
0709 12:27:27.625753 (+7346360us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:23.135500 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:23.171406 (+ 35906us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:23.171446 (+    40us) write_op.cc:435] Acquired schema lock
0709 12:27:23.171474 (+    28us) tablet.cc:662] Decoding operations
0709 12:27:23.173199 (+  1725us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:23.173261 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:23.173290 (+    29us) tablet.cc:685] Acquiring locks for 27 operations
0709 12:27:23.264465 (+ 91175us) tablet.cc:701] Row locks acquired
0709 12:27:23.264486 (+    21us) write_op.cc:260] PREPARE: finished
0709 12:27:23.264643 (+   157us) write_op.cc:270] Start()
0709 12:27:23.264761 (+   118us) write_op.cc:276] Timestamp: P: 1783600043264591 usec, L: 0
0709 12:27:23.264782 (+    21us) op_driver.cc:348] REPLICATION: starting
0709 12:27:23.265665 (+   883us) log.cc:844] Serialized 10559 byte log entry
0709 12:27:23.636228 (+370563us) op_driver.cc:464] REPLICATION: finished
0709 12:27:24.174201 (+537973us) spinlock_profiling.cc:243] Waited 23.3 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f481df4a0ac 00007f4826da49a9 00007f481df6669b 00007f481df6493f 00007f481df66c02 00007f4824a8aef0
0709 12:27:24.414785 (+240584us) write_op.cc:301] APPLY: starting
0709 12:27:24.419566 (+  4781us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:24.946039 (+526473us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:24.947334 (+  1295us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:25.466364 (+519030us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:25.525127 (+ 58763us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=54,key_file_lookups=54,delta_file_lookups=54,mrs_lookups=0
0709 12:27:25.528452 (+  3325us) write_op.cc:312] APPLY: finished
0709 12:27:25.610707 (+ 82255us) log.cc:844] Serialized 236 byte log entry
0709 12:27:25.856069 (+245362us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:25.918383 (+ 62314us) write_op.cc:454] Released schema lock
0709 12:27:25.939393 (+ 21010us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:25.967593 (+ 28200us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:25.967625 (+    32us) write_op.cc:454] Released schema lock
0709 12:27:26.072887 (+105262us) spinlock_profiling.cc:243] Waited 1.35 ms on lock 0x7b4400022b4c. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f481ddefdb1 00007f481de8dc85 00007f481de8e6a2 00007f4820c001db 00007f4820bfbaaf 00007f4820bef86e 00007f4820beebb6 00007f4820bee7d8 00007f4820bf8221 00007f4820bf81d9 00007f4820bf8169
Metrics: {"mutex_wait_us":2675,"reported_tablets":43,"child_traces":[["op",{"apply.queue_time_us":750426,"apply.run_cpu_time_us":55639,"apply.run_wall_time_us":1553150,"cfile_cache_hit":110,"cfile_cache_hit_bytes":117041,"num_ops":27,"prepare.queue_time_us":70236,"prepare.run_cpu_time_us":26634,"prepare.run_wall_time_us":241909,"raft.queue_time_us":105262,"raft.run_cpu_time_us":28759,"raft.run_wall_time_us":710694,"replication_time_us":371297,"spinlock_wait_cycles":56752640,"thread_start_us":1032977,"threads_started":5,"wal-append.queue_time_us":362728,"wal-append.run_cpu_time_us":22224,"wal-append.run_wall_time_us":2492142}]]}
I20260709 12:27:27.636617  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:27.642622 13846 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.646543  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:27.648622  6113 raft_consensus.cc:1275] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 17 index: 12. Preceding OpId from leader: term: 18 index: 13. (index mismatch)
I20260709 12:27:27.613693  5861 catalog_manager.cc:5697] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:27.653846  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:27.659085  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:27.663069  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:27.666563  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:27.667129  5962 rpcz_store.cc:275] Call kudu.consensus.ConsensusService.UpdateConsensus from 127.0.0.1:34550 (request call id 3475) took 1371 ms. Trace:
I20260709 12:27:27.680596  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:27.660975  5861 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 17 to 19. New cstate: current_term: 19 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:27.682749  5861 catalog_manager.cc:5697] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 15 to 16, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 16 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:27.686244  6009 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:27.672200  6036 raft_consensus.cc:2955] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Committing config change with OpId 18.13: config changed from index 12 to 13, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:27.689265  5861 catalog_manager.cc:5697] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 15 to 18. New cstate: current_term: 18 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:27.693321  5861 catalog_manager.cc:5697] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 18 to 19, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 19 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:27.693893  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:27.695218  5861 catalog_manager.cc:5697] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 19 to 22. New cstate: current_term: 22 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:27.700955  5861 catalog_manager.cc:5697] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 21 to 23. New cstate: current_term: 23 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:27.704734  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:27.705585  6645 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:27.708395  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.696623  6609 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:27.717118  6645 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:27:27.707175  5861 catalog_manager.cc:5697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 15 to 21, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 21 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:27.722076  5861 catalog_manager.cc:5697] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 19 to 22, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 22 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:27.735625 13928 raft_consensus.cc:493] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:27.736204 13928 raft_consensus.cc:515] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:27.731554 13926 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:27.739977 13831 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:27.743789 13846 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.748430  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:27.753134  5966 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:27.709635 13840 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:27.710070 14088 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:27.734690 13989 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:27:27.744699 14057 log.cc:927] Time spent T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:27:27.738233 13928 leader_election.cc:290] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:27.670384  5962 rpcz_store.cc:276] 0709 12:27:26.295446 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:26.295896 (+   450us) service_pool.cc:224] Handling call
0709 12:27:26.296162 (+   266us) raft_consensus.cc:1471] Updating replica for 0 ops
0709 12:27:26.296359 (+   197us) raft_consensus.cc:1534] Early marking committed up to index 14
0709 12:27:27.292159 (+995800us) log.cc:844] Serialized 14 byte log entry
0709 12:27:27.666765 (+374606us) raft_consensus.cc:1539] Triggering prepare for 0 ops
0709 12:27:27.666827 (+    62us) raft_consensus.cc:1645] Marking committed up to 14
0709 12:27:27.666881 (+    54us) raft_consensus.cc:1697] Filling consensus response to leader.
0709 12:27:27.666949 (+    68us) raft_consensus.cc:1691] UpdateReplicas() finished
0709 12:27:27.667069 (+   120us) inbound_call.cc:177] Queueing success response
Metrics: {"prepare.queue_time_us":528862,"prepare.run_cpu_time_us":33,"prepare.run_wall_time_us":34,"raft.queue_time_us":4461,"thread_start_us":1365280,"threads_started":2}
I20260709 12:27:27.781526  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:27.785400  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:27.809103  6113 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:27:27.778926 14064 raft_consensus.cc:493] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:27.810976  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.812556  6116 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:27:27.814174  6116 raft_consensus.cc:606] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:27.803503 14092 raft_consensus.cc:493] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:27.815423  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.815349 14092 raft_consensus.cc:515] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:27.817451 14092 leader_election.cc:290] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:27.810489 14100 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:27.803284 13950 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:27.818607 13950 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.821120  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:27.770911 14088 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.844146  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0468d70863214876bf59fb3ea9474307" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.846776  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "02dd5c8c15e34ecfbc46620193fb5762" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.848711  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.849951  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7d1c158430bb487aa1d4c5a69165aa32" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.851748  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4783d1a7790a4be2a959bd61e6f21947" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 19 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:27.819909 13846 raft_consensus.cc:493] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:27.851641 13549 raft_consensus.cc:493] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:27.861999  5965 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 23. Current term is 24. Ops: []
I20260709 12:27:27.865229  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "12ca0d61cb524660bae3b43f9f1c5389" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 19 candidate_status { last_received { term: 18 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:27.850039 14092 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:27.870108 14092 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:27.815114 14064 raft_consensus.cc:515] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.880756 14129 consensus_queue.cc:1059] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 17, Time since last communication: 0.002s
W20260709 12:27:27.886955  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 193120us
I20260709 12:27:27.828456 14100 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:27.873298 13846 raft_consensus.cc:515] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:27.874703 13549 raft_consensus.cc:515] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:27.914793 13549 leader_election.cc:290] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.915458 13950 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.916298 14088 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:27.917251 14100 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:27.891495 14105 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:27.934759  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:27.934438  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:27.899091  6009 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:27.912914 14064 leader_election.cc:290] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:27.924638 14058 consensus_queue.cc:1048] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:27.911377 13846 leader_election.cc:290] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:27.940263  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:27.943740  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 247184us
I20260709 12:27:27.943679 14099 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:27:28.045590  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 105017us
W20260709 12:27:28.046880  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 108760us
I20260709 12:27:28.047078  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
W20260709 12:27:28.051293  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 101556us
W20260709 12:27:28.051542  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 91866.5us
W20260709 12:27:28.051206  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 158839us
I20260709 12:27:28.055835  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "382d3eda9eaa4b9c96393a12d9f2be5c" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 23 index: 18 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:27.942118 14105 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.062270 14126 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:28.070225  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:28.047685 13846 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:28.063437 13989 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:28.056249 14099 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:28.064817  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:28.079427  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35f225b19c174d73b8b1d76af9a231dd" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:28.084961  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5a6d648272bf4bef9d5337acfc9d4a96" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 17 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:28.086023  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:28.090026  6041 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b46c3c3bcf5c4016bb6bab0051ff3094" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:28.092893  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:28.093726  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:28.080381 13928 raft_consensus.cc:493] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:28.103680  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:28.099290  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:28.109555  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e596fee38d14bcb913a2aaadffa2a72" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 17 candidate_status { last_received { term: 16 index: 13 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:28.115504  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:28.115573 14099 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.116891  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e3ef3cb064eb4a1597f89e040fce3c7e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 21 candidate_status { last_received { term: 20 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:28.091899 13926 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:28.119215 13926 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:28.124197  6084 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:28.125558 13530 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:28.126899  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:28.127781 14101 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:28.088997 14088 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:28.132771  6084 leader_election.cc:304] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:28.138164  6084 leader_election.cc:304] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:28.134598  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ec584257f9db451c965f6b092aa9069c" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:28.109107  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7b7660ead3b4a4da081b0199f44037f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:28.146842  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "117509103bb449868a97cf0ba4fdda89" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 10 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:28.151077  6084 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:28.090566 14115 consensus_queue.cc:1048] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.046s
I20260709 12:27:28.086086 13846 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.087334 13989 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.082352 14126 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.148590 14064 raft_consensus.cc:2749] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:28.154909 14101 raft_consensus.cc:2749] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:27:28.166996 14122 log.cc:927] Time spent T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: Append to log took a long time: real 0.068s	user 0.000s	sys 0.001s
I20260709 12:27:28.136161 13928 raft_consensus.cc:515] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:28.176337 14125 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.080s	user 0.001s	sys 0.000s
I20260709 12:27:28.179667 13928 leader_election.cc:290] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:28.180398  6609 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:28.181705 13939 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:28.183566 13989 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:28.186611 14092 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:28.187800 14105 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:28.194990 14123 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: Append to log took a long time: real 0.128s	user 0.000s	sys 0.000s
I20260709 12:27:28.181758 14126 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:28.207554 14019 raft_consensus.cc:3055] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:27:28.210498  6650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:27:28.215533  6650 raft_consensus.cc:606] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:28.221554 13846 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:28.222589 13926 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.225030 13926 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:28.214929 14019 raft_consensus.cc:740] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:28.226552 14019 consensus_queue.cc:260] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.228020 14019 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:28.286835  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:28.291496 13387 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:27:28.297919  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 146719us
I20260709 12:27:28.300295  6084 leader_election.cc:304] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:28.303802  6650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c357e710ee044329b93321405ae76071"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:27:28.305012  6650 raft_consensus.cc:606] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:28.304184 13991 raft_consensus.cc:2749] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:28.315836  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:28.320536  5934 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 24 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:28.329525 14098 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader election lost for term 24. Reason: could not achieve majority
I20260709 12:27:28.331590  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ba1e2d6430774a629131a0953161507b" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 23 candidate_status { last_received { term: 22 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:28.334007  5934 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:28.335848  5934 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:28.336807 13846 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:28.338845 14127 raft_consensus.cc:493] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:28.339802 14127 raft_consensus.cc:515] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:28.346496 14127 leader_election.cc:290] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:28.347219  6036 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:28.369977  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:28.387629 14092 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:28.393029 13928 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:27:28.402678  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 102679us
I20260709 12:27:28.403788  6084 leader_election.cc:304] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:28.414566  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:27:28.415428  6118 raft_consensus.cc:606] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:28.416750  6035 raft_consensus.cc:1240] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 23. Current term is 24. Ops: []
I20260709 12:27:28.426509  6650 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:27:28.427415  6650 raft_consensus.cc:606] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:28.432564 13387 raft_consensus.cc:2749] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:27:28.435284  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 99771.4us
I20260709 12:27:28.436525  5934 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:28.439320 14092 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:28.441435  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:27:28.451453  5962 raft_consensus.cc:1240] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 23. Current term is 24. Ops: []
I20260709 12:27:28.466908 13929 consensus_queue.cc:1059] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 23.17, Next index: 18, Last known committed idx: 16, Time since last communication: 0.003s
I20260709 12:27:28.478091 13810 raft_consensus.cc:993] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:27:28.481491 13810 raft_consensus.cc:1081] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:27:28.479108  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:28.485847 14088 raft_consensus.cc:3055] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 23 LEADER]: Stepping down as leader of term 23
I20260709 12:27:28.486320 14088 raft_consensus.cc:740] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 23 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:28.487828 14088 consensus_queue.cc:260] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 23, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.500555 13980 raft_consensus.cc:993] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:27:28.501219 13387 raft_consensus.cc:1081] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:27:28.506821  6084 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:28.507792 13387 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:28.508702  6084 leader_election.cc:304] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:28.501762  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:28.513789 13905 raft_consensus.cc:2749] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:28.514803  6009 leader_election.cc:304] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:28.513612  6042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36260
I20260709 12:27:28.516032 14128 raft_consensus.cc:2749] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:28.517230  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:28.519474  6042 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:28.519930  6042 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:28.519804  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bc02451d94184328a520860e40f6b77c" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:28.540299 14088 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:28.549793  6037 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:27:28.550488  6037 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:28.550838  6037 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:28.555967 14117 raft_consensus.cc:993] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:27:28.558713 14056 raft_consensus.cc:1081] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:27:28.572809  6038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:60122
I20260709 12:27:28.573401  6038 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:28.573756  6038 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:28.580227 13387 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:28.580999 13387 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:28.587956 13387 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:28.588195  6084 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:28.591008 13805 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:28.600936  6038 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.625864  6037 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.626413 14056 raft_consensus.cc:993] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:27:28.635573  6038 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:28.637712  6040 raft_consensus.cc:1240] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20. Ops: []
I20260709 12:27:28.639524  6037 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:28.639827  6042 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:28.644364 14056 raft_consensus.cc:1081] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:27:28.652210  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:28.657004  6042 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:28.656590 14056 consensus_queue.cc:1059] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: INVALID_TERM, Last received: 19.15, Next index: 16, Last known committed idx: 15, Time since last communication: 0.009s
I20260709 12:27:28.666910 13929 raft_consensus.cc:3055] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:27:28.667338 13929 raft_consensus.cc:740] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:28.668339 13929 consensus_queue.cc:260] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.670078  5934 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:28.676512 13647 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:28.686571  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:28.705266  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:28.707901  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:28.710045  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:28.712752  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:28.713940  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:28.714421 13929 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:28.714572  6646 raft_consensus.cc:3055] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:27:28.714985  6646 raft_consensus.cc:740] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:28.715792  6646 consensus_queue.cc:260] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.719841  6646 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:28.716065  5932 leader_election.cc:304] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:28.727941 14077 raft_consensus.cc:2749] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:28.736416  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:28.739075  5932 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:28.740604  5932 leader_election.cc:304] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:28.741390 14077 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:28.742082 14077 raft_consensus.cc:2749] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:28.748234  5932 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f1bb8e63c2b448cdafd51f05d277c741; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:28.753096  6646 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:28.764539  6645 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 24.
I20260709 12:27:28.780967  6649 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:28.791329  6650 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 15. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:27:28.797170 13647 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:28.804629  5961 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c357e710ee044329b93321405ae76071"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:37174
I20260709 12:27:28.813467  6009 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:28.815639  6009 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:28.816727 13928 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:27:28.817528 13928 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:28.818490 13928 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.820245 14128 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election won for term 20
W20260709 12:27:28.809365  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 61300.8us
I20260709 12:27:28.820786 14128 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:28.823778  5961 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:28.823580 14134 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.003s
I20260709 12:27:28.825368  5961 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:28.821703 14128 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.830309  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:28.842195 13840 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:28.848042  6042 raft_consensus.cc:1240] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 16. Current term is 17. Ops: []
I20260709 12:27:28.851958 13840 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:28.858736  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:28.859355  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c87516dfcddf4c8b8d921f3512db9063" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 23 candidate_status { last_received { term: 22 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:28.859558  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:28.862385  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:28.869357  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:28.869954  6113 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:28.874296  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:28.882017  5961 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.884817  6112 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:28.888170  6112 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:28.889487 13840 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.918036  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:28.919669  6114 raft_consensus.cc:3055] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Stepping down as leader of term 16
I20260709 12:27:28.919971  6114 raft_consensus.cc:740] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:28.927428  5961 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:28.927875  5965 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b1c2c76afb3f4fb2911e84592dd6b52b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:28.932947  6112 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:28.942646  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:28.943337  6650 raft_consensus.cc:3055] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Stepping down as leader of term 18
I20260709 12:27:28.943670  6650 raft_consensus.cc:740] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:28.944305  6118 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:27:28.950503  5961 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 17 candidate_status { last_received { term: 16 index: 12 } } ignore_live_leader: true dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:28.951167  5961 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Advancing to term 17
I20260709 12:27:28.954771  6081 leader_election.cc:304] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:28.956264 13980 raft_consensus.cc:2749] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:28.944535  6650 consensus_queue.cc:260] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 18, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:28.964785  6009 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:28.967070  5961 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:27:28.966698  6114 consensus_queue.cc:260] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 16, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:28.966605 14126 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:28.979912 13531 raft_consensus.cc:993] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:27:28.980456 13531 raft_consensus.cc:1081] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:27:28.986380  6113 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:28.988899  6118 raft_consensus.cc:1240] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Rejecting Update request from peer 24012af7747d4c4ea89c3da2ff950099 for earlier term 19. Current term is 20. Ops: []
I20260709 12:27:29.018990  6650 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:29.040128  6114 raft_consensus.cc:3060] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Advancing to term 17
W20260709 12:27:29.041328  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 75271.7us
I20260709 12:27:29.085259  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 19 candidate_status { last_received { term: 18 index: 14 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:29.085887  6038 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
W20260709 12:27:29.098371  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 89695.1us
I20260709 12:27:29.103804  6038 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:27:29.118840  6009 leader_election.cc:304] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:29.128337  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:29.130679 14128 raft_consensus.cc:2749] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:29.131521 14128 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
I20260709 12:27:29.132398  6009 leader_election.cc:304] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:29.226162  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 113927us
I20260709 12:27:29.227062 14151 raft_consensus.cc:2749] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:27:29.254522  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 89725.7us
I20260709 12:27:29.255741  5932 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:29.254667  6006 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 17 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
W20260709 12:27:29.285679  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 131099us
I20260709 12:27:29.231426 14128 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 14, Time since last communication: 0.052s
W20260709 12:27:29.292570  5934 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 247711us
W20260709 12:27:29.300360  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 45788.3us
I20260709 12:27:29.301129 14154 raft_consensus.cc:2804] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader election won for term 17
I20260709 12:27:29.302920 14162 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:29.303671 14162 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:29.304533 14154 raft_consensus.cc:697] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:29.305605 14154 consensus_queue.cc:237] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 16.12, Last appended by leader: 12, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:29.299185 13647 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:29.333858  6650 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 19.
I20260709 12:27:29.306319 14162 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:29.340801 14153 log.cc:927] Time spent T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.133s	user 0.001s	sys 0.000s
I20260709 12:27:29.380613  5861 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59632 (request call id 343) took 7080 ms. Trace:
I20260709 12:27:29.418747  5861 rpcz_store.cc:276] 0709 12:27:22.300061 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:22.300284 (+   223us) service_pool.cc:224] Handling call
0709 12:27:29.380375 (+7080091us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:28.086148 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:28.114636 (+ 28488us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:28.114670 (+    34us) write_op.cc:435] Acquired schema lock
0709 12:27:28.114687 (+    17us) tablet.cc:662] Decoding operations
0709 12:27:28.115735 (+  1048us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:28.115797 (+    62us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:28.115822 (+    25us) tablet.cc:685] Acquiring locks for 11 operations
0709 12:27:28.116854 (+  1032us) tablet.cc:701] Row locks acquired
0709 12:27:28.116868 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:27:28.117018 (+   150us) write_op.cc:270] Start()
0709 12:27:28.117132 (+   114us) write_op.cc:276] Timestamp: P: 1783600048116968 usec, L: 0
0709 12:27:28.117146 (+    14us) op_driver.cc:348] REPLICATION: starting
0709 12:27:28.117815 (+   669us) log.cc:844] Serialized 4340 byte log entry
0709 12:27:28.238663 (+120848us) op_driver.cc:464] REPLICATION: finished
0709 12:27:28.397795 (+159132us) write_op.cc:301] APPLY: starting
0709 12:27:28.434055 (+ 36260us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:28.457472 (+ 23417us) spinlock_profiling.cc:243] Waited 8.42 ms on lock 0x7b1800025060. stack: 00007f481df35343 00007f481df35240 00007f481d8c41d4 00007f4827602304 00007f4827602299 00007f4826e2fab1 00007f4826e3c281 00007f4820d930ec 00007f4820ddfc0a 00007f4820ddf4f7 00007f4820ddf490 00007f4820d8a754 00007f4824aaaf13 00007f4824aab532 00007f4824af2b93 00007f482499fde3
0709 12:27:28.637390 (+179918us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:28.637442 (+    52us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:28.793658 (+156216us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:28.794021 (+   363us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=22,key_file_lookups=22,delta_file_lookups=22,mrs_lookups=0
0709 12:27:28.794065 (+    44us) write_op.cc:312] APPLY: finished
0709 12:27:28.794544 (+   479us) log.cc:844] Serialized 105 byte log entry
0709 12:27:28.833800 (+ 39256us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:28.834089 (+   289us) write_op.cc:454] Released schema lock
0709 12:27:28.834155 (+    66us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:28.837103 (+  2948us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:28.837142 (+    39us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":27510,"reported_tablets":37,"child_traces":[["op",{"apply.queue_time_us":158636,"apply.run_cpu_time_us":22144,"apply.run_wall_time_us":439409,"cfile_cache_hit":46,"cfile_cache_hit_bytes":50129,"num_ops":11,"prepare.queue_time_us":229252,"prepare.run_cpu_time_us":30929,"prepare.run_wall_time_us":155261,"raft.queue_time_us":835,"raft.run_cpu_time_us":11811,"raft.run_wall_time_us":246281,"replication_time_us":121344,"spinlock_wait_cycles":19369216,"thread_start_us":356037,"threads_started":4,"wal-append.queue_time_us":117121}]]}
I20260709 12:27:29.378228  6114 raft_consensus.cc:2468] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:27:29.391322  6646 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:27:29.395594  6645 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:27:29.398288  5865 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 25 to 26, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 26 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:27:29.404944  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 104507us
I20260709 12:27:29.428908  6081 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:29.429884 14156 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:29.428967  5865 catalog_manager.cc:5697] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 16 to 19, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 19 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:29.432400  5865 catalog_manager.cc:5697] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 15 to 19. New cstate: current_term: 19 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:27:29.409112  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 153466us
W20260709 12:27:29.409574  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 125425us
I20260709 12:27:29.434772  5865 catalog_manager.cc:5697] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 18 to 20. New cstate: current_term: 20 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:29.382673 13647 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:29.437414 13647 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 18.14, Last appended by leader: 14, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:29.439602  6645 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:29.440358  6645 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 24.
I20260709 12:27:29.442991 14152 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:27:29.449697  6084 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:29.451256 13735 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election won for term 24
I20260709 12:27:29.451671 13735 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting leader election (detected failure of leader 24012af7747d4c4ea89c3da2ff950099)
I20260709 12:27:29.452049 13735 raft_consensus.cc:3060] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:29.452502 14152 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:29.464241 13735 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:29.454326  5865 catalog_manager.cc:5697] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 13 to 15. New cstate: current_term: 15 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:29.476238  5966 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:34550
I20260709 12:27:29.476867  5966 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:29.477219  5966 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:29.482174  5865 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 18 to 19, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 19 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:29.485294  5865 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 19 to 20, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 20 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:29.486232  5966 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:29.534087 14179 log.cc:927] Time spent T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
I20260709 12:27:29.550983 13735 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:29.552724  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:29.558491  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:29.559062  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 20 candidate_status { last_received { term: 19 index: 14 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:29.559162  6114 raft_consensus.cc:3055] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:27:29.559749  6646 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:29.561251  5962 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:29.561715  5967 raft_consensus.cc:1240] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Rejecting Update request from peer 0069e2ba1f02412e8e1d6c20a1fb510f for earlier term 19. Current term is 20. Ops: []
I20260709 12:27:29.562073  5962 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 24: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:29.559721  6114 raft_consensus.cc:740] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:29.564293  6114 consensus_queue.cc:260] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:29.565374  6114 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:29.570021  6646 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 20.
I20260709 12:27:29.580793  6114 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 20.
I20260709 12:27:29.581769  5934 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:29.622555 13647 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:29.623099 13647 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:29.582345  5966 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 20 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:29.583750  5964 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7bf137aab07e4b9b8024d07355c33351" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 24 candidate_status { last_received { term: 23 index: 17 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
I20260709 12:27:29.624325  5964 raft_consensus.cc:2393] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 24: Already voted for candidate f1bb8e63c2b448cdafd51f05d277c741 in this term.
I20260709 12:27:29.624039 13647 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 19.14, Last appended by leader: 14, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:29.591466 14152 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:29.592077  6644 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:27:29.625252 14152 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:29.627648 14152 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:29.630532 14152 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:29.628355  5865 catalog_manager.cc:5697] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 17 to 23. New cstate: current_term: 23 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:29.636521  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:29.616748  6649 raft_consensus.cc:2468] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 24.
I20260709 12:27:29.644740  6084 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:29.645663 14176 raft_consensus.cc:2804] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader election won for term 24
I20260709 12:27:29.646445 14176 raft_consensus.cc:697] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:29.649259 14176 consensus_queue.cc:237] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 23.17, Last appended by leader: 17, Current term: 24, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:29.658638 14173 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:29.659353 14173 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } attrs { replace: true } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:29.663651 14173 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:29.665097  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:29.667024  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:29.684655  6114 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Advancing to term 24
I20260709 12:27:29.691488  6118 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:27:29.693255  6118 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:27:29.697356  5967 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741" is_pre_election: true
I20260709 12:27:29.698791  6006 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:29.699932 14152 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:29.702989  6081 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:29.703969 13735 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:29.724560  6114 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:27:29.752296  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0b00ef9114f441baff2557bc164b4d7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:29.757534 14154 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:29.769543 14152 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.001s
I20260709 12:27:29.790519 14126 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:27:29.800621  5967 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:27:29.804822 14152 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:29.848261  6649 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:29.860769 14161 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.009s
I20260709 12:27:29.883188  6114 raft_consensus.cc:1275] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 16 index: 12. Preceding OpId from leader: term: 17 index: 13. (index mismatch)
I20260709 12:27:29.889855 14126 consensus_queue.cc:1048] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.021s
I20260709 12:27:29.960796  6037 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 18 index: 14. Preceding OpId from leader: term: 19 index: 15. (index mismatch)
I20260709 12:27:29.974551 14161 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:30.100454  6649 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:27:30.106127 13647 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.017s
I20260709 12:27:30.196285  5865 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:54950 (request call id 222) took 4788 ms. Trace:
I20260709 12:27:30.197106  5863 catalog_manager.cc:5697] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:30.201103  6114 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 19 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:27:30.201994  5966 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:27:30.199998  5863 catalog_manager.cc:5697] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 24 to 25, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 25 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:30.204509  5863 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 14 to 21, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 21 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:30.206693  5863 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 17 to 19, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 19 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:30.212554 14195 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:27:30.208956  5863 catalog_manager.cc:5697] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:30.221153 13647 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:30.218245  5863 catalog_manager.cc:5697] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 17 to 19, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 19 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.231235  5863 catalog_manager.cc:5697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index 12 to 13, term changed from 19 to 20, leader changed from <none> to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 20 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 13 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:30.241485  5863 catalog_manager.cc:5697] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 19 to 23, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 23 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.243500  5863 catalog_manager.cc:5697] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 22 to 24. New cstate: current_term: 24 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:30.215700  5865 rpcz_store.cc:276] 0709 12:27:25.407656 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:25.409494 (+  1838us) service_pool.cc:224] Handling call
0709 12:27:30.196186 (+4786692us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:29.750974 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:29.751636 (+   662us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:29.751686 (+    50us) write_op.cc:435] Acquired schema lock
0709 12:27:29.751704 (+    18us) tablet.cc:662] Decoding operations
0709 12:27:29.766613 (+ 14909us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:29.766738 (+   125us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:29.766770 (+    32us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:27:29.767623 (+   853us) tablet.cc:701] Row locks acquired
0709 12:27:29.767677 (+    54us) write_op.cc:260] PREPARE: finished
0709 12:27:29.767899 (+   222us) write_op.cc:270] Start()
0709 12:27:29.768087 (+   188us) write_op.cc:276] Timestamp: P: 1783600049767823 usec, L: 0
0709 12:27:29.768113 (+    26us) op_driver.cc:348] REPLICATION: starting
0709 12:27:29.768885 (+   772us) log.cc:844] Serialized 3194 byte log entry
0709 12:27:29.863440 (+ 94555us) op_driver.cc:464] REPLICATION: finished
0709 12:27:29.968183 (+104743us) write_op.cc:301] APPLY: starting
0709 12:27:29.995132 (+ 26949us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:30.100974 (+105842us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:30.101096 (+   122us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:30.151072 (+ 49976us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:30.151294 (+   222us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=16,key_file_lookups=16,delta_file_lookups=16,mrs_lookups=0
0709 12:27:30.151338 (+    44us) write_op.cc:312] APPLY: finished
0709 12:27:30.151597 (+   259us) log.cc:844] Serialized 81 byte log entry
0709 12:27:30.161000 (+  9403us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:30.161124 (+   124us) write_op.cc:454] Released schema lock
0709 12:27:30.161175 (+    51us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:30.170126 (+  8951us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:30.170158 (+    32us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":269,"reported_tablets":36,"child_traces":[["op",{"apply.queue_time_us":67725,"apply.run_cpu_time_us":13188,"apply.run_wall_time_us":201393,"cfile_cache_hit":34,"cfile_cache_hit_bytes":37583,"num_ops":8,"prepare.queue_time_us":50060,"prepare.run_cpu_time_us":4336,"prepare.run_wall_time_us":18272,"replication_time_us":95166,"thread_start_us":78923,"threads_started":2}]]}
I20260709 12:27:30.260317  6649 raft_consensus.cc:1275] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 23 index: 17. Preceding OpId from leader: term: 24 index: 18. (index mismatch)
I20260709 12:27:30.288779 14155 consensus_queue.cc:1048] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.001s
I20260709 12:27:30.289610  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:30.300905  5863 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 22 to 24, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 24 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:30.304872  5863 catalog_manager.cc:5697] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 15 to 18, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 18 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:30.307870  5863 catalog_manager.cc:5697] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 15 to 17. New cstate: current_term: 17 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:30.311030  5863 catalog_manager.cc:5697] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 24 to 27, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 27 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:30.316815  5863 catalog_manager.cc:5697] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 14 to 17, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 17 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:30.330931  5863 catalog_manager.cc:5697] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 20 to 21, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 21 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } }
I20260709 12:27:30.443401  5865 catalog_manager.cc:5697] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 17 to 18, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 18 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.445215  5865 catalog_manager.cc:5697] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 14 to 17, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 17 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.449781  5865 catalog_manager.cc:5697] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 19 to 20, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 20 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:30.451318  5865 catalog_manager.cc:5697] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 19 to 20, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 20 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:30.459324  5865 catalog_manager.cc:5697] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 18 to 19, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 19 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:30.461810  5865 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 19 to 20, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 20 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:30.463477  5865 catalog_manager.cc:5697] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 23 to 24, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 24 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:30.460847  5863 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59640 (request call id 332) took 1607 ms. Trace:
I20260709 12:27:30.464640  5863 rpcz_store.cc:276] 0709 12:27:28.863481 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:28.863738 (+   257us) service_pool.cc:224] Handling call
0709 12:27:30.460751 (+1597013us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:27:30.359341 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:27:30.360032 (+   691us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:27:30.360065 (+    33us) write_op.cc:435] Acquired schema lock
0709 12:27:30.360081 (+    16us) tablet.cc:662] Decoding operations
0709 12:27:30.366082 (+  6001us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:27:30.369731 (+  3649us) write_op.cc:641] Partition lock acquired for write op
0709 12:27:30.369763 (+    32us) tablet.cc:685] Acquiring locks for 15 operations
0709 12:27:30.371123 (+  1360us) tablet.cc:701] Row locks acquired
0709 12:27:30.371137 (+    14us) write_op.cc:260] PREPARE: finished
0709 12:27:30.371271 (+   134us) write_op.cc:270] Start()
0709 12:27:30.371377 (+   106us) write_op.cc:276] Timestamp: P: 1783600050371226 usec, L: 0
0709 12:27:30.371395 (+    18us) op_driver.cc:348] REPLICATION: starting
0709 12:27:30.372038 (+   643us) log.cc:844] Serialized 5966 byte log entry
0709 12:27:30.374499 (+  2461us) op_driver.cc:464] REPLICATION: finished
0709 12:27:30.374924 (+   425us) write_op.cc:301] APPLY: starting
0709 12:27:30.375007 (+    83us) tablet.cc:1367] starting BulkCheckPresence
0709 12:27:30.382885 (+  7878us) tablet.cc:1370] finished BulkCheckPresence
0709 12:27:30.382987 (+   102us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:27:30.419004 (+ 36017us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:27:30.421830 (+  2826us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=30,key_file_lookups=30,delta_file_lookups=30,mrs_lookups=0
0709 12:27:30.421876 (+    46us) write_op.cc:312] APPLY: finished
0709 12:27:30.422208 (+   332us) log.cc:844] Serialized 139 byte log entry
0709 12:27:30.422987 (+   779us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:30.423139 (+   152us) write_op.cc:454] Released schema lock
0709 12:27:30.423191 (+    52us) write_op.cc:341] FINISH: Updating metrics
0709 12:27:30.423747 (+   556us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:27:30.423787 (+    40us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":64637,"reported_tablets":29,"child_traces":[["op",{"apply.queue_time_us":149,"apply.run_cpu_time_us":18329,"apply.run_wall_time_us":48801,"cfile_cache_hit":60,"cfile_cache_hit_bytes":62730,"num_ops":15,"prepare.queue_time_us":6438,"prepare.run_cpu_time_us":4466,"prepare.run_wall_time_us":15080,"replication_time_us":2926,"thread_start_us":7322,"threads_started":1}]]}
I20260709 12:27:30.469964  5865 catalog_manager.cc:5697] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 23 to 24, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 24 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:30.445976  6037 consensus_queue.cc:237] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 21.15, Last appended by leader: 14, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:30.480630 14151 raft_consensus.cc:476] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Not starting pre-election -- already a leader
I20260709 12:27:30.503466  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:27:30.504067  6118 raft_consensus.cc:606] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:30.531442  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38df61ba407240499023581d9f885037"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:27:30.532022  6118 raft_consensus.cc:606] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:30.538826  6114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:27:30.540122  5863 catalog_manager.cc:5697] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 13 to 17, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 17 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:30.542533  6114 raft_consensus.cc:606] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:30.557863  6649 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0"
dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:60902
I20260709 12:27:30.558537  6649 raft_consensus.cc:606] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:30.610522  6114 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:27:30.611109  6114 raft_consensus.cc:606] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Received request to transfer leadership to TS f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:30.617916  6649 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:27:30.620272  5966 raft_consensus.cc:1275] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 21 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:27:30.621966 14151 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:30.633730 14154 consensus_queue.cc:1048] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:30.640185 13840 raft_consensus.cc:2955] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Committing config change with OpId 21.16: config changed from index 13 to 16, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:30.654671  6118 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "cc2b965a354c426fb89e1a743dccd273"
dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
mode: GRACEFUL
new_leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:50992
I20260709 12:27:30.655393  6118 raft_consensus.cc:606] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Received request to transfer leadership to TS 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:30.655720  6118 raft_consensus.cc:614] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Rejecting request to transer leadership while not leader
I20260709 12:27:30.659086  5966 raft_consensus.cc:2955] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 13 to 16, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:30.664903  5851 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet a0b00ef9114f441baff2557bc164b4d7 with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:30.676036 14195 raft_consensus.cc:993] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:27:30.676576 13735 raft_consensus.cc:1081] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:27:30.682711  5964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:34550
I20260709 12:27:30.683287  5964 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:30.683617  5964 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:30.702883  5861 catalog_manager.cc:5697] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index 13 to 16, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New cstate: current_term: 21 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:30.722733  6103 tablet_service.cc:1558] Processing DeleteTablet for tablet a0b00ef9114f441baff2557bc164b4d7 with delete_type TABLET_DATA_TOMBSTONED (TS 0069e2ba1f02412e8e1d6c20a1fb510f not found in new config with opid_index 16) from {username='slave'} at 127.0.0.1:34280
I20260709 12:27:30.714027  5964 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:30.721141  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:27:30.726498  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:30.727087  6038 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:30.726534  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:27:30.737938  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:30.751039  6650 raft_consensus.cc:2955] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Committing config change with OpId 21.16: config changed from index 13 to 16, VOTER 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:30.751958  6038 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:27:30.753166  5964 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:30.753717 14208 tablet_replica.cc:333] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:30.754808  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:30.755420  6114 raft_consensus.cc:3055] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Stepping down as leader of term 17
I20260709 12:27:30.755725  6114 raft_consensus.cc:740] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:30.757233  6114 consensus_queue.cc:260] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 17, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:30.758288  6114 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:30.756722  5932 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:30.762252 13647 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:30.755008 14208 raft_consensus.cc:2243] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:30.763535  5866 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:59648 (request call id 323) took 9869 ms. Trace:
I20260709 12:27:30.764142  5866 rpcz_store.cc:276] 0709 12:27:20.893038 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:20.893293 (+   255us) service_pool.cc:224] Handling call
0709 12:27:30.762432 (+9869139us) inbound_call.cc:177] Queueing success response
Metrics: {"mutex_wait_us":22230,"reported_tablets":43}
I20260709 12:27:30.764268 14208 raft_consensus.cc:2272] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:30.764230 13647 raft_consensus.cc:697] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:30.767841 13647 consensus_queue.cc:237] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:30.770398  6114 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 18.
I20260709 12:27:30.798597 14195 raft_consensus.cc:993] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:27:30.798724 14208 ts_tablet_manager.cc:1916] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20260709 12:27:30.810155 14195 raft_consensus.cc:1081] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:27:30.839246 13735 raft_consensus.cc:993] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:27:30.839759 13735 raft_consensus.cc:1081] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:27:30.841559 14176 raft_consensus.cc:993] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: : Instructing follower 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:27:30.841542  5964 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:34550
I20260709 12:27:30.842149 14176 raft_consensus.cc:1081] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 LEADER]: Signalling peer 0557a7246c8945b99e5215c99d4ddf9c to start an election
I20260709 12:27:30.842192  5964 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:30.842741  5964 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:30.846884 14208 ts_tablet_manager.cc:1929] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 21.15
I20260709 12:27:30.850699  5964 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:30.869819  6038 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36260
I20260709 12:27:30.871251  6038 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:30.871620  6038 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:30.874265  5964 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:30.876243  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:30.876631  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 15 candidate_status { last_received { term: 14 index: 11 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:30.876820  6114 raft_consensus.cc:3055] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Stepping down as leader of term 14
I20260709 12:27:30.877178  6114 raft_consensus.cc:740] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:30.877343  6650 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:30.878443  6114 consensus_queue.cc:260] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 14, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:30.879912  6114 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 14 FOLLOWER]: Advancing to term 15
I20260709 12:27:30.886346 14208 log.cc:1199] T a0b00ef9114f441baff2557bc164b4d7 P 0069e2ba1f02412e8e1d6c20a1fb510f: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/wals/a0b00ef9114f441baff2557bc164b4d7
I20260709 12:27:30.898999  6650 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:27:30.901809  6038 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:30.909044  5853 catalog_manager.cc:5028] TS 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): tablet a0b00ef9114f441baff2557bc164b4d7 (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
I20260709 12:27:30.912710  6114 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 15.
I20260709 12:27:30.914111  6042 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38df61ba407240499023581d9f885037"
dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
 from {username='slave'} at 127.0.0.1:36260
I20260709 12:27:30.914757  6042 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:30.915122  6042 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:30.915199  5934 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 15 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:30.920858 14174 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Leader election won for term 15
I20260709 12:27:30.921381 14174 raft_consensus.cc:697] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:30.922221 14174 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 14.11, Last appended by leader: 11, Current term: 15, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:30.937837  6042 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:30.955013  6042 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 27 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:30.957499  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:30.958074  6646 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:30.962975  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 27 candidate_status { last_received { term: 26 index: 19 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:30.963690  6114 raft_consensus.cc:3055] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 LEADER]: Stepping down as leader of term 26
I20260709 12:27:30.964047  6114 raft_consensus.cc:740] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:30.962977  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:30.940464  5866 catalog_manager.cc:5697] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 17 to 18, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 18 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:30.965443  6118 raft_consensus.cc:3055] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Stepping down as leader of term 19
I20260709 12:27:30.966817  6114 consensus_queue.cc:260] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 26, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:30.967952  6038 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:30.968515  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 16 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:30.969079  6650 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:30.966895  6118 raft_consensus.cc:740] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Becoming Follower/Learner. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:30.970865  6114 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Advancing to term 27
I20260709 12:27:30.970075  6118 consensus_queue.cc:260] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 19, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:30.977736  6114 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 27.
I20260709 12:27:30.979909  6650 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:30.980365  6646 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 27 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 27.
I20260709 12:27:30.980798  6009 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 27 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:30.981608  6009 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:30.982206 14210 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Leader election won for term 27
I20260709 12:27:30.982832  6118 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:30.982959 14210 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:30.983943 14210 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 19, Committed index: 19, Last appended: 26.19, Last appended by leader: 19, Current term: 27, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:30.988919 14151 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:30.989485 14151 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:30.990406 14151 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 19.16, Last appended by leader: 16, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:31.005234  6118 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:31.078565  5866 catalog_manager.cc:5697] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 14 to 15, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 15 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.074424  5863 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 26 to 27, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 27 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.137351 14063 raft_consensus.cc:993] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: : Instructing follower f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:27:31.137935 14063 raft_consensus.cc:1081] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Signalling peer f1bb8e63c2b448cdafd51f05d277c741 to start an election
I20260709 12:27:31.144243  5967 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0"
dest_uuid: "f1bb8e63c2b448cdafd51f05d277c741"
 from {username='slave'} at 127.0.0.1:37174
I20260709 12:27:31.144872  5967 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:27:31.145227  5967 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:31.149537  5866 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 19 to 20, leader changed from 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 20 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.155479  5967 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:31.157379  5967 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Requested vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:31.160244  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: true dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:31.161005  6649 raft_consensus.cc:3055] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Stepping down as leader of term 21
I20260709 12:27:31.161465  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "f1bb8e63c2b448cdafd51f05d277c741" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: true dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:31.162076  6114 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:31.161368  6649 raft_consensus.cc:740] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:31.171321  6649 consensus_queue.cc:260] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 21, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:31.174089  6649 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:31.183581  6118 consensus_queue.cc:237] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 20.14, Last appended by leader: 13, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:31.194015  6649 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 22.
I20260709 12:27:31.195225  5934 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741; no voters: 
I20260709 12:27:31.196130 14174 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:31.196667 14174 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Becoming Leader. State: Replica: f1bb8e63c2b448cdafd51f05d277c741, State: Running, Role: LEADER
I20260709 12:27:31.197537 14174 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:31.196058  6114 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f1bb8e63c2b448cdafd51f05d277c741 in term 22.
I20260709 12:27:31.213579  6114 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:27:31.215112 14077 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:31.237951  6649 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:27:31.239415 13735 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:31.246110  6042 raft_consensus.cc:1275] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 20 index: 14. Preceding OpId from leader: term: 20 index: 15. (index mismatch)
I20260709 12:27:31.247747 14155 consensus_queue.cc:1048] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
I20260709 12:27:31.254910  5866 catalog_manager.cc:5697] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 reported cstate change: term changed from 21 to 22, leader changed from 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) to f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65). New cstate: current_term: 22 leader_uuid: "f1bb8e63c2b448cdafd51f05d277c741" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:31.276716 14195 raft_consensus.cc:2955] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Committing config change with OpId 20.15: config changed from index 13 to 15, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:31.283118  6038 raft_consensus.cc:2955] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 13 to 15, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:31.293944  6649 raft_consensus.cc:2955] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Committing config change with OpId 20.15: config changed from index 13 to 15, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:31.301716  5853 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet e3ef3cb064eb4a1597f89e040fce3c7e with cas_config_opid_index 13: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:31.322687  5866 catalog_manager.cc:5697] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 13 to 15, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New cstate: current_term: 20 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:31.388933  6649 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 27 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 12:27:31.389343  6042 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:27:31.395227 14126 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.000s
I20260709 12:27:31.397660 14174 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:31.410171  6118 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:27:31.411870 13647 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:31.469590  5956 tablet_service.cc:1558] Processing DeleteTablet for tablet e3ef3cb064eb4a1597f89e040fce3c7e with delete_type TABLET_DATA_TOMBSTONED (TS f1bb8e63c2b448cdafd51f05d277c741 not found in new config with opid_index 15) from {username='slave'} at 127.0.0.1:41396
I20260709 12:27:31.517880  6646 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 14 index: 11. Preceding OpId from leader: term: 15 index: 12. (index mismatch)
I20260709 12:27:31.519490  6118 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:27:31.519871 14222 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
I20260709 12:27:31.529788 14126 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.006s
I20260709 12:27:31.539672 14230 tablet_replica.cc:333] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:31.577648  6114 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 26 index: 19. Preceding OpId from leader: term: 27 index: 20. (index mismatch)
I20260709 12:27:31.579087  6646 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 19 index: 16. Preceding OpId from leader: term: 20 index: 17. (index mismatch)
I20260709 12:27:31.581717 13840 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
I20260709 12:27:31.574317 14230 raft_consensus.cc:2243] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:31.589883 14230 raft_consensus.cc:2272] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:31.585843 14151 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 20, Last known committed idx: 19, Time since last communication: 0.010s
I20260709 12:27:31.617792 14230 ts_tablet_manager.cc:1916] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
W20260709 12:27:31.679508  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 52813.7us
I20260709 12:27:31.783573  6118 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:27:31.785249  6646 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Refusing update from remote peer f1bb8e63c2b448cdafd51f05d277c741: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:27:31.811447 14077 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.013s
I20260709 12:27:31.832541 14243 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.004s
W20260709 12:27:31.910744  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 107412us
I20260709 12:27:31.966492  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:27:31.975399 14230 ts_tablet_manager.cc:1929] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 20.14
I20260709 12:27:31.994935 14230 log.cc:1199] T e3ef3cb064eb4a1597f89e040fce3c7e P f1bb8e63c2b448cdafd51f05d277c741: Deleting WAL directory at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/wals/e3ef3cb064eb4a1597f89e040fce3c7e
W20260709 12:27:31.998597  6082 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 81085us
I20260709 12:27:32.016506  5850 catalog_manager.cc:5028] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): tablet e3ef3cb064eb4a1597f89e040fce3c7e (table test-workload [id=320467eb1eff4b52a15f6712ded136a5]) successfully deleted
W20260709 12:27:32.028139  5932 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 49070.9us
W20260709 12:27:32.092218  6608 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 48422us
W20260709 12:27:32.129489  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 126410us
/apache/dev/git/kudu/src/kudu/master/auto_leader_rebalancer-test.cc:461: Failure
Failed
Bad status: Illegal state: leader_transfer_task size should be 0, but 1
I20260709 12:27:32.162518  4821 tablet_server.cc:179] TabletServer@127.4.181.65:0 shutting down...
W20260709 12:27:32.198220  6608 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 12 similar messages]
W20260709 12:27:32.251590  6006 consensus_peers.cc:597] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.252260  6006 consensus_peers.cc:597] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.261147  6608 consensus_peers.cc:597] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.266671  6608 consensus_peers.cc:597] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.270002  6608 consensus_peers.cc:597] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.270747  6608 consensus_peers.cc:597] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.310608  6608 consensus_peers.cc:597] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.312219  6608 consensus_peers.cc:597] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.328086  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 53447us
W20260709 12:27:32.344985  6608 consensus_peers.cc:597] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.347147  6081 consensus_peers.cc:597] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.349622  6081 consensus_peers.cc:597] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.351825  6081 consensus_peers.cc:597] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.353124  6081 consensus_peers.cc:597] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.357880  6081 consensus_peers.cc:597] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.368875  6006 consensus_peers.cc:597] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.391166  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:32.393119  4821 tablet_replica.cc:333] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.394093  4821 raft_consensus.cc:2243] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:27:32.395159  4821 raft_consensus.cc:2272] T adcfbfcb66fd4891959337c005335841 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.406244  4821 tablet_replica.cc:333] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
W20260709 12:27:32.416018  6081 consensus_peers.cc:597] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.417656  4821 raft_consensus.cc:2243] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.418351  4821 raft_consensus.cc:2272] T 22f53da618b548f89206b5390bbf5aec P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:32.424615  6006 consensus_peers.cc:597] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.436618  4821 tablet_replica.cc:333] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.437630  4821 raft_consensus.cc:2243] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.438478  4821 raft_consensus.cc:2272] T 7d1c158430bb487aa1d4c5a69165aa32 P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.441370  4821 tablet_replica.cc:333] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
W20260709 12:27:32.441641  6081 consensus_peers.cc:597] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.442113  4821 raft_consensus.cc:2243] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.450855  4821 raft_consensus.cc:2272] T ec584257f9db451c965f6b092aa9069c P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.453579  4821 tablet_replica.cc:333] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.454339  4821 raft_consensus.cc:2243] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.462703  4821 raft_consensus.cc:2272] T 7bf137aab07e4b9b8024d07355c33351 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.466701  4821 tablet_replica.cc:333] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.467555  4821 raft_consensus.cc:2243] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.468258  4821 raft_consensus.cc:2272] T a0b00ef9114f441baff2557bc164b4d7 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:32.477041  6081 consensus_peers.cc:597] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.487528  4821 tablet_replica.cc:333] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.488546  4821 raft_consensus.cc:2243] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:27:32.489542  4821 raft_consensus.cc:2272] T bd91034e550f4704be7f47b7aff3ed25 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.497344  4821 tablet_replica.cc:333] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.498165  4821 raft_consensus.cc:2243] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.498790  4821 raft_consensus.cc:2272] T 35f225b19c174d73b8b1d76af9a231dd P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.501518  4821 tablet_replica.cc:333] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
W20260709 12:27:32.516582  6006 consensus_peers.cc:597] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.502375  4821 raft_consensus.cc:2243] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:27:32.523583  4821 raft_consensus.cc:2272] T 4a03c10b4bbc407ebfd96681074ae05b P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:32.530606  6608 consensus_peers.cc:597] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.531530  4821 tablet_replica.cc:333] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
W20260709 12:27:32.532415  6006 consensus_peers.cc:597] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.532466  4821 raft_consensus.cc:2243] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.533656  4821 raft_consensus.cc:2272] T 382d3eda9eaa4b9c96393a12d9f2be5c P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.537504  4821 tablet_replica.cc:333] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.538363  4821 raft_consensus.cc:2243] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.544866  4821 raft_consensus.cc:2272] T 1c1322bdafce4b389254f08a59254d2e P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.559280  4821 tablet_replica.cc:333] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.560245  4821 raft_consensus.cc:2243] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.560978  4821 raft_consensus.cc:2272] T cc2b965a354c426fb89e1a743dccd273 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.568634  4821 tablet_replica.cc:333] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.569500  4821 raft_consensus.cc:2243] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 LEADER]: Raft consensus shutting down.
W20260709 12:27:32.571643  6081 consensus_peers.cc:597] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.573722  6608 consensus_peers.cc:597] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.574651  4821 raft_consensus.cc:2272] T cf28639931bb43a58703f0afd043e166 P f1bb8e63c2b448cdafd51f05d277c741 [term 11 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:32.623770  6081 consensus_peers.cc:597] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.627679  6081 consensus_peers.cc:597] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.634220  4821 tablet_replica.cc:333] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.635174  4821 raft_consensus.cc:2243] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.635774  4821 raft_consensus.cc:2272] T 5e596fee38d14bcb913a2aaadffa2a72 P f1bb8e63c2b448cdafd51f05d277c741 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.638372  4821 tablet_replica.cc:333] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.645733  4821 raft_consensus.cc:2243] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.648213  4821 raft_consensus.cc:2272] T 3fd6047b66ab4b4abc3fe659e8cff000 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.662052  4821 tablet_replica.cc:333] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.663117  4821 raft_consensus.cc:2243] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Raft consensus shutting down.
W20260709 12:27:32.664111  6081 consensus_peers.cc:597] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.664402  4821 raft_consensus.cc:2272] T 42702625c5a04990a24ae81a2dede920 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.673401  4821 tablet_replica.cc:333] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
W20260709 12:27:32.677474  6081 consensus_peers.cc:597] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.678045  6608 consensus_peers.cc:597] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.679132  4821 raft_consensus.cc:2243] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.679925  4821 raft_consensus.cc:2272] T a1138b447c084c17ab4b465255e54118 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:32.688234  6006 consensus_peers.cc:597] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.701555  4821 tablet_replica.cc:333] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.699074  6115 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 25.13, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:27:32.714637  4821 raft_consensus.cc:2243] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Raft consensus shutting down.
W20260709 12:27:32.717635  6084 consensus_peers.cc:597] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: aa90f801f44d4669a2a93aafa33e4e17. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.719677  6038 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 25 index: 13. Preceding OpId from leader: term: 25 index: 14. (index mismatch)
I20260709 12:27:32.721175 14173 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:27:32.724278  6081 consensus_peers.cc:597] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.723120  4821 raft_consensus.cc:2272] T c357e710ee044329b93321405ae76071 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.739032  4821 tablet_replica.cc:333] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.738700 14261 raft_consensus.cc:2955] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 LEADER]: Committing config change with OpId 25.14: config changed from index -1 to 14, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:27:32.739993  4821 raft_consensus.cc:2243] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:27:32.741210  4821 raft_consensus.cc:2272] T a0acc59e2e4d43029c959c64a291c5a0 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.759327  6115 consensus_queue.cc:237] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 10, Committed index: 10, Last appended: 17.10, Last appended by leader: 9, Current term: 17, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:27:32.757507  6038 raft_consensus.cc:2955] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Committing config change with OpId 25.14: config changed from index -1 to 14, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
W20260709 12:27:32.764110  6608 consensus_peers.cc:597] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.790198  4821 tablet_replica.cc:333] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.791112  4821 raft_consensus.cc:2243] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.791678  4821 raft_consensus.cc:2272] T cbdceec3ce444e7b812ac717eafb85ee P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.794378  4821 tablet_replica.cc:333] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.803397  4821 raft_consensus.cc:2243] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:32.804343  4821 raft_consensus.cc:2272] T 4f2d24cb0978411e851e8ff35955bf2e P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.819285  5861 catalog_manager.cc:5697] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 14, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 25 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:27:32.828644  4821 tablet_replica.cc:333] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.829542  4821 raft_consensus.cc:2243] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.830216  4821 raft_consensus.cc:2272] T d0a77cc9656a4b88bc262752ad91e486 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.845292  6038 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 10. Preceding OpId from leader: term: 17 index: 11. (index mismatch)
I20260709 12:27:32.852458 14261 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 11, Last known committed idx: 10, Time since last communication: 0.000s
W20260709 12:27:32.857508  6084 consensus_peers.cc:597] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477): Couldn't send request to peer 24012af7747d4c4ea89c3da2ff950099. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 117509103bb449868a97cf0ba4fdda89. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:32.859776  6081 consensus_peers.cc:597] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:32.865031  4821 tablet_replica.cc:333] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.865999  4821 raft_consensus.cc:2243] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.866153 14244 raft_consensus.cc:2955] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:27:32.867673  6038 raft_consensus.cc:2955] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Committing config change with OpId 17.11: config changed from index -1 to 11, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New config: { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:27:32.892295  4821 raft_consensus.cc:2272] T b1b3ddf896ce40f5b9c2632735843215 P f1bb8e63c2b448cdafd51f05d277c741 [term 14 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:32.895619  5914 auto_rebalancer.cc:629] Failed to schedule move for tablet 3d61b6b50d6746189e849070b208d9a5: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:27:32.910900  5914 auto_rebalancer.cc:629] Failed to schedule move for tablet 465414d7b00f409684b7f69cfbcfad77: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20260709 12:27:32.939906  4821 tablet_replica.cc:333] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.940799  4821 raft_consensus.cc:2243] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.941824  4821 raft_consensus.cc:2272] T 5a6d648272bf4bef9d5337acfc9d4a96 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.955071  4821 tablet_replica.cc:333] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.955868  4821 raft_consensus.cc:2243] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.956449  4821 raft_consensus.cc:2272] T aa90f801f44d4669a2a93aafa33e4e17 P f1bb8e63c2b448cdafd51f05d277c741 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.959563  4821 tablet_replica.cc:333] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.960412  4821 raft_consensus.cc:2243] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.961066  4821 raft_consensus.cc:2272] T 117509103bb449868a97cf0ba4fdda89 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.981520  4821 tablet_replica.cc:333] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.982290  4821 raft_consensus.cc:2243] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:27:32.983299  4821 raft_consensus.cc:2272] T 07996c0296b04a39b1b151e8885389e2 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.986119  4821 tablet_replica.cc:333] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.986845  4821 raft_consensus.cc:2243] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.987447  4821 raft_consensus.cc:2272] T 7df97235d12b46dd8e54f8f1d6ed40bd P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.990111  4821 tablet_replica.cc:333] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.990903  4821 raft_consensus.cc:2243] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:32.993719  4821 raft_consensus.cc:2272] T c087bb99e3b64274863f583bf7ae435f P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:32.996626  4821 tablet_replica.cc:333] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:32.997504  4821 raft_consensus.cc:2243] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:32.998121  4821 raft_consensus.cc:2272] T 1d97a0d1272049469a8fe2111554686a P f1bb8e63c2b448cdafd51f05d277c741 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.008941  4821 tablet_replica.cc:333] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.009747  4821 raft_consensus.cc:2243] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.010392  4821 raft_consensus.cc:2272] T 0ad617c44395493f82e992b73a4295ad P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.018263  4821 tablet_replica.cc:333] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.012235  5863 catalog_manager.cc:5697] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index -1 to 11, NON_VOTER 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) added. New cstate: current_term: 17 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } } }
I20260709 12:27:33.019165  4821 raft_consensus.cc:2243] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.020166  4821 raft_consensus.cc:2272] T efdaf6941ab7409d90619a5e9f5c10c3 P f1bb8e63c2b448cdafd51f05d277c741 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.028788  4821 tablet_replica.cc:333] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.029601  4821 raft_consensus.cc:2243] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.030215  4821 raft_consensus.cc:2272] T b1c2c76afb3f4fb2911e84592dd6b52b P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.032892  4821 tablet_replica.cc:333] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.033645  4821 raft_consensus.cc:2243] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.034729  4821 raft_consensus.cc:2272] T 78c13bc0b46b40a3886a209b87dd6f98 P f1bb8e63c2b448cdafd51f05d277c741 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.038928  4821 tablet_replica.cc:333] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.039690  4821 raft_consensus.cc:2243] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.040294  4821 raft_consensus.cc:2272] T afdcf44718954edea3bd3aa8ada58035 P f1bb8e63c2b448cdafd51f05d277c741 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.044088  4821 tablet_replica.cc:333] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.044840  4821 raft_consensus.cc:2243] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.045403  4821 raft_consensus.cc:2272] T ba1e2d6430774a629131a0953161507b P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.058043  4821 tablet_replica.cc:333] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.058787  4821 raft_consensus.cc:2243] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.060072  4821 raft_consensus.cc:2272] T 06e81868728a4e2592f3ee289cff3431 P f1bb8e63c2b448cdafd51f05d277c741 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.071692  4821 tablet_replica.cc:333] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.074965  4821 raft_consensus.cc:2243] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.075579  4821 raft_consensus.cc:2272] T bc02451d94184328a520860e40f6b77c P f1bb8e63c2b448cdafd51f05d277c741 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.077976  4821 tablet_replica.cc:333] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.078727  4821 raft_consensus.cc:2243] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.079320  4821 raft_consensus.cc:2272] T 4783d1a7790a4be2a959bd61e6f21947 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.116272  4821 tablet_replica.cc:333] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.144253  4821 raft_consensus.cc:2243] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.145620  4821 raft_consensus.cc:2272] T 0636290fb57e4842995ddf9549f0c721 P f1bb8e63c2b448cdafd51f05d277c741 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.171500  4821 tablet_replica.cc:333] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.172447  4821 raft_consensus.cc:2243] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.173846  4821 raft_consensus.cc:2272] T 465414d7b00f409684b7f69cfbcfad77 P f1bb8e63c2b448cdafd51f05d277c741 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.196841  4821 tablet_replica.cc:333] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.197590  4821 raft_consensus.cc:2243] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.202142  4821 raft_consensus.cc:2272] T 3d61b6b50d6746189e849070b208d9a5 P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.213160  4821 tablet_replica.cc:333] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.213892  4821 raft_consensus.cc:2243] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.232800  4821 raft_consensus.cc:2272] T b46c3c3bcf5c4016bb6bab0051ff3094 P f1bb8e63c2b448cdafd51f05d277c741 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.235970  4821 tablet_replica.cc:333] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.253815  4821 raft_consensus.cc:2243] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.256520  4821 raft_consensus.cc:2272] T 0468d70863214876bf59fb3ea9474307 P f1bb8e63c2b448cdafd51f05d277c741 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.263712  4821 tablet_replica.cc:333] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.264397  4821 raft_consensus.cc:2243] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:33.264997  4821 raft_consensus.cc:2272] T 39cca9184e5b4b468627eb290d029f68 P f1bb8e63c2b448cdafd51f05d277c741 [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.275730  4821 tablet_replica.cc:333] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741: stopping tablet replica
I20260709 12:27:33.276392  4821 raft_consensus.cc:2243] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:27:33.277454  4821 raft_consensus.cc:2272] T 68476262e38a4c15a51c80b96e7d58a6 P f1bb8e63c2b448cdafd51f05d277c741 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:33.304706 14276 ts_tablet_manager.cc:933] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:33.347380 14276 tablet_copy_client.cc:323] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.67:39787
I20260709 12:27:33.369237 14278 ts_tablet_manager.cc:933] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099: Initiating tablet copy from peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:33.376183  6127 tablet_copy_service.cc:140] P 0069e2ba1f02412e8e1d6c20a1fb510f: Received BeginTabletCopySession request for tablet 117509103bb449868a97cf0ba4fdda89 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:42484)
I20260709 12:27:33.376835  6127 tablet_copy_service.cc:161] P 0069e2ba1f02412e8e1d6c20a1fb510f: Beginning new tablet copy session on tablet 117509103bb449868a97cf0ba4fdda89 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:42484: session id = 24012af7747d4c4ea89c3da2ff950099-117509103bb449868a97cf0ba4fdda89
I20260709 12:27:33.401260  6127 tablet_copy_source_session.cc:215] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:33.410596 14276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 117509103bb449868a97cf0ba4fdda89. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.411245 14278 tablet_copy_client.cc:323] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Beginning tablet copy session from remote peer at address 127.4.181.67:39787
I20260709 12:27:33.430779  6127 tablet_copy_service.cc:140] P 0069e2ba1f02412e8e1d6c20a1fb510f: Received BeginTabletCopySession request for tablet aa90f801f44d4669a2a93aafa33e4e17 from peer 24012af7747d4c4ea89c3da2ff950099 ({username='slave'} at 127.0.0.1:42484)
I20260709 12:27:33.434772  6127 tablet_copy_service.cc:161] P 0069e2ba1f02412e8e1d6c20a1fb510f: Beginning new tablet copy session on tablet aa90f801f44d4669a2a93aafa33e4e17 from peer 24012af7747d4c4ea89c3da2ff950099 at {username='slave'} at 127.0.0.1:42484: session id = 24012af7747d4c4ea89c3da2ff950099-aa90f801f44d4669a2a93aafa33e4e17
I20260709 12:27:33.465966  6127 tablet_copy_source_session.cc:215] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: Tablet Copy: opened 0 blocks and 1 log segments
I20260709 12:27:33.469879 14276 tablet_copy_client.cc:806] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:33.489375 14278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet aa90f801f44d4669a2a93aafa33e4e17. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:33.488000 14276 tablet_copy_client.cc:670] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:33.508546 14276 tablet_copy_client.cc:538] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:33.551357 14278 tablet_copy_client.cc:806] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 0 data blocks...
I20260709 12:27:33.563840 14278 tablet_copy_client.cc:670] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Starting download of 1 WAL segments...
I20260709 12:27:33.554145 14276 tablet_bootstrap.cc:492] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:27:33.572603 14278 tablet_copy_client.cc:538] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260709 12:27:33.605561 14261 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:33.606199 14261 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:33.608314 14261 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:33.614862  6081 leader_election.cc:336] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:33.620200 14260 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:33.620829 14260 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:33.623068 14260 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:33.624529  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:33.630543 14278 tablet_bootstrap.cc:492] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap starting.
I20260709 12:27:33.645337  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:33.645547  6608 leader_election.cc:336] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:33.660797  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:33.661756 14260 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:33.687417  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:33.692085 14270 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:33.693135 14259 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:33.693646 14259 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:33.695715 14259 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:33.697001 14260 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:33.697527 14260 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:33.698820  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:33.699410  6115 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 17.
I20260709 12:27:33.700472  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:33.701323 14259 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Leader pre-election won for term 18
I20260709 12:27:33.701782 14259 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:33.702200 14259 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:33.704347  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:33.702230 14260 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:33.709720  6608 leader_election.cc:336] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:33.710191  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:33.710949 14260 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:27:33.714781  6006 leader_election.cc:336] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:33.734043 14259 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:33.797782  6006 leader_election.cc:336] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:33.800112 14250 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:33.800966 14250 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:33.802383  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "adcfbfcb66fd4891959337c005335841" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 18 candidate_status { last_received { term: 17 index: 11 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:33.803056  6115 raft_consensus.cc:3060] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Advancing to term 18
I20260709 12:27:33.805150 14250 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:33.805693  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:33.809589  6006 leader_election.cc:336] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:33.810029  6006 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:33.811121 14250 raft_consensus.cc:2749] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election lost for term 12. Reason: could not achieve majority
I20260709 12:27:33.813695 14259 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:33.816006  6115 raft_consensus.cc:2468] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:27:33.817297  6009 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 18 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:33.818853 14239 raft_consensus.cc:2804] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader election won for term 18
I20260709 12:27:33.819339 14239 raft_consensus.cc:697] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:33.820144 14239 consensus_queue.cc:237] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 18, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:33.831102 14270 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:33.831642 14270 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:33.833842 14270 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:33.837843  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:33.838587  6650 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:27:33.838907 14259 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:33.839556 14259 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:33.841131  6081 leader_election.cc:336] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:33.846608 14250 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:27:33.847167  6006 leader_election.cc:336] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:33.848482 14250 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:33.852293 14250 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:33.849459 14276 log.cc:927] Time spent T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.061s	user 0.000s	sys 0.002s
I20260709 12:27:33.853489  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:33.854166  6650 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:27:33.855152  6084 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:33.855947  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:33.856257 14261 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:33.856726 14261 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:33.857089 14261 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:33.857681 14259 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:33.860934  6006 leader_election.cc:336] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:33.861418  6006 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:33.868557  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:33.870808 14249 raft_consensus.cc:2749] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:33.888561 14250 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:33.889173 14250 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:33.895354 14250 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:33.889313 14261 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:33.918833 14278 log.cc:927] Time spent T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.087s	user 0.001s	sys 0.000s
I20260709 12:27:33.921792 14278 tablet_bootstrap.cc:492] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:33.922791 14278 tablet_bootstrap.cc:492] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:27:33.923550 14278 ts_tablet_manager.cc:1403] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.293s	user 0.052s	sys 0.005s
I20260709 12:27:33.929045 14270 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:33.929633 14270 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:33.931735 14261 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:33.937371 14278 raft_consensus.cc:359] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [term 25 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:27:33.938900 14270 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:33.941967  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:33.942672  6040 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 24.
I20260709 12:27:33.945932  6082 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:33.954083 14261 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:33.938331 14278 raft_consensus.cc:740] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [term 25 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:27:33.954537 14261 raft_consensus.cc:493] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:33.977273  5863 catalog_manager.cc:5697] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 17 to 18, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 18 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:33.984494 14257 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:33.985257 14257 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:33.988277  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 94626.9us
I20260709 12:27:33.999166 14276 tablet_bootstrap.cc:492] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap replayed 1/1 log segments. Stats: ops{read=11 overwritten=0 applied=11 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:27:34.000160 14276 tablet_bootstrap.cc:492] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099: Bootstrap complete.
I20260709 12:27:34.000929 14276 ts_tablet_manager.cc:1403] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099: Time spent bootstrapping tablet: real 0.447s	user 0.034s	sys 0.016s
I20260709 12:27:33.979349 14261 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:34.007731  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bd91034e550f4704be7f47b7aff3ed25" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 12 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:34.008296  6649 raft_consensus.cc:3060] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:34.006209 14286 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.011827 14286 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.013933 14286 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:34.025483  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:34.007515 14227 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.027426 14286 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.028016 14286 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.025170  6649 raft_consensus.cc:2468] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:27:34.033072 14286 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:34.034909 14260 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.044763 14260 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.036854 14250 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.048537 14250 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:34.029716 14227 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.052572 14261 raft_consensus.cc:515] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.040102 14257 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:34.041649  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:34.004153 14278 consensus_queue.cc:260] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 25.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 14 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:27:34.055347  6038 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 11.
I20260709 12:27:34.049860 14260 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:34.052733  6650 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 20.
I20260709 12:27:34.028882 14276 raft_consensus.cc:359] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:27:34.065119 14276 raft_consensus.cc:740] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEARNER]: Becoming Follower/Learner. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Initialized, Role: LEARNER
I20260709 12:27:34.065877 14276 consensus_queue.cc:260] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 11, Last appended: 17.11, Last appended by leader: 11, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 11 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: NON_VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: true } }
I20260709 12:27:34.061678  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:34.063254  6609 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:34.052733 14227 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:34.068576  6115 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 22.
W20260709 12:27:34.070312  6006 leader_election.cc:336] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.074206 14250 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.074862 14250 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.076916 14250 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:34.079406  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:34.079854  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48357.1us
I20260709 12:27:34.082950  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:34.085341 14278 ts_tablet_manager.cc:1434] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.161s	user 0.008s	sys 0.001s
I20260709 12:27:34.084553  6115 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:27:34.083010 14227 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Leader pre-election won for term 12
I20260709 12:27:34.087101 14227 raft_consensus.cc:493] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.087610 14227 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:34.087041 14261 leader_election.cc:290] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:34.089700  6006 leader_election.cc:336] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.091472 14276 ts_tablet_manager.cc:1434] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099: Time spent starting tablet: real 0.090s	user 0.006s	sys 0.004s
I20260709 12:27:34.092259  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4a03c10b4bbc407ebfd96681074ae05b" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 24 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:34.092868  6038 raft_consensus.cc:3060] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:34.099215 14291 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader pre-election won for term 23
I20260709 12:27:34.099776 14291 raft_consensus.cc:493] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.100155 14291 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:34.100417  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:34.101531 14290 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:34.101922 14290 raft_consensus.cc:493] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.102269 14290 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:34.103106  6128 tablet_copy_service.cc:342] P 0069e2ba1f02412e8e1d6c20a1fb510f: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-117509103bb449868a97cf0ba4fdda89 received from {username='slave'} at 127.0.0.1:42484
I20260709 12:27:34.103677  6128 tablet_copy_service.cc:434] P 0069e2ba1f02412e8e1d6c20a1fb510f: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-117509103bb449868a97cf0ba4fdda89 on tablet 117509103bb449868a97cf0ba4fdda89 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:34.106730  6127 tablet_copy_service.cc:342] P 0069e2ba1f02412e8e1d6c20a1fb510f: Request end of tablet copy session 24012af7747d4c4ea89c3da2ff950099-aa90f801f44d4669a2a93aafa33e4e17 received from {username='slave'} at 127.0.0.1:42484
I20260709 12:27:34.107244  6127 tablet_copy_service.cc:434] P 0069e2ba1f02412e8e1d6c20a1fb510f: ending tablet copy session 24012af7747d4c4ea89c3da2ff950099-aa90f801f44d4669a2a93aafa33e4e17 on tablet aa90f801f44d4669a2a93aafa33e4e17 with peer 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:34.120427  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c357e710ee044329b93321405ae76071" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:34.121213  6649 raft_consensus.cc:3060] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:34.129153 14290 raft_consensus.cc:515] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.131407  6038 raft_consensus.cc:2468] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 25.
W20260709 12:27:34.151477  6608 leader_election.cc:336] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.147622 14291 raft_consensus.cc:515] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.155730 14291 leader_election.cc:290] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:34.098771 14227 raft_consensus.cc:515] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.134996  6649 raft_consensus.cc:2468] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:34.139725  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:34.156694 14290 leader_election.cc:290] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:34.159021  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:34.166095  6115 raft_consensus.cc:3060] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Advancing to term 23
I20260709 12:27:34.159324  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4f2d24cb0978411e851e8ff35955bf2e" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:34.166738  6114 raft_consensus.cc:3060] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:34.142135 14261 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.170397 14261 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.171535  6113 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 24.
I20260709 12:27:34.172753 14261 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:34.136093  6081 leader_election.cc:336] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:34.177759  6081 leader_election.cc:336] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.161072  6082 leader_election.cc:304] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:27:34.188900  6081 leader_election.cc:336] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.189817 14288 raft_consensus.cc:2804] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:27:34.190541 14288 raft_consensus.cc:697] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:34.191493 14288 consensus_queue.cc:237] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 24.15, Last appended by leader: 15, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.192407  6115 raft_consensus.cc:2468] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 23.
W20260709 12:27:34.190408  6081 leader_election.cc:336] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:34.193707  6081 leader_election.cc:336] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.185091  6114 raft_consensus.cc:2468] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 21.
I20260709 12:27:34.186687 14259 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:27:34.202147  6608 leader_election.cc:336] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.203269 14259 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:34.203586  6608 leader_election.cc:336] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:34.175969  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 151049us
I20260709 12:27:34.205605 14259 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:34.208096  6649 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a0acc59e2e4d43029c959c64a291c5a0" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 23 candidate_status { last_received { term: 22 index: 18 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:34.208914  6649 raft_consensus.cc:2393] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 23: Already voted for candidate 24012af7747d4c4ea89c3da2ff950099 in this term.
W20260709 12:27:34.218952  6006 leader_election.cc:336] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:34.219947  6608 leader_election.cc:336] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:34.220556  6608 leader_election.cc:336] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.228796  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
W20260709 12:27:34.229246  6081 leader_election.cc:336] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.229496  6040 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 24.
I20260709 12:27:34.242933  6084 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.244156  6084 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.245429 14286 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.245549  6084 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 24012af7747d4c4ea89c3da2ff950099, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.245996 14286 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.247140 14289 raft_consensus.cc:2804] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:34.247710 14289 raft_consensus.cc:697] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:34.248222 14286 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:34.248781 14286 raft_consensus.cc:2764] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election decision vote started in defunct term 20: won
I20260709 12:27:34.248545 14289 consensus_queue.cc:237] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 15.12, Last appended by leader: 12, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.251374  6009 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.251976  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.252727 14286 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.253952 14286 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.255185 14261 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:34.255636 14261 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.256031 14261 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:34.256179 14286 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:34.258428  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "cf28639931bb43a58703f0afd043e166" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 12 candidate_status { last_received { term: 11 index: 11 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:34.259091  6040 raft_consensus.cc:3060] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 11 FOLLOWER]: Advancing to term 12
I20260709 12:27:34.253539  6611 leader_election.cc:304] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:34.262802 14250 raft_consensus.cc:2804] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:34.263597 14294 raft_consensus.cc:2804] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader election won for term 23
I20260709 12:27:34.264325 14294 raft_consensus.cc:697] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 23 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:34.265168 14294 consensus_queue.cc:237] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 22.18, Last appended by leader: 18, Current term: 23, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:34.269207  6608 leader_election.cc:336] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.268757  6611 leader_election.cc:304] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.272274  6009 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.275230 14250 raft_consensus.cc:697] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:34.281623  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:34.281620 14290 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.262027 14227 leader_election.cc:290] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:34.286018 14290 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.286104 14260 raft_consensus.cc:2804] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:27:34.287745 14260 raft_consensus.cc:697] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:34.287833  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:34.288276 14290 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:34.288640 14260 consensus_queue.cc:237] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.289858  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:34.293274  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:34.293711  6040 raft_consensus.cc:2468] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 12.
I20260709 12:27:34.294945  6609 leader_election.cc:304] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 12 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.295965 14257 raft_consensus.cc:2804] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Leader election won for term 12
I20260709 12:27:34.296479 14257 raft_consensus.cc:697] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:34.270843 14296 raft_consensus.cc:2749] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:34.297360 14257 consensus_queue.cc:237] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 11.11, Last appended by leader: 11, Current term: 12, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.283648  5861 catalog_manager.cc:5697] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 24 to 25, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 25 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:34.282979 14250 consensus_queue.cc:237] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.304989 14249 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:34.309104 14249 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.309526 14249 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:34.328027  6009 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.328766 14303 raft_consensus.cc:2749] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:27:34.336169  6608 leader_election.cc:336] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.336360 14290 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.337005 14290 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.339159 14290 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:34.342118  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:34.336707  6608 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.346659 14249 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.348785 14249 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:34.350687 14261 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:34.360703  6081 leader_election.cc:336] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.361274  6081 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.362782  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:34.363600  6114 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 25: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:34.354707 14291 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:34.371096 14261 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:34.383114  6113 raft_consensus.cc:1275] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 18 index: 12. (index mismatch)
I20260709 12:27:34.370333 14270 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.386672 14270 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.388824 14270 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:34.392488 14249 consensus_queue.cc:1048] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.000s
W20260709 12:27:34.395046  6006 leader_election.cc:336] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.395768  6006 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.397317  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:34.397696 14249 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:27:34.404817  6040 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:34.407171  6038 raft_consensus.cc:2393] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 25: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
W20260709 12:27:34.412878  6006 consensus_peers.cc:597] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:34.419654  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 58988.9us
W20260709 12:27:34.422658  6081 leader_election.cc:336] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.428539 14299 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:34.429885 14239 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.430409 14239 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.423198  6081 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:34.421007  6608 leader_election.cc:336] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.433681  6608 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.435962 14239 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:34.438130  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:34.437234  5861 catalog_manager.cc:5697] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 19 to 20, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 20 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:34.471421  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 48782us
I20260709 12:27:34.453892 14294 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:34.466590 14303 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.474781 14303 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.475385 14300 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.475937 14300 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.477173 14303 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:34.478607 14300 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:34.480033  6608 consensus_peers.cc:597] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:34.471860  5863 catalog_manager.cc:5697] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 22 to 23, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 23 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:34.488250  6006 leader_election.cc:336] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.493155  6650 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:34.511477 14239 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.512113 14239 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.515738 14239 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:34.488227 14289 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:34.534333  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:34.535085  6118 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 18.
I20260709 12:27:34.542431  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
W20260709 12:27:34.539422  6084 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 57079.9us
I20260709 12:27:34.543165  6118 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:27:34.556828  6009 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.536403 14303 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.539389 14270 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:27:34.564816  4821 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 5989)
I20260709 12:27:34.565222  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:34.565958  6038 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
I20260709 12:27:34.563985 14239 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:34.566362 14270 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.565984 14303 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.573100 14239 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.603855  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
W20260709 12:27:34.616797  6006 leader_election.cc:336] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.620936 14303 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:34.610663 14239 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:34.624132 14296 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:34.624720 14296 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.625145 14296 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:34.616046 14270 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:34.627689 14305 log.cc:927] Time spent T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: Append to log took a long time: real 0.159s	user 0.001s	sys 0.000s
W20260709 12:27:34.632830  6006 leader_election.cc:336] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.636901  6038 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c" is_pre_election: true
I20260709 12:27:34.637602  6038 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 18.
W20260709 12:27:34.641746  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 48305.5us
I20260709 12:27:34.639650  6644 raft_consensus.cc:1217] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEARNER]: Deduplicated request from leader. Original: 17.10->[17.11-17.11]   Dedup: 17.11->[]
I20260709 12:27:34.642891  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:34.648166 14259 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.654700  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:34.655687  6609 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:45473, user_credentials={real_user=slave}} blocked reactor thread for 110935us
I20260709 12:27:34.658512  6009 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.651754 14259 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.657306 14249 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:34.662998 14249 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.663450 14249 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:34.663784 14259 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:34.665925 14304 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:34.666317 14304 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.666750 14304 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Advancing to term 22
I20260709 12:27:34.662326 14311 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election won for term 19
I20260709 12:27:34.667331 14311 raft_consensus.cc:493] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.667737 14311 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:34.674763 14304 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.677135 14304 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:34.686884  6006 consensus_peers.cc:597] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:34.687369  6006 leader_election.cc:336] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.687860  6646 raft_consensus.cc:1217] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [term 25 LEARNER]: Deduplicated request from leader. Original: 25.13->[25.14-25.14]   Dedup: 25.14->[]
I20260709 12:27:34.689872  6115 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:34.690548  6115 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
I20260709 12:27:34.688174  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:34.693779  6038 raft_consensus.cc:1275] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 24 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:27:34.691730  6644 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 24.
I20260709 12:27:34.696625 14239 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.698372  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "68476262e38a4c15a51c80b96e7d58a6" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 22 candidate_status { last_received { term: 21 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:34.702569  6114 raft_consensus.cc:3060] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:27:34.699141  6006 leader_election.cc:336] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:34.703430  6006 leader_election.cc:336] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.705080 14261 consensus_queue.cc:1048] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:34.710244  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.702819 14304 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Starting pre-election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
W20260709 12:27:34.732707  6006 consensus_peers.cc:597] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:34.723541 14304 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:34.737345  6608 consensus_peers.cc:597] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:34.737438 14304 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:34.741197  6608 consensus_peers.cc:597] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:34.742422  6006 leader_election.cc:336] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.742950 14249 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.745623  6114 raft_consensus.cc:2468] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 22.
I20260709 12:27:34.702119 14296 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.744966 14249 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:34.765221  6006 leader_election.cc:336] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.716646 14259 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:34.765481 14311 raft_consensus.cc:515] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.766363 14259 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.766863 14259 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:34.768224 14311 leader_election.cc:290] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:34.768915  6081 leader_election.cc:336] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:34.771382  6081 leader_election.cc:336] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.771796  6081 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:34.772747  6081 leader_election.cc:336] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.773118  6081 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:34.774250  6081 leader_election.cc:336] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.776001 14300 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Leader election lost for term 25. Reason: could not achieve majority
I20260709 12:27:34.776678 14300 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:34.777071 14259 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.779376 14259 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:34.778259 14296 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:34.782825  6006 leader_election.cc:336] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:34.800554  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:45477, user_credentials={real_user=slave}} blocked reactor thread for 86006.3us
I20260709 12:27:34.801298  5861 catalog_manager.cc:5697] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 15 to 16, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 16 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:34.812342 14239 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:34.813249  6081 consensus_peers.cc:597] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:34.813753  6081 consensus_peers.cc:597] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:34.821017  6608 consensus_peers.cc:597] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:34.826167  6608 consensus_peers.cc:597] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:34.826735  6608 consensus_peers.cc:597] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:34.827263  6608 consensus_peers.cc:597] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:34.827476  6081 leader_election.cc:336] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:34.828020  6081 leader_election.cc:336] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.830086  5863 catalog_manager.cc:5697] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 20 to 21, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 21 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:34.832094  5863 catalog_manager.cc:5697] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 11 to 12, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 12 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:34.833386  6608 consensus_peers.cc:597] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:34.840750  6009 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.845440  6042 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:34.846233  6042 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0069e2ba1f02412e8e1d6c20a1fb510f in current term 19: Already voted for candidate 0557a7246c8945b99e5215c99d4ddf9c in this term.
I20260709 12:27:34.846339  6644 raft_consensus.cc:1275] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 12. Preceding OpId from leader: term: 16 index: 13. (index mismatch)
I20260709 12:27:34.847868 14311 consensus_queue.cc:1048] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
I20260709 12:27:34.855271 14319 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:34.855718  6114 raft_consensus.cc:1275] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 22 index: 18. Preceding OpId from leader: term: 23 index: 19. (index mismatch)
I20260709 12:27:34.855784 14319 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.857311 14319 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:34.858932  6037 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "06e81868728a4e2592f3ee289cff3431" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0557a7246c8945b99e5215c99d4ddf9c"
I20260709 12:27:34.859513  6037 raft_consensus.cc:3060] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Advancing to term 19
I20260709 12:27:34.857323 14260 consensus_queue.cc:1048] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.005s
I20260709 12:27:34.864480  6009 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.869133 14320 raft_consensus.cc:2804] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Leader election won for term 22
I20260709 12:27:34.870180 14320 raft_consensus.cc:697] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:34.871096 14320 consensus_queue.cc:237] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 21.13, Last appended by leader: 13, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:34.862620  6608 consensus_peers.cc:597] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:34.875313  6037 raft_consensus.cc:2468] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 19.
I20260709 12:27:34.882560 14319 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.884719 14319 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:34.886677  6608 consensus_peers.cc:597] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:34.896049  6040 raft_consensus.cc:1275] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 11 index: 11. Preceding OpId from leader: term: 12 index: 12. (index mismatch)
I20260709 12:27:34.897114  6114 raft_consensus.cc:1275] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:27:34.897854 14314 consensus_queue.cc:1048] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.001s
I20260709 12:27:34.899876 14314 consensus_queue.cc:1048] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:34.908411  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:34.909126  6114 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 27.
I20260709 12:27:34.911387  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 19 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:34.912169  6114 raft_consensus.cc:2393] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election vote request: Denying vote to candidate 0557a7246c8945b99e5215c99d4ddf9c in current term 19: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
W20260709 12:27:34.912896  6081 consensus_peers.cc:597] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:34.914556  6646 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0636290fb57e4842995ddf9549f0c721" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:34.915132  6646 raft_consensus.cc:3060] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Advancing to term 25
I20260709 12:27:34.915592  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c087bb99e3b64274863f583bf7ae435f" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 21 candidate_status { last_received { term: 20 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:34.916216  6650 raft_consensus.cc:3060] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:34.917949  6645 raft_consensus.cc:1275] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:27:34.924204  6646 raft_consensus.cc:2468] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 25.
I20260709 12:27:34.928136  6650 raft_consensus.cc:2468] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 21.
I20260709 12:27:34.936610  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "465414d7b00f409684b7f69cfbcfad77" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:34.937225  6113 raft_consensus.cc:3060] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:27:34.938925  6081 consensus_peers.cc:597] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:34.943578  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:34.949659  6081 consensus_peers.cc:597] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:34.946297  6113 raft_consensus.cc:2468] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:34.950343  6009 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:34.952376  6009 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099; no voters: f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:34.955668  6006 leader_election.cc:336] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:34.962447 14287 raft_consensus.cc:2804] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:27:34.955504  6082 leader_election.cc:304] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.963251 14287 raft_consensus.cc:697] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:34.965152 14316 raft_consensus.cc:2804] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election won for term 19
I20260709 12:27:34.964943 14287 consensus_queue.cc:237] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:34.965765 14316 raft_consensus.cc:697] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:34.966734 14316 consensus_queue.cc:237] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 19, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:34.963161  6009 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:34.955858 14320 consensus_queue.cc:1048] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.018s
I20260709 12:27:34.953945 14311 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:27:34.986510 14250 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:34.986967 14250 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Starting leader election (detected failure of leader f1bb8e63c2b448cdafd51f05d277c741)
I20260709 12:27:34.987353 14250 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Advancing to term 28
W20260709 12:27:35.010941  6009 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 47862.2us
I20260709 12:27:35.011209 14309 raft_consensus.cc:1064] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:27:35.011740  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 19 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:35.016810  6006 consensus_peers.cc:597] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:35.017326  6006 consensus_peers.cc:597] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:34.954751 14319 raft_consensus.cc:2804] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Leader election won for term 21
W20260709 12:27:35.019819  6006 leader_election.cc:336] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:35.020367  6006 consensus_peers.cc:597] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:35.023046  6009 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:35.021391 14239 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader election lost for term 19. Reason: could not achieve majority
I20260709 12:27:35.036487 14303 raft_consensus.cc:2804] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:35.037005 14303 raft_consensus.cc:697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:35.037846 14303 consensus_queue.cc:237] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:35.013921 14309 consensus_queue.cc:237] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 11, Committed index: 11, Last appended: 17.11, Last appended by leader: 9, Current term: 17, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:35.047674  6081 consensus_peers.cc:597] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:35.048136  6081 consensus_peers.cc:597] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:35.063115  6608 consensus_peers.cc:597] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:35.027448 14319 raft_consensus.cc:697] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:35.010351 14250 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 28 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:35.079879 14270 raft_consensus.cc:1064] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: attempting to promote NON_VOTER 24012af7747d4c4ea89c3da2ff950099 to VOTER
I20260709 12:27:35.072618 14319 consensus_queue.cc:237] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 20.15, Last appended by leader: 15, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:35.084529 14270 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 25.14, Last appended by leader: 12, Current term: 25, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:35.088018 14250 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 28 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:35.101392  6081 consensus_peers.cc:597] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:35.102046  6081 consensus_peers.cc:597] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:35.102429  6081 consensus_peers.cc:597] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:35.111389  6646 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:27:35.122639 14309 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.018s
I20260709 12:27:35.150743  5863 catalog_manager.cc:5697] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 18 to 19, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 19 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } }
W20260709 12:27:35.155637  6081 consensus_peers.cc:597] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:35.173995  6006 leader_election.cc:336] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:35.190652  6081 consensus_peers.cc:597] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:35.192497  6037 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:27:35.192714  6042 raft_consensus.cc:1275] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 17 index: 11. Preceding OpId from leader: term: 17 index: 12. (index mismatch)
I20260709 12:27:35.203756  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d61b6b50d6746189e849070b208d9a5" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 28 candidate_status { last_received { term: 27 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:35.204380  6113 raft_consensus.cc:3060] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:35.204610 14288 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.004s
I20260709 12:27:35.205444  6645 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [term 25 LEARNER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 25 index: 14. Preceding OpId from leader: term: 25 index: 15. (index mismatch)
I20260709 12:27:35.209802 14316 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.000s
W20260709 12:27:35.211805  6006 consensus_peers.cc:597] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:35.215808  6113 raft_consensus.cc:2468] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 28.
I20260709 12:27:35.203809 14309 consensus_queue.cc:1048] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 12, Last known committed idx: 11, Time since last communication: 0.014s
I20260709 12:27:35.221858  5861 catalog_manager.cc:5697] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 21 to 22, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 22 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:35.223747  5861 catalog_manager.cc:5697] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 24 to 25, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 25 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:35.238152  6081 consensus_peers.cc:597] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:35.242028  6081 consensus_peers.cc:597] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:35.246796  6009 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:35.247685 14338 raft_consensus.cc:2804] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:27:35.248383 14338 raft_consensus.cc:697] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 28 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:35.249270 14338 consensus_queue.cc:237] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 27.13, Last appended by leader: 13, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:35.260561  6006 consensus_peers.cc:597] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:35.295711  6608 consensus_peers.cc:597] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:35.309012 14316 raft_consensus.cc:2955] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 LEADER]: Committing config change with OpId 25.15: config changed from index 14 to 15, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:35.322893 14286 raft_consensus.cc:2955] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:27:35.333940  6081 consensus_peers.cc:597] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:35.328572  5861 catalog_manager.cc:5697] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 19 to 20, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 20 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:35.341457  5861 catalog_manager.cc:5697] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 20 to 21, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 21 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:35.344515  5861 catalog_manager.cc:5697] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 27 to 28, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 28 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:35.346145  6645 raft_consensus.cc:2955] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:27:35.361898  6006 consensus_peers.cc:597] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:35.385535  6035 raft_consensus.cc:2955] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Committing config change with OpId 25.15: config changed from index 14 to 15, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:35.389261  5866 catalog_manager.cc:5697] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: config changed from index 11 to 12, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 17 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:35.400046  6037 raft_consensus.cc:2955] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Committing config change with OpId 17.12: config changed from index 11 to 12, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:35.397850  6645 raft_consensus.cc:2955] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Committing config change with OpId 25.15: config changed from index 14 to 15, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New config: { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:35.415380  6118 raft_consensus.cc:1275] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 21 index: 13. Preceding OpId from leader: term: 22 index: 14. (index mismatch)
W20260709 12:27:35.417979  6608 consensus_peers.cc:597] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:35.418622 14320 consensus_queue.cc:1048] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:35.455305  6037 raft_consensus.cc:1275] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 19 index: 13. (index mismatch)
I20260709 12:27:35.457435 14316 consensus_queue.cc:1048] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260709 12:27:35.489305  6081 consensus_peers.cc:597] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:35.494299  5861 catalog_manager.cc:5697] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: config changed from index 14 to 15, 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68) changed from NON_VOTER to VOTER. New cstate: current_term: 25 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:35.523098  6006 consensus_peers.cc:597] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:35.530359  6006 consensus_peers.cc:597] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:35.537442  6006 consensus_peers.cc:597] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:35.565277  4821 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 5989)
I20260709 12:27:35.569272  6114 consensus_queue.cc:237] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 25.15, Last appended by leader: 12, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:35.576153  6645 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:27:35.585251 14316 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.008s
I20260709 12:27:35.602413  6646 raft_consensus.cc:1275] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
I20260709 12:27:35.602413  6649 raft_consensus.cc:1275] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 20 index: 15. Preceding OpId from leader: term: 21 index: 16. (index mismatch)
I20260709 12:27:35.604717 14239 consensus_queue.cc:1048] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
I20260709 12:27:35.605623 14303 consensus_queue.cc:1048] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:27:35.606988  6608 consensus_peers.cc:597] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:35.616318  6114 raft_consensus.cc:1275] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:27:35.626101 14270 raft_consensus.cc:2955] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 LEADER]: Committing config change with OpId 25.16: config changed from index 15 to 16, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:35.630118  6037 raft_consensus.cc:1275] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 25 index: 15. Preceding OpId from leader: term: 25 index: 16. (index mismatch)
I20260709 12:27:35.631954  6645 raft_consensus.cc:2955] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 15 to 16, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:35.641491 14316 consensus_queue.cc:1048] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
W20260709 12:27:35.648911  6006 consensus_peers.cc:597] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:35.650914  6037 raft_consensus.cc:2955] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Committing config change with OpId 25.16: config changed from index 15 to 16, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New config: { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
I20260709 12:27:35.659013 14250 consensus_queue.cc:1048] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:35.721782  5853 catalog_manager.cc:5210] ChangeConfig:REMOVE_PEER RPC for tablet aa90f801f44d4669a2a93aafa33e4e17 with cas_config_opid_index 15: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20260709 12:27:35.790774  5861 catalog_manager.cc:5697] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: config changed from index 15 to 16, VOTER f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) evicted. New cstate: current_term: 25 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } } }
W20260709 12:27:35.801790  6006 consensus_peers.cc:597] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:35.915030  6113 raft_consensus.cc:1275] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 28 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 27 index: 13. Preceding OpId from leader: term: 28 index: 14. (index mismatch)
I20260709 12:27:35.930655 14250 consensus_queue.cc:1048] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
I20260709 12:27:36.010202 14338 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.011271 14338 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:36.010100  5850 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 57284.3us
I20260709 12:27:36.013396 14338 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:36.017577  6118 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:36.018342  6118 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 25.
I20260709 12:27:36.021579  6009 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:36.026753 14287 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Leader pre-election won for term 26
I20260709 12:27:36.028272 14287 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.033363 14287 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Advancing to term 26
W20260709 12:27:36.041666  6006 leader_election.cc:336] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:36.043633  5850 catalog_manager.cc:4755] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet aa90f801f44d4669a2a93aafa33e4e17: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:36.049046 14287 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:36.051370 14287 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:36.058300  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42702625c5a04990a24ae81a2dede920" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 24 index: 13 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
W20260709 12:27:36.059667  6006 leader_election.cc:336] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:36.086148  6114 raft_consensus.cc:3060] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Advancing to term 26
I20260709 12:27:36.095016  6114 raft_consensus.cc:2468] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 26.
I20260709 12:27:36.096309  6009 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:36.098289 14338 raft_consensus.cc:2804] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Leader election won for term 26
I20260709 12:27:36.098840 14338 raft_consensus.cc:697] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:36.099718 14338 consensus_queue.cc:237] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 13, Committed index: 13, Last appended: 24.13, Last appended by leader: 13, Current term: 26, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:36.132694  5861 catalog_manager.cc:5697] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 24 to 26, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 26 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:36.513561  6114 raft_consensus.cc:1275] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 24 index: 13. Preceding OpId from leader: term: 26 index: 14. (index mismatch)
I20260709 12:27:36.515429 14287 consensus_queue.cc:1048] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 14, Last known committed idx: 13, Time since last communication: 0.000s
W20260709 12:27:36.565809  4821 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 5989)
W20260709 12:27:36.644302  6006 consensus_peers.cc:597] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:36.890517  6608 consensus_peers.cc:597] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:36.931505  6608 consensus_peers.cc:597] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:36.934178  6081 consensus_peers.cc:597] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:36.954730 14338 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:36.955307 14338 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:36.957362 14338 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:36.965430  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:36.966128  6114 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 19.
W20260709 12:27:36.968051  6006 leader_election.cc:336] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:36.977640  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:36.981920 14303 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:36.982370 14303 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:36.982707 14303 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:27:36.997328  6608 consensus_peers.cc:597] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.011583  6081 consensus_peers.cc:597] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.018617  6006 consensus_peers.cc:597] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:37.061249 14303 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:37.076597 14303 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Requested vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:37.088651  6608 consensus_peers.cc:597] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:37.094901  6114 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "07996c0296b04a39b1b151e8885389e2" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 20 candidate_status { last_received { term: 18 index: 12 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:37.099393  6114 raft_consensus.cc:3060] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
W20260709 12:27:37.097903  6006 consensus_peers.cc:597] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.096241  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 45904.4us
W20260709 12:27:37.155330  6081 consensus_peers.cc:597] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:37.163329  6114 raft_consensus.cc:2468] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0557a7246c8945b99e5215c99d4ddf9c in term 20.
I20260709 12:27:37.180315  6009 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c; no voters: 
I20260709 12:27:37.192498 14303 raft_consensus.cc:2804] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:37.193171 14303 raft_consensus.cc:697] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Becoming Leader. State: Replica: 0557a7246c8945b99e5215c99d4ddf9c, State: Running, Role: LEADER
I20260709 12:27:37.194315 14303 consensus_queue.cc:237] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 18.12, Last appended by leader: 12, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:37.232263  6081 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111) [suppressed 425 similar messages]
W20260709 12:27:37.234933  6081 consensus_peers.cc:597] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.252264  6608 consensus_peers.cc:597] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:37.295884  6608 consensus_peers.cc:597] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:37.306080  6081 consensus_peers.cc:597] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:37.309129  6006 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 57953.7us
W20260709 12:27:37.319097  5850 catalog_manager.cc:4755] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet aa90f801f44d4669a2a93aafa33e4e17: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:37.330349  6081 consensus_peers.cc:597] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.345970  6608 consensus_peers.cc:597] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.350677  6006 leader_election.cc:336] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:37.374338  6608 consensus_peers.cc:597] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:37.400272  5861 catalog_manager.cc:5697] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c reported cstate change: term changed from 18 to 20, leader changed from f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65) to 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66). New cstate: current_term: 20 leader_uuid: "0557a7246c8945b99e5215c99d4ddf9c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:37.424075  6608 consensus_peers.cc:597] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.452061  6006 consensus_peers.cc:597] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.453043  6006 consensus_peers.cc:597] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.453763  6006 consensus_peers.cc:597] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:37.476634  6081 consensus_peers.cc:597] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.500813  6006 consensus_peers.cc:597] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.549495  6081 consensus_peers.cc:597] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.563549  6608 consensus_peers.cc:597] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.566323  4821 thread.cc:527] Waited for 4000ms trying to join with diag-logger (tid 5989)
W20260709 12:27:37.595661  6608 consensus_peers.cc:597] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.613912  6081 consensus_peers.cc:597] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.630033  6006 consensus_peers.cc:597] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.642308  6081 consensus_peers.cc:597] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:37.664582  6081 consensus_peers.cc:597] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.667625  6081 consensus_peers.cc:597] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:37.714331  6081 consensus_peers.cc:597] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.790545  6006 consensus_peers.cc:597] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:37.813949  6608 consensus_peers.cc:597] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:37.817265  6114 raft_consensus.cc:1275] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer 0557a7246c8945b99e5215c99d4ddf9c: Log matching property violated. Preceding OpId in replica: term: 18 index: 12. Preceding OpId from leader: term: 20 index: 13. (index mismatch)
I20260709 12:27:37.821141 14239 consensus_queue.cc:1048] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.004s
W20260709 12:27:37.851418  6006 consensus_peers.cc:597] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.857430  6608 consensus_peers.cc:597] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.899726  6081 consensus_peers.cc:597] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.962095  6006 consensus_peers.cc:597] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:37.970747  6081 consensus_peers.cc:597] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:37.998817  6006 consensus_peers.cc:597] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:38.032531  6006 consensus_peers.cc:597] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:38.069192  6608 consensus_peers.cc:597] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:38.259752  6006 consensus_peers.cc:597] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:38.264475  6006 consensus_peers.cc:597] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:38.424424  5850 catalog_manager.cc:4755] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet aa90f801f44d4669a2a93aafa33e4e17: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:38.636029  4821 thread.cc:527] Waited for 5000ms trying to join with diag-logger (tid 5989)
W20260709 12:27:39.316562  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 139200us
I20260709 12:27:39.357607 14393 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:39.358729 14393 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:39.362031 14393 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:39.419586  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:39.433836  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "aa90f801f44d4669a2a93aafa33e4e17" candidate_uuid: "0557a7246c8945b99e5215c99d4ddf9c" candidate_term: 26 candidate_status { last_received { term: 25 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:39.440068  6081 consensus_peers.cc:597] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:39.472736  6006 consensus_peers.cc:597] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:39.485426  6009 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0557a7246c8945b99e5215c99d4ddf9c; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:39.495739 14394 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:27:39.528151  6081 consensus_peers.cc:597] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:39.557386  6081 consensus_peers.cc:597] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:39.600916  6081 consensus_peers.cc:597] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:39.641177  6608 consensus_peers.cc:597] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:39.646533  4821 thread.cc:527] Waited for 6000ms trying to join with diag-logger (tid 5989)
W20260709 12:27:39.713107  6608 consensus_peers.cc:597] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:39.728826  6608 consensus_peers.cc:597] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:39.808403  6608 consensus_peers.cc:597] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:39.824330  6006 consensus_peers.cc:597] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:39.841298  6608 consensus_peers.cc:597] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:39.848630  6608 consensus_peers.cc:597] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:39.942266  6608 consensus_peers.cc:597] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:39.963995  6081 consensus_peers.cc:597] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:40.023228  6006 consensus_peers.cc:597] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.063508  6065 debug-util.cc:398] Leaking SignalData structure 0x7b08001d29e0 after lost signal to thread 4824
W20260709 12:27:40.064728  6065 debug-util.cc:398] Leaking SignalData structure 0x7b08003bc920 after lost signal to thread 5900
W20260709 12:27:40.066079  6065 debug-util.cc:398] Leaking SignalData structure 0x7b0800320280 after lost signal to thread 6068
W20260709 12:27:40.067373  6065 debug-util.cc:398] Leaking SignalData structure 0x7b080027c6e0 after lost signal to thread 6142
W20260709 12:27:40.068675  6065 debug-util.cc:398] Leaking SignalData structure 0x7b080038a680 after lost signal to thread 6675
W20260709 12:27:40.069249  6065 debug-util.cc:398] Leaking SignalData structure 0x7b080022cf40 after lost signal to thread 14336
W20260709 12:27:40.069502  6065 debug-util.cc:398] Leaking SignalData structure 0x7b08002fff40 after lost signal to thread 14359
W20260709 12:27:40.069796  6065 debug-util.cc:398] Leaking SignalData structure 0x7b0800209840 after lost signal to thread 14374
W20260709 12:27:40.082697  6608 consensus_peers.cc:597] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.090651  6081 consensus_peers.cc:597] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.123169  6081 consensus_peers.cc:597] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.175659  6081 consensus_peers.cc:597] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:40.207319  6081 consensus_peers.cc:597] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.239754  6608 consensus_peers.cc:597] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.268196  6006 consensus_peers.cc:597] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.287300  6006 consensus_peers.cc:597] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:40.307400  6608 consensus_peers.cc:597] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.360050  6006 consensus_peers.cc:597] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.361464  6081 consensus_peers.cc:597] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:40.408613  6006 consensus_peers.cc:597] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:40.439495  6608 consensus_peers.cc:597] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.457753  6081 consensus_peers.cc:597] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.458542  6081 consensus_peers.cc:597] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.493266  6081 consensus_peers.cc:597] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.529601  5850 catalog_manager.cc:4755] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet aa90f801f44d4669a2a93aafa33e4e17: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:40.594938  6006 consensus_peers.cc:597] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.627074  6608 consensus_peers.cc:597] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.667735  6006 consensus_peers.cc:597] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:40.741009  6006 consensus_peers.cc:597] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.769065  6608 consensus_peers.cc:597] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.832917  6081 consensus_peers.cc:597] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.874612  6006 consensus_peers.cc:597] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:40.879081  6081 consensus_peers.cc:597] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.894639  6608 consensus_peers.cc:597] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:40.999995  6006 consensus_peers.cc:597] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:41.585520  4821 tablet_server.cc:196] TabletServer@127.4.181.65:0 shutdown complete.
W20260709 12:27:41.737682  6611 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:39787, user_credentials={real_user=slave}} blocked reactor thread for 48398.1us
W20260709 12:27:42.028631  6081 consensus_peers.cc:597] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:42.058296  6081 consensus_peers.cc:597] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:42.062188  4821 tablet_server.cc:179] TabletServer@127.4.181.66:0 shutting down...
W20260709 12:27:42.068172  6608 consensus_peers.cc:597] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:42.085240  6082 consensus_peers.cc:597] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.086086  6082 consensus_peers.cc:597] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.102967  6609 consensus_peers.cc:597] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.114069  6082 consensus_peers.cc:597] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.147655  6081 consensus_peers.cc:597] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:42.149094  6609 consensus_peers.cc:597] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.153280  6608 consensus_peers.cc:597] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:42.169513  6609 consensus_peers.cc:597] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.175040  6609 consensus_peers.cc:597] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.204772  6081 consensus_peers.cc:597] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:42.235858  6608 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111) [suppressed 396 similar messages]
W20260709 12:27:42.239354  6608 consensus_peers.cc:597] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:42.253400  6609 consensus_peers.cc:597] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.271086  6608 consensus_peers.cc:597] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:42.306682  6081 consensus_peers.cc:597] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:42.308344  6006 consensus_peers.cc:597] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:42.309273  6006 consensus_peers.cc:597] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:42.310146  6006 consensus_peers.cc:597] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:42.314127  6006 consensus_peers.cc:597] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:42.314945  6006 consensus_peers.cc:597] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:42.326061  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:42.328188  4821 tablet_replica.cc:333] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.329487  4821 raft_consensus.cc:2243] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.330888  4821 raft_consensus.cc:2272] T adcfbfcb66fd4891959337c005335841 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:42.334285  6608 consensus_peers.cc:597] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:42.334316  4821 tablet_replica.cc:333] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.339365  4821 raft_consensus.cc:2243] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 23 LEADER]: Raft consensus shutting down.
W20260709 12:27:42.361582  6082 consensus_peers.cc:597] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.362875  6082 consensus_peers.cc:597] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:42.365061  4821 raft_consensus.cc:2272] T 22f53da618b548f89206b5390bbf5aec P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:42.373620  6082 consensus_peers.cc:597] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.374298  6082 consensus_peers.cc:597] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.375159  6082 consensus_peers.cc:597] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:42.377949  4821 tablet_replica.cc:333] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
W20260709 12:27:42.378978  6082 consensus_peers.cc:597] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:42.379878  4821 raft_consensus.cc:2243] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.382216  4821 raft_consensus.cc:2272] T 12ca0d61cb524660bae3b43f9f1c5389 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:42.388278  6608 consensus_peers.cc:597] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:42.404445  6609 consensus_peers.cc:597] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.408064  6609 consensus_peers.cc:597] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:42.408583  4821 tablet_replica.cc:333] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
W20260709 12:27:42.410205  6082 consensus_peers.cc:597] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:42.411731  4821 raft_consensus.cc:2243] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.412591  4821 raft_consensus.cc:2272] T 02dd5c8c15e34ecfbc46620193fb5762 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.415478  4821 tablet_replica.cc:333] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.416347  4821 raft_consensus.cc:2243] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.417070  4821 raft_consensus.cc:2272] T 1c1322bdafce4b389254f08a59254d2e P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.419973  4821 tablet_replica.cc:333] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.420912  4821 raft_consensus.cc:2243] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.422367  4821 raft_consensus.cc:2272] T cc2b965a354c426fb89e1a743dccd273 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.425486  4821 tablet_replica.cc:333] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.426334  4821 raft_consensus.cc:2243] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.427467  4821 raft_consensus.cc:2272] T 5744a277c5a3409b95831573168daf3f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.430356  4821 tablet_replica.cc:333] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.438922  4821 raft_consensus.cc:2243] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.441321  4821 raft_consensus.cc:2272] T cf28639931bb43a58703f0afd043e166 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.452421  4821 tablet_replica.cc:333] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.467638  4821 raft_consensus.cc:2243] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.482151  4821 raft_consensus.cc:2272] T 1956c0a3a799470a83a524ca2ae0ce14 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:42.485423  6082 consensus_peers.cc:597] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.491304  6608 consensus_peers.cc:597] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:42.495213  4821 tablet_replica.cc:333] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.500154  4821 raft_consensus.cc:2243] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Raft consensus shutting down.
W20260709 12:27:42.505149  6082 consensus_peers.cc:597] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.512185  6082 consensus_peers.cc:597] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.509850  6081 consensus_peers.cc:597] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:42.509269  6609 consensus_peers.cc:597] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:42.507628  4821 raft_consensus.cc:2272] T a0b00ef9114f441baff2557bc164b4d7 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:42.525563  6081 consensus_peers.cc:597] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:42.527026  4821 tablet_replica.cc:333] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.528126  4821 raft_consensus.cc:2243] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.529340  4821 raft_consensus.cc:2272] T 3fd6047b66ab4b4abc3fe659e8cff000 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.533118  4821 tablet_replica.cc:333] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.536947  4821 raft_consensus.cc:2243] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.538714  4821 raft_consensus.cc:2272] T 42702625c5a04990a24ae81a2dede920 P 0557a7246c8945b99e5215c99d4ddf9c [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.550242  4821 tablet_replica.cc:333] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.552531  4821 raft_consensus.cc:2243] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.555452  4821 raft_consensus.cc:2272] T a1138b447c084c17ab4b465255e54118 P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.562613  4821 tablet_replica.cc:333] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.563560  4821 raft_consensus.cc:2243] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.572758  4821 raft_consensus.cc:2272] T c357e710ee044329b93321405ae76071 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:42.576048  6082 consensus_peers.cc:597] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:42.586809  6608 consensus_peers.cc:597] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:42.591550  4821 tablet_replica.cc:333] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.592522  4821 raft_consensus.cc:2243] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.593672  4821 raft_consensus.cc:2272] T cbdceec3ce444e7b812ac717eafb85ee P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.596709  4821 tablet_replica.cc:333] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.597473  4821 raft_consensus.cc:2243] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.598242  4821 raft_consensus.cc:2272] T 35f225b19c174d73b8b1d76af9a231dd P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.611104  4821 tablet_replica.cc:333] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.618805  4821 raft_consensus.cc:2243] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.620940  4821 raft_consensus.cc:2272] T 4a03c10b4bbc407ebfd96681074ae05b P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.625385  4821 tablet_replica.cc:333] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.634182  4821 raft_consensus.cc:2243] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.635233  4821 raft_consensus.cc:2272] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.638270  4821 tablet_replica.cc:333] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.639045  4821 raft_consensus.cc:2243] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.646896  4821 raft_consensus.cc:2272] T be9bf17a0be244b3bdd7bec88bf5a051 P 0557a7246c8945b99e5215c99d4ddf9c [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.649730  4821 tablet_replica.cc:333] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.666448  4821 raft_consensus.cc:2243] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.667317  4821 raft_consensus.cc:2272] T b1b3ddf896ce40f5b9c2632735843215 P 0557a7246c8945b99e5215c99d4ddf9c [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.670372  4821 tablet_replica.cc:333] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.679533  4821 raft_consensus.cc:2243] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.723417  4821 raft_consensus.cc:2272] T 117509103bb449868a97cf0ba4fdda89 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.740768  4821 tablet_replica.cc:333] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.741874  4821 raft_consensus.cc:2243] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.742638  4821 raft_consensus.cc:2272] T d0a77cc9656a4b88bc262752ad91e486 P 0557a7246c8945b99e5215c99d4ddf9c [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:42.748744  6608 consensus_peers.cc:597] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:42.766247  4821 tablet_replica.cc:333] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
W20260709 12:27:42.782809  6608 consensus_peers.cc:597] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:42.770614  4821 raft_consensus.cc:2243] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.799568  4821 raft_consensus.cc:2272] T 38df61ba407240499023581d9f885037 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.809087  4821 tablet_replica.cc:333] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
W20260709 12:27:42.814169  6608 consensus_peers.cc:597] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:42.816411  6081 consensus_peers.cc:597] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:42.817248  6081 consensus_peers.cc:597] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:42.830009  4821 raft_consensus.cc:2243] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.833319  4821 raft_consensus.cc:2272] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:42.833871  6608 consensus_peers.cc:597] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:42.836102  4821 tablet_replica.cc:333] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.837306  4821 raft_consensus.cc:2243] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.838541  4821 raft_consensus.cc:2272] T aa90f801f44d4669a2a93aafa33e4e17 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.846045  4821 tablet_replica.cc:333] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.847141  4821 raft_consensus.cc:2243] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.849259  4821 raft_consensus.cc:2272] T 81efabae1bb448e3a8483e6231673c10 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:42.858534  6081 consensus_peers.cc:597] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:42.864194  4821 tablet_replica.cc:333] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.865139  4821 raft_consensus.cc:2243] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.866305  4821 raft_consensus.cc:2272] T d24ea63f22cb4977ad36707d9d0fffea P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.869040  4821 tablet_replica.cc:333] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.869838  4821 raft_consensus.cc:2243] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.871007  4821 raft_consensus.cc:2272] T 78c13bc0b46b40a3886a209b87dd6f98 P 0557a7246c8945b99e5215c99d4ddf9c [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.892127  4821 tablet_replica.cc:333] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.893002  4821 raft_consensus.cc:2243] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.894184  4821 raft_consensus.cc:2272] T 6b70d6df693140769deef828413df1ba P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.923077  4821 tablet_replica.cc:333] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.924185  4821 raft_consensus.cc:2243] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 28 LEADER]: Raft consensus shutting down.
W20260709 12:27:42.927547  6081 consensus_peers.cc:597] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:42.931874  4821 raft_consensus.cc:2272] T 3d61b6b50d6746189e849070b208d9a5 P 0557a7246c8945b99e5215c99d4ddf9c [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.935987  4821 tablet_replica.cc:333] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.936892  4821 raft_consensus.cc:2243] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.937628  4821 raft_consensus.cc:2272] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.942581  4821 tablet_replica.cc:333] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.943662  4821 raft_consensus.cc:2243] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.944357  4821 raft_consensus.cc:2272] T d7b7660ead3b4a4da081b0199f44037f P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.947000  4821 tablet_replica.cc:333] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.947935  4821 raft_consensus.cc:2243] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.949226  4821 raft_consensus.cc:2272] T c087bb99e3b64274863f583bf7ae435f P 0557a7246c8945b99e5215c99d4ddf9c [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.952418  4821 tablet_replica.cc:333] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.953212  4821 raft_consensus.cc:2243] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 31 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.959404  4821 raft_consensus.cc:2272] T 1d97a0d1272049469a8fe2111554686a P 0557a7246c8945b99e5215c99d4ddf9c [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.962570  4821 tablet_replica.cc:333] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.963385  4821 raft_consensus.cc:2243] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.964287  4821 raft_consensus.cc:2272] T c87516dfcddf4c8b8d921f3512db9063 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.967309  4821 tablet_replica.cc:333] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.968091  4821 raft_consensus.cc:2243] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.969334  4821 raft_consensus.cc:2272] T 07996c0296b04a39b1b151e8885389e2 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.971998  4821 tablet_replica.cc:333] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.972855  4821 raft_consensus.cc:2243] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.973706  4821 raft_consensus.cc:2272] T 7df97235d12b46dd8e54f8f1d6ed40bd P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.981122  4821 tablet_replica.cc:333] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.981927  4821 raft_consensus.cc:2243] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.982726  4821 raft_consensus.cc:2272] T afdcf44718954edea3bd3aa8ada58035 P 0557a7246c8945b99e5215c99d4ddf9c [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.985556  4821 tablet_replica.cc:333] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.986291  4821 raft_consensus.cc:2243] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:42.987244  4821 raft_consensus.cc:2272] T 06e81868728a4e2592f3ee289cff3431 P 0557a7246c8945b99e5215c99d4ddf9c [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.989907  4821 tablet_replica.cc:333] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:42.990706  4821 raft_consensus.cc:2243] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:27:42.991820  4821 raft_consensus.cc:2272] T 0636290fb57e4842995ddf9549f0c721 P 0557a7246c8945b99e5215c99d4ddf9c [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:42.994936  4821 tablet_replica.cc:333] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
W20260709 12:27:42.996028  6006 consensus_peers.cc:597] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:42.996747  4821 raft_consensus.cc:2243] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 LEADER]: Raft consensus shutting down.
W20260709 12:27:42.998173  6081 consensus_peers.cc:597] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:42.999325  4821 raft_consensus.cc:2272] T 465414d7b00f409684b7f69cfbcfad77 P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.002104  4821 tablet_replica.cc:333] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:43.002933  4821 raft_consensus.cc:2243] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:43.004055  4821 raft_consensus.cc:2272] T e3ef3cb064eb4a1597f89e040fce3c7e P 0557a7246c8945b99e5215c99d4ddf9c [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.007330  4821 tablet_replica.cc:333] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:43.008867  4821 raft_consensus.cc:2243] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:43.028592  4821 raft_consensus.cc:2272] T 39cca9184e5b4b468627eb290d029f68 P 0557a7246c8945b99e5215c99d4ddf9c [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.031838  4821 tablet_replica.cc:333] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:43.032625  4821 raft_consensus.cc:2243] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:27:43.034278  4821 raft_consensus.cc:2272] T 68476262e38a4c15a51c80b96e7d58a6 P 0557a7246c8945b99e5215c99d4ddf9c [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.052902  4821 tablet_replica.cc:333] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:43.054010  4821 raft_consensus.cc:2243] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 LEADER]: Raft consensus shutting down.
I20260709 12:27:43.061816  4821 raft_consensus.cc:2272] T efdaf6941ab7409d90619a5e9f5c10c3 P 0557a7246c8945b99e5215c99d4ddf9c [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:43.065122  4821 tablet_replica.cc:333] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c: stopping tablet replica
I20260709 12:27:43.066007  4821 raft_consensus.cc:2243] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:43.066855  4821 raft_consensus.cc:2272] T b1c2c76afb3f4fb2911e84592dd6b52b P 0557a7246c8945b99e5215c99d4ddf9c [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:43.149302  6081 consensus_peers.cc:597] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:43.215224  6081 consensus_peers.cc:597] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:43.237959  6081 consensus_peers.cc:597] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:43.265313  6608 consensus_peers.cc:597] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:43.439394  6608 consensus_peers.cc:597] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
I20260709 12:27:43.513072 14420 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.513689 14420 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:43.524451  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:43.528743 14420 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:43.531534  6082 leader_election.cc:336] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:43.532238  6082 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:43.534077 14420 raft_consensus.cc:2749] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:43.638751 14405 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.639406 14405 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:43.838102 14422 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.838797 14422 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:43.840936 14422 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:43.841099 14397 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.841631 14397 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:43.843122 14397 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:43.851150 14422 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.851706 14422 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:43.854537 14422 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
W20260709 12:27:43.859309  6609 leader_election.cc:336] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:43.860884 14397 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:43.861248  6609 leader_election.cc:336] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:43.861503 14397 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:43.887388  6608 leader_election.cc:336] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:43.888012  6608 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:43.888767 14425 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:43.890303 14397 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:43.900930  6609 leader_election.cc:336] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:43.901243 14423 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.901850 14423 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:43.903831 14419 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.906240 14419 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:43.911073 14419 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:43.904313 14423 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:43.902240 14425 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.919489 14425 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:43.920219 14424 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.920770 14424 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:43.923426 14424 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:43.915987 14430 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.935451 14430 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:43.937773 14430 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:43.925208 14425 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:43.929827  6609 leader_election.cc:336] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:43.642237 14405 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:43.939958  6608 leader_election.cc:336] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:43.949246 14430 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.949843 14430 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:43.949431 14422 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.954053  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:43.954372 14422 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:43.954929  6644 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:43.956651 14422 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:43.954779  6650 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 24.
I20260709 12:27:43.956779  6647 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:43.960052  6647 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 15.
I20260709 12:27:43.964502 14430 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:43.966547 14405 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.967324 14405 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:43.968322  6609 leader_election.cc:336] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:43.968806  6609 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:43.969515 14405 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:43.972152 14405 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:27:43.973878  6608 leader_election.cc:336] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:43.966282 14427 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.975172 14427 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:43.976835  6084 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:43.977228 14427 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:43.987498 14429 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Leader pre-election won for term 25
I20260709 12:27:43.990816 14429 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.991179 14429 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:27:43.991657  6609 leader_election.cc:336] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:43.993038  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:43.993884 14432 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:43.987501  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:43.995044 14419 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Leader pre-election won for term 16
I20260709 12:27:43.995464 14419 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:43.995872 14419 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:43.999806 14431 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:44.000182  6082 leader_election.cc:336] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.000378 14431 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:44.013556  6082 leader_election.cc:336] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.014174  6082 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:44.017226 14430 raft_consensus.cc:2749] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:44.018795  6082 leader_election.cc:336] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:44.019377  6082 leader_election.cc:336] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:44.020174  6082 leader_election.cc:336] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.005468 14419 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.021396  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
W20260709 12:27:44.022006  6081 leader_election.cc:336] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:44.022744 14430 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.023530 14430 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.026691  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:44.027385  6113 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 19.
I20260709 12:27:44.027513  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:44.020190 14431 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:44.026736 14419 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:44.006145 14429 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.028726  6113 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:44.029423  6113 raft_consensus.cc:2393] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 16: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:44.032245  6110 raft_consensus.cc:2393] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 24012af7747d4c4ea89c3da2ff950099 in current term 25: Already voted for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in this term.
I20260709 12:27:44.034044 14429 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:44.037825  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:44.038748  6611 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:44.040076 14434 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election won for term 20
I20260709 12:27:44.040480 14434 raft_consensus.cc:493] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.040859 14434 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:44.049165 14432 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.049782 14432 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.046149  6643 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1956c0a3a799470a83a524ca2ae0ce14" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 16 candidate_status { last_received { term: 15 index: 14 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:44.051472  6611 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:44.066789  6643 raft_consensus.cc:3060] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Advancing to term 16
I20260709 12:27:44.054522  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "be9bf17a0be244b3bdd7bec88bf5a051" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 25 candidate_status { last_received { term: 24 index: 18 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:44.069762  6650 raft_consensus.cc:3060] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Advancing to term 25
W20260709 12:27:44.055042  6082 leader_election.cc:336] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:44.071803  6082 leader_election.cc:336] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:44.072283  6082 leader_election.cc:336] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:44.073232  6608 leader_election.cc:336] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:44.073935 14430 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:44.049080 14434 raft_consensus.cc:515] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.075785  6643 raft_consensus.cc:2468] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 16.
I20260709 12:27:44.076136 14434 leader_election.cc:290] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:44.076303 14432 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:44.076908  6081 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:44.077632 14430 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:44.078650  6081 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42981, user_credentials={real_user=slave}} blocked reactor thread for 56662.3us
W20260709 12:27:44.079700  6081 leader_election.cc:336] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:44.087953  6084 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:44.100304  6081 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:44.100360 14429 raft_consensus.cc:2804] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Leader election won for term 16
I20260709 12:27:44.101133 14429 raft_consensus.cc:697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:44.102123 14429 consensus_queue.cc:237] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 15.14, Last appended by leader: 14, Current term: 16, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.085544 14397 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:44.093245  6650 raft_consensus.cc:2468] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 25.
I20260709 12:27:44.088347  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
W20260709 12:27:44.093737  6082 leader_election.cc:336] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.105052  6082 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:44.105616 14397 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
W20260709 12:27:44.106086  6082 leader_election.cc:336] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 16 election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.106576  6084 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:44.106738 14419 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:44.107788  6082 leader_election.cc:336] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:44.093791  6609 leader_election.cc:336] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.108249  6082 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:44.108147 14419 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:44.108814  6609 leader_election.cc:336] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.109193  6609 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:44.110167 14423 raft_consensus.cc:2749] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:44.110709 14419 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:44.110267 14405 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:44.102057  6081 leader_election.cc:336] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:44.112287  6081 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:44.112848  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:44.112989 14427 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:27:44.113274  6081 leader_election.cc:336] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:44.113809  6081 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:44.110980 14423 raft_consensus.cc:2804] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Leader election won for term 25
I20260709 12:27:44.114869 14427 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:44.115038 14423 raft_consensus.cc:697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
W20260709 12:27:44.116114  6081 leader_election.cc:336] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:44.116667  6081 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:44.116537 14423 consensus_queue.cc:237] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 18, Committed index: 18, Last appended: 24.18, Last appended by leader: 18, Current term: 25, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:44.109961  6082 leader_election.cc:336] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 25 election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.117589 14427 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:44.107306 14435 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.118983 14435 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.121805  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5744a277c5a3409b95831573168daf3f" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 20 candidate_status { last_received { term: 19 index: 15 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:44.122447  6116 raft_consensus.cc:3060] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Advancing to term 20
I20260709 12:27:44.107347 14431 raft_consensus.cc:2749] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:44.107348 14428 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:44.134904  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:44.131162 14435 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:44.135264 14397 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 27 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.136972 14397 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 27 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:44.138674  6609 leader_election.cc:336] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.139501 14397 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 28 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:44.154635  6609 leader_election.cc:336] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.157677  6116 raft_consensus.cc:2468] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:27:44.163532  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:44.164240  6110 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 27.
I20260709 12:27:44.162415  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:44.165864 14397 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:27:44.162849  6082 leader_election.cc:336] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 28 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.172660  6082 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, 24012af7747d4c4ea89c3da2ff950099
I20260709 12:27:44.174248  6611 leader_election.cc:304] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:44.175508  6611 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 28 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:44.176285 14435 raft_consensus.cc:2804] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader election won for term 20
I20260709 12:27:44.176802 14435 raft_consensus.cc:697] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:44.176893 14434 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 27 FOLLOWER]: Leader pre-election won for term 28
I20260709 12:27:44.177532 14434 raft_consensus.cc:493] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 27 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.178086 14397 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.178647 14423 raft_consensus.cc:2749] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Leader pre-election lost for term 28. Reason: could not achieve majority
I20260709 12:27:44.178923 14434 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:44.177767 14435 consensus_queue.cc:237] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 15, Committed index: 15, Last appended: 19.15, Last appended by leader: 15, Current term: 20, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.177876  5863 catalog_manager.cc:5697] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 15 to 16, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 16 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:44.178733 14397 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.185396 14397 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:44.192369  6609 leader_election.cc:336] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.194408  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:44.195262  6110 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:27:44.197180  6611 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:44.200439 14397 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:44.200955 14397 raft_consensus.cc:493] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.201397 14397 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:44.214416 14397 raft_consensus.cc:515] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.198756 14434 raft_consensus.cc:515] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 28 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:44.226778  6609 leader_election.cc:336] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 28 election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.230114  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38df61ba407240499023581d9f885037" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 28 candidate_status { last_received { term: 27 index: 20 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:44.230845  6110 raft_consensus.cc:3060] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Advancing to term 28
I20260709 12:27:44.228204 14434 leader_election.cc:290] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 28 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:44.238607  6110 raft_consensus.cc:2468] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 28 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 28.
W20260709 12:27:44.246641  6609 leader_election.cc:336] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.247028  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "81efabae1bb448e3a8483e6231673c10" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:44.247822  6116 raft_consensus.cc:3060] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:44.248000  6611 leader_election.cc:304] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 28 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:44.249648 14435 raft_consensus.cc:2804] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 28 FOLLOWER]: Leader election won for term 28
I20260709 12:27:44.250396 14435 raft_consensus.cc:697] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 28 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:44.251425 14435 consensus_queue.cc:237] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 20, Committed index: 20, Last appended: 27.20, Last appended by leader: 20, Current term: 28, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.254055 14405 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.254611 14405 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.255075  6116 raft_consensus.cc:2468] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 21.
I20260709 12:27:44.256453  6611 leader_election.cc:304] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:44.256667 14405 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:44.257345 14425 raft_consensus.cc:2804] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:27:44.257858 14425 raft_consensus.cc:697] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:44.258229 14423 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.259127  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:44.243878  5861 catalog_manager.cc:5697] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 19 to 20, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 20 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:44.259637 14424 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.242763 14397 leader_election.cc:290] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:44.260178 14424 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.261595  6116 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:27:44.262852  6611 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:44.262953 14429 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.258791 14423 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.263509 14429 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:44.264765  6609 leader_election.cc:336] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.265672 14423 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:44.266309 14432 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:44.265800 14429 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:44.258746 14425 consensus_queue.cc:237] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.268082  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099" is_pre_election: true
I20260709 12:27:44.268750  6650 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 21.
I20260709 12:27:44.269677  6084 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:44.270527 14429 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader pre-election won for term 22
I20260709 12:27:44.266719 14432 raft_consensus.cc:493] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.270979 14429 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.270560 14424 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:44.271402 14429 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:27:44.272073  6081 leader_election.cc:336] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:44.272343 14432 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:44.279337 14424 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.279899 14424 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:44.280784  6082 leader_election.cc:336] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:44.281391  6609 leader_election.cc:336] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.279327 14429 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.282655 14432 raft_consensus.cc:515] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.284694 14429 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68:45477)
I20260709 12:27:44.284801 14424 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:44.281970  6082 leader_election.cc:336] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.285447  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:44.285904  4821 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 6065)
I20260709 12:27:44.287086  6116 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" is_pre_election: true
I20260709 12:27:44.287513  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8ff337cd5a364d1c9100f9a31dd826f7" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 17 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:44.287744  6116 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 20.
I20260709 12:27:44.288121  6110 raft_consensus.cc:3060] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:44.288946  6611 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:44.286515 14432 leader_election.cc:290] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:44.290134 14432 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election won for term 21
I20260709 12:27:44.290549 14432 raft_consensus.cc:493] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting leader election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.290943 14432 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Advancing to term 21
I20260709 12:27:44.287983 14429 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:44.285877  6650 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6b70d6df693140769deef828413df1ba" candidate_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" candidate_term: 22 candidate_status { last_received { term: 21 index: 17 } } ignore_live_leader: false dest_uuid: "24012af7747d4c4ea89c3da2ff950099"
I20260709 12:27:44.295995  6650 raft_consensus.cc:3060] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Advancing to term 22
W20260709 12:27:44.304095  6082 leader_election.cc:336] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:44.305142  6608 leader_election.cc:336] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:44.312775  6110 raft_consensus.cc:2468] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 21.
I20260709 12:27:44.309442  6650 raft_consensus.cc:2468] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0069e2ba1f02412e8e1d6c20a1fb510f in term 22.
I20260709 12:27:44.314636  6084 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 22 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:44.317348 14428 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.317843 14428 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:44.320132 14428 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:44.321695 14429 raft_consensus.cc:2804] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader election won for term 22
W20260709 12:27:44.324916  6081 leader_election.cc:336] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:44.322536 14429 raft_consensus.cc:697] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 LEADER]: Becoming Leader. State: Replica: 0069e2ba1f02412e8e1d6c20a1fb510f, State: Running, Role: LEADER
I20260709 12:27:44.326812 14429 consensus_queue.cc:237] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 21.17, Last appended by leader: 17, Current term: 22, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.307016 14432 raft_consensus.cc:515] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.330158  6611 leader_election.cc:304] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 
I20260709 12:27:44.331199 14425 raft_consensus.cc:2804] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:27:44.331738 14425 raft_consensus.cc:697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:44.332616 14425 consensus_queue.cc:237] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 17, Committed index: 17, Last appended: 20.17, Last appended by leader: 17, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.339776  6110 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d24ea63f22cb4977ad36707d9d0fffea" candidate_uuid: "24012af7747d4c4ea89c3da2ff950099" candidate_term: 21 candidate_status { last_received { term: 20 index: 16 } } ignore_live_leader: false dest_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f"
I20260709 12:27:44.340476  6110 raft_consensus.cc:3060] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Advancing to term 21
W20260709 12:27:44.345773  6609 leader_election.cc:336] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:44.346696  6609 leader_election.cc:336] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.346961 14432 leader_election.cc:290] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: Requested vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:44.349269 14432 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.349836 14432 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:44.352188 14432 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:44.356725  6609 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:44.357869  6608 leader_election.cc:336] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:44.358261 14432 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:27:44.357597  6082 leader_election.cc:336] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.361472  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:44.362335 14428 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:44.364419 14429 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:44.364676  6609 leader_election.cc:336] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.371822  6110 raft_consensus.cc:2468] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 24012af7747d4c4ea89c3da2ff950099 in term 21.
I20260709 12:27:44.370664 14429 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:44.373103  6611 leader_election.cc:304] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:44.375068 14432 raft_consensus.cc:2804] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader election won for term 21
I20260709 12:27:44.375326 14429 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:44.375612 14432 raft_consensus.cc:697] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Becoming Leader. State: Replica: 24012af7747d4c4ea89c3da2ff950099, State: Running, Role: LEADER
I20260709 12:27:44.376601 14432 consensus_queue.cc:237] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 16, Committed index: 16, Last appended: 20.16, Last appended by leader: 16, Current term: 21, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:44.380764  6609 leader_election.cc:336] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:44.383281  6081 consensus_peers.cc:597] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:44.400813  6082 leader_election.cc:336] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.402184 14429 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.402731 14429 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:44.404978 14429 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:44.408303  6609 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:44.409421 14425 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:27:44.409967  6081 leader_election.cc:336] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:44.410529  6081 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:44.414508 14428 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:44.420806  6081 leader_election.cc:336] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:44.426182  5863 catalog_manager.cc:5697] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 24 to 25, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 25 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:44.429405  5863 catalog_manager.cc:5697] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f reported cstate change: term changed from 21 to 22, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67). New cstate: current_term: 22 leader_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:44.428081 14425 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:44.432880 14425 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:44.435616  6082 leader_election.cc:336] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.436206  6082 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:44.439105 14425 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:44.439476 14429 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:44.459867  6608 leader_election.cc:336] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:44.464607  5861 catalog_manager.cc:5697] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 27 to 28, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 28 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:44.469993  5861 catalog_manager.cc:5697] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 20 to 21, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 21 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:44.476917  5861 catalog_manager.cc:5697] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 20 to 21, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 21 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20260709 12:27:44.480827  5861 catalog_manager.cc:5697] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 reported cstate change: term changed from 20 to 21, leader changed from 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66) to 24012af7747d4c4ea89c3da2ff950099 (127.4.181.68). New cstate: current_term: 21 leader_uuid: "24012af7747d4c4ea89c3da2ff950099" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20260709 12:27:44.479782  6609 leader_election.cc:336] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:44.484030  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:44.484826 14425 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
W20260709 12:27:44.551817  6081 consensus_peers.cc:597] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:44.605998  6609 consensus_peers.cc:597] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:44.626417  6110 raft_consensus.cc:1275] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 19 index: 15. Preceding OpId from leader: term: 20 index: 16. (index mismatch)
I20260709 12:27:44.628309 14425 consensus_queue.cc:1048] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 16, Last known committed idx: 15, Time since last communication: 0.000s
I20260709 12:27:44.638751  6650 raft_consensus.cc:1275] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 15 index: 14. Preceding OpId from leader: term: 16 index: 15. (index mismatch)
I20260709 12:27:44.641165 14429 consensus_queue.cc:1048] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 15, Last known committed idx: 14, Time since last communication: 0.001s
W20260709 12:27:44.643280  6081 consensus_peers.cc:597] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:44.651113  6081 consensus_peers.cc:597] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:44.669925  5850 catalog_manager.cc:4755] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet aa90f801f44d4669a2a93aafa33e4e17: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:44.675168  6609 consensus_peers.cc:597] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:44.686630  6081 consensus_peers.cc:597] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:44.689272  6116 raft_consensus.cc:1275] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
W20260709 12:27:44.698789  6082 consensus_peers.cc:597] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:44.706789 14432 consensus_queue.cc:1048] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:27:44.709007  5897 debug-util.cc:398] Leaking SignalData structure 0x7b080000a440 after lost signal to thread 4824
W20260709 12:27:44.710000  5897 debug-util.cc:398] Leaking SignalData structure 0x7b080039e780 after lost signal to thread 5900
W20260709 12:27:44.711339  5897 debug-util.cc:398] Leaking SignalData structure 0x7b08002e35a0 after lost signal to thread 6142
I20260709 12:27:44.711679  6650 raft_consensus.cc:1275] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 24 index: 18. Preceding OpId from leader: term: 25 index: 19. (index mismatch)
W20260709 12:27:44.712472  5897 debug-util.cc:398] Leaking SignalData structure 0x7b08002c87a0 after lost signal to thread 6675
I20260709 12:27:44.713034 14423 consensus_queue.cc:1048] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 19, Last known committed idx: 18, Time since last communication: 0.000s
W20260709 12:27:44.708671  6609 consensus_peers.cc:597] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:44.730286  6082 consensus_peers.cc:597] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:44.730806  6082 consensus_peers.cc:597] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:44.736336  6110 raft_consensus.cc:1275] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 28 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 27 index: 20. Preceding OpId from leader: term: 28 index: 21. (index mismatch)
W20260709 12:27:44.742231  6609 consensus_peers.cc:597] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:44.746824 14432 consensus_queue.cc:1048] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 21, Last known committed idx: 20, Time since last communication: 0.001s
W20260709 12:27:44.755560  6609 consensus_peers.cc:597] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:44.749970  6082 consensus_peers.cc:597] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:44.773965  6609 consensus_peers.cc:597] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:44.782173  6609 consensus_peers.cc:597] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:44.802871  6082 consensus_peers.cc:597] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:44.811022  6608 consensus_peers.cc:597] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:44.822896  6082 consensus_peers.cc:597] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:44.836786  6608 consensus_peers.cc:597] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:44.852996  6609 consensus_peers.cc:597] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:44.861007  6082 consensus_peers.cc:597] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:44.866096  6643 raft_consensus.cc:1275] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Refusing update from remote peer 0069e2ba1f02412e8e1d6c20a1fb510f: Log matching property violated. Preceding OpId in replica: term: 21 index: 17. Preceding OpId from leader: term: 22 index: 18. (index mismatch)
I20260709 12:27:44.874140 14423 consensus_queue.cc:1048] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [LEADER]: Connected to new peer: Peer: permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
W20260709 12:27:44.876969  6609 consensus_peers.cc:597] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:44.878433  6116 raft_consensus.cc:1275] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 20 index: 17. Preceding OpId from leader: term: 21 index: 18. (index mismatch)
I20260709 12:27:44.881371 14435 consensus_queue.cc:1048] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 18, Last known committed idx: 17, Time since last communication: 0.000s
I20260709 12:27:44.899363  6116 raft_consensus.cc:1275] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Refusing update from remote peer 24012af7747d4c4ea89c3da2ff950099: Log matching property violated. Preceding OpId in replica: term: 20 index: 16. Preceding OpId from leader: term: 21 index: 17. (index mismatch)
I20260709 12:27:44.901132 14435 consensus_queue.cc:1048] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 17, Last known committed idx: 16, Time since last communication: 0.000s
W20260709 12:27:44.919553  6609 consensus_peers.cc:597] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:44.924296  6081 consensus_peers.cc:597] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:44.943730  6608 consensus_peers.cc:597] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:44.961107  6609 consensus_peers.cc:597] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:44.985713  6609 consensus_peers.cc:597] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:45.020210  6609 consensus_peers.cc:597] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:45.040510  6608 consensus_peers.cc:597] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:45.058591  6608 consensus_peers.cc:597] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:45.059757  6082 consensus_peers.cc:597] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:45.060444  6082 consensus_peers.cc:597] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:45.060901  6082 consensus_peers.cc:597] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:45.130003  6081 consensus_peers.cc:597] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:45.140439  6608 consensus_peers.cc:597] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:45.144260  6082 consensus_peers.cc:597] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:45.157243  6082 consensus_peers.cc:597] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:45.159192  6082 consensus_peers.cc:597] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:45.206918  6082 consensus_peers.cc:597] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:45.212286  6082 consensus_peers.cc:597] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:45.286357  4821 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 6065)
W20260709 12:27:45.302066  6082 consensus_peers.cc:597] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:45.314922  6081 consensus_peers.cc:597] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:45.337657  6608 consensus_peers.cc:597] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:45.374418  6081 consensus_peers.cc:597] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:45.389694  6608 consensus_peers.cc:597] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:45.404122  6081 consensus_peers.cc:597] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:45.413025  6081 consensus_peers.cc:597] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 21: this message will repeat every 5th retry.
W20260709 12:27:45.448414  6082 consensus_peers.cc:597] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:45.449582 14435 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:45.450495 14435 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:45.452775 14435 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:45.460645  6609 leader_election.cc:336] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:45.462430  6608 leader_election.cc:336] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:45.462860  6608 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:45.463742 14435 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:27:45.469954  6608 consensus_peers.cc:597] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:45.490633  6081 consensus_peers.cc:597] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:45.550009  6608 consensus_peers.cc:597] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:45.578681  6608 consensus_peers.cc:597] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:45.604321 14423 raft_consensus.cc:493] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:45.604933 14423 raft_consensus.cc:515] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:45.607020 14423 leader_election.cc:290] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:45.608786 14435 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:45.609326 14435 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:45.611433 14435 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:45.616312  6082 leader_election.cc:336] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:45.617117  6081 leader_election.cc:336] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:45.619086  6081 leader_election.cc:304] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:45.620309 14428 raft_consensus.cc:2749] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:45.621639 14425 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
W20260709 12:27:45.622062  6608 leader_election.cc:336] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:45.622157 14425 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:45.624362  6609 leader_election.cc:336] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:45.624526 14425 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:45.626828  6609 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:45.627588 14425 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:27:45.631230  6608 leader_election.cc:336] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:45.636111  6609 leader_election.cc:336] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:45.636588  6609 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:45.637437 14425 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:45.658972  6608 consensus_peers.cc:597] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:45.659590  6608 consensus_peers.cc:597] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:45.691798 14435 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:45.692325 14435 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:45.709779 14435 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:45.715097  6608 leader_election.cc:336] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:45.717527  6609 leader_election.cc:336] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:45.718261  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:45.718989 14435 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:45.902608 14428 raft_consensus.cc:493] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:45.903157 14428 raft_consensus.cc:515] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:45.905463 14428 leader_election.cc:290] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:45.921025  6081 leader_election.cc:336] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:45.921962  6082 leader_election.cc:336] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:45.922499  6082 leader_election.cc:304] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:45.923513 14428 raft_consensus.cc:2749] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:45.925024 14428 raft_consensus.cc:493] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:45.925571 14428 raft_consensus.cc:515] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:45.927775 14428 leader_election.cc:290] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:45.936160  6081 leader_election.cc:336] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:45.953550  6082 leader_election.cc:336] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:45.954185  6082 leader_election.cc:304] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:45.955024 14428 raft_consensus.cc:2749] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:45.995239  6081 consensus_peers.cc:597] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:46.008942  6081 consensus_peers.cc:597] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:46.009508  6081 consensus_peers.cc:597] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:46.089547 14423 raft_consensus.cc:493] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:46.090087 14423 raft_consensus.cc:515] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:46.092260 14423 leader_election.cc:290] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:46.102978  6082 leader_election.cc:336] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:46.105430  6081 leader_election.cc:336] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:46.105870  6081 leader_election.cc:304] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:46.109318 14423 raft_consensus.cc:2749] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
I20260709 12:27:46.130790 14425 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:46.131404 14425 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:46.133445 14425 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:46.156144  6608 leader_election.cc:336] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:46.171104  6609 leader_election.cc:336] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:46.171799  6609 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:46.172389 14425 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:46.173543 14425 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:46.175756 14425 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:46.179359 14425 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:27:46.201963  6608 leader_election.cc:336] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:46.225273  6609 leader_election.cc:336] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:46.225991  6609 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:46.230991 14425 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:46.240943  5855 maintenance_manager.cc:419] P 5def43035e3245068dbad43bca95206c: Scheduling FlushDeltaMemStoresOp(00000000000000000000000000000000): perf score=0.033340
I20260709 12:27:46.257714 14428 raft_consensus.cc:493] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 28 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:46.258262 14428 raft_consensus.cc:515] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 28 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:46.266649 14428 leader_election.cc:290] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 29 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:46.268963  6608 consensus_peers.cc:597] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:46.270682  6081 leader_election.cc:336] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:46.272612  6082 leader_election.cc:336] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 29 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:46.273077  6082 leader_election.cc:304] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 29 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:46.274289 14428 raft_consensus.cc:2749] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 28 FOLLOWER]: Leader pre-election lost for term 29. Reason: could not achieve majority
I20260709 12:27:46.275213 14428 raft_consensus.cc:493] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:46.275691 14428 raft_consensus.cc:515] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:46.277804 14428 leader_election.cc:290] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 27 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
I20260709 12:27:46.282887 14423 raft_consensus.cc:493] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:46.283427 14423 raft_consensus.cc:515] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:46.284312  6081 leader_election.cc:336] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:46.285794 14423 leader_election.cc:290] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:46.300789  6082 leader_election.cc:336] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 27 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:46.301309  6082 leader_election.cc:304] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 27 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:46.302553 14428 raft_consensus.cc:2749] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Leader pre-election lost for term 27. Reason: could not achieve majority
W20260709 12:27:46.314013  6081 leader_election.cc:336] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:46.318130  6082 leader_election.cc:336] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:46.322758  6082 leader_election.cc:304] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:46.324153 14428 raft_consensus.cc:2749] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:46.418592 14428 raft_consensus.cc:493] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:46.419263 14428 raft_consensus.cc:515] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
I20260709 12:27:46.421305 14428 leader_election.cc:290] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:46.430159  6081 leader_election.cc:336] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:46.432016  6082 leader_election.cc:336] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:46.432478  6082 leader_election.cc:304] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:46.433979 14428 raft_consensus.cc:2749] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:46.472461  5854 maintenance_manager.cc:643] P 5def43035e3245068dbad43bca95206c: FlushDeltaMemStoresOp(00000000000000000000000000000000) complete. Timing: real 0.231s	user 0.044s	sys 0.005s Metrics: {"bytes_written":9430,"delete_count":0,"lbm_write_time_us":1033,"lbm_writes_lt_1ms":7,"reinsert_count":0,"thread_start_us":9891,"threads_started":1,"update_count":384,"wal-append.queue_time_us":10169}
I20260709 12:27:46.475265  5855 maintenance_manager.cc:419] P 5def43035e3245068dbad43bca95206c: Scheduling MajorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.455834
I20260709 12:27:46.500720 14428 raft_consensus.cc:493] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:46.501394 14428 raft_consensus.cc:515] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } }
W20260709 12:27:46.508090  6081 leader_election.cc:336] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:46.505967 14428 leader_election.cc:290] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:46.521605  6082 leader_election.cc:336] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:46.522234  6082 leader_election.cc:304] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0069e2ba1f02412e8e1d6c20a1fb510f; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:46.523785 14428 raft_consensus.cc:2749] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:46.561578  4821 tablet_server.cc:196] TabletServer@127.4.181.66:0 shutdown complete.
W20260709 12:27:46.617841  6081 consensus_peers.cc:597] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
I20260709 12:27:46.665113 14435 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:46.665805 14435 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:46.668551 14435 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:46.677807  6609 leader_election.cc:336] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:46.678592  6608 leader_election.cc:336] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:46.678992  6608 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:46.680279 14425 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:46.735926  4821 tablet_server.cc:179] TabletServer@127.4.181.67:0 shutting down...
I20260709 12:27:46.788983  5854 maintenance_manager.cc:643] P 5def43035e3245068dbad43bca95206c: MajorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.302s	user 0.126s	sys 0.037s Metrics: {"cfile_cache_miss":10,"cfile_cache_miss_bytes":30403,"cfile_init":4,"delete_count":0,"delta_blocks_compacted":2,"delta_iterators_relevant":2,"dirs.queue_time_us":50854,"dirs.run_cpu_time_us":685,"dirs.run_wall_time_us":20996,"lbm_read_time_us":1932,"lbm_reads_lt_1ms":26,"lbm_write_time_us":1946,"lbm_writes_lt_1ms":13,"peak_mem_usage":604135,"reinsert_count":0,"thread_start_us":53823,"threads_started":2,"update_count":398}
I20260709 12:27:46.793643  5855 maintenance_manager.cc:419] P 5def43035e3245068dbad43bca95206c: Scheduling MinorDeltaCompactionOp(00000000000000000000000000000000): perf score=0.002000
I20260709 12:27:46.795068  5854 maintenance_manager.cc:643] P 5def43035e3245068dbad43bca95206c: MinorDeltaCompactionOp(00000000000000000000000000000000) complete. Timing: real 0.000s	user 0.000s	sys 0.000s Metrics: {}
W20260709 12:27:46.828537  6609 consensus_peers.cc:597] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:46.831439  6611 consensus_peers.cc:597] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:46.851475  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:46.852794  4821 tablet_replica.cc:333] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.853654  4821 raft_consensus.cc:2243] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.854362  4821 raft_consensus.cc:2272] T adcfbfcb66fd4891959337c005335841 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.860178  4821 tablet_replica.cc:333] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.861019  4821 raft_consensus.cc:2243] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.861586  4821 raft_consensus.cc:2272] T 22f53da618b548f89206b5390bbf5aec P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:46.863322  6611 consensus_peers.cc:597] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:46.864053  4821 tablet_replica.cc:333] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.864915  4821 raft_consensus.cc:2243] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.866308  4821 raft_consensus.cc:2272] T ec584257f9db451c965f6b092aa9069c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.868865  4821 tablet_replica.cc:333] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.869632  4821 raft_consensus.cc:2243] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 LEADER]: Raft consensus shutting down.
W20260709 12:27:46.864885  6611 consensus_peers.cc:597] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:46.870780  4821 raft_consensus.cc:2272] T 12ca0d61cb524660bae3b43f9f1c5389 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.873294  4821 tablet_replica.cc:333] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.874076  4821 raft_consensus.cc:2243] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.875053  4821 raft_consensus.cc:2272] T 1c1322bdafce4b389254f08a59254d2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.877737  4821 tablet_replica.cc:333] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.878540  4821 raft_consensus.cc:2243] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.879205  4821 raft_consensus.cc:2272] T 02dd5c8c15e34ecfbc46620193fb5762 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.881762  4821 tablet_replica.cc:333] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.882531  4821 raft_consensus.cc:2243] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.883103  4821 raft_consensus.cc:2272] T cc2b965a354c426fb89e1a743dccd273 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.885633  4821 tablet_replica.cc:333] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.886369  4821 raft_consensus.cc:2243] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.887110  4821 raft_consensus.cc:2272] T 5744a277c5a3409b95831573168daf3f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:46.887985  6611 consensus_peers.cc:597] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:46.889436  4821 tablet_replica.cc:333] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.890280  4821 raft_consensus.cc:2243] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.891279  4821 raft_consensus.cc:2272] T 7bf137aab07e4b9b8024d07355c33351 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.893690  4821 tablet_replica.cc:333] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.894424  4821 raft_consensus.cc:2243] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.896138  4821 raft_consensus.cc:2272] T 5e596fee38d14bcb913a2aaadffa2a72 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.898571  4821 tablet_replica.cc:333] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.899380  4821 raft_consensus.cc:2243] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.899976  4821 raft_consensus.cc:2272] T 42702625c5a04990a24ae81a2dede920 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 26 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.902729  4821 tablet_replica.cc:333] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.903522  4821 raft_consensus.cc:2243] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.904559  4821 raft_consensus.cc:2272] T a1138b447c084c17ab4b465255e54118 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.907050  4821 tablet_replica.cc:333] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.907843  4821 raft_consensus.cc:2243] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.908526  4821 raft_consensus.cc:2272] T a0acc59e2e4d43029c959c64a291c5a0 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:46.910293  6611 consensus_peers.cc:597] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:46.910928  4821 tablet_replica.cc:333] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.911828  4821 raft_consensus.cc:2243] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.913007  4821 raft_consensus.cc:2272] T be9bf17a0be244b3bdd7bec88bf5a051 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.915465  4821 tablet_replica.cc:333] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.916257  4821 raft_consensus.cc:2243] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.917335  4821 raft_consensus.cc:2272] T 1956c0a3a799470a83a524ca2ae0ce14 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.920285  4821 tablet_replica.cc:333] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.921087  4821 raft_consensus.cc:2243] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.922181  4821 raft_consensus.cc:2272] T bd91034e550f4704be7f47b7aff3ed25 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.924783  4821 tablet_replica.cc:333] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.925520  4821 raft_consensus.cc:2243] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:46.925957  6611 consensus_peers.cc:597] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:46.926088  4821 raft_consensus.cc:2272] T 7d1c158430bb487aa1d4c5a69165aa32 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.928766  4821 tablet_replica.cc:333] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.945943  4821 raft_consensus.cc:2243] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.949698  4821 raft_consensus.cc:2272] T cbdceec3ce444e7b812ac717eafb85ee P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.953991  4821 tablet_replica.cc:333] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.955559  4821 raft_consensus.cc:2243] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.956710  4821 raft_consensus.cc:2272] T 35f225b19c174d73b8b1d76af9a231dd P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.961359  4821 tablet_replica.cc:333] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.962186  4821 raft_consensus.cc:2243] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.963351  4821 raft_consensus.cc:2272] T 4a03c10b4bbc407ebfd96681074ae05b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.965992  4821 tablet_replica.cc:333] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.966843  4821 raft_consensus.cc:2243] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.967953  4821 raft_consensus.cc:2272] T 382d3eda9eaa4b9c96393a12d9f2be5c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.970376  4821 tablet_replica.cc:333] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.971159  4821 raft_consensus.cc:2243] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Raft consensus shutting down.
W20260709 12:27:46.971233  6611 consensus_peers.cc:597] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:46.972715  4821 raft_consensus.cc:2272] T 117509103bb449868a97cf0ba4fdda89 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:46.974114  6611 consensus_peers.cc:597] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:46.975303  4821 tablet_replica.cc:333] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.976151  4821 raft_consensus.cc:2243] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.976768  4821 raft_consensus.cc:2272] T 4f2d24cb0978411e851e8ff35955bf2e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.979573  4821 tablet_replica.cc:333] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.980377  4821 raft_consensus.cc:2243] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.981066  4821 raft_consensus.cc:2272] T 81efabae1bb448e3a8483e6231673c10 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.983641  4821 tablet_replica.cc:333] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.984469  4821 raft_consensus.cc:2243] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.985728  4821 raft_consensus.cc:2272] T 06e81868728a4e2592f3ee289cff3431 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.988219  4821 tablet_replica.cc:333] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.989157  4821 raft_consensus.cc:2243] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.989913  4821 raft_consensus.cc:2272] T bc02451d94184328a520860e40f6b77c P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.992802  4821 tablet_replica.cc:333] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.993674  4821 raft_consensus.cc:2243] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 28 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:46.994300  4821 raft_consensus.cc:2272] T 3d61b6b50d6746189e849070b208d9a5 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:46.997016  4821 tablet_replica.cc:333] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:46.998067  4821 raft_consensus.cc:2243] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:27:46.999239  4821 raft_consensus.cc:2272] T b46c3c3bcf5c4016bb6bab0051ff3094 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.001991  4821 tablet_replica.cc:333] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:47.002744  4821 raft_consensus.cc:2243] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.003423  4821 raft_consensus.cc:2272] T 5a6d648272bf4bef9d5337acfc9d4a96 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.005836  4821 tablet_replica.cc:333] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:47.006603  4821 raft_consensus.cc:2243] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 28 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:47.006888  6611 consensus_peers.cc:597] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:47.007157  4821 raft_consensus.cc:2272] T 38df61ba407240499023581d9f885037 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.009841  4821 tablet_replica.cc:333] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:47.010608  4821 raft_consensus.cc:2243] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.011581  4821 raft_consensus.cc:2272] T b1c2c76afb3f4fb2911e84592dd6b52b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.014153  4821 tablet_replica.cc:333] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
W20260709 12:27:47.023403  6609 consensus_peers.cc:597] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:47.025159  4821 raft_consensus.cc:2243] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.026500  4821 raft_consensus.cc:2272] T d7b7660ead3b4a4da081b0199f44037f P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.029469  4821 tablet_replica.cc:333] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:47.030275  4821 raft_consensus.cc:2243] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.030962  4821 raft_consensus.cc:2272] T c87516dfcddf4c8b8d921f3512db9063 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.033320  4821 tablet_replica.cc:333] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:47.034080  4821 raft_consensus.cc:2243] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.034729  4821 raft_consensus.cc:2272] T 07996c0296b04a39b1b151e8885389e2 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.037276  4821 tablet_replica.cc:333] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:47.038055  4821 raft_consensus.cc:2243] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.038678  4821 raft_consensus.cc:2272] T 0ad617c44395493f82e992b73a4295ad P 0069e2ba1f02412e8e1d6c20a1fb510f [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.041111  4821 tablet_replica.cc:333] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
W20260709 12:27:47.041179  6609 consensus_peers.cc:597] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:47.041941  4821 raft_consensus.cc:2243] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.043257  4821 raft_consensus.cc:2272] T 6b70d6df693140769deef828413df1ba P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.045717  4821 tablet_replica.cc:333] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:47.046533  4821 raft_consensus.cc:2243] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.047220  4821 raft_consensus.cc:2272] T 68476262e38a4c15a51c80b96e7d58a6 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.050571  4821 tablet_replica.cc:333] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:47.051298  4821 raft_consensus.cc:2243] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.052441  4821 raft_consensus.cc:2272] T 39cca9184e5b4b468627eb290d029f68 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 27 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.054888  4821 tablet_replica.cc:333] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:47.058792  4821 raft_consensus.cc:2243] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.059425  4821 raft_consensus.cc:2272] T 8ff337cd5a364d1c9100f9a31dd826f7 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.061839  4821 tablet_replica.cc:333] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
W20260709 12:27:47.066731  6609 consensus_peers.cc:597] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:47.067165  4821 raft_consensus.cc:2243] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.068447  4821 raft_consensus.cc:2272] T aa90f801f44d4669a2a93aafa33e4e17 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 25 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:47.072158  6611 consensus_peers.cc:597] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:47.073449  4821 tablet_replica.cc:333] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:47.074349  4821 raft_consensus.cc:2243] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.075481  4821 raft_consensus.cc:2272] T ba1e2d6430774a629131a0953161507b P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.085335  4821 tablet_replica.cc:333] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:47.086225  4821 raft_consensus.cc:2243] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.087191  4821 raft_consensus.cc:2272] T 4783d1a7790a4be2a959bd61e6f21947 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.090199  4821 tablet_replica.cc:333] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
W20260709 12:27:47.078372  6609 consensus_peers.cc:597] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:47.100677  6608 consensus_peers.cc:597] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:47.102028  6611 consensus_peers.cc:597] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:47.109925  6609 consensus_peers.cc:597] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:47.111135  4821 raft_consensus.cc:2243] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.111826  4821 raft_consensus.cc:2272] T 465414d7b00f409684b7f69cfbcfad77 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:47.112541  6611 consensus_peers.cc:597] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:47.118234  4821 tablet_replica.cc:333] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:47.119110  4821 raft_consensus.cc:2243] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.119992  4821 raft_consensus.cc:2272] T d24ea63f22cb4977ad36707d9d0fffea P 0069e2ba1f02412e8e1d6c20a1fb510f [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.122817  4821 tablet_replica.cc:333] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:47.123510  4821 raft_consensus.cc:2243] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:47.124208  4821 raft_consensus.cc:2272] T 0468d70863214876bf59fb3ea9474307 P 0069e2ba1f02412e8e1d6c20a1fb510f [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.127028  4821 tablet_replica.cc:333] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f: stopping tablet replica
I20260709 12:27:47.127836  4821 raft_consensus.cc:2243] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:47.129014  4821 raft_consensus.cc:2272] T e3ef3cb064eb4a1597f89e040fce3c7e P 0069e2ba1f02412e8e1d6c20a1fb510f [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:47.157941 14435 raft_consensus.cc:493] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:47.158547 14435 raft_consensus.cc:515] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:47.161039 14435 leader_election.cc:290] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:47.166298  6609 leader_election.cc:336] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:47.167562  6608 leader_election.cc:336] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:47.168021  6608 leader_election.cc:304] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:47.168810 14435 raft_consensus.cc:2749] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
W20260709 12:27:47.174998  6611 consensus_peers.cc:597] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:47.209987  6609 consensus_peers.cc:597] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:47.236920  6609 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111) [suppressed 654 similar messages]
W20260709 12:27:47.256031  6611 consensus_peers.cc:597] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:47.282411  6609 consensus_peers.cc:597] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:47.284510  6608 consensus_peers.cc:597] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:47.395085  6611 connection.cc:769] client connection to 127.4.181.67:39787 send error: Network error: sendmsg error: Broken pipe (error 32)
W20260709 12:27:47.398041  6609 consensus_peers.cc:597] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:47.399746  6611 consensus_peers.cc:597] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:27:47.409875  6608 consensus_peers.cc:597] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:47.480131  6609 consensus_peers.cc:597] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:47.482270  6609 consensus_peers.cc:597] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:47.531595  6608 consensus_peers.cc:597] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 26: this message will repeat every 5th retry.
W20260709 12:27:47.546868  6609 consensus_peers.cc:597] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:47.628374  6608 consensus_peers.cc:597] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:47.657905  6608 consensus_peers.cc:597] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:47.695701  6608 consensus_peers.cc:597] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:47.710414 14470 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:47.710934 14470 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:47.713809 14470 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:47.718022  6608 leader_election.cc:336] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:47.718509  6609 leader_election.cc:336] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:47.718849  6609 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:47.719424 14470 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
W20260709 12:27:47.728802  6609 consensus_peers.cc:597] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:47.782267  6608 consensus_peers.cc:597] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:47.822664  6608 consensus_peers.cc:597] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:47.831370 14470 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:47.832094 14470 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:47.834311 14470 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:47.840272  6608 leader_election.cc:336] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:47.841092  6609 leader_election.cc:336] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:47.841506  6609 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:47.842161 14470 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:27:47.990764  6608 consensus_peers.cc:597] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:47.992183 14471 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:47.992692 14471 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:47.993428  6608 consensus_peers.cc:597] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:47.994870 14471 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:47.998162  6611 leader_election.cc:336] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:47.999101 14471 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:47.999549 14471 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:47.999836  6609 leader_election.cc:336] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:48.000350  6609 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:48.001037 14470 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:48.001543 14471 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:48.004541  6609 leader_election.cc:336] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:48.005857  6611 leader_election.cc:336] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:48.006158  6611 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:48.006698 14471 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:48.012938 14471 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:48.013494 14471 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:48.014878 14470 raft_consensus.cc:493] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:48.015573 14470 raft_consensus.cc:515] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:48.015285 14471 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:48.019490  6611 leader_election.cc:336] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:48.019693 14470 leader_election.cc:290] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:48.021255  6608 leader_election.cc:336] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:48.021754  6608 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:48.022979 14470 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:27:48.024451  6611 leader_election.cc:336] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
W20260709 12:27:48.024873  6608 leader_election.cc:336] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:48.025213  6608 leader_election.cc:304] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:48.025748 14470 raft_consensus.cc:2749] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:27:48.056691  6608 consensus_peers.cc:597] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:48.063603 14470 raft_consensus.cc:493] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:48.064106 14470 raft_consensus.cc:515] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Starting pre-election with config: opid_index: 15 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:48.065975 14470 leader_election.cc:290] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:48.070252  6609 leader_election.cc:336] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:48.070950  6611 leader_election.cc:336] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:48.071365  6611 leader_election.cc:304] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 21 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:48.072088 14470 raft_consensus.cc:2749] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Leader pre-election lost for term 21. Reason: could not achieve majority
I20260709 12:27:48.109558 14435 raft_consensus.cc:493] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:48.110018 14435 raft_consensus.cc:515] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:48.111439 14470 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:48.112130 14470 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:48.111822 14435 leader_election.cc:290] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:48.115115 14470 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:48.116611  6611 leader_election.cc:336] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
W20260709 12:27:48.117496  6608 leader_election.cc:336] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:48.118074  6608 leader_election.cc:304] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:48.119144 14470 raft_consensus.cc:2749] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:27:48.120078  6609 leader_election.cc:336] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:48.121496  6608 leader_election.cc:336] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:48.122140  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:48.123072 14470 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:48.124614 14470 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:48.125242 14470 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:48.127426 14470 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:48.131145  6608 leader_election.cc:336] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:48.131726  6611 leader_election.cc:336] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:48.132068  6611 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:48.132652 14470 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:48.192101 14470 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:48.192596 14470 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:48.195246 14470 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:48.199020  6611 leader_election.cc:336] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
W20260709 12:27:48.199501  6609 leader_election.cc:336] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:48.200083  6609 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:48.200783 14470 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
I20260709 12:27:48.225571 14435 raft_consensus.cc:493] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:48.226015 14435 raft_consensus.cc:515] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:48.228223 14435 leader_election.cc:290] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:48.231487  6608 leader_election.cc:336] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:48.232319  6611 leader_election.cc:336] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:48.232728  6611 leader_election.cc:304] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 25 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:48.233338 14435 raft_consensus.cc:2749] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Leader pre-election lost for term 25. Reason: could not achieve majority
I20260709 12:27:48.282864 14435 raft_consensus.cc:493] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:48.283484 14435 raft_consensus.cc:515] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:48.285115 14435 leader_election.cc:290] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:48.288658  6609 leader_election.cc:336] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:48.289100  6611 leader_election.cc:336] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:48.289494  6611 leader_election.cc:304] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:48.290041 14435 raft_consensus.cc:2749] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
W20260709 12:27:48.321221  6139 debug-util.cc:398] Leaking SignalData structure 0x7b0800331060 after lost signal to thread 4824
W20260709 12:27:48.322417  6139 debug-util.cc:398] Leaking SignalData structure 0x7b08003f0fa0 after lost signal to thread 5900
W20260709 12:27:48.323083  6139 debug-util.cc:398] Leaking SignalData structure 0x7b0800045920 after lost signal to thread 6142
W20260709 12:27:48.324198  6139 debug-util.cc:398] Leaking SignalData structure 0x7b08002e14e0 after lost signal to thread 6675
I20260709 12:27:48.398639 14435 raft_consensus.cc:493] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:48.399252 14435 raft_consensus.cc:515] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:48.402503  4821 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 6139)
I20260709 12:27:48.406019 14435 leader_election.cc:290] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:48.408275  6611 leader_election.cc:336] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
W20260709 12:27:48.412047  6609 leader_election.cc:336] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:48.412472  6609 leader_election.cc:304] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:48.413148 14435 raft_consensus.cc:2749] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
I20260709 12:27:48.421604 14435 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:48.422106 14435 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:48.428366  6611 leader_election.cc:336] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:48.426187 14435 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:48.430152  6609 leader_election.cc:336] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:48.430610  6609 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:48.431268 14435 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:27:48.436460  6608 consensus_peers.cc:597] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:48.449455 14435 raft_consensus.cc:493] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:48.450006 14435 raft_consensus.cc:515] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Starting pre-election with config: opid_index: 12 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } attrs { replace: true } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:48.453459 14435 leader_election.cc:290] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:48.459077  6608 leader_election.cc:336] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:48.459786  6611 leader_election.cc:336] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:48.460263  6611 leader_election.cc:304] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 4 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:48.461349 14435 raft_consensus.cc:2749] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Leader pre-election lost for term 18. Reason: could not achieve majority
W20260709 12:27:48.461443  6609 leader_election.cc:336] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 18 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:48.489549  6608 consensus_peers.cc:597] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:48.610539 14475 raft_consensus.cc:493] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:48.612010 14475 raft_consensus.cc:515] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 16 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:48.621798  6608 leader_election.cc:336] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:48.622984 14475 leader_election.cc:290] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:48.625484  6609 leader_election.cc:336] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:48.625958  6609 leader_election.cc:304] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:48.627470 14474 raft_consensus.cc:2749] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
I20260709 12:27:48.845715 14475 raft_consensus.cc:493] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:48.846591 14475 raft_consensus.cc:515] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:48.848991 14475 leader_election.cc:290] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:48.853955  6608 leader_election.cc:336] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:48.856334  6609 leader_election.cc:336] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:48.856761  6609 leader_election.cc:304] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 16 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:48.857517 14474 raft_consensus.cc:2749] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Leader pre-election lost for term 16. Reason: could not achieve majority
I20260709 12:27:49.179090 14475 raft_consensus.cc:493] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:49.179872 14475 raft_consensus.cc:515] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:49.182685 14475 leader_election.cc:290] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:49.189378  6608 leader_election.cc:336] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:49.192771  6609 leader_election.cc:336] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:49.193259  6609 leader_election.cc:304] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:49.194819 14475 raft_consensus.cc:2749] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:27:49.278860  6611 consensus_peers.cc:597] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:49.329488  6611 consensus_peers.cc:597] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:49.355952  6609 consensus_peers.cc:597] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:49.415827  6609 consensus_peers.cc:597] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:27:49.422927  6611 consensus_peers.cc:597] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:49.445961  6611 consensus_peers.cc:597] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:49.477074  6611 consensus_peers.cc:597] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:49.482738  6611 consensus_peers.cc:597] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:49.485080  6611 consensus_peers.cc:597] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:49.486600  6609 consensus_peers.cc:597] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:49.491348 14475 raft_consensus.cc:493] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:49.492264 14475 raft_consensus.cc:515] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:49.495967 14475 leader_election.cc:290] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:49.499879  6608 leader_election.cc:336] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:49.501236  6609 leader_election.cc:336] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:49.501670  6609 leader_election.cc:304] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 22 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:49.502616 14475 raft_consensus.cc:2749] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Leader pre-election lost for term 22. Reason: could not achieve majority
W20260709 12:27:49.525318  6608 consensus_peers.cc:597] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:49.552220  6609 consensus_peers.cc:597] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:49.569084  6609 consensus_peers.cc:597] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:49.612511  6611 consensus_peers.cc:597] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:49.618695  6611 consensus_peers.cc:597] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:49.623883  4821 tablet_server.cc:196] TabletServer@127.4.181.67:0 shutdown complete.
W20260709 12:27:49.629958  6611 consensus_peers.cc:597] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:49.641115  6611 consensus_peers.cc:597] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:49.642402 14474 raft_consensus.cc:493] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:49.643266 14474 raft_consensus.cc:515] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:49.646283 14474 leader_election.cc:290] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:49.652236  6609 leader_election.cc:336] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:49.654042  6611 leader_election.cc:336] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:49.654610  6611 leader_election.cc:304] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 26 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:49.655800 14475 raft_consensus.cc:2749] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Leader pre-election lost for term 26. Reason: could not achieve majority
W20260709 12:27:49.656008  6611 consensus_peers.cc:597] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:49.662537  6611 consensus_peers.cc:597] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:49.685423  6611 consensus_peers.cc:597] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:27:49.697400  6609 consensus_peers.cc:597] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
W20260709 12:27:49.700232  6608 consensus_peers.cc:597] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
W20260709 12:27:49.735260  6611 consensus_peers.cc:597] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Couldn't send request to peer 0069e2ba1f02412e8e1d6c20a1fb510f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:27:49.765307 14475 raft_consensus.cc:493] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:49.766052 14475 raft_consensus.cc:515] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:49.768810 14475 leader_election.cc:290] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:49.774446  6609 leader_election.cc:336] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:49.775058  6611 leader_election.cc:336] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:49.775549  6611 leader_election.cc:304] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 17 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:49.776327 14475 raft_consensus.cc:2749] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Leader pre-election lost for term 17. Reason: could not achieve majority
W20260709 12:27:49.790524  6608 consensus_peers.cc:597] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:49.795574  4821 tablet_server.cc:179] TabletServer@127.4.181.68:0 shutting down...
I20260709 12:27:49.798931 14475 raft_consensus.cc:493] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:49.799731 14475 raft_consensus.cc:515] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:49.803141 14475 leader_election.cc:290] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:49.809092  6609 leader_election.cc:336] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:49.815943  6608 leader_election.cc:336] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:49.816469  6608 leader_election.cc:304] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:49.817188 14474 raft_consensus.cc:2749] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
W20260709 12:27:49.821894  6608 consensus_peers.cc:597] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 36: this message will repeat every 5th retry.
I20260709 12:27:49.828928 14475 raft_consensus.cc:493] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:49.829849 14475 raft_consensus.cc:515] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:49.832293 14475 leader_election.cc:290] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
W20260709 12:27:49.836819  6611 leader_election.cc:336] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:49.850219 14475 raft_consensus.cc:493] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
W20260709 12:27:49.850701  6608 leader_election.cc:336] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:49.851281  6608 leader_election.cc:304] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
W20260709 12:27:49.851835  6609 consensus_peers.cc:597] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:49.852064 14474 raft_consensus.cc:2749] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:49.851204 14475 raft_consensus.cc:515] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Starting pre-election with config: opid_index: 7 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
W20260709 12:27:49.854919  6609 consensus_peers.cc:597] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:27:49.860210 14474 raft_consensus.cc:493] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting pre-election (detected failure of leader 0557a7246c8945b99e5215c99d4ddf9c)
I20260709 12:27:49.861459 14474 raft_consensus.cc:515] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f1bb8e63c2b448cdafd51f05d277c741" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42981 } } peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:49.863600 14474 leader_election.cc:290] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473)
W20260709 12:27:49.868513  6609 leader_election.cc:336] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
W20260709 12:27:49.869978  6608 leader_election.cc:336] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:49.873368  6608 leader_election.cc:336] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: RPC error from VoteRequest() call to peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
W20260709 12:27:49.873574  6611 leader_election.cc:336] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:49.873858  6608 leader_election.cc:304] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 24 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0557a7246c8945b99e5215c99d4ddf9c, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:49.874061  6611 leader_election.cc:304] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, f1bb8e63c2b448cdafd51f05d277c741
I20260709 12:27:49.874913 14475 leader_election.cc:290] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 19 pre-election: Requested pre-vote from peers f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:49.875114 14474 raft_consensus.cc:2749] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Leader pre-election lost for term 24. Reason: could not achieve majority
I20260709 12:27:49.875576 14475 raft_consensus.cc:2749] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Leader pre-election lost for term 19. Reason: could not achieve majority
I20260709 12:27:49.880951  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:27:49.881934 14477 raft_consensus.cc:493] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:49.882580 14477 raft_consensus.cc:515] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:49.885545  4821 tablet_replica.cc:333] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.889063  4821 raft_consensus.cc:2243] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Raft consensus shutting down.
W20260709 12:27:49.889662  6611 leader_election.cc:336] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:49.890662  4821 raft_consensus.cc:2272] T 117509103bb449868a97cf0ba4fdda89 P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.895545  4821 tablet_replica.cc:333] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.896843  4821 raft_consensus.cc:2243] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:49.898598 14477 leader_election.cc:290] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:49.899461  4821 raft_consensus.cc:2272] T 7d1c158430bb487aa1d4c5a69165aa32 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:49.902344  6609 leader_election.cc:336] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:49.902963  6609 leader_election.cc:304] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 23 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:49.903333  4821 tablet_replica.cc:333] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.903846 14477 raft_consensus.cc:2749] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Leader pre-election lost for term 23. Reason: could not achieve majority
I20260709 12:27:49.904343  4821 raft_consensus.cc:2243] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:27:49.905861  4821 raft_consensus.cc:2272] T 81efabae1bb448e3a8483e6231673c10 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.909822  4821 tablet_replica.cc:333] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.910756  4821 raft_consensus.cc:2243] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 14 LEADER]: Raft consensus shutting down.
W20260709 12:27:49.911108  6609 consensus_peers.cc:597] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 -> Peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Couldn't send request to peer 0557a7246c8945b99e5215c99d4ddf9c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111). This is attempt 16: this message will repeat every 5th retry.
I20260709 12:27:49.912281  4821 raft_consensus.cc:2272] T b1b3ddf896ce40f5b9c2632735843215 P 24012af7747d4c4ea89c3da2ff950099 [term 14 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.915999  4821 tablet_replica.cc:333] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.916882  4821 raft_consensus.cc:2243] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:49.917655  4821 raft_consensus.cc:2272] T 12ca0d61cb524660bae3b43f9f1c5389 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:49.918394  6608 consensus_peers.cc:597] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 -> Peer f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): Couldn't send request to peer f1bb8e63c2b448cdafd51f05d277c741. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111). This is attempt 31: this message will repeat every 5th retry.
I20260709 12:27:49.920632  4821 tablet_replica.cc:333] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.921366  4821 raft_consensus.cc:2243] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:49.921845  4821 raft_consensus.cc:2272] T c087bb99e3b64274863f583bf7ae435f P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.924535  4821 tablet_replica.cc:333] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.925256  4821 raft_consensus.cc:2243] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:49.925881  4821 raft_consensus.cc:2272] T 1956c0a3a799470a83a524ca2ae0ce14 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.929117  4821 tablet_replica.cc:333] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.930003  4821 raft_consensus.cc:2243] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:49.930948  4821 raft_consensus.cc:2272] T bd91034e550f4704be7f47b7aff3ed25 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.933612  4821 tablet_replica.cc:333] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.934331  4821 raft_consensus.cc:2243] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:49.935178  4821 raft_consensus.cc:2272] T a0b00ef9114f441baff2557bc164b4d7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.938136  4821 tablet_replica.cc:333] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.938876  4821 raft_consensus.cc:2243] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:49.940461  4821 raft_consensus.cc:2272] T bc02451d94184328a520860e40f6b77c P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.943564  4821 tablet_replica.cc:333] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.944150  4821 raft_consensus.cc:2243] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:49.944689  4821 raft_consensus.cc:2272] T 7bf137aab07e4b9b8024d07355c33351 P 24012af7747d4c4ea89c3da2ff950099 [term 24 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.947194  4821 tablet_replica.cc:333] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.947916  4821 raft_consensus.cc:2243] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:49.948768  4821 raft_consensus.cc:2272] T be9bf17a0be244b3bdd7bec88bf5a051 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.951895  4821 tablet_replica.cc:333] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.952617  4821 raft_consensus.cc:2243] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:27:49.954000  4821 raft_consensus.cc:2272] T 7df97235d12b46dd8e54f8f1d6ed40bd P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.957216  4821 tablet_replica.cc:333] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.957921  4821 raft_consensus.cc:2243] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:27:49.959295  4821 raft_consensus.cc:2272] T 4f2d24cb0978411e851e8ff35955bf2e P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.962141  4821 tablet_replica.cc:333] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.962808  4821 raft_consensus.cc:2243] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:49.963480  4821 raft_consensus.cc:2272] T 6b70d6df693140769deef828413df1ba P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.965817  4821 tablet_replica.cc:333] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.966511  4821 raft_consensus.cc:2243] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:27:49.967470  4821 raft_consensus.cc:2272] T d24ea63f22cb4977ad36707d9d0fffea P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.969513  4821 tablet_replica.cc:333] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.970060  4821 raft_consensus.cc:2243] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Raft consensus shutting down.
I20260709 12:27:49.971024  4821 raft_consensus.cc:2272] T d0a77cc9656a4b88bc262752ad91e486 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.973244  4821 tablet_replica.cc:333] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.973896  4821 raft_consensus.cc:2243] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:49.974597  4821 raft_consensus.cc:2272] T efdaf6941ab7409d90619a5e9f5c10c3 P 24012af7747d4c4ea89c3da2ff950099 [term 15 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.976236 14475 raft_consensus.cc:493] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election (detected failure of leader 0069e2ba1f02412e8e1d6c20a1fb510f)
I20260709 12:27:49.976881  4821 tablet_replica.cc:333] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.976805 14475 raft_consensus.cc:515] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "0557a7246c8945b99e5215c99d4ddf9c" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 45473 } } peers { permanent_uuid: "0069e2ba1f02412e8e1d6c20a1fb510f" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 39787 } } peers { permanent_uuid: "24012af7747d4c4ea89c3da2ff950099" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 45477 } attrs { promote: false } }
I20260709 12:27:49.977552  4821 raft_consensus.cc:2243] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:49.978969  4821 raft_consensus.cc:2272] T aa90f801f44d4669a2a93aafa33e4e17 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.979553 14475 leader_election.cc:290] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Requested pre-vote from peers 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473), 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787)
I20260709 12:27:49.983012  4821 tablet_replica.cc:333] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.983937  4821 raft_consensus.cc:2243] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 18 LEADER]: Raft consensus shutting down.
W20260709 12:27:49.984717  6609 leader_election.cc:336] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0557a7246c8945b99e5215c99d4ddf9c (127.4.181.66:45473): Network error: Client connection negotiation failed: client connection to 127.4.181.66:45473: connect: Connection refused (error 111)
I20260709 12:27:49.985347  4821 raft_consensus.cc:2272] T 5a6d648272bf4bef9d5337acfc9d4a96 P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Raft consensus is shut down!
W20260709 12:27:49.985574  6611 leader_election.cc:336] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: RPC error from VoteRequest() call to peer 0069e2ba1f02412e8e1d6c20a1fb510f (127.4.181.67:39787): Network error: Client connection negotiation failed: client connection to 127.4.181.67:39787: connect: Connection refused (error 111)
I20260709 12:27:49.986961  6611 leader_election.cc:304] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [CANDIDATE]: Term 20 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 24012af7747d4c4ea89c3da2ff950099; no voters: 0069e2ba1f02412e8e1d6c20a1fb510f, 0557a7246c8945b99e5215c99d4ddf9c
I20260709 12:27:49.987689 14475 raft_consensus.cc:2749] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Leader pre-election lost for term 20. Reason: could not achieve majority
I20260709 12:27:49.988675  4821 tablet_replica.cc:333] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.989316  4821 raft_consensus.cc:2243] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 LEADER]: Raft consensus shutting down.
I20260709 12:27:49.990686  4821 raft_consensus.cc:2272] T 8ff337cd5a364d1c9100f9a31dd826f7 P 24012af7747d4c4ea89c3da2ff950099 [term 21 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.993268  4821 tablet_replica.cc:333] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.993863  4821 raft_consensus.cc:2243] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:49.994513  4821 raft_consensus.cc:2272] T ec584257f9db451c965f6b092aa9069c P 24012af7747d4c4ea89c3da2ff950099 [term 18 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:49.997152  4821 tablet_replica.cc:333] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:49.997715  4821 raft_consensus.cc:2243] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:49.998234  4821 raft_consensus.cc:2272] T d7b7660ead3b4a4da081b0199f44037f P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.000581  4821 tablet_replica.cc:333] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.001123  4821 raft_consensus.cc:2243] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.002322  4821 raft_consensus.cc:2272] T 02dd5c8c15e34ecfbc46620193fb5762 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.004627  4821 tablet_replica.cc:333] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.005260  4821 raft_consensus.cc:2243] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.006369  4821 raft_consensus.cc:2272] T e3ef3cb064eb4a1597f89e040fce3c7e P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.009868  4821 tablet_replica.cc:333] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.010416  4821 raft_consensus.cc:2243] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.011396  4821 raft_consensus.cc:2272] T 0468d70863214876bf59fb3ea9474307 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.013449  4821 tablet_replica.cc:333] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.013932  4821 raft_consensus.cc:2243] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 20 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.015043  4821 raft_consensus.cc:2272] T 5744a277c5a3409b95831573168daf3f P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.017347  4821 tablet_replica.cc:333] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.017982  4821 raft_consensus.cc:2243] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 19 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.019014  4821 raft_consensus.cc:2272] T 4783d1a7790a4be2a959bd61e6f21947 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.021236  4821 tablet_replica.cc:333] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.021811  4821 raft_consensus.cc:2243] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.022523  4821 raft_consensus.cc:2272] T 78c13bc0b46b40a3886a209b87dd6f98 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.025389  4821 tablet_replica.cc:333] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.026017  4821 raft_consensus.cc:2243] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.027037  4821 raft_consensus.cc:2272] T afdcf44718954edea3bd3aa8ada58035 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.028906  4821 tablet_replica.cc:333] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.029407  4821 raft_consensus.cc:2243] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.030009  4821 raft_consensus.cc:2272] T c357e710ee044329b93321405ae76071 P 24012af7747d4c4ea89c3da2ff950099 [term 20 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.032269  4821 tablet_replica.cc:333] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.032824  4821 raft_consensus.cc:2243] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.033370  4821 raft_consensus.cc:2272] T 3fd6047b66ab4b4abc3fe659e8cff000 P 24012af7747d4c4ea89c3da2ff950099 [term 19 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.035936  4821 tablet_replica.cc:333] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.036439  4821 raft_consensus.cc:2243] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 22 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.037325  4821 raft_consensus.cc:2272] T c87516dfcddf4c8b8d921f3512db9063 P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.039283  4821 tablet_replica.cc:333] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.039758  4821 raft_consensus.cc:2243] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 23 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.040670  4821 raft_consensus.cc:2272] T a0acc59e2e4d43029c959c64a291c5a0 P 24012af7747d4c4ea89c3da2ff950099 [term 23 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.042701  4821 tablet_replica.cc:333] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.043216  4821 raft_consensus.cc:2243] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 12 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.044246  4821 raft_consensus.cc:2272] T cf28639931bb43a58703f0afd043e166 P 24012af7747d4c4ea89c3da2ff950099 [term 12 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.046288  4821 tablet_replica.cc:333] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.046803  4821 raft_consensus.cc:2243] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.047475  4821 raft_consensus.cc:2272] T ba1e2d6430774a629131a0953161507b P 24012af7747d4c4ea89c3da2ff950099 [term 22 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.049670  4821 tablet_replica.cc:333] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.050133  4821 raft_consensus.cc:2243] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.050618  4821 raft_consensus.cc:2272] T 0636290fb57e4842995ddf9549f0c721 P 24012af7747d4c4ea89c3da2ff950099 [term 25 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.052441  4821 tablet_replica.cc:333] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.052902  4821 raft_consensus.cc:2243] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Raft consensus shutting down.
I20260709 12:27:50.053448  4821 raft_consensus.cc:2272] T 5e596fee38d14bcb913a2aaadffa2a72 P 24012af7747d4c4ea89c3da2ff950099 [term 16 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.055498  4821 tablet_replica.cc:333] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.055970  4821 raft_consensus.cc:2243] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 31 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.056967  4821 raft_consensus.cc:2272] T 1d97a0d1272049469a8fe2111554686a P 24012af7747d4c4ea89c3da2ff950099 [term 31 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.059685  4821 tablet_replica.cc:333] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.060263  4821 raft_consensus.cc:2243] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 17 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.061369  4821 raft_consensus.cc:2272] T 0ad617c44395493f82e992b73a4295ad P 24012af7747d4c4ea89c3da2ff950099 [term 17 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.063380  4821 tablet_replica.cc:333] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099: stopping tablet replica
I20260709 12:27:50.063813  4821 raft_consensus.cc:2243] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 28 LEADER]: Raft consensus shutting down.
I20260709 12:27:50.064970  4821 raft_consensus.cc:2272] T 38df61ba407240499023581d9f885037 P 24012af7747d4c4ea89c3da2ff950099 [term 28 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:50.637632  4821 tablet_server.cc:196] TabletServer@127.4.181.68:0 shutdown complete.
I20260709 12:27:50.717464  4821 master.cc:562] Master@127.4.181.126:41341 shutting down...
W20260709 12:27:50.746985  5914 auto_rebalancer.cc:873] Removing replace marker failed: Catalog manager is not initialized. State: Closing
W20260709 12:27:50.747233  5914 auto_rebalancer.cc:901] Could not move replica: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:27:50.747475  5914 auto_rebalancer.cc:330] scheduled replica move failed to complete: Service unavailable: Catalog manager is not initialized. State: Closing
W20260709 12:27:52.904855  5850 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111) [suppressed 291 similar messages]
W20260709 12:27:52.908601  5850 catalog_manager.cc:4755] TS f1bb8e63c2b448cdafd51f05d277c741 (127.4.181.65:42981): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet aa90f801f44d4669a2a93aafa33e4e17: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42981: connect: Connection refused (error 111)
I20260709 12:27:53.059393  4821 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:27:53.060185  4821 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:27:53.060530  4821 tablet_replica.cc:333] T 00000000000000000000000000000000 P 5def43035e3245068dbad43bca95206c: stopping tablet replica
I20260709 12:27:53.270678  4821 master.cc:584] Master@127.4.181.126:41341 shutdown complete.
I20260709 12:27:53.314783  4821 test_util.cc:182] -----------------------------------------------
I20260709 12:27:53.315140  4821 test_util.cc:183] Had failures, leaving test files at /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1783599758264527-4821-0
[  FAILED  ] LeaderRebalancerTest.AddTserver (255122 ms)
[ RUN      ] LeaderRebalancerTest.RestartTserver
I20260709 12:27:53.319306  4821 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.181.126:42487
I20260709 12:27:53.320636  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:53.328033 14481 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:53.328049 14482 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:53.328172 14484 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:53.329787  4821 server_base.cc:1061] running on GCE node
I20260709 12:27:53.333303  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:53.333587  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:53.333849  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600073333827 us; error 0 us; skew 500 ppm
I20260709 12:27:53.334429  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:53.337132  4821 webserver.cc:533] Webserver started at http://127.4.181.126:42537/ using document root <none> and password file <none>
I20260709 12:27:53.337625  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:53.337791  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:53.338035  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:53.339380  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/master-0-root/instance:
uuid: "756f49f67389419d9b559e8d3ea56374"
format_stamp: "Formatted at 2026-07-09 12:27:53 on dist-test-slave-k014"
I20260709 12:27:53.344515  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:27:53.348742 14489 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:53.349587  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:27:53.349902  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/master-0-root
uuid: "756f49f67389419d9b559e8d3ea56374"
format_stamp: "Formatted at 2026-07-09 12:27:53 on dist-test-slave-k014"
I20260709 12:27:53.350183  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:53.372781  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:53.374009  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:53.412648  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.126:42487
I20260709 12:27:53.412750 14540 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.126:42487 every 8 connection(s)
I20260709 12:27:53.416671 14541 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:53.426960 14541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374: Bootstrap starting.
I20260709 12:27:53.431918 14541 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:53.436192 14541 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374: No bootstrap required, opened a new log
I20260709 12:27:53.438391 14541 raft_consensus.cc:359] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "756f49f67389419d9b559e8d3ea56374" member_type: VOTER }
I20260709 12:27:53.438843 14541 raft_consensus.cc:385] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:53.439054 14541 raft_consensus.cc:740] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 756f49f67389419d9b559e8d3ea56374, State: Initialized, Role: FOLLOWER
I20260709 12:27:53.439580 14541 consensus_queue.cc:260] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "756f49f67389419d9b559e8d3ea56374" member_type: VOTER }
I20260709 12:27:53.440026 14541 raft_consensus.cc:399] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:27:53.440227 14541 raft_consensus.cc:493] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:27:53.440475 14541 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:53.444922 14541 raft_consensus.cc:515] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "756f49f67389419d9b559e8d3ea56374" member_type: VOTER }
I20260709 12:27:53.445405 14541 leader_election.cc:304] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 756f49f67389419d9b559e8d3ea56374; no voters: 
I20260709 12:27:53.446537 14541 leader_election.cc:290] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:27:53.446861 14544 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:53.448504 14544 raft_consensus.cc:697] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [term 1 LEADER]: Becoming Leader. State: Replica: 756f49f67389419d9b559e8d3ea56374, State: Running, Role: LEADER
I20260709 12:27:53.449318 14544 consensus_queue.cc:237] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "756f49f67389419d9b559e8d3ea56374" member_type: VOTER }
I20260709 12:27:53.449921 14541 sys_catalog.cc:565] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:27:53.454437 14545 sys_catalog.cc:455] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "756f49f67389419d9b559e8d3ea56374" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "756f49f67389419d9b559e8d3ea56374" member_type: VOTER } }
I20260709 12:27:53.454775 14546 sys_catalog.cc:455] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 756f49f67389419d9b559e8d3ea56374. Latest consensus state: current_term: 1 leader_uuid: "756f49f67389419d9b559e8d3ea56374" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "756f49f67389419d9b559e8d3ea56374" member_type: VOTER } }
I20260709 12:27:53.455101 14545 sys_catalog.cc:458] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:53.455237 14546 sys_catalog.cc:458] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [sys.catalog]: This master's current role is: LEADER
I20260709 12:27:53.466406 14551 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:27:53.467545  4821 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:27:53.471935 14551 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:27:53.480732 14551 catalog_manager.cc:1383] Generated new cluster ID: 393db12d292c4b7091a4848822c30bda
I20260709 12:27:53.481012 14551 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:27:53.497720 14551 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:27:53.498984 14551 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:27:53.510728 14551 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374: Generated new TSK 0
I20260709 12:27:53.511313 14551 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:27:53.534304  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:53.540529 14562 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:53.541723 14563 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:53.544998  4821 server_base.cc:1061] running on GCE node
W20260709 12:27:53.545388 14565 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:53.547921  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:53.548110  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:53.548228  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600073548217 us; error 0 us; skew 500 ppm
I20260709 12:27:53.548704  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:53.551045  4821 webserver.cc:533] Webserver started at http://127.4.181.65:43625/ using document root <none> and password file <none>
I20260709 12:27:53.551553  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:53.551710  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:53.551924  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:53.553027  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/instance:
uuid: "c0cbbdf206b5458e9af48c22b862264a"
format_stamp: "Formatted at 2026-07-09 12:27:53 on dist-test-slave-k014"
I20260709 12:27:53.557616  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.001s
I20260709 12:27:53.561225 14570 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:53.562083  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:27:53.562402  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-0-root
uuid: "c0cbbdf206b5458e9af48c22b862264a"
format_stamp: "Formatted at 2026-07-09 12:27:53 on dist-test-slave-k014"
I20260709 12:27:53.562745  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:53.580492  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:53.581696  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:53.583168  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:53.585346  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:53.585531  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:53.585757  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:53.585915  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:53.625288  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.65:39063
I20260709 12:27:53.625413 14632 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.65:39063 every 8 connection(s)
I20260709 12:27:53.630339  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:53.638216 14637 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:53.640456 14638 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:53.641777 14640 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:53.642540  4821 server_base.cc:1061] running on GCE node
I20260709 12:27:53.644855  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:53.645093  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:53.645275  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600073645256 us; error 0 us; skew 500 ppm
I20260709 12:27:53.645977  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:53.648092 14633 heartbeater.cc:344] Connected to a master server at 127.4.181.126:42487
I20260709 12:27:53.648551 14633 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:53.648739  4821 webserver.cc:533] Webserver started at http://127.4.181.66:32925/ using document root <none> and password file <none>
I20260709 12:27:53.649407  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:53.649520 14633 heartbeater.cc:507] Master 127.4.181.126:42487 requested a full tablet report, sending...
I20260709 12:27:53.649652  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:53.650070  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:53.651558  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/instance:
uuid: "9a105adb44fb47078d6cb03a6c02026f"
format_stamp: "Formatted at 2026-07-09 12:27:53 on dist-test-slave-k014"
I20260709 12:27:53.652200 14506 ts_manager.cc:194] Registered new tserver with Master: c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:53.653986 14506 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52216
I20260709 12:27:53.656214  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.001s
I20260709 12:27:53.660182 14645 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:53.660972  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:27:53.661266  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-1-root
uuid: "9a105adb44fb47078d6cb03a6c02026f"
format_stamp: "Formatted at 2026-07-09 12:27:53 on dist-test-slave-k014"
I20260709 12:27:53.661550  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:53.675120  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:53.676304  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:53.677742  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:53.679957  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:53.680145  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:53.680351  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:53.680519  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:53.720456  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.66:46705
I20260709 12:27:53.720602 14707 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.66:46705 every 8 connection(s)
I20260709 12:27:53.725647  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:53.732519 14711 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:53.734431 14712 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:53.736017 14714 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:53.737774  4821 server_base.cc:1061] running on GCE node
I20260709 12:27:53.737790 14708 heartbeater.cc:344] Connected to a master server at 127.4.181.126:42487
I20260709 12:27:53.738355 14708 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:53.738801  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:27:53.739048  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:53.739135 14708 heartbeater.cc:507] Master 127.4.181.126:42487 requested a full tablet report, sending...
I20260709 12:27:53.739207  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600073739189 us; error 0 us; skew 500 ppm
I20260709 12:27:53.739979  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:53.741555 14506 ts_manager.cc:194] Registered new tserver with Master: 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:27:53.742890  4821 webserver.cc:533] Webserver started at http://127.4.181.67:38207/ using document root <none> and password file <none>
I20260709 12:27:53.743484 14506 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52232
I20260709 12:27:53.743602  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:53.743988  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:53.744329  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:53.745590  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/instance:
uuid: "c95afda23abe49318972444cc68998a7"
format_stamp: "Formatted at 2026-07-09 12:27:53 on dist-test-slave-k014"
I20260709 12:27:53.750082  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:27:53.753712 14719 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:53.754431  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:27:53.754765  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-2-root
uuid: "c95afda23abe49318972444cc68998a7"
format_stamp: "Formatted at 2026-07-09 12:27:53 on dist-test-slave-k014"
I20260709 12:27:53.755052  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:53.784897  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:53.786124  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:53.787647  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:53.789937  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:53.790144  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:53.790364  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:53.790544  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:27:53.833127  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.67:42945
I20260709 12:27:53.833238 14781 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.67:42945 every 8 connection(s)
I20260709 12:27:53.838282  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:27:53.845867 14785 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:27:53.847672 14786 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:53.851830  4821 server_base.cc:1061] running on GCE node
W20260709 12:27:53.851456 14788 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:27:53.851966 14782 heartbeater.cc:344] Connected to a master server at 127.4.181.126:42487
I20260709 12:27:53.852514 14782 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:53.853387  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:27:53.853572 14782 heartbeater.cc:507] Master 127.4.181.126:42487 requested a full tablet report, sending...
W20260709 12:27:53.853705  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:27:53.854048  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600073854026 us; error 0 us; skew 500 ppm
I20260709 12:27:53.854866  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:27:53.855916 14506 ts_manager.cc:194] Registered new tserver with Master: c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:53.857738 14506 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52244
I20260709 12:27:53.857837  4821 webserver.cc:533] Webserver started at http://127.4.181.68:38777/ using document root <none> and password file <none>
I20260709 12:27:53.858449  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:27:53.858695  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:27:53.858985  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:27:53.860507  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-3-root/instance:
uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
format_stamp: "Formatted at 2026-07-09 12:27:53 on dist-test-slave-k014"
I20260709 12:27:53.865141  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:27:53.868517 14793 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:53.869508  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:27:53.869853  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-3-root
uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
format_stamp: "Formatted at 2026-07-09 12:27:53 on dist-test-slave-k014"
I20260709 12:27:53.870112  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:27:53.888998  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:27:53.890278  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:27:53.891814  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:27:53.894168  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:27:53.894371  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:53.894675  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:27:53.894826  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:27:53.940227  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.68:35543
I20260709 12:27:53.940327 14855 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.68:35543 every 8 connection(s)
I20260709 12:27:53.953732 14856 heartbeater.cc:344] Connected to a master server at 127.4.181.126:42487
I20260709 12:27:53.954154 14856 heartbeater.cc:461] Registering TS with master...
I20260709 12:27:53.954912 14856 heartbeater.cc:507] Master 127.4.181.126:42487 requested a full tablet report, sending...
I20260709 12:27:53.956804 14506 ts_manager.cc:194] Registered new tserver with Master: 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:53.958010  4821 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.014733517s
I20260709 12:27:53.958428 14506 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52248
I20260709 12:27:53.985472 14506 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52264:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
I20260709 12:27:54.262513 14598 tablet_service.cc:1511] Processing CreateTablet for tablet 9f24860ec9a043a491db9afb3516eedd (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:27:54.264122 14598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f24860ec9a043a491db9afb3516eedd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.266009 14673 tablet_service.cc:1511] Processing CreateTablet for tablet 9f24860ec9a043a491db9afb3516eedd (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:27:54.266269 14595 tablet_service.cc:1511] Processing CreateTablet for tablet fa8000e051fc45f8a4f3782b144f95a8 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:27:54.267623 14673 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f24860ec9a043a491db9afb3516eedd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.267843 14595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8000e051fc45f8a4f3782b144f95a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.270083 14596 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8190b1186645b4aa61fbd5207622cf (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:27:54.271610 14596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8190b1186645b4aa61fbd5207622cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.271347 14671 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9c76cb01cd4cd78bb4a2826b2b06ea (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:27:54.272830 14671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9c76cb01cd4cd78bb4a2826b2b06ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.275655 14670 tablet_service.cc:1511] Processing CreateTablet for tablet fa8000e051fc45f8a4f3782b144f95a8 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:27:54.277245 14670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8000e051fc45f8a4f3782b144f95a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.277926 14594 tablet_service.cc:1511] Processing CreateTablet for tablet 1f50744c152c4f22b65828c60d9d2974 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:27:54.279520 14594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f50744c152c4f22b65828c60d9d2974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.279320 14669 tablet_service.cc:1511] Processing CreateTablet for tablet 1f50744c152c4f22b65828c60d9d2974 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:27:54.280755 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f50744c152c4f22b65828c60d9d2974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.269986 14672 tablet_service.cc:1511] Processing CreateTablet for tablet 242076f4476b46f1a12a0a07ced33d27 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:27:54.281738 14593 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd7f28a6ca34728b1f3c599fc653c6d (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:27:54.282584 14672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242076f4476b46f1a12a0a07ced33d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.283561 14593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd7f28a6ca34728b1f3c599fc653c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.279538 14668 tablet_service.cc:1511] Processing CreateTablet for tablet e928d444370c4dc49f31e057169dbba0 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:27:54.285894 14668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e928d444370c4dc49f31e057169dbba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.275542 14597 tablet_service.cc:1511] Processing CreateTablet for tablet 242076f4476b46f1a12a0a07ced33d27 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:27:54.288342 14597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242076f4476b46f1a12a0a07ced33d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.305320 14592 tablet_service.cc:1511] Processing CreateTablet for tablet 5e224159bcb74464a91df02dfd2d755a (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:27:54.307231 14667 tablet_service.cc:1511] Processing CreateTablet for tablet 5e224159bcb74464a91df02dfd2d755a (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:27:54.308786 14667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e224159bcb74464a91df02dfd2d755a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.309095 14747 tablet_service.cc:1511] Processing CreateTablet for tablet 242076f4476b46f1a12a0a07ced33d27 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20260709 12:27:54.311712 14746 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8190b1186645b4aa61fbd5207622cf (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:27:54.314111 14745 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9c76cb01cd4cd78bb4a2826b2b06ea (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:27:54.314841 14666 tablet_service.cc:1511] Processing CreateTablet for tablet 4c3d4c5596d44c5ebc68130616ef1ddb (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:27:54.316331 14666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c3d4c5596d44c5ebc68130616ef1ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.317385 14744 tablet_service.cc:1511] Processing CreateTablet for tablet fa8000e051fc45f8a4f3782b144f95a8 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20260709 12:27:54.320171 14743 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd7f28a6ca34728b1f3c599fc653c6d (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:27:54.323168 14742 tablet_service.cc:1511] Processing CreateTablet for tablet e928d444370c4dc49f31e057169dbba0 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:27:54.325456 14592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e224159bcb74464a91df02dfd2d755a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.326082 14741 tablet_service.cc:1511] Processing CreateTablet for tablet 5e224159bcb74464a91df02dfd2d755a (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20260709 12:27:54.328240 14821 tablet_service.cc:1511] Processing CreateTablet for tablet 9f24860ec9a043a491db9afb3516eedd (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION VALUES < 36398027
I20260709 12:27:54.331045 14747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 242076f4476b46f1a12a0a07ced33d27. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.340344 14816 tablet_service.cc:1511] Processing CreateTablet for tablet e928d444370c4dc49f31e057169dbba0 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20260709 12:27:54.340749 14665 tablet_service.cc:1511] Processing CreateTablet for tablet b7c747ce7b704240a1399f870f7b99e0 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:27:54.342150 14665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c747ce7b704240a1399f870f7b99e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.331462 14820 tablet_service.cc:1511] Processing CreateTablet for tablet 9e8190b1186645b4aa61fbd5207622cf (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20260709 12:27:54.333491 14819 tablet_service.cc:1511] Processing CreateTablet for tablet 7f9c76cb01cd4cd78bb4a2826b2b06ea (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20260709 12:27:54.343590 14741 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5e224159bcb74464a91df02dfd2d755a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.344133 14815 tablet_service.cc:1511] Processing CreateTablet for tablet 4c3d4c5596d44c5ebc68130616ef1ddb (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:27:54.335788 14818 tablet_service.cc:1511] Processing CreateTablet for tablet 1f50744c152c4f22b65828c60d9d2974 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20260709 12:27:54.329679 14821 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9f24860ec9a043a491db9afb3516eedd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.346911 14820 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8190b1186645b4aa61fbd5207622cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.337982 14817 tablet_service.cc:1511] Processing CreateTablet for tablet 6dd7f28a6ca34728b1f3c599fc653c6d (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20260709 12:27:54.348114 14817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd7f28a6ca34728b1f3c599fc653c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.348315 14743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6dd7f28a6ca34728b1f3c599fc653c6d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.350891 14819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9c76cb01cd4cd78bb4a2826b2b06ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.353405 14590 tablet_service.cc:1511] Processing CreateTablet for tablet 82ff441d536243878e4f32c69217a59a (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:27:54.354225 14815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c3d4c5596d44c5ebc68130616ef1ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.354810 14590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ff441d536243878e4f32c69217a59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.338114 14591 tablet_service.cc:1511] Processing CreateTablet for tablet 4c3d4c5596d44c5ebc68130616ef1ddb (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20260709 12:27:54.357280 14818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1f50744c152c4f22b65828c60d9d2974. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.361374 14591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c3d4c5596d44c5ebc68130616ef1ddb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.362962 14740 tablet_service.cc:1511] Processing CreateTablet for tablet 82ff441d536243878e4f32c69217a59a (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:27:54.364969 14816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e928d444370c4dc49f31e057169dbba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.350854 14746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e8190b1186645b4aa61fbd5207622cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.378948 14744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fa8000e051fc45f8a4f3782b144f95a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.380275 14740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ff441d536243878e4f32c69217a59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.380985 14745 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7f9c76cb01cd4cd78bb4a2826b2b06ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.381639 14742 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e928d444370c4dc49f31e057169dbba0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.389894 14814 tablet_service.cc:1511] Processing CreateTablet for tablet 82ff441d536243878e4f32c69217a59a (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20260709 12:27:54.391422 14814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 82ff441d536243878e4f32c69217a59a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.419725 14877 tablet_bootstrap.cc:492] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:54.432353 14739 tablet_service.cc:1511] Processing CreateTablet for tablet b7c747ce7b704240a1399f870f7b99e0 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:27:54.435045 14739 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c747ce7b704240a1399f870f7b99e0. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:54.461445 14554 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:54.466777 14876 tablet_bootstrap.cc:492] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:54.497172 14813 tablet_service.cc:1511] Processing CreateTablet for tablet b7c747ce7b704240a1399f870f7b99e0 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20260709 12:27:54.498406 14598 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6c65eac6134e59bf2b86cb44ca7a4f (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:27:54.499749 14598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6c65eac6134e59bf2b86cb44ca7a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.502660 14813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b7c747ce7b704240a1399f870f7b99e0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.503736 14665 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6c65eac6134e59bf2b86cb44ca7a4f (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:27:54.505105 14665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6c65eac6134e59bf2b86cb44ca7a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.517119 14738 tablet_service.cc:1511] Processing CreateTablet for tablet 8f6c65eac6134e59bf2b86cb44ca7a4f (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20260709 12:27:54.518152 14812 tablet_service.cc:1511] Processing CreateTablet for tablet 37fcef99f4594e7f9d6132ec5719da49 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:27:54.519356 14738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f6c65eac6134e59bf2b86cb44ca7a4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.519565 14812 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fcef99f4594e7f9d6132ec5719da49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.520160 14877 tablet_bootstrap.cc:654] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:54.531303 14878 tablet_bootstrap.cc:492] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:54.547729 14669 tablet_service.cc:1511] Processing CreateTablet for tablet 37fcef99f4594e7f9d6132ec5719da49 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:27:54.549147 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fcef99f4594e7f9d6132ec5719da49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.549124 14596 tablet_service.cc:1511] Processing CreateTablet for tablet 37fcef99f4594e7f9d6132ec5719da49 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20260709 12:27:54.550556 14596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 37fcef99f4594e7f9d6132ec5719da49. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.553810 14878 tablet_bootstrap.cc:654] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:54.556550 14876 tablet_bootstrap.cc:654] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:54.561996 14819 tablet_service.cc:1511] Processing CreateTablet for tablet 8f70df459ff44f5b95b6a780b4d2a596 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:27:54.563421 14819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f70df459ff44f5b95b6a780b4d2a596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.565462 14743 tablet_service.cc:1511] Processing CreateTablet for tablet 8f70df459ff44f5b95b6a780b4d2a596 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:27:54.566890 14743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f70df459ff44f5b95b6a780b4d2a596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.586766 14598 tablet_service.cc:1511] Processing CreateTablet for tablet 8f70df459ff44f5b95b6a780b4d2a596 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20260709 12:27:54.588464 14598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8f70df459ff44f5b95b6a780b4d2a596. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.607376 14740 tablet_service.cc:1511] Processing CreateTablet for tablet 4fed1c5a7249449bb4b8c8a3543ba599 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:27:54.608863 14740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fed1c5a7249449bb4b8c8a3543ba599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.587343 14879 tablet_bootstrap.cc:492] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:54.588645 14669 tablet_service.cc:1511] Processing CreateTablet for tablet 4fed1c5a7249449bb4b8c8a3543ba599 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:27:54.627712 14877 tablet_bootstrap.cc:492] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:54.627365 14818 tablet_service.cc:1511] Processing CreateTablet for tablet 4fed1c5a7249449bb4b8c8a3543ba599 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20260709 12:27:54.628270 14877 ts_tablet_manager.cc:1403] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.209s	user 0.016s	sys 0.008s
I20260709 12:27:54.628918 14818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fed1c5a7249449bb4b8c8a3543ba599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.630129 14878 tablet_bootstrap.cc:492] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:54.630519 14879 tablet_bootstrap.cc:654] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:54.630652 14878 ts_tablet_manager.cc:1403] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.100s	user 0.021s	sys 0.032s
I20260709 12:27:54.628361 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4fed1c5a7249449bb4b8c8a3543ba599. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.641647 14878 raft_consensus.cc:359] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:54.643445 14878 raft_consensus.cc:385] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:54.643843 14878 raft_consensus.cc:740] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:54.644649 14878 consensus_queue.cc:260] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:54.643364 14744 tablet_service.cc:1511] Processing CreateTablet for tablet 2cf96c15d37c4522ab37cf6e48555598 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:27:54.648733 14876 tablet_bootstrap.cc:492] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:54.649286 14876 ts_tablet_manager.cc:1403] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.183s	user 0.011s	sys 0.000s
I20260709 12:27:54.651016 14744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cf96c15d37c4522ab37cf6e48555598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.651216 14671 tablet_service.cc:1511] Processing CreateTablet for tablet 2cf96c15d37c4522ab37cf6e48555598 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:27:54.652678 14671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cf96c15d37c4522ab37cf6e48555598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.657720 14633 heartbeater.cc:499] Master 127.4.181.126:42487 was elected leader, sending a full tablet report...
I20260709 12:27:54.660763 14813 tablet_service.cc:1511] Processing CreateTablet for tablet dba1b4acd4da45e7b1eee66ab684bd93 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:27:54.662823 14591 tablet_service.cc:1511] Processing CreateTablet for tablet 2cf96c15d37c4522ab37cf6e48555598 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20260709 12:27:54.668531 14876 raft_consensus.cc:359] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:54.669405 14876 raft_consensus.cc:385] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:54.669725 14876 raft_consensus.cc:740] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:54.652556 14877 raft_consensus.cc:359] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:54.671217 14877 raft_consensus.cc:385] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:54.671711 14877 raft_consensus.cc:740] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:54.672696 14877 consensus_queue.cc:260] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:54.673780 14672 tablet_service.cc:1511] Processing CreateTablet for tablet dba1b4acd4da45e7b1eee66ab684bd93 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:27:54.675917 14672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba1b4acd4da45e7b1eee66ab684bd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.663362 14813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba1b4acd4da45e7b1eee66ab684bd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.664232 14591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2cf96c15d37c4522ab37cf6e48555598. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.681607 14876 consensus_queue.cc:260] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:54.691349 14816 tablet_service.cc:1511] Processing CreateTablet for tablet 9a3a3209f9d64ed6bc4036a9d8bc0ef0 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:27:54.697309 14816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a3a3209f9d64ed6bc4036a9d8bc0ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.705122 14738 tablet_service.cc:1511] Processing CreateTablet for tablet 9a3a3209f9d64ed6bc4036a9d8bc0ef0 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:27:54.708823 14856 heartbeater.cc:499] Master 127.4.181.126:42487 was elected leader, sending a full tablet report...
I20260709 12:27:54.709218 14877 ts_tablet_manager.cc:1434] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.081s	user 0.009s	sys 0.005s
I20260709 12:27:54.711051 14738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a3a3209f9d64ed6bc4036a9d8bc0ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.711241 14598 tablet_service.cc:1511] Processing CreateTablet for tablet 9a3a3209f9d64ed6bc4036a9d8bc0ef0 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20260709 12:27:54.711853 14597 tablet_service.cc:1511] Processing CreateTablet for tablet dba1b4acd4da45e7b1eee66ab684bd93 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20260709 12:27:54.712519 14598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a3a3209f9d64ed6bc4036a9d8bc0ef0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.708938 14708 heartbeater.cc:499] Master 127.4.181.126:42487 was elected leader, sending a full tablet report...
I20260709 12:27:54.710204 14877 tablet_bootstrap.cc:492] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
W20260709 12:27:54.725348 14709 tablet.cc:2406] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:27:54.726495 14669 tablet_service.cc:1511] Processing CreateTablet for tablet c1a597bed4c64a10a9f8b50e72c7b611 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:27:54.728058 14743 tablet_service.cc:1511] Processing CreateTablet for tablet c1a597bed4c64a10a9f8b50e72c7b611 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:27:54.729537 14743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a597bed4c64a10a9f8b50e72c7b611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.726310 14879 tablet_bootstrap.cc:492] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:54.733048 14879 ts_tablet_manager.cc:1403] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.146s	user 0.021s	sys 0.033s
I20260709 12:27:54.736506 14596 tablet_service.cc:1511] Processing CreateTablet for tablet df5fcaa8194c4e4d8edfc076579b7629 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:27:54.738991 14879 raft_consensus.cc:359] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:54.718828 14878 ts_tablet_manager.cc:1434] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.083s	user 0.014s	sys 0.000s
I20260709 12:27:54.739888 14879 raft_consensus.cc:385] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:54.740324 14879 raft_consensus.cc:740] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:54.740891 14665 tablet_service.cc:1511] Processing CreateTablet for tablet df5fcaa8194c4e4d8edfc076579b7629 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:27:54.744379 14879 consensus_queue.cc:260] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:54.745286 14597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dba1b4acd4da45e7b1eee66ab684bd93. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.726884 14819 tablet_service.cc:1511] Processing CreateTablet for tablet c1a597bed4c64a10a9f8b50e72c7b611 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20260709 12:27:54.754081 14596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5fcaa8194c4e4d8edfc076579b7629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.752681 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a597bed4c64a10a9f8b50e72c7b611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.757711 14876 ts_tablet_manager.cc:1434] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.108s	user 0.009s	sys 0.004s
I20260709 12:27:54.751063 14740 tablet_service.cc:1511] Processing CreateTablet for tablet df5fcaa8194c4e4d8edfc076579b7629 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20260709 12:27:54.754863 14590 tablet_service.cc:1511] Processing CreateTablet for tablet 8848d1ae1c0143efa3af13914871a009 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:27:54.752068 14819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c1a597bed4c64a10a9f8b50e72c7b611. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.761627 14665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5fcaa8194c4e4d8edfc076579b7629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.761253 14740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df5fcaa8194c4e4d8edfc076579b7629. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.771999 14885 raft_consensus.cc:493] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.751390 14818 tablet_service.cc:1511] Processing CreateTablet for tablet 8848d1ae1c0143efa3af13914871a009 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:27:54.772650 14885 raft_consensus.cc:515] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:54.766408 14668 tablet_service.cc:1511] Processing CreateTablet for tablet 8848d1ae1c0143efa3af13914871a009 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20260709 12:27:54.775858 14668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8848d1ae1c0143efa3af13914871a009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.777681 14885 leader_election.cc:290] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:54.768532 14747 tablet_service.cc:1511] Processing CreateTablet for tablet 8c2e9afe81394f0daa8b09695c7a43ae (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:27:54.780128 14747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c2e9afe81394f0daa8b09695c7a43ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.740947 14878 tablet_bootstrap.cc:492] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:54.779170 14818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8848d1ae1c0143efa3af13914871a009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.761307 14590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8848d1ae1c0143efa3af13914871a009. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.769086 14876 tablet_bootstrap.cc:492] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:54.791028 14594 tablet_service.cc:1511] Processing CreateTablet for tablet 8c2e9afe81394f0daa8b09695c7a43ae (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:27:54.792569 14594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c2e9afe81394f0daa8b09695c7a43ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.789851 14815 tablet_service.cc:1511] Processing CreateTablet for tablet 8c2e9afe81394f0daa8b09695c7a43ae (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20260709 12:27:54.795467 14815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c2e9afe81394f0daa8b09695c7a43ae. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.745450 14877 tablet_bootstrap.cc:654] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:54.809144 14886 raft_consensus.cc:493] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:54.809696 14886 raft_consensus.cc:515] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:54.823225 14876 tablet_bootstrap.cc:654] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:54.814431 14886 leader_election.cc:290] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:54.838411 14816 tablet_service.cc:1511] Processing CreateTablet for tablet ef1bdc8f0d36475f87c7da7d8a998240 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:27:54.839963 14595 tablet_service.cc:1511] Processing CreateTablet for tablet 78415090b3b941069b3cc1a7540a8542 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:27:54.843397 14816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef1bdc8f0d36475f87c7da7d8a998240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.843518 14595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78415090b3b941069b3cc1a7540a8542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.856158 14817 tablet_service.cc:1511] Processing CreateTablet for tablet 55019c611cb74a908cb633373c6b502b (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:27:54.857587 14817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55019c611cb74a908cb633373c6b502b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.860592 14782 heartbeater.cc:499] Master 127.4.181.126:42487 was elected leader, sending a full tablet report...
I20260709 12:27:54.860291 14593 tablet_service.cc:1511] Processing CreateTablet for tablet 55019c611cb74a908cb633373c6b502b (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:27:54.862161 14593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55019c611cb74a908cb633373c6b502b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.867633 14876 tablet_bootstrap.cc:492] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:54.873987 14743 tablet_service.cc:1511] Processing CreateTablet for tablet 78415090b3b941069b3cc1a7540a8542 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:27:54.899000 14743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78415090b3b941069b3cc1a7540a8542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.900343 14876 ts_tablet_manager.cc:1403] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.131s	user 0.013s	sys 0.005s
I20260709 12:27:54.895607 14879 ts_tablet_manager.cc:1434] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.162s	user 0.013s	sys 0.019s
I20260709 12:27:54.903726 14879 tablet_bootstrap.cc:492] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:54.911602 14878 tablet_bootstrap.cc:654] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:54.919474 14669 tablet_service.cc:1511] Processing CreateTablet for tablet ef1bdc8f0d36475f87c7da7d8a998240 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:27:54.920260 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f24860ec9a043a491db9afb3516eedd" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:54.920866 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef1bdc8f0d36475f87c7da7d8a998240. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:54.922031 14649 leader_election.cc:343] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:54.924942 14668 tablet_service.cc:1511] Processing CreateTablet for tablet 55019c611cb74a908cb633373c6b502b (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20260709 12:27:54.927271 14668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 55019c611cb74a908cb633373c6b502b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.927578 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f24860ec9a043a491db9afb3516eedd" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:54.928422 14608 raft_consensus.cc:2468] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:54.896922 14738 tablet_service.cc:1511] Processing CreateTablet for tablet ef1bdc8f0d36475f87c7da7d8a998240 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20260709 12:27:54.932196 14738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef1bdc8f0d36475f87c7da7d8a998240. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.936983 14744 tablet_service.cc:1511] Processing CreateTablet for tablet 0d83f753ff274231bf05990f4eda9551 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:27:54.937834 14876 raft_consensus.cc:359] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:54.938345 14744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d83f753ff274231bf05990f4eda9551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.931988 14646 leader_election.cc:304] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:27:54.939162 14885 raft_consensus.cc:2804] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:54.939544 14885 raft_consensus.cc:493] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:54.939867 14885 raft_consensus.cc:3060] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:54.943800 14665 tablet_service.cc:1511] Processing CreateTablet for tablet 78415090b3b941069b3cc1a7540a8542 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20260709 12:27:54.944634 14877 tablet_bootstrap.cc:492] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:54.945214 14665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 78415090b3b941069b3cc1a7540a8542. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.945223 14877 ts_tablet_manager.cc:1403] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.235s	user 0.013s	sys 0.008s
I20260709 12:27:54.945502 14746 tablet_service.cc:1511] Processing CreateTablet for tablet 1bdea069a44b42d099e6fc3f6c6333cc (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:27:54.946945 14746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bdea069a44b42d099e6fc3f6c6333cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.949213 14877 raft_consensus.cc:359] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:54.949963 14877 raft_consensus.cc:385] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:54.951985 14815 tablet_service.cc:1511] Processing CreateTablet for tablet 0d83f753ff274231bf05990f4eda9551 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:27:54.953433 14815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d83f753ff274231bf05990f4eda9551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.950248 14877 raft_consensus.cc:740] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:54.958560 14877 consensus_queue.cc:260] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:54.959008 14596 tablet_service.cc:1511] Processing CreateTablet for tablet 0d83f753ff274231bf05990f4eda9551 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20260709 12:27:54.958578 14876 raft_consensus.cc:385] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:54.961071 14876 raft_consensus.cc:740] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:54.962047 14885 raft_consensus.cc:515] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:54.964501 14885 leader_election.cc:290] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:54.965724 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f24860ec9a043a491db9afb3516eedd" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:54.966276 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f24860ec9a043a491db9afb3516eedd" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
W20260709 12:27:54.967669 14649 leader_election.cc:343] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:54.968007 14574 leader_election.cc:343] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:54.968822 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f24860ec9a043a491db9afb3516eedd" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:54.969446 14608 raft_consensus.cc:3060] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:54.971804 14671 tablet_service.cc:1511] Processing CreateTablet for tablet 1bdea069a44b42d099e6fc3f6c6333cc (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:27:54.973199 14671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bdea069a44b42d099e6fc3f6c6333cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:54.976895 14877 ts_tablet_manager.cc:1434] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.031s	user 0.007s	sys 0.000s
I20260709 12:27:54.980638 14877 tablet_bootstrap.cc:492] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:54.986388 14879 tablet_bootstrap.cc:654] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:54.988381 14608 raft_consensus.cc:2468] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:54.998354 14877 tablet_bootstrap.cc:654] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:55.000294 14884 raft_consensus.cc:493] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.000893 14884 raft_consensus.cc:515] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:54.960673 14596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0d83f753ff274231bf05990f4eda9551. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.013579 14884 leader_election.cc:290] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:55.022181 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f24860ec9a043a491db9afb3516eedd" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:55.030732 14683 raft_consensus.cc:2393] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0cbbdf206b5458e9af48c22b862264a in current term 1: Already voted for candidate 9a105adb44fb47078d6cb03a6c02026f in this term.
I20260709 12:27:55.032487 14877 tablet_bootstrap.cc:492] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:55.018260 14646 leader_election.cc:304] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:27:55.033599 14897 raft_consensus.cc:2804] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:55.034088 14897 raft_consensus.cc:697] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:27:55.035044 14573 leader_election.cc:304] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:27:55.036232 14886 raft_consensus.cc:2749] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:55.037866 14669 tablet_service.cc:1511] Processing CreateTablet for tablet 8777b3a550644b50835c268da566aee7 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:27:54.962080 14876 consensus_queue.cc:260] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:55.038179 14897 consensus_queue.cc:237] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.040340 14876 ts_tablet_manager.cc:1434] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.140s	user 0.009s	sys 0.000s
I20260709 12:27:55.041436 14876 tablet_bootstrap.cc:492] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:55.033035 14877 ts_tablet_manager.cc:1403] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.053s	user 0.012s	sys 0.002s
I20260709 12:27:55.046975 14595 tablet_service.cc:1511] Processing CreateTablet for tablet 8777b3a550644b50835c268da566aee7 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:27:55.048380 14595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8777b3a550644b50835c268da566aee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.052565 14743 tablet_service.cc:1511] Processing CreateTablet for tablet 8777b3a550644b50835c268da566aee7 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20260709 12:27:55.054050 14743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8777b3a550644b50835c268da566aee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.057467 14598 tablet_service.cc:1511] Processing CreateTablet for tablet e03b11e4110e41ec830cee6e3f1a88db (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:27:55.057953 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8777b3a550644b50835c268da566aee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.058887 14598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03b11e4110e41ec830cee6e3f1a88db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.061540 14878 tablet_bootstrap.cc:492] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:55.061385 14672 tablet_service.cc:1511] Processing CreateTablet for tablet e03b11e4110e41ec830cee6e3f1a88db (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:27:55.062054 14878 ts_tablet_manager.cc:1403] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.321s	user 0.017s	sys 0.015s
I20260709 12:27:55.064013 14672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03b11e4110e41ec830cee6e3f1a88db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.065140 14878 raft_consensus.cc:359] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.069229 14877 raft_consensus.cc:359] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:55.069299 14740 tablet_service.cc:1511] Processing CreateTablet for tablet 3c423e2343f442c79ab8cecd3cb76d57 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:27:55.070328 14877 raft_consensus.cc:385] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:55.070762 14877 raft_consensus.cc:740] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:55.070941 14815 tablet_service.cc:1511] Processing CreateTablet for tablet e03b11e4110e41ec830cee6e3f1a88db (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20260709 12:27:55.071646 14877 consensus_queue.cc:260] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:55.072438 14815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e03b11e4110e41ec830cee6e3f1a88db. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.075660 14877 ts_tablet_manager.cc:1434] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:27:55.076826 14877 tablet_bootstrap.cc:492] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:55.069442 14817 tablet_service.cc:1511] Processing CreateTablet for tablet 1bdea069a44b42d099e6fc3f6c6333cc (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20260709 12:27:55.079882 14817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1bdea069a44b42d099e6fc3f6c6333cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.084604 14877 tablet_bootstrap.cc:654] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:55.091379 14879 tablet_bootstrap.cc:492] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:55.091993 14879 ts_tablet_manager.cc:1403] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.189s	user 0.007s	sys 0.019s
I20260709 12:27:55.092200 14816 tablet_service.cc:1511] Processing CreateTablet for tablet 3c423e2343f442c79ab8cecd3cb76d57 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:27:55.093592 14816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c423e2343f442c79ab8cecd3cb76d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.095167 14879 raft_consensus.cc:359] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:55.095978 14879 raft_consensus.cc:385] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:55.096282 14879 raft_consensus.cc:740] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:55.098716 14740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c423e2343f442c79ab8cecd3cb76d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.100514 14876 tablet_bootstrap.cc:654] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:55.065932 14878 raft_consensus.cc:385] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:55.097204 14879 consensus_queue.cc:260] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:55.115265 14504 catalog_manager.cc:5697] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:55.122506 14596 tablet_service.cc:1511] Processing CreateTablet for tablet 3c423e2343f442c79ab8cecd3cb76d57 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20260709 12:27:55.111685 14878 raft_consensus.cc:740] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:55.124084 14596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3c423e2343f442c79ab8cecd3cb76d57. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.133685 14818 tablet_service.cc:1511] Processing CreateTablet for tablet d93f4e1359094f6ba6afc3148d28df68 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:27:55.135901 14818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d93f4e1359094f6ba6afc3148d28df68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.137758 14879 ts_tablet_manager.cc:1434] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.045s	user 0.008s	sys 0.001s
I20260709 12:27:55.140651 14738 tablet_service.cc:1511] Processing CreateTablet for tablet d93f4e1359094f6ba6afc3148d28df68 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:27:55.145049 14738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d93f4e1359094f6ba6afc3148d28df68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.147203 14876 tablet_bootstrap.cc:492] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:55.147856 14876 ts_tablet_manager.cc:1403] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.107s	user 0.012s	sys 0.012s
I20260709 12:27:55.140661 14593 tablet_service.cc:1511] Processing CreateTablet for tablet 99a425949e144909995513a045d40199 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:27:55.149137 14878 consensus_queue.cc:260] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.150242 14593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a425949e144909995513a045d40199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.153033 14878 ts_tablet_manager.cc:1434] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.002s
I20260709 12:27:55.154304 14878 tablet_bootstrap.cc:492] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:55.154415 14876 raft_consensus.cc:359] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:55.157385 14672 tablet_service.cc:1511] Processing CreateTablet for tablet d93f4e1359094f6ba6afc3148d28df68 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20260709 12:27:55.158808 14672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d93f4e1359094f6ba6afc3148d28df68. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.157469 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8190b1186645b4aa61fbd5207622cf" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:27:55.161428 14795 leader_election.cc:343] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:55.164531 14887 raft_consensus.cc:493] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.165123 14887 raft_consensus.cc:515] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:55.156447 14876 raft_consensus.cc:385] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:55.170898 14876 raft_consensus.cc:740] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:55.170837 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8190b1186645b4aa61fbd5207622cf" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:55.171449 14879 tablet_bootstrap.cc:492] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:55.175595 14887 leader_election.cc:290] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
W20260709 12:27:55.176987 14794 leader_election.cc:343] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:55.177536 14794 leader_election.cc:304] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:27:55.178429 14884 raft_consensus.cc:2749] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:55.171813 14876 consensus_queue.cc:260] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:55.179811 14665 tablet_service.cc:1511] Processing CreateTablet for tablet 99a425949e144909995513a045d40199 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:27:55.181423 14665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a425949e144909995513a045d40199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.190009 14886 raft_consensus.cc:493] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.190675 14886 raft_consensus.cc:515] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:55.193148 14886 leader_election.cc:290] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:55.194026 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:55.194669 14746 tablet_service.cc:1511] Processing CreateTablet for tablet 99a425949e144909995513a045d40199 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20260709 12:27:55.196141 14746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 99a425949e144909995513a045d40199. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.194816 14683 raft_consensus.cc:2468] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:27:55.198796 14573 leader_election.cc:304] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:55.202638 14886 raft_consensus.cc:2804] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:55.203090 14886 raft_consensus.cc:493] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:55.202898 14817 tablet_service.cc:1511] Processing CreateTablet for tablet 7acba2c9fabb41d6b3b6c382fd7d19c8 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:27:55.207859 14886 raft_consensus.cc:3060] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:55.213376 14598 tablet_service.cc:1511] Processing CreateTablet for tablet 7acba2c9fabb41d6b3b6c382fd7d19c8 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:27:55.211324 14876 ts_tablet_manager.cc:1434] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.063s	user 0.009s	sys 0.001s
I20260709 12:27:55.219376 14879 tablet_bootstrap.cc:654] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:55.230077 14876 tablet_bootstrap.cc:492] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:55.231719 14817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7acba2c9fabb41d6b3b6c382fd7d19c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.237138 14598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7acba2c9fabb41d6b3b6c382fd7d19c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.237128 14747 tablet_service.cc:1511] Processing CreateTablet for tablet 446076fe225641ee8d6ad7fe5a4777ee (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:27:55.244760 14747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446076fe225641ee8d6ad7fe5a4777ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.249500 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:55.251827 14886 raft_consensus.cc:515] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:55.253094 14608 raft_consensus.cc:2393] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c95afda23abe49318972444cc68998a7 in current term 1: Already voted for candidate c0cbbdf206b5458e9af48c22b862264a in this term.
I20260709 12:27:55.256114 14886 leader_election.cc:290] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:55.257011 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:55.258368 14877 tablet_bootstrap.cc:492] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:55.260830 14683 raft_consensus.cc:3060] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:55.261045 14877 ts_tablet_manager.cc:1403] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.184s	user 0.026s	sys 0.003s
I20260709 12:27:55.261830 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:55.262544 14756 raft_consensus.cc:3060] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:55.264451 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:55.265982 14878 tablet_bootstrap.cc:654] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:55.266510 14877 raft_consensus.cc:359] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.267273 14877 raft_consensus.cc:385] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:55.267577 14877 raft_consensus.cc:740] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:55.268347 14877 consensus_queue.cc:260] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.270540 14877 ts_tablet_manager.cc:1434] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:27:55.271639 14877 tablet_bootstrap.cc:492] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:55.274390 14756 raft_consensus.cc:2468] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:55.271324 14669 tablet_service.cc:1511] Processing CreateTablet for tablet 7acba2c9fabb41d6b3b6c382fd7d19c8 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20260709 12:27:55.280416 14595 tablet_service.cc:1511] Processing CreateTablet for tablet 446076fe225641ee8d6ad7fe5a4777ee (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20260709 12:27:55.281404 14876 tablet_bootstrap.cc:654] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:55.281749 14595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446076fe225641ee8d6ad7fe5a4777ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.280453 14572 leader_election.cc:304] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:27:55.280990 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7acba2c9fabb41d6b3b6c382fd7d19c8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.284297 14884 raft_consensus.cc:493] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.283622 14886 raft_consensus.cc:2804] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:55.284844 14884 raft_consensus.cc:515] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.286911 14879 tablet_bootstrap.cc:492] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:55.288034 14683 raft_consensus.cc:2468] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:55.288587 14884 leader_election.cc:290] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:55.294021 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9c76cb01cd4cd78bb4a2826b2b06ea" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:55.294754 14816 tablet_service.cc:1511] Processing CreateTablet for tablet 446076fe225641ee8d6ad7fe5a4777ee (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
W20260709 12:27:55.295496 14795 leader_election.cc:343] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:55.296307 14816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 446076fe225641ee8d6ad7fe5a4777ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.303360 14879 ts_tablet_manager.cc:1403] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.132s	user 0.028s	sys 0.012s
I20260709 12:27:55.315034 14887 raft_consensus.cc:493] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.319778 14887 raft_consensus.cc:515] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:55.321046 14743 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd3630b48e04f27bb2a681c2b329e2f (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:27:55.321794 14665 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd3630b48e04f27bb2a681c2b329e2f (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:27:55.322438 14743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd3630b48e04f27bb2a681c2b329e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.322829 14887 leader_election.cc:290] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:55.323110 14665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd3630b48e04f27bb2a681c2b329e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.323736 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd7f28a6ca34728b1f3c599fc653c6d" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:55.324407 14608 raft_consensus.cc:2468] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:27:55.326934 14720 leader_election.cc:304] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:27:55.336980 14594 tablet_service.cc:1511] Processing CreateTablet for tablet a40ba67c52d8403bbaaac500b1b803ec (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:27:55.338449 14594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40ba67c52d8403bbaaac500b1b803ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.339254 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd7f28a6ca34728b1f3c599fc653c6d" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
W20260709 12:27:55.340968 14723 leader_election.cc:343] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:55.343415 14815 tablet_service.cc:1511] Processing CreateTablet for tablet 0fd3630b48e04f27bb2a681c2b329e2f (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20260709 12:27:55.349177 14886 raft_consensus.cc:697] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:27:55.347453 14672 tablet_service.cc:1511] Processing CreateTablet for tablet a40ba67c52d8403bbaaac500b1b803ec (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:27:55.351464 14672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40ba67c52d8403bbaaac500b1b803ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.351583 14747 tablet_service.cc:1511] Processing CreateTablet for tablet a40ba67c52d8403bbaaac500b1b803ec (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20260709 12:27:55.352877 14747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a40ba67c52d8403bbaaac500b1b803ec. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.346652 14887 raft_consensus.cc:2804] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:55.350126 14886 consensus_queue.cc:237] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:55.357000 14887 raft_consensus.cc:493] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:55.357122 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9c76cb01cd4cd78bb4a2826b2b06ea" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:55.357436 14887 raft_consensus.cc:3060] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:55.358794 14796 leader_election.cc:343] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:55.365283 14815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0fd3630b48e04f27bb2a681c2b329e2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.368079 14819 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6cc46cc8484c24aef89febc4a0da98 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:27:55.369431 14819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6cc46cc8484c24aef89febc4a0da98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.359256 14796 leader_election.cc:304] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7
I20260709 12:27:55.372888 14884 raft_consensus.cc:2749] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:55.379350 14595 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6cc46cc8484c24aef89febc4a0da98 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:27:55.380721 14595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6cc46cc8484c24aef89febc4a0da98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.383985 14671 tablet_service.cc:1511] Processing CreateTablet for tablet 9e6cc46cc8484c24aef89febc4a0da98 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20260709 12:27:55.385344 14671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9e6cc46cc8484c24aef89febc4a0da98. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.387219 14897 raft_consensus.cc:493] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.387825 14897 raft_consensus.cc:515] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:55.390079 14897 leader_election.cc:290] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:55.391465 14876 tablet_bootstrap.cc:492] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:55.391273 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d4c5596d44c5ebc68130616ef1ddb" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:55.392022 14876 ts_tablet_manager.cc:1403] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.162s	user 0.010s	sys 0.004s
I20260709 12:27:55.392532 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
W20260709 12:27:55.392843 14646 leader_election.cc:343] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:55.393996 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d4c5596d44c5ebc68130616ef1ddb" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:55.395092 14876 raft_consensus.cc:359] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:55.395792 14876 raft_consensus.cc:385] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20260709 12:27:55.395972 14649 leader_election.cc:343] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:55.396129 14876 raft_consensus.cc:740] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:55.396456 14649 leader_election.cc:304] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:27:55.396916 14876 consensus_queue.cc:260] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:55.372232 14877 tablet_bootstrap.cc:654] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:55.368120 14879 raft_consensus.cc:359] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.411145 14879 raft_consensus.cc:385] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:55.411528 14879 raft_consensus.cc:740] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:55.403507 14683 raft_consensus.cc:2393] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c95afda23abe49318972444cc68998a7 in current term 1: Already voted for candidate c0cbbdf206b5458e9af48c22b862264a in this term.
I20260709 12:27:55.412369 14593 tablet_service.cc:1511] Processing CreateTablet for tablet df4e4a9a715c4425a25afa8c34b1dd2a (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:27:55.412915 14879 consensus_queue.cc:260] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.413837 14593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4e4a9a715c4425a25afa8c34b1dd2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.381306 14746 tablet_service.cc:1511] Processing CreateTablet for tablet df4e4a9a715c4425a25afa8c34b1dd2a (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:27:55.413616 14668 tablet_service.cc:1511] Processing CreateTablet for tablet a82a93abcc0d49fe8790a150daf9accc (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:27:55.399431 14897 raft_consensus.cc:2749] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:55.413516 14722 leader_election.cc:304] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:27:55.414983 14668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82a93abcc0d49fe8790a150daf9accc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.415230 14746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4e4a9a715c4425a25afa8c34b1dd2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.403535 14818 tablet_service.cc:1511] Processing CreateTablet for tablet df4e4a9a715c4425a25afa8c34b1dd2a (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20260709 12:27:55.419759 14818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet df4e4a9a715c4425a25afa8c34b1dd2a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.426595 14887 raft_consensus.cc:515] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:55.428897 14887 leader_election.cc:290] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:55.429663 14887 raft_consensus.cc:2749] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:55.430056 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd7f28a6ca34728b1f3c599fc653c6d" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:55.431305 14608 raft_consensus.cc:3060] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:55.429685 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6dd7f28a6ca34728b1f3c599fc653c6d" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:55.433429 14817 tablet_service.cc:1511] Processing CreateTablet for tablet a82a93abcc0d49fe8790a150daf9accc (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
W20260709 12:27:55.433825 14723 leader_election.cc:343] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:55.435395 14817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82a93abcc0d49fe8790a150daf9accc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.439177 14743 tablet_service.cc:1511] Processing CreateTablet for tablet a82a93abcc0d49fe8790a150daf9accc (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20260709 12:27:55.445078 14743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a82a93abcc0d49fe8790a150daf9accc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.447178 14608 raft_consensus.cc:2468] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:27:55.454036 14720 leader_election.cc:304] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:27:55.455390 14887 raft_consensus.cc:2804] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:55.456380 14887 raft_consensus.cc:697] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:27:55.457342 14887 consensus_queue.cc:237] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:55.457813 14668 tablet_service.cc:1511] Processing CreateTablet for tablet 2e708aa2c4bb45e0b3614e6447ef90cb (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:27:55.455648 14876 ts_tablet_manager.cc:1434] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.063s	user 0.007s	sys 0.000s
I20260709 12:27:55.462524 14876 tablet_bootstrap.cc:492] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:55.463361 14668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e708aa2c4bb45e0b3614e6447ef90cb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:55.465284 14554 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:55.466648 14738 tablet_service.cc:1511] Processing CreateTablet for tablet 2e708aa2c4bb45e0b3614e6447ef90cb (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:27:55.468022 14738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e708aa2c4bb45e0b3614e6447ef90cb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.471156 14878 tablet_bootstrap.cc:492] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:55.471684 14878 ts_tablet_manager.cc:1403] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.318s	user 0.011s	sys 0.005s
I20260709 12:27:55.474911 14878 raft_consensus.cc:359] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.475639 14878 raft_consensus.cc:385] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:55.475925 14878 raft_consensus.cc:740] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:55.476814 14878 consensus_queue.cc:260] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.494717 14595 tablet_service.cc:1511] Processing CreateTablet for tablet 2e708aa2c4bb45e0b3614e6447ef90cb (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20260709 12:27:55.496119 14813 tablet_service.cc:1511] Processing CreateTablet for tablet 0c22c8f015eb4f498db641dca9ea7900 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:27:55.497293 14595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2e708aa2c4bb45e0b3614e6447ef90cb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:55.492836 14722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:46705, user_credentials={real_user=slave}} blocked reactor thread for 79562.6us
I20260709 12:27:55.502681 14504 catalog_manager.cc:5697] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:55.504973 14596 tablet_service.cc:1511] Processing CreateTablet for tablet 0c22c8f015eb4f498db641dca9ea7900 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:27:55.506326 14596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c22c8f015eb4f498db641dca9ea7900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.506537 14672 tablet_service.cc:1511] Processing CreateTablet for tablet 0c22c8f015eb4f498db641dca9ea7900 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20260709 12:27:55.507856 14672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c22c8f015eb4f498db641dca9ea7900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.508556 14876 tablet_bootstrap.cc:654] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:55.497323 14813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c22c8f015eb4f498db641dca9ea7900. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.515250 14878 ts_tablet_manager.cc:1434] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.043s	user 0.008s	sys 0.000s
I20260709 12:27:55.516378 14878 tablet_bootstrap.cc:492] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:55.530157 14738 tablet_service.cc:1511] Processing CreateTablet for tablet c2429c63bff3418fa4b6e9e734cc5b04 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:27:55.530550 14886 raft_consensus.cc:493] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.531143 14886 raft_consensus.cc:515] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:55.531251 14897 consensus_queue.cc:1048] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:55.531603 14738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2429c63bff3418fa4b6e9e734cc5b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.534571 14897 raft_consensus.cc:493] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.535696 14879 ts_tablet_manager.cc:1434] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.220s	user 0.012s	sys 0.003s
I20260709 12:27:55.536900 14879 tablet_bootstrap.cc:492] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:55.556182 14816 tablet_service.cc:1511] Processing CreateTablet for tablet c2429c63bff3418fa4b6e9e734cc5b04 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:27:55.557657 14816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2429c63bff3418fa4b6e9e734cc5b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.560508 14877 tablet_bootstrap.cc:492] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:55.570504 14877 ts_tablet_manager.cc:1403] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.299s	user 0.010s	sys 0.009s
I20260709 12:27:55.562526 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8000e051fc45f8a4f3782b144f95a8" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:55.563854 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8000e051fc45f8a4f3782b144f95a8" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:27:55.573572 14573 leader_election.cc:343] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:55.581040 14572 leader_election.cc:343] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:55.581565 14572 leader_election.cc:304] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7
I20260709 12:27:55.582638 14911 raft_consensus.cc:2749] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:55.585356 14593 tablet_service.cc:1511] Processing CreateTablet for tablet c2429c63bff3418fa4b6e9e734cc5b04 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20260709 12:27:55.551432 14897 raft_consensus.cc:515] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.592592 14506 catalog_manager.cc:5697] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:55.597447 14878 tablet_bootstrap.cc:654] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:55.598827 14897 leader_election.cc:290] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:55.600849 14593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c2429c63bff3418fa4b6e9e734cc5b04. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.606209 14668 tablet_service.cc:1511] Processing CreateTablet for tablet bb08a1bd554c4287aab87fc068c0039d (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:27:55.606827 14743 tablet_service.cc:1511] Processing CreateTablet for tablet bb08a1bd554c4287aab87fc068c0039d (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:27:55.607653 14668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb08a1bd554c4287aab87fc068c0039d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.608203 14743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb08a1bd554c4287aab87fc068c0039d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.608840 14818 tablet_service.cc:1511] Processing CreateTablet for tablet bb08a1bd554c4287aab87fc068c0039d (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20260709 12:27:55.611330 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c747ce7b704240a1399f870f7b99e0" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:55.611765 14818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bb08a1bd554c4287aab87fc068c0039d. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:55.612923 14649 leader_election.cc:343] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:55.561286 14886 leader_election.cc:290] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:55.631387 14877 raft_consensus.cc:359] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:55.631747 14830 raft_consensus.cc:3060] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:55.637645 14879 tablet_bootstrap.cc:654] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:55.642091 14887 raft_consensus.cc:493] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.668947 14887 raft_consensus.cc:515] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.645699 14595 tablet_service.cc:1511] Processing CreateTablet for tablet 42f3f72687b04e52af87a05e2f8767d7 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:27:55.652387 14813 tablet_service.cc:1511] Processing CreateTablet for tablet 7b80b946940f485e813a69a1ed96c203 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:27:55.652387 14671 tablet_service.cc:1511] Processing CreateTablet for tablet 42f3f72687b04e52af87a05e2f8767d7 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:27:55.674579 14595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f3f72687b04e52af87a05e2f8767d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.674685 14671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f3f72687b04e52af87a05e2f8767d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.654201 14746 tablet_service.cc:1511] Processing CreateTablet for tablet 42f3f72687b04e52af87a05e2f8767d7 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20260709 12:27:55.657979 14672 tablet_service.cc:1511] Processing CreateTablet for tablet 7b80b946940f485e813a69a1ed96c203 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:27:55.658044 14594 tablet_service.cc:1511] Processing CreateTablet for tablet 7b80b946940f485e813a69a1ed96c203 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20260709 12:27:55.659164 14876 tablet_bootstrap.cc:492] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:55.674685 14813 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b80b946940f485e813a69a1ed96c203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.677608 14594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b80b946940f485e813a69a1ed96c203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.677248 14876 ts_tablet_manager.cc:1403] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.215s	user 0.017s	sys 0.002s
I20260709 12:27:55.676775 14746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 42f3f72687b04e52af87a05e2f8767d7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.676786 14672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7b80b946940f485e813a69a1ed96c203. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.691908 14877 raft_consensus.cc:385] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:55.692338 14877 raft_consensus.cc:740] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:55.697817 14877 consensus_queue.cc:260] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:55.713999 14815 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca6238c0f244dd1a911e44a703e0f8b (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:27:55.714444 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c747ce7b704240a1399f870f7b99e0" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:55.715123 14683 raft_consensus.cc:2468] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:27:55.715412 14815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca6238c0f244dd1a911e44a703e0f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.716533 14722 leader_election.cc:304] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:27:55.718631 14919 raft_consensus.cc:2804] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:55.719049 14919 raft_consensus.cc:493] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:55.718967 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c747ce7b704240a1399f870f7b99e0" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:55.719504 14919 raft_consensus.cc:3060] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:55.720613 14723 leader_election.cc:343] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:55.721205 14887 leader_election.cc:290] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:55.725673 14598 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca6238c0f244dd1a911e44a703e0f8b (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:27:55.726161 14665 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5cdf241a9849819398d5d313152db6 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:27:55.727505 14665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5cdf241a9849819398d5d313152db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.728688 14738 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5cdf241a9849819398d5d313152db6 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:27:55.730001 14738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5cdf241a9849819398d5d313152db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.731122 14598 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca6238c0f244dd1a911e44a703e0f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.742796 14877 ts_tablet_manager.cc:1434] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.114s	user 0.007s	sys 0.000s
I20260709 12:27:55.744303 14878 tablet_bootstrap.cc:492] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:55.744871 14878 ts_tablet_manager.cc:1403] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.229s	user 0.033s	sys 0.030s
I20260709 12:27:55.712404 14876 raft_consensus.cc:359] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:55.757251 14877 tablet_bootstrap.cc:492] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:55.753888 14876 raft_consensus.cc:385] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:55.769062 14819 tablet_service.cc:1511] Processing CreateTablet for tablet 2c5cdf241a9849819398d5d313152db6 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20260709 12:27:55.770277 14819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2c5cdf241a9849819398d5d313152db6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.775226 14747 tablet_service.cc:1511] Processing CreateTablet for tablet 0ca6238c0f244dd1a911e44a703e0f8b (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20260709 12:27:55.776556 14597 tablet_service.cc:1511] Processing CreateTablet for tablet b596dc92cc2c45838a165addea430360 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:27:55.777850 14597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b596dc92cc2c45838a165addea430360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.749642 14919 raft_consensus.cc:515] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.784267 14878 raft_consensus.cc:359] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:55.785151 14817 tablet_service.cc:1511] Processing CreateTablet for tablet 318e36a972bd4f25a06acdfea9b1bfe9 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:27:55.785229 14743 tablet_service.cc:1511] Processing CreateTablet for tablet b596dc92cc2c45838a165addea430360 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:27:55.765715 14876 raft_consensus.cc:740] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:55.786537 14817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318e36a972bd4f25a06acdfea9b1bfe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.787946 14919 leader_election.cc:290] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:55.788679 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c747ce7b704240a1399f870f7b99e0" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:55.789290 14683 raft_consensus.cc:3060] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:55.790017 14668 tablet_service.cc:1511] Processing CreateTablet for tablet b596dc92cc2c45838a165addea430360 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20260709 12:27:55.791222 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c747ce7b704240a1399f870f7b99e0" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:55.801447 14668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b596dc92cc2c45838a165addea430360. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:55.801775 14723 leader_election.cc:343] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:55.792029 14876 consensus_queue.cc:260] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:55.794046 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c747ce7b704240a1399f870f7b99e0" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:55.785121 14878 raft_consensus.cc:385] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:55.796190 14879 tablet_bootstrap.cc:492] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:55.797020 14590 tablet_service.cc:1511] Processing CreateTablet for tablet 318e36a972bd4f25a06acdfea9b1bfe9 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:27:55.805279 14878 raft_consensus.cc:740] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:55.805469 14756 raft_consensus.cc:2393] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a105adb44fb47078d6cb03a6c02026f in current term 1: Already voted for candidate c95afda23abe49318972444cc68998a7 in this term.
I20260709 12:27:55.806084 14590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318e36a972bd4f25a06acdfea9b1bfe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.807004 14647 leader_election.cc:304] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:27:55.798177 14669 tablet_service.cc:1511] Processing CreateTablet for tablet 318e36a972bd4f25a06acdfea9b1bfe9 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20260709 12:27:55.808246 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 318e36a972bd4f25a06acdfea9b1bfe9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.808287 14926 consensus_queue.cc:1048] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:55.813086 14876 ts_tablet_manager.cc:1434] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.135s	user 0.017s	sys 0.003s
I20260709 12:27:55.814244 14876 tablet_bootstrap.cc:492] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:55.815717 14879 ts_tablet_manager.cc:1403] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.279s	user 0.017s	sys 0.025s
I20260709 12:27:55.815805 14738 tablet_service.cc:1511] Processing CreateTablet for tablet da938990b3ec47338496f5764c730ccb (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:27:55.825136 14814 tablet_service.cc:1511] Processing CreateTablet for tablet da938990b3ec47338496f5764c730ccb (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:27:55.848030 14814 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da938990b3ec47338496f5764c730ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.849524 14879 raft_consensus.cc:359] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.827162 14670 tablet_service.cc:1511] Processing CreateTablet for tablet 13f4c8c6619b4856afad5d98d9cec315 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:27:55.850303 14879 raft_consensus.cc:385] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:55.850677 14879 raft_consensus.cc:740] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:55.828037 14878 consensus_queue.cc:260] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:55.832973 14886 consensus_queue.cc:1048] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:55.837139 14740 tablet_service.cc:1511] Processing CreateTablet for tablet 13f4c8c6619b4856afad5d98d9cec315 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:27:55.776616 14747 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0ca6238c0f244dd1a911e44a703e0f8b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.851320 14670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13f4c8c6619b4856afad5d98d9cec315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.863360 14743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b596dc92cc2c45838a165addea430360. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.869812 14746 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7f54d9f158426396fa7e71a63ce964 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:27:55.871923 14596 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7f54d9f158426396fa7e71a63ce964 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:27:55.873202 14596 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7f54d9f158426396fa7e71a63ce964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.878605 14876 tablet_bootstrap.cc:654] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:55.871625 14817 tablet_service.cc:1511] Processing CreateTablet for tablet 13f4c8c6619b4856afad5d98d9cec315 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20260709 12:27:55.882634 14911 consensus_queue.cc:1048] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:27:55.883033 14723 consensus_peers.cc:597] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 -> Peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Couldn't send request to peer 420d5d7b2b504ff7923b7f4098c0fcce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:55.884833 14817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13f4c8c6619b4856afad5d98d9cec315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.890655 14738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da938990b3ec47338496f5764c730ccb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.892557 14669 tablet_service.cc:1511] Processing CreateTablet for tablet 5d7f54d9f158426396fa7e71a63ce964 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20260709 12:27:55.907055 14669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7f54d9f158426396fa7e71a63ce964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.893455 14877 tablet_bootstrap.cc:654] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:55.905324 14740 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 13f4c8c6619b4856afad5d98d9cec315. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.912873 14593 tablet_service.cc:1511] Processing CreateTablet for tablet 645a95a66395468daa1986ee77838eaa (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:27:55.918247 14595 tablet_service.cc:1511] Processing CreateTablet for tablet da938990b3ec47338496f5764c730ccb (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20260709 12:27:55.861251 14879 consensus_queue.cc:260] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.918833 14593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 645a95a66395468daa1986ee77838eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.919451 14919 raft_consensus.cc:493] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.919905 14919 raft_consensus.cc:515] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.920552 14879 ts_tablet_manager.cc:1434] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.075s	user 0.003s	sys 0.003s
I20260709 12:27:55.921639 14879 tablet_bootstrap.cc:492] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:55.915292 14746 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d7f54d9f158426396fa7e71a63ce964. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.932569 14887 consensus_queue.cc:1048] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:55.943033 14815 tablet_service.cc:1511] Processing CreateTablet for tablet 645a95a66395468daa1986ee77838eaa (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:27:55.944425 14815 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 645a95a66395468daa1986ee77838eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.944757 14919 leader_election.cc:290] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:55.945652 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e928d444370c4dc49f31e057169dbba0" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:55.945734 14595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet da938990b3ec47338496f5764c730ccb. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:27:55.948379 14722 leader_election.cc:343] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:55.950340 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e928d444370c4dc49f31e057169dbba0" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
W20260709 12:27:55.951956 14723 leader_election.cc:343] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:55.952414 14723 leader_election.cc:304] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:27:55.952692 14818 tablet_service.cc:1511] Processing CreateTablet for tablet 742010a70c40456a920924c8339a6e26 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:27:55.954064 14818 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 742010a70c40456a920924c8339a6e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.954638 14919 raft_consensus.cc:2749] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:55.958189 14876 tablet_bootstrap.cc:492] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:55.959105 14683 raft_consensus.cc:2468] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:27:55.962723 14929 raft_consensus.cc:2749] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:55.961054 14590 tablet_service.cc:1511] Processing CreateTablet for tablet 742010a70c40456a920924c8339a6e26 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:27:55.967303 14590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 742010a70c40456a920924c8339a6e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.956203 14878 ts_tablet_manager.cc:1434] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.211s	user 0.008s	sys 0.007s
I20260709 12:27:55.972390 14722 leader_election.cc:304] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:27:55.972831 14878 tablet_bootstrap.cc:492] T 6dd7f28a6ca34728b1f3c599fc653c6d P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:55.973771 14919 raft_consensus.cc:2804] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:55.974548 14919 raft_consensus.cc:697] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:27:55.962930 14672 tablet_service.cc:1511] Processing CreateTablet for tablet 645a95a66395468daa1986ee77838eaa (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20260709 12:27:55.976078 14672 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 645a95a66395468daa1986ee77838eaa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.975644 14919 consensus_queue.cc:237] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:55.972555 14876 ts_tablet_manager.cc:1403] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.159s	user 0.010s	sys 0.008s
I20260709 12:27:55.961891 14879 tablet_bootstrap.cc:654] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:55.956260 14743 tablet_service.cc:1511] Processing CreateTablet for tablet 742010a70c40456a920924c8339a6e26 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20260709 12:27:55.986205 14743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 742010a70c40456a920924c8339a6e26. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:55.988682 14929 raft_consensus.cc:493] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:55.989208 14929 raft_consensus.cc:515] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.002652 14929 leader_election.cc:290] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:56.003789 14744 tablet_service.cc:1511] Processing CreateTablet for tablet b2190ef737a2471ab10213a5ea05bf40 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:27:56.005128 14744 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2190ef737a2471ab10213a5ea05bf40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.005288 14876 raft_consensus.cc:359] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.006033 14876 raft_consensus.cc:385] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.007899 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f50744c152c4f22b65828c60d9d2974" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:55.989123 14671 tablet_service.cc:1511] Processing CreateTablet for tablet b2190ef737a2471ab10213a5ea05bf40 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:27:56.019577 14671 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2190ef737a2471ab10213a5ea05bf40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.007804 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f50744c152c4f22b65828c60d9d2974" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
W20260709 12:27:56.024881 14649 leader_election.cc:343] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.006311 14876 raft_consensus.cc:740] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.054823 14817 tablet_service.cc:1511] Processing CreateTablet for tablet b2190ef737a2471ab10213a5ea05bf40 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20260709 12:27:56.055297 14877 tablet_bootstrap.cc:492] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:56.055928 14877 ts_tablet_manager.cc:1403] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.303s	user 0.020s	sys 0.017s
I20260709 12:27:56.058174 14878 tablet_bootstrap.cc:654] T 6dd7f28a6ca34728b1f3c599fc653c6d P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.059275 14877 raft_consensus.cc:359] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.060093 14877 raft_consensus.cc:385] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.060400 14877 raft_consensus.cc:740] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.060478 14876 consensus_queue.cc:260] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.061163 14877 consensus_queue.cc:260] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.063359 14594 tablet_service.cc:1511] Processing CreateTablet for tablet d7c8780aab4e49fc9b697191f4fde170 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:27:56.064853 14594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c8780aab4e49fc9b697191f4fde170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.068039 14816 tablet_service.cc:1511] Processing CreateTablet for tablet edf0c9a7101d45abbba0a1109b880e41 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:27:56.066061 14743 tablet_service.cc:1511] Processing CreateTablet for tablet d7c8780aab4e49fc9b697191f4fde170 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:27:56.070583 14743 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c8780aab4e49fc9b697191f4fde170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.072382 14816 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edf0c9a7101d45abbba0a1109b880e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.076830 14879 tablet_bootstrap.cc:492] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:56.077379 14879 ts_tablet_manager.cc:1403] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.156s	user 0.010s	sys 0.010s
I20260709 12:27:56.068039 14668 tablet_service.cc:1511] Processing CreateTablet for tablet d7c8780aab4e49fc9b697191f4fde170 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20260709 12:27:56.079926 14668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d7c8780aab4e49fc9b697191f4fde170. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.080391 14879 raft_consensus.cc:359] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.081172 14879 raft_consensus.cc:385] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.081477 14879 raft_consensus.cc:740] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.083359 14607 raft_consensus.cc:2468] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:56.063417 14877 ts_tablet_manager.cc:1434] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.003s
I20260709 12:27:56.095717 14876 ts_tablet_manager.cc:1434] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.118s	user 0.007s	sys 0.000s
I20260709 12:27:56.096053 14646 leader_election.cc:304] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:27:56.096339 14938 raft_consensus.cc:493] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.097034 14938 raft_consensus.cc:515] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.097924 14929 raft_consensus.cc:2804] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.098377 14929 raft_consensus.cc:493] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.098762 14929 raft_consensus.cc:3060] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.098994 14817 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b2190ef737a2471ab10213a5ea05bf40. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.100215 14938 leader_election.cc:290] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:27:56.101619 14876 tablet_bootstrap.cc:492] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:56.108995 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f50744c152c4f22b65828c60d9d2974" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:56.102749 14506 catalog_manager.cc:5697] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } }
W20260709 12:27:56.110610 14574 leader_election.cc:343] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.118557 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f50744c152c4f22b65828c60d9d2974" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:56.121127 14670 tablet_service.cc:1511] Processing CreateTablet for tablet edf0c9a7101d45abbba0a1109b880e41 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:27:56.113382 14593 tablet_service.cc:1511] Processing CreateTablet for tablet dcee6c60580642cd8bb2d1941ea0be79 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:27:56.115880 14738 tablet_service.cc:1511] Processing CreateTablet for tablet dcee6c60580642cd8bb2d1941ea0be79 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:27:56.123430 14819 tablet_service.cc:1511] Processing CreateTablet for tablet dcee6c60580642cd8bb2d1941ea0be79 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20260709 12:27:56.124583 14738 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcee6c60580642cd8bb2d1941ea0be79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.124734 14819 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcee6c60580642cd8bb2d1941ea0be79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.123456 14597 tablet_service.cc:1511] Processing CreateTablet for tablet edf0c9a7101d45abbba0a1109b880e41 (DEFAULT_TABLE table=test-workload [id=8eb8a0d4b3a84750a6f469ea2bf74d6f]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20260709 12:27:56.123477 14593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dcee6c60580642cd8bb2d1941ea0be79. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.134742 14597 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edf0c9a7101d45abbba0a1109b880e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.143365 14670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet edf0c9a7101d45abbba0a1109b880e41. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:27:56.179335 14876 tablet_bootstrap.cc:654] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.128525 14879 consensus_queue.cc:260] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.184790 14879 ts_tablet_manager.cc:1434] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.107s	user 0.008s	sys 0.000s
I20260709 12:27:56.185350 14929 raft_consensus.cc:515] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.186050 14879 tablet_bootstrap.cc:492] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:56.186733 14682 raft_consensus.cc:2393] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0cbbdf206b5458e9af48c22b862264a in current term 1: Already voted for candidate 9a105adb44fb47078d6cb03a6c02026f in this term.
I20260709 12:27:56.189186 14573 leader_election.cc:304] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:27:56.189906 14938 raft_consensus.cc:3060] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.200388 14938 raft_consensus.cc:2749] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:56.204339 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f50744c152c4f22b65828c60d9d2974" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:56.205597 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f50744c152c4f22b65828c60d9d2974" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
W20260709 12:27:56.210347 14649 leader_election.cc:343] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.206786 14877 tablet_bootstrap.cc:492] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:56.205814 14929 leader_election.cc:290] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:56.217245 14877 tablet_bootstrap.cc:654] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.232481 14607 raft_consensus.cc:2468] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:56.234582 14646 leader_election.cc:304] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:27:56.241827 14945 raft_consensus.cc:2804] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.247133 14876 tablet_bootstrap.cc:492] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:56.247781 14876 ts_tablet_manager.cc:1403] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.146s	user 0.015s	sys 0.000s
I20260709 12:27:56.249255 14878 tablet_bootstrap.cc:492] T 6dd7f28a6ca34728b1f3c599fc653c6d P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:56.250978 14878 ts_tablet_manager.cc:1403] T 6dd7f28a6ca34728b1f3c599fc653c6d P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.278s	user 0.041s	sys 0.043s
I20260709 12:27:56.251096 14876 raft_consensus.cc:359] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.252686 14876 raft_consensus.cc:385] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.253029 14876 raft_consensus.cc:740] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.255617 14938 raft_consensus.cc:493] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.256148 14938 raft_consensus.cc:515] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.259138 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8190b1186645b4aa61fbd5207622cf" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:56.259518 14878 raft_consensus.cc:359] T 6dd7f28a6ca34728b1f3c599fc653c6d P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.259815 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8190b1186645b4aa61fbd5207622cf" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:56.260464 14878 raft_consensus.cc:385] T 6dd7f28a6ca34728b1f3c599fc653c6d P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.258268 14938 leader_election.cc:290] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
W20260709 12:27:56.261030 14572 leader_election.cc:343] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.260952 14878 raft_consensus.cc:740] T 6dd7f28a6ca34728b1f3c599fc653c6d P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.260823 14830 raft_consensus.cc:2468] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:27:56.260790 14879 tablet_bootstrap.cc:654] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.262599 14574 leader_election.cc:304] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:27:56.262310 14878 consensus_queue.cc:260] T 6dd7f28a6ca34728b1f3c599fc653c6d P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.263607 14938 raft_consensus.cc:2804] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.263983 14938 raft_consensus.cc:493] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.264430 14938 raft_consensus.cc:3060] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.265302 14878 ts_tablet_manager.cc:1434] T 6dd7f28a6ca34728b1f3c599fc653c6d P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:27:56.266450 14878 tablet_bootstrap.cc:492] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:56.270644 14884 raft_consensus.cc:493] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.271191 14884 raft_consensus.cc:515] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.271574 14938 raft_consensus.cc:515] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.273061 14878 tablet_bootstrap.cc:654] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.273388 14884 leader_election.cc:290] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:27:56.253821 14876 consensus_queue.cc:260] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.274430 14938 leader_election.cc:290] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:56.275146 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fcef99f4594e7f9d6132ec5719da49" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:56.276798 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fcef99f4594e7f9d6132ec5719da49" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:56.277938 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8190b1186645b4aa61fbd5207622cf" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
W20260709 12:27:56.285948 14794 leader_election.cc:343] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:56.286652 14796 leader_election.cc:343] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:56.287012 14572 leader_election.cc:343] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.287190 14796 leader_election.cc:304] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:27:56.287909 14945 raft_consensus.cc:697] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:27:56.288214 14884 raft_consensus.cc:2749] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:56.288826 14945 consensus_queue.cc:237] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.280040 14876 ts_tablet_manager.cc:1434] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:27:56.290375 14877 tablet_bootstrap.cc:492] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:56.291002 14877 ts_tablet_manager.cc:1403] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.119s	user 0.010s	sys 0.007s
I20260709 12:27:56.291453 14876 tablet_bootstrap.cc:492] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:56.279857 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8190b1186645b4aa61fbd5207622cf" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:56.293987 14830 raft_consensus.cc:3060] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.297909 14876 tablet_bootstrap.cc:654] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.304068 14830 raft_consensus.cc:2468] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:56.283649 14879 tablet_bootstrap.cc:492] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:56.307653 14879 ts_tablet_manager.cc:1403] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.000s
I20260709 12:27:56.308748 14878 tablet_bootstrap.cc:492] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:56.309481 14878 ts_tablet_manager.cc:1403] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.043s	user 0.024s	sys 0.016s
I20260709 12:27:56.304821 14877 raft_consensus.cc:359] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.311671 14831 raft_consensus.cc:3060] T 6dd7f28a6ca34728b1f3c599fc653c6d P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.313014 14878 raft_consensus.cc:359] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.313840 14878 raft_consensus.cc:385] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.314131 14878 raft_consensus.cc:740] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.314962 14878 consensus_queue.cc:260] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.317471 14878 ts_tablet_manager.cc:1434] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.002s
I20260709 12:27:56.318637 14878 tablet_bootstrap.cc:492] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:56.325273 14878 tablet_bootstrap.cc:654] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.326010 14877 raft_consensus.cc:385] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.321332 14504 catalog_manager.cc:5697] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.328169 14879 raft_consensus.cc:359] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.329306 14879 raft_consensus.cc:385] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.331234 14879 raft_consensus.cc:740] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.330552 14574 leader_election.cc:304] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:27:56.326427 14877 raft_consensus.cc:740] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.332077 14938 raft_consensus.cc:2804] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.332643 14938 raft_consensus.cc:697] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:27:56.333315 14876 tablet_bootstrap.cc:492] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:56.333905 14876 ts_tablet_manager.cc:1403] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.043s	user 0.021s	sys 0.015s
I20260709 12:27:56.333595 14938 consensus_queue.cc:237] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.337507 14876 raft_consensus.cc:359] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.338304 14876 raft_consensus.cc:385] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.338644 14876 raft_consensus.cc:740] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.339125 14877 consensus_queue.cc:260] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.339453 14876 consensus_queue.cc:260] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.342109 14877 ts_tablet_manager.cc:1434] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.051s	user 0.003s	sys 0.005s
I20260709 12:27:56.346441 14877 tablet_bootstrap.cc:492] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:56.343325 14879 consensus_queue.cc:260] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.342444 14876 ts_tablet_manager.cc:1434] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:27:56.352023 14876 tablet_bootstrap.cc:492] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:56.363415 14879 ts_tablet_manager.cc:1434] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.055s	user 0.004s	sys 0.004s
I20260709 12:27:56.364739 14879 tablet_bootstrap.cc:492] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:56.366531 14942 raft_consensus.cc:493] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.367206 14942 raft_consensus.cc:515] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.366674 14505 catalog_manager.cc:5697] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:56.370430 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9c76cb01cd4cd78bb4a2826b2b06ea" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:56.370450 14942 leader_election.cc:290] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:56.370826 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9c76cb01cd4cd78bb4a2826b2b06ea" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:56.371876 14831 raft_consensus.cc:2468] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
W20260709 12:27:56.372641 14722 leader_election.cc:343] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.373442 14723 leader_election.cc:304] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:27:56.374223 14942 raft_consensus.cc:2804] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.374617 14942 raft_consensus.cc:493] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.374946 14942 raft_consensus.cc:3060] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.379961 14919 consensus_queue.cc:1048] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:27:56.383077 14942 raft_consensus.cc:515] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.384478 14876 tablet_bootstrap.cc:654] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.383077 14877 tablet_bootstrap.cc:654] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.385371 14945 raft_consensus.cc:493] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.386081 14945 raft_consensus.cc:515] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.387836 14942 leader_election.cc:290] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:56.388142 14945 leader_election.cc:290] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:56.389120 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9c76cb01cd4cd78bb4a2826b2b06ea" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:56.389750 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8000e051fc45f8a4f3782b144f95a8" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
W20260709 12:27:56.390760 14722 leader_election.cc:343] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.391760 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8000e051fc45f8a4f3782b144f95a8" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:56.392455 14756 raft_consensus.cc:2468] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:56.393301 14607 raft_consensus.cc:2468] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:56.393671 14647 leader_election.cc:304] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:27:56.395295 14945 raft_consensus.cc:2804] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.395700 14945 raft_consensus.cc:493] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.396040 14945 raft_consensus.cc:3060] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.398940 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9c76cb01cd4cd78bb4a2826b2b06ea" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:56.399744 14831 raft_consensus.cc:3060] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.408010 14831 raft_consensus.cc:2468] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:27:56.408614 14945 raft_consensus.cc:515] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.411546 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8000e051fc45f8a4f3782b144f95a8" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:56.412178 14607 raft_consensus.cc:3060] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.412956 14723 leader_election.cc:304] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:27:56.413211 14878 tablet_bootstrap.cc:492] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:56.413892 14887 raft_consensus.cc:2804] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.414328 14878 ts_tablet_manager.cc:1403] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.096s	user 0.016s	sys 0.037s
I20260709 12:27:56.414364 14887 raft_consensus.cc:697] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:27:56.415449 14879 tablet_bootstrap.cc:654] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.417558 14878 raft_consensus.cc:359] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.418358 14878 raft_consensus.cc:385] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.415362 14887 consensus_queue.cc:237] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.418709 14878 raft_consensus.cc:740] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.419482 14878 consensus_queue.cc:260] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.420920 14607 raft_consensus.cc:2468] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:56.421707 14878 ts_tablet_manager.cc:1434] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.007s	user 0.000s	sys 0.004s
I20260709 12:27:56.422420 14646 leader_election.cc:304] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:56.423585 14946 raft_consensus.cc:2804] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.424135 14946 raft_consensus.cc:697] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
W20260709 12:27:56.424530 14723 consensus_peers.cc:597] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 -> Peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Couldn't send request to peer 420d5d7b2b504ff7923b7f4098c0fcce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:56.423724 14878 tablet_bootstrap.cc:492] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:56.424985 14946 consensus_queue.cc:237] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.432380 14878 tablet_bootstrap.cc:654] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.432219 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8000e051fc45f8a4f3782b144f95a8" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:56.432937 14756 raft_consensus.cc:3060] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.442823 14756 raft_consensus.cc:2468] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:56.444936 14945 leader_election.cc:290] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:56.446874 14878 tablet_bootstrap.cc:492] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:56.447456 14878 ts_tablet_manager.cc:1403] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.024s	user 0.018s	sys 0.000s
I20260709 12:27:56.449146 14504 catalog_manager.cc:5697] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:56.450161 14878 raft_consensus.cc:359] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.450947 14878 raft_consensus.cc:385] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.451499 14878 raft_consensus.cc:740] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.452370 14877 tablet_bootstrap.cc:492] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:56.452335 14878 consensus_queue.cc:260] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.452920 14877 ts_tablet_manager.cc:1403] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.107s	user 0.015s	sys 0.009s
I20260709 12:27:56.455639 14877 raft_consensus.cc:359] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.456274 14877 raft_consensus.cc:385] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.456555 14877 raft_consensus.cc:740] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.456759 14506 catalog_manager.cc:5697] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:56.457317 14877 consensus_queue.cc:260] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.459510 14877 ts_tablet_manager.cc:1434] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.001s
I20260709 12:27:56.459781 14929 raft_consensus.cc:493] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.460521 14877 tablet_bootstrap.cc:492] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:56.460273 14929 raft_consensus.cc:515] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.462143 14878 ts_tablet_manager.cc:1434] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:27:56.462363 14929 leader_election.cc:290] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:56.463944 14878 tablet_bootstrap.cc:492] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:56.465238 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e928d444370c4dc49f31e057169dbba0" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:56.465492 14876 tablet_bootstrap.cc:492] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:56.465955 14876 ts_tablet_manager.cc:1403] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.114s	user 0.021s	sys 0.006s
I20260709 12:27:56.468750 14876 raft_consensus.cc:359] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.469359 14876 raft_consensus.cc:385] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.465898 14831 raft_consensus.cc:2468] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:56.470340 14878 tablet_bootstrap.cc:654] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.471011 14649 leader_election.cc:304] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
W20260709 12:27:56.469275 14554 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:56.471823 14929 raft_consensus.cc:2804] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.472427 14929 raft_consensus.cc:493] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.469722 14876 raft_consensus.cc:740] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.472826 14929 raft_consensus.cc:3060] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.473323 14876 consensus_queue.cc:260] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.478168 14877 tablet_bootstrap.cc:654] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.483347 14876 ts_tablet_manager.cc:1434] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.017s	user 0.007s	sys 0.001s
I20260709 12:27:56.484450 14876 tablet_bootstrap.cc:492] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:56.485036 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e928d444370c4dc49f31e057169dbba0" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:56.491583 14877 tablet_bootstrap.cc:492] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:56.493932 14756 raft_consensus.cc:2468] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:56.494261 14877 ts_tablet_manager.cc:1403] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.000s
I20260709 12:27:56.497267 14877 raft_consensus.cc:359] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.497954 14877 raft_consensus.cc:385] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.498234 14877 raft_consensus.cc:740] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.499083 14877 consensus_queue.cc:260] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.500420 14879 tablet_bootstrap.cc:492] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:56.501008 14879 ts_tablet_manager.cc:1403] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.137s	user 0.023s	sys 0.011s
I20260709 12:27:56.501362 14877 ts_tablet_manager.cc:1434] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:56.502401 14877 tablet_bootstrap.cc:492] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:56.506217 14876 tablet_bootstrap.cc:654] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.508637 14879 raft_consensus.cc:359] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.510953 14879 raft_consensus.cc:385] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.510000 14878 tablet_bootstrap.cc:492] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:56.511360 14879 raft_consensus.cc:740] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.511920 14878 ts_tablet_manager.cc:1403] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.048s	user 0.024s	sys 0.021s
I20260709 12:27:56.512406 14879 consensus_queue.cc:260] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.507704 14877 tablet_bootstrap.cc:654] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.514765 14878 raft_consensus.cc:359] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.515415 14878 raft_consensus.cc:385] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.515686 14878 raft_consensus.cc:740] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.516369 14878 consensus_queue.cc:260] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.518326 14878 ts_tablet_manager.cc:1434] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.000s
I20260709 12:27:56.510687 14929 raft_consensus.cc:515] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.521111 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e928d444370c4dc49f31e057169dbba0" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:56.521341 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e928d444370c4dc49f31e057169dbba0" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:56.521739 14756 raft_consensus.cc:3060] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.522656 14831 raft_consensus.cc:3060] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.523554 14878 tablet_bootstrap.cc:492] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:56.529718 14878 tablet_bootstrap.cc:654] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.529865 14831 raft_consensus.cc:2468] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:56.530292 14877 tablet_bootstrap.cc:492] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:56.530613 14929 leader_election.cc:290] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:56.530856 14877 ts_tablet_manager.cc:1403] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.005s
I20260709 12:27:56.532038 14649 leader_election.cc:304] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:27:56.533034 14929 raft_consensus.cc:2804] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.533763 14877 raft_consensus.cc:359] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.534422 14929 raft_consensus.cc:697] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:27:56.535656 14929 consensus_queue.cc:237] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.534740 14877 raft_consensus.cc:385] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.538952 14877 raft_consensus.cc:740] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.541083 14877 consensus_queue.cc:260] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.543188 14756 raft_consensus.cc:2468] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:56.546769 14878 tablet_bootstrap.cc:492] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:56.547345 14878 ts_tablet_manager.cc:1403] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.024s	user 0.012s	sys 0.009s
I20260709 12:27:56.543798 14877 ts_tablet_manager.cc:1434] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:27:56.546659 14879 ts_tablet_manager.cc:1434] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.045s	user 0.007s	sys 0.000s
I20260709 12:27:56.548867 14877 tablet_bootstrap.cc:492] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:56.549904 14878 raft_consensus.cc:359] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.550614 14878 raft_consensus.cc:385] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.550871 14878 raft_consensus.cc:740] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.551803 14878 consensus_queue.cc:260] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.553040 14506 catalog_manager.cc:5697] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:56.555478 14877 tablet_bootstrap.cc:654] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.558220 14879 tablet_bootstrap.cc:492] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:56.563977 14878 ts_tablet_manager.cc:1434] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:27:56.565279 14876 tablet_bootstrap.cc:492] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:56.565824 14876 ts_tablet_manager.cc:1403] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.082s	user 0.026s	sys 0.002s
I20260709 12:27:56.566879 14879 tablet_bootstrap.cc:654] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.568856 14876 raft_consensus.cc:359] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.570039 14876 raft_consensus.cc:385] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.572151 14884 raft_consensus.cc:493] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.574703 14876 raft_consensus.cc:740] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.574909 14884 raft_consensus.cc:515] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.576104 14876 consensus_queue.cc:260] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.577049 14884 leader_election.cc:290] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:27:56.573913 14878 tablet_bootstrap.cc:492] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:56.578157 14876 ts_tablet_manager.cc:1434] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:27:56.579212 14876 tablet_bootstrap.cc:492] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:56.584506 14878 tablet_bootstrap.cc:654] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.584506 14876 tablet_bootstrap.cc:654] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.586099 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f50744c152c4f22b65828c60d9d2974" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:56.587404 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f50744c152c4f22b65828c60d9d2974" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:56.588166 14607 raft_consensus.cc:2393] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 420d5d7b2b504ff7923b7f4098c0fcce in current term 1: Already voted for candidate 9a105adb44fb47078d6cb03a6c02026f in this term.
I20260709 12:27:56.588886 14877 tablet_bootstrap.cc:492] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:56.589133 14879 tablet_bootstrap.cc:492] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:56.589421 14877 ts_tablet_manager.cc:1403] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.007s
I20260709 12:27:56.589632 14879 ts_tablet_manager.cc:1403] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.032s	user 0.021s	sys 0.006s
I20260709 12:27:56.592108 14796 leader_election.cc:304] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:27:56.593398 14884 raft_consensus.cc:3060] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.596220 14877 raft_consensus.cc:359] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.596391 14879 raft_consensus.cc:359] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.597205 14879 raft_consensus.cc:385] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.597492 14879 raft_consensus.cc:740] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.598132 14879 consensus_queue.cc:260] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.601948 14879 ts_tablet_manager.cc:1434] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:27:56.597024 14877 raft_consensus.cc:385] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.603135 14884 raft_consensus.cc:2749] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:56.603477 14877 raft_consensus.cc:740] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.604266 14877 consensus_queue.cc:260] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.605194 14879 tablet_bootstrap.cc:492] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:56.606312 14877 ts_tablet_manager.cc:1434] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.001s
I20260709 12:27:56.607372 14877 tablet_bootstrap.cc:492] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:56.611763 14879 tablet_bootstrap.cc:654] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.612735 14877 tablet_bootstrap.cc:654] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.615901 14876 tablet_bootstrap.cc:492] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:56.616390 14876 ts_tablet_manager.cc:1403] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.037s	user 0.011s	sys 0.011s
I20260709 12:27:56.616603 14878 tablet_bootstrap.cc:492] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:56.617090 14878 ts_tablet_manager.cc:1403] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.043s	user 0.011s	sys 0.000s
I20260709 12:27:56.617424 14938 raft_consensus.cc:493] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.617960 14938 raft_consensus.cc:515] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.619171 14876 raft_consensus.cc:359] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.619683 14878 raft_consensus.cc:359] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.620157 14938 leader_election.cc:290] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:27:56.620370 14878 raft_consensus.cc:385] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.620707 14878 raft_consensus.cc:740] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.619908 14876 raft_consensus.cc:385] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.621179 14876 raft_consensus.cc:740] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.621794 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d4c5596d44c5ebc68130616ef1ddb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:56.621958 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d4c5596d44c5ebc68130616ef1ddb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:56.621989 14876 consensus_queue.cc:260] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.622974 14682 raft_consensus.cc:2468] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:27:56.623006 14831 raft_consensus.cc:2468] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:27:56.624327 14573 leader_election.cc:304] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:56.624704 14876 ts_tablet_manager.cc:1434] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.001s
I20260709 12:27:56.625327 14911 raft_consensus.cc:2804] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.625751 14911 raft_consensus.cc:493] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.626093 14911 raft_consensus.cc:3060] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.629843 14938 raft_consensus.cc:493] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.630358 14938 raft_consensus.cc:515] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.632429 14938 leader_election.cc:290] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:56.634435 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6c65eac6134e59bf2b86cb44ca7a4f" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:56.635136 14682 raft_consensus.cc:2468] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:27:56.636634 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6c65eac6134e59bf2b86cb44ca7a4f" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:27:56.638386 14572 leader_election.cc:343] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.639309 14878 consensus_queue.cc:260] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.640023 14573 leader_election.cc:304] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:27:56.641366 14938 raft_consensus.cc:2804] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.641847 14938 raft_consensus.cc:493] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.642261 14938 raft_consensus.cc:3060] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.634868 14911 raft_consensus.cc:515] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.642999 14876 tablet_bootstrap.cc:492] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:56.647670 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d4c5596d44c5ebc68130616ef1ddb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:56.648139 14879 tablet_bootstrap.cc:492] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:56.648383 14682 raft_consensus.cc:3060] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.648676 14879 ts_tablet_manager.cc:1403] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.044s	user 0.022s	sys 0.004s
I20260709 12:27:56.647403 14877 tablet_bootstrap.cc:492] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:56.649921 14877 ts_tablet_manager.cc:1403] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.043s	user 0.014s	sys 0.012s
I20260709 12:27:56.646545 14911 leader_election.cc:290] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:27:56.647256 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d4c5596d44c5ebc68130616ef1ddb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:56.652676 14831 raft_consensus.cc:3060] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.653189 14877 raft_consensus.cc:359] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.653909 14877 raft_consensus.cc:385] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.654187 14877 raft_consensus.cc:740] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.655012 14877 consensus_queue.cc:260] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.657048 14877 ts_tablet_manager.cc:1434] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.007s	user 0.004s	sys 0.001s
I20260709 12:27:56.660563 14876 tablet_bootstrap.cc:654] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.644305 14878 ts_tablet_manager.cc:1434] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.000s
I20260709 12:27:56.662243 14682 raft_consensus.cc:2468] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:56.663740 14573 leader_election.cc:304] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:56.664783 14911 raft_consensus.cc:2804] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.661382 14831 raft_consensus.cc:2468] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:56.668187 14878 tablet_bootstrap.cc:492] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:56.669292 14938 raft_consensus.cc:515] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.670075 14879 raft_consensus.cc:359] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.670969 14879 raft_consensus.cc:385] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.671250 14879 raft_consensus.cc:740] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.673911 14877 tablet_bootstrap.cc:492] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:56.674041 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6c65eac6134e59bf2b86cb44ca7a4f" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:56.674945 14682 raft_consensus.cc:3060] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.677359 14879 consensus_queue.cc:260] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.680325 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6c65eac6134e59bf2b86cb44ca7a4f" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:56.681022 14877 tablet_bootstrap.cc:654] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.681983 14878 tablet_bootstrap.cc:654] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:56.681921 14572 leader_election.cc:343] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.683221 14938 leader_election.cc:290] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:56.685964 14911 raft_consensus.cc:697] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:27:56.686947 14911 consensus_queue.cc:237] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.698488 14879 ts_tablet_manager.cc:1434] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.049s	user 0.006s	sys 0.000s
I20260709 12:27:56.702608 14879 tablet_bootstrap.cc:492] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:56.703970 14682 raft_consensus.cc:2468] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:56.707391 14573 leader_election.cc:304] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:27:56.708055 14879 tablet_bootstrap.cc:654] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.707624 14876 tablet_bootstrap.cc:492] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:56.708292 14877 tablet_bootstrap.cc:492] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:56.708645 14911 raft_consensus.cc:2804] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.705399 14505 catalog_manager.cc:5697] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:56.709235 14911 raft_consensus.cc:697] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:27:56.709470 14876 ts_tablet_manager.cc:1403] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.067s	user 0.026s	sys 0.027s
I20260709 12:27:56.710091 14911 consensus_queue.cc:237] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.708830 14877 ts_tablet_manager.cc:1403] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.035s	user 0.018s	sys 0.012s
I20260709 12:27:56.713899 14878 tablet_bootstrap.cc:492] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:56.714439 14878 ts_tablet_manager.cc:1403] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.046s	user 0.010s	sys 0.001s
I20260709 12:27:56.716738 14877 raft_consensus.cc:359] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.713146 14876 raft_consensus.cc:359] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.717582 14877 raft_consensus.cc:385] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.718032 14877 raft_consensus.cc:740] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.717239 14878 raft_consensus.cc:359] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.718623 14878 raft_consensus.cc:385] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.717839 14876 raft_consensus.cc:385] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.719236 14876 raft_consensus.cc:740] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.718948 14877 consensus_queue.cc:260] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.720007 14876 consensus_queue.cc:260] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.720623 14946 consensus_queue.cc:1048] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:56.721439 14877 ts_tablet_manager.cc:1434] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:27:56.722206 14876 ts_tablet_manager.cc:1434] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 12:27:56.722482 14877 tablet_bootstrap.cc:492] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:56.723218 14876 tablet_bootstrap.cc:492] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:56.718959 14878 raft_consensus.cc:740] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.726826 14911 raft_consensus.cc:493] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.727599 14877 tablet_bootstrap.cc:654] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.727295 14911 raft_consensus.cc:515] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.729208 14876 tablet_bootstrap.cc:654] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.730223 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:56.731066 14757 raft_consensus.cc:2468] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:27:56.732503 14572 leader_election.cc:304] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:27:56.733363 14976 raft_consensus.cc:2804] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.733718 14976 raft_consensus.cc:493] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.734021 14976 raft_consensus.cc:3060] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.734604 14884 raft_consensus.cc:493] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.735159 14884 raft_consensus.cc:515] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.737260 14884 leader_election.cc:290] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:56.742821 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:56.726210 14878 consensus_queue.cc:260] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.744850 14929 consensus_queue.cc:1048] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:56.745086 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:56.745848 14757 raft_consensus.cc:2468] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 0.
I20260709 12:27:56.748029 14795 leader_election.cc:304] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:27:56.749796 14884 raft_consensus.cc:2804] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.750186 14884 raft_consensus.cc:493] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.750615 14884 raft_consensus.cc:3060] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.743083 14976 raft_consensus.cc:515] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.760417 14607 raft_consensus.cc:2393] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 420d5d7b2b504ff7923b7f4098c0fcce in current term 1: Already voted for candidate c0cbbdf206b5458e9af48c22b862264a in this term.
I20260709 12:27:56.762809 14911 leader_election.cc:290] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:56.768157 14976 leader_election.cc:290] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:56.770346 14878 ts_tablet_manager.cc:1434] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.056s	user 0.003s	sys 0.003s
I20260709 12:27:56.771174 14884 raft_consensus.cc:515] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.775147 14876 tablet_bootstrap.cc:492] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:56.775717 14876 ts_tablet_manager.cc:1403] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.053s	user 0.029s	sys 0.019s
I20260709 12:27:56.775499 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:56.776345 14757 raft_consensus.cc:3060] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.778676 14876 raft_consensus.cc:359] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.779120 14976 consensus_queue.cc:1048] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:56.781589 14946 raft_consensus.cc:493] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.782197 14946 raft_consensus.cc:515] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.783301 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:56.784108 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:56.784567 14946 leader_election.cc:290] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:56.786046 14879 tablet_bootstrap.cc:492] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:56.785954 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fcef99f4594e7f9d6132ec5719da49" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:56.786784 14879 ts_tablet_manager.cc:1403] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.084s	user 0.014s	sys 0.003s
I20260709 12:27:56.787072 14607 raft_consensus.cc:2468] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:56.788720 14646 leader_election.cc:304] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:56.789705 14879 raft_consensus.cc:359] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.790308 14878 tablet_bootstrap.cc:492] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:56.790498 14879 raft_consensus.cc:385] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.790799 14879 raft_consensus.cc:740] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.791625 14879 consensus_queue.cc:260] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.793922 14879 ts_tablet_manager.cc:1434] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:27:56.794922 14879 tablet_bootstrap.cc:492] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:56.796021 14946 raft_consensus.cc:2804] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.796561 14946 raft_consensus.cc:493] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.796990 14946 raft_consensus.cc:3060] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.779482 14929 raft_consensus.cc:493] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.799336 14929 raft_consensus.cc:515] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.800978 14879 tablet_bootstrap.cc:654] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.802542 14929 leader_election.cc:290] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:56.802898 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9c76cb01cd4cd78bb4a2826b2b06ea" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:56.805078 14757 raft_consensus.cc:2468] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:56.809567 14878 tablet_bootstrap.cc:654] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.817145 14942 consensus_queue.cc:1048] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:56.817409 14572 leader_election.cc:304] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:27:56.818639 14976 raft_consensus.cc:2804] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.819136 14976 raft_consensus.cc:697] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
W20260709 12:27:56.802867 14795 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:42945, user_credentials={real_user=slave}} blocked reactor thread for 54956.2us
I20260709 12:27:56.819959 14976 consensus_queue.cc:237] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.779429 14876 raft_consensus.cc:385] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.813529 14830 raft_consensus.cc:2393] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0cbbdf206b5458e9af48c22b862264a in current term 1: Already voted for candidate 420d5d7b2b504ff7923b7f4098c0fcce in this term.
I20260709 12:27:56.814949 14884 leader_election.cc:290] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:56.815580 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:56.816234 14984 raft_consensus.cc:493] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.830663 14984 raft_consensus.cc:515] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.831947 14827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7f9c76cb01cd4cd78bb4a2826b2b06ea" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:56.832448 14946 raft_consensus.cc:515] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.833040 14984 leader_election.cc:290] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:56.826615 14877 tablet_bootstrap.cc:492] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:56.821257 14876 raft_consensus.cc:740] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.834187 14877 ts_tablet_manager.cc:1403] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.112s	user 0.033s	sys 0.041s
I20260709 12:27:56.835633 14876 consensus_queue.cc:260] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.838093 14876 ts_tablet_manager.cc:1434] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.062s	user 0.007s	sys 0.000s
I20260709 12:27:56.839080 14876 tablet_bootstrap.cc:492] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:56.838862 14877 raft_consensus.cc:359] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.839663 14877 raft_consensus.cc:385] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.838943 14756 raft_consensus.cc:3060] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.841300 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed1c5a7249449bb4b8c8a3543ba599" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:56.841957 14946 leader_election.cc:290] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:56.841975 14682 raft_consensus.cc:2468] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 0.
I20260709 12:27:56.843971 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fcef99f4594e7f9d6132ec5719da49" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:56.844574 14608 raft_consensus.cc:3060] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.840209 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:56.847816 14757 raft_consensus.cc:2393] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 420d5d7b2b504ff7923b7f4098c0fcce in current term 1: Already voted for candidate c0cbbdf206b5458e9af48c22b862264a in this term.
I20260709 12:27:56.839836 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fcef99f4594e7f9d6132ec5719da49" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:56.839972 14877 raft_consensus.cc:740] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.855756 14877 consensus_queue.cc:260] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.856216 14796 leader_election.cc:304] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:27:56.858690 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed1c5a7249449bb4b8c8a3543ba599" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:56.859973 14911 raft_consensus.cc:493] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.860504 14911 raft_consensus.cc:515] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.861104 14876 tablet_bootstrap.cc:654] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.858736 14884 raft_consensus.cc:2804] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.863008 14795 leader_election.cc:304] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:27:56.863899 14911 leader_election.cc:290] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
W20260709 12:27:56.864336 14795 leader_election.cc:343] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.864487 14984 raft_consensus.cc:2749] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:27:56.849007 14828 raft_consensus.cc:2468] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:56.865749 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242076f4476b46f1a12a0a07ced33d27" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:56.870157 14757 raft_consensus.cc:2468] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:27:56.870780 14884 raft_consensus.cc:493] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.871192 14942 raft_consensus.cc:493] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.871289 14884 raft_consensus.cc:3060] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.871739 14942 raft_consensus.cc:515] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.874496 14572 leader_election.cc:304] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:27:56.865943 14682 raft_consensus.cc:3060] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.867007 14879 tablet_bootstrap.cc:492] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:56.877027 14879 ts_tablet_manager.cc:1403] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.082s	user 0.013s	sys 0.006s
I20260709 12:27:56.867568 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242076f4476b46f1a12a0a07ced33d27" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:56.880115 14877 ts_tablet_manager.cc:1434] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.045s	user 0.006s	sys 0.000s
I20260709 12:27:56.881276 14877 tablet_bootstrap.cc:492] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:56.870987 14608 raft_consensus.cc:2468] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:56.887601 14876 tablet_bootstrap.cc:492] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:56.888094 14876 ts_tablet_manager.cc:1403] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.049s	user 0.019s	sys 0.012s
I20260709 12:27:56.889741 14879 raft_consensus.cc:359] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.890283 14879 raft_consensus.cc:385] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.890504 14879 raft_consensus.cc:740] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.891687 14942 leader_election.cc:290] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:56.892123 14646 leader_election.cc:304] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:56.893812 14877 tablet_bootstrap.cc:654] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.878297 14911 raft_consensus.cc:2804] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.896620 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f70df459ff44f5b95b6a780b4d2a596" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:56.892983 14683 raft_consensus.cc:2468] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:27:56.901376 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f70df459ff44f5b95b6a780b4d2a596" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:56.902045 14608 raft_consensus.cc:2468] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:27:56.900625 14831 raft_consensus.cc:2468] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:27:56.903208 14938 consensus_queue.cc:1048] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:56.903635 14720 leader_election.cc:304] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:27:56.904712 14942 raft_consensus.cc:2804] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:56.905105 14942 raft_consensus.cc:493] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.905530 14942 raft_consensus.cc:3060] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.898228 14911 raft_consensus.cc:493] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:56.912778 14911 raft_consensus.cc:3060] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.904997 14929 consensus_queue.cc:1048] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20260709 12:27:56.894325 14649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:35543, user_credentials={real_user=slave}} blocked reactor thread for 73048.3us
I20260709 12:27:56.919494 14876 raft_consensus.cc:359] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.920342 14876 raft_consensus.cc:385] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:56.920600 14876 raft_consensus.cc:740] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:56.922765 14876 consensus_queue.cc:260] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.924183 14984 raft_consensus.cc:493] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:56.924734 14984 raft_consensus.cc:515] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.936344 14876 ts_tablet_manager.cc:1434] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.048s	user 0.008s	sys 0.000s
I20260709 12:27:56.936592 14984 leader_election.cc:290] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:56.938490 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c747ce7b704240a1399f870f7b99e0" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:56.943488 14876 tablet_bootstrap.cc:492] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:56.947708 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "37fcef99f4594e7f9d6132ec5719da49" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:56.948385 14831 raft_consensus.cc:3060] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.949091 14919 consensus_queue.cc:1048] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:56.955144 14755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b7c747ce7b704240a1399f870f7b99e0" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:56.955734 14879 consensus_queue.cc:260] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:56.956918 14795 leader_election.cc:304] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7
I20260709 12:27:56.956857 14884 raft_consensus.cc:515] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:56.957108 14989 raft_consensus.cc:2804] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.962445 14989 raft_consensus.cc:697] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:27:56.963558 14989 consensus_queue.cc:237] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.964347 14986 raft_consensus.cc:2749] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:56.967532 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed1c5a7249449bb4b8c8a3543ba599" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:56.968233 14682 raft_consensus.cc:3060] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.969619 14831 raft_consensus.cc:2468] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:56.961374 14942 raft_consensus.cc:515] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:56.973908 14911 raft_consensus.cc:515] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:56.976153 14682 raft_consensus.cc:2468] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:27:56.976852 14755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242076f4476b46f1a12a0a07ced33d27" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:56.977312 14796 leader_election.cc:304] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:27:56.961086 14878 tablet_bootstrap.cc:492] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:56.977720 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f70df459ff44f5b95b6a780b4d2a596" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:56.958948 14649 leader_election.cc:304] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:27:56.978480 14607 raft_consensus.cc:3060] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.979085 14884 leader_election.cc:290] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:56.981644 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4fed1c5a7249449bb4b8c8a3543ba599" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:56.978473 14878 ts_tablet_manager.cc:1403] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.192s	user 0.022s	sys 0.006s
I20260709 12:27:56.977474 14755 raft_consensus.cc:3060] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:56.957899 14879 ts_tablet_manager.cc:1434] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.081s	user 0.004s	sys 0.006s
I20260709 12:27:56.979660 14884 raft_consensus.cc:2804] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:56.984454 14879 tablet_bootstrap.cc:492] T 4fed1c5a7249449bb4b8c8a3543ba599 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:56.984489 14876 tablet_bootstrap.cc:654] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:56.985469 14942 leader_election.cc:290] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
W20260709 12:27:56.991601 14795 leader_election.cc:343] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:56.990387 14884 raft_consensus.cc:697] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:27:56.995704 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f70df459ff44f5b95b6a780b4d2a596" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:56.979758 14505 catalog_manager.cc:5697] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:57.007287 14878 raft_consensus.cc:359] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.012288 14878 raft_consensus.cc:385] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.012646 14878 raft_consensus.cc:740] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.019148 14878 consensus_queue.cc:260] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.015913 14831 raft_consensus.cc:3060] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.010841 14505 catalog_manager.cc:5697] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.031737 14828 raft_consensus.cc:3060] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.023108 14946 raft_consensus.cc:2749] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.038923 14878 ts_tablet_manager.cc:1434] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.056s	user 0.006s	sys 0.001s
I20260709 12:27:57.040213 14878 tablet_bootstrap.cc:492] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:57.044356 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242076f4476b46f1a12a0a07ced33d27" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:57.045064 14681 raft_consensus.cc:3060] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.035923 14976 raft_consensus.cc:493] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.054118 14992 consensus_queue.cc:1048] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.017s
I20260709 12:27:57.057982 14976 raft_consensus.cc:515] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.060753 14976 leader_election.cc:290] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:57.061511 14877 tablet_bootstrap.cc:492] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:57.062063 14877 ts_tablet_manager.cc:1403] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.181s	user 0.015s	sys 0.010s
I20260709 12:27:57.062170 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5fcaa8194c4e4d8edfc076579b7629" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:57.062608 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5fcaa8194c4e4d8edfc076579b7629" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
W20260709 12:27:57.067215 14572 leader_election.cc:343] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:57.069012 14573 leader_election.cc:343] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.069600 14573 leader_election.cc:304] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7
I20260709 12:27:57.071435 14976 raft_consensus.cc:2749] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.072495 14681 raft_consensus.cc:2468] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:57.074843 14573 leader_election.cc:304] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:57.076314 14938 raft_consensus.cc:2804] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:57.084035 14879 tablet_bootstrap.cc:654] T 4fed1c5a7249449bb4b8c8a3543ba599 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.088411 14878 tablet_bootstrap.cc:654] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.085757 14992 consensus_queue.cc:1048] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:27:57.093268 14877 raft_consensus.cc:359] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.098028 14877 raft_consensus.cc:385] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.098640 14877 raft_consensus.cc:740] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.101368 14877 consensus_queue.cc:260] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.103608 14877 ts_tablet_manager.cc:1434] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.041s	user 0.007s	sys 0.000s
I20260709 12:27:57.078261 14755 raft_consensus.cc:2468] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:57.035668 14884 consensus_queue.cc:237] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.095017 14938 raft_consensus.cc:697] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:27:57.100533 14945 consensus_queue.cc:1048] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:27:57.135821 14938 consensus_queue.cc:237] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.141532 14831 raft_consensus.cc:2468] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:27:57.146654 14878 tablet_bootstrap.cc:492] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:57.147200 14878 ts_tablet_manager.cc:1403] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.107s	user 0.015s	sys 0.007s
I20260709 12:27:57.149984 14723 leader_election.cc:304] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:27:57.151901 15007 raft_consensus.cc:493] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.152648 14607 raft_consensus.cc:2468] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:27:57.155435 14911 leader_election.cc:290] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:27:57.156148 14878 raft_consensus.cc:359] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.157346 14878 raft_consensus.cc:385] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.157640 14878 raft_consensus.cc:740] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.159337 14877 tablet_bootstrap.cc:492] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:57.161365 14876 tablet_bootstrap.cc:492] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:57.163523 14876 ts_tablet_manager.cc:1403] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.220s	user 0.032s	sys 0.017s
I20260709 12:27:57.167191 14878 consensus_queue.cc:260] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.170069 14878 ts_tablet_manager.cc:1434] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.023s	user 0.007s	sys 0.001s
I20260709 12:27:57.171777 14878 tablet_bootstrap.cc:492] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:57.161234 14887 raft_consensus.cc:2804] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:57.177031 14887 raft_consensus.cc:697] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:27:57.177983 14887 consensus_queue.cc:237] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.171031 14984 raft_consensus.cc:493] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:57.199451 15006 log.cc:927] Time spent T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a: Append to log took a long time: real 0.053s	user 0.000s	sys 0.000s
I20260709 12:27:57.200429 14878 tablet_bootstrap.cc:654] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.201349 14984 raft_consensus.cc:515] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.152611 15007 raft_consensus.cc:515] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.204559 15007 leader_election.cc:290] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:57.205984 14984 leader_election.cc:290] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:27:57.207664 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba1b4acd4da45e7b1eee66ab684bd93" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:57.208585 14683 raft_consensus.cc:2468] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 0.
I20260709 12:27:57.209045 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf96c15d37c4522ab37cf6e48555598" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:57.209792 14682 raft_consensus.cc:2468] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:27:57.214843 14879 tablet_bootstrap.cc:492] T 4fed1c5a7249449bb4b8c8a3543ba599 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:57.215505 14879 ts_tablet_manager.cc:1403] T 4fed1c5a7249449bb4b8c8a3543ba599 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.231s	user 0.007s	sys 0.018s
I20260709 12:27:57.225322 14796 leader_election.cc:304] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:27:57.226869 14984 raft_consensus.cc:2804] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:57.227375 14984 raft_consensus.cc:493] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.227727 14984 raft_consensus.cc:3060] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.233397 14573 leader_election.cc:304] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:57.234298 14876 raft_consensus.cc:359] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.235741 14876 raft_consensus.cc:385] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.235965 14876 raft_consensus.cc:740] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.237094 14755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf96c15d37c4522ab37cf6e48555598" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:57.238044 15016 consensus_queue.cc:1048] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:57.239454 15016 raft_consensus.cc:2804] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:57.239780 15016 raft_consensus.cc:493] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.243238 15016 raft_consensus.cc:3060] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.245119 14986 raft_consensus.cc:493] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.245652 14986 raft_consensus.cc:515] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.246176 14877 tablet_bootstrap.cc:654] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.247900 14986 leader_election.cc:290] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:57.250263 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:57.249928 14879 raft_consensus.cc:359] T 4fed1c5a7249449bb4b8c8a3543ba599 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.251451 14879 raft_consensus.cc:385] T 4fed1c5a7249449bb4b8c8a3543ba599 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.251931 14879 raft_consensus.cc:740] T 4fed1c5a7249449bb4b8c8a3543ba599 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.250824 14876 consensus_queue.cc:260] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
W20260709 12:27:57.255141 14795 leader_election.cc:343] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.252645 14879 consensus_queue.cc:260] T 4fed1c5a7249449bb4b8c8a3543ba599 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.269289 14879 ts_tablet_manager.cc:1434] T 4fed1c5a7249449bb4b8c8a3543ba599 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.053s	user 0.008s	sys 0.000s
I20260709 12:27:57.251698 14984 raft_consensus.cc:515] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.271032 14879 tablet_bootstrap.cc:492] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:57.278875 14876 ts_tablet_manager.cc:1434] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.114s	user 0.004s	sys 0.003s
I20260709 12:27:57.283967 14878 tablet_bootstrap.cc:492] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:57.284497 14878 ts_tablet_manager.cc:1403] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.113s	user 0.011s	sys 0.015s
I20260709 12:27:57.277086 14984 leader_election.cc:290] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
W20260709 12:27:57.288265 14572 leader_election.cc:343] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.275993 14606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:57.292889 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba1b4acd4da45e7b1eee66ab684bd93" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:57.286155 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba1b4acd4da45e7b1eee66ab684bd93" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:57.293591 14682 raft_consensus.cc:3060] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.293987 14608 raft_consensus.cc:3060] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.305915 14682 raft_consensus.cc:2468] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:27:57.311127 14942 raft_consensus.cc:493] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.326380 14878 raft_consensus.cc:359] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.320796 14608 raft_consensus.cc:2468] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:27:57.322476 15016 raft_consensus.cc:515] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.328081 14942 raft_consensus.cc:515] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.328843 14506 catalog_manager.cc:5697] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 0 to 1, leader changed from <none> to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 1 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:57.330175 14942 leader_election.cc:290] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:27:57.331017 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf96c15d37c4522ab37cf6e48555598" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:57.331414 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6c65eac6134e59bf2b86cb44ca7a4f" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:57.324313 14938 consensus_queue.cc:1048] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:57.327543 14878 raft_consensus.cc:385] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.332222 14878 raft_consensus.cc:740] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.331627 14681 raft_consensus.cc:3060] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.334033 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dba1b4acd4da45e7b1eee66ab684bd93" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:57.334683 14607 raft_consensus.cc:2376] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1. Re-sending same reply.
W20260709 12:27:57.336277 14794 leader_election.cc:343] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.336764 14794 leader_election.cc:304] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:27:57.337854 14984 raft_consensus.cc:2749] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.333060 14878 consensus_queue.cc:260] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.339731 14876 tablet_bootstrap.cc:492] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:57.339994 14794 leader_election.cc:304] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:57.340689 14878 ts_tablet_manager.cc:1434] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.056s	user 0.004s	sys 0.008s
I20260709 12:27:57.340960 14984 raft_consensus.cc:2804] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:57.341687 14878 tablet_bootstrap.cc:492] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:57.341632 14984 raft_consensus.cc:697] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:27:57.342586 14984 consensus_queue.cc:237] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.345263 14757 raft_consensus.cc:3060] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.346988 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6c65eac6134e59bf2b86cb44ca7a4f" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:57.346426 14876 tablet_bootstrap.cc:654] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.346419 14504 catalog_manager.cc:5697] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.352063 14938 consensus_queue.cc:1048] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:57.353935 14680 raft_consensus.cc:2393] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c95afda23abe49318972444cc68998a7 in current term 1: Already voted for candidate c0cbbdf206b5458e9af48c22b862264a in this term.
I20260709 12:27:57.355204 14989 consensus_queue.cc:1048] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:57.356112 14722 leader_election.cc:304] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:27:57.362982 14878 tablet_bootstrap.cc:654] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.361408 14681 raft_consensus.cc:2468] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:57.373553 14877 tablet_bootstrap.cc:492] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:57.374070 14877 ts_tablet_manager.cc:1403] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.215s	user 0.036s	sys 0.024s
I20260709 12:27:57.380019 14573 leader_election.cc:304] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:57.380947 14976 consensus_queue.cc:1048] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.381191 14911 raft_consensus.cc:2804] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:57.381768 14911 raft_consensus.cc:697] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:27:57.382637 14911 consensus_queue.cc:237] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.379185 14505 catalog_manager.cc:5697] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:57.389791 15016 leader_election.cc:290] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:57.392513 14976 consensus_queue.cc:1048] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.387991 14942 raft_consensus.cc:2749] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.401057 15016 consensus_queue.cc:1048] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20260709 12:27:57.405428 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf96c15d37c4522ab37cf6e48555598" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:57.412427 14877 raft_consensus.cc:359] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.415138 14877 raft_consensus.cc:385] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.415392 14877 raft_consensus.cc:740] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.416100 14877 consensus_queue.cc:260] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.414709 14879 tablet_bootstrap.cc:654] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:57.423189 14572 leader_election.cc:343] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.423676 14929 consensus_queue.cc:1048] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.425701 14877 ts_tablet_manager.cc:1434] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:27:57.426815 14877 tablet_bootstrap.cc:492] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:57.431921 14876 tablet_bootstrap.cc:492] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:57.432463 14876 ts_tablet_manager.cc:1403] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.093s	user 0.010s	sys 0.016s
I20260709 12:27:57.437476 14876 raft_consensus.cc:359] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.438161 14876 raft_consensus.cc:385] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.438433 14876 raft_consensus.cc:740] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.439484 14876 consensus_queue.cc:260] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.441777 14876 ts_tablet_manager.cc:1434] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.000s
I20260709 12:27:57.442718 14876 tablet_bootstrap.cc:492] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:57.444650 14878 tablet_bootstrap.cc:492] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:57.445393 14878 ts_tablet_manager.cc:1403] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.104s	user 0.019s	sys 0.007s
I20260709 12:27:57.445869 14503 catalog_manager.cc:5697] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.448623 14878 raft_consensus.cc:359] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.449301 14878 raft_consensus.cc:385] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.449568 14878 raft_consensus.cc:740] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.454914 14877 tablet_bootstrap.cc:654] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.450227 14878 consensus_queue.cc:260] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.461520 14878 ts_tablet_manager.cc:1434] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.016s	user 0.005s	sys 0.000s
I20260709 12:27:57.462739 14878 tablet_bootstrap.cc:492] T 8848d1ae1c0143efa3af13914871a009 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:57.467933 14929 raft_consensus.cc:493] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.468493 14929 raft_consensus.cc:515] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.468447 14878 tablet_bootstrap.cc:654] T 8848d1ae1c0143efa3af13914871a009 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.472527 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8848d1ae1c0143efa3af13914871a009" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:57.472855 14929 leader_election.cc:290] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:57.464865 14504 catalog_manager.cc:5697] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 0 to 1, leader changed from <none> to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 1 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.474119 14608 raft_consensus.cc:2468] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:57.474663 14929 raft_consensus.cc:493] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.475194 14929 raft_consensus.cc:515] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.475807 14646 leader_election.cc:304] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:57.476725 14992 raft_consensus.cc:2804] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:57.477094 14992 raft_consensus.cc:493] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.477425 14992 raft_consensus.cc:3060] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.477547 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8848d1ae1c0143efa3af13914871a009" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:57.478119 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1a597bed4c64a10a9f8b50e72c7b611" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:27:57.479616 14647 leader_election.cc:343] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:57.480501 14649 leader_election.cc:343] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.481546 14878 tablet_bootstrap.cc:492] T 8848d1ae1c0143efa3af13914871a009 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:57.482023 14878 ts_tablet_manager.cc:1403] T 8848d1ae1c0143efa3af13914871a009 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.000s
I20260709 12:27:57.482128 14876 tablet_bootstrap.cc:654] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.483731 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1a597bed4c64a10a9f8b50e72c7b611" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:57.484417 14828 raft_consensus.cc:2468] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:57.486208 14649 leader_election.cc:304] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:27:57.487061 14989 raft_consensus.cc:2804] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:57.487475 14989 raft_consensus.cc:493] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.487797 14989 raft_consensus.cc:3060] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.488021 14929 leader_election.cc:290] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:57.488692 14878 raft_consensus.cc:359] T 8848d1ae1c0143efa3af13914871a009 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.489511 14878 raft_consensus.cc:385] T 8848d1ae1c0143efa3af13914871a009 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.489799 14878 raft_consensus.cc:740] T 8848d1ae1c0143efa3af13914871a009 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.493273 14878 consensus_queue.cc:260] T 8848d1ae1c0143efa3af13914871a009 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.497767 14992 raft_consensus.cc:515] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.507854 14989 raft_consensus.cc:515] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.509263 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8848d1ae1c0143efa3af13914871a009" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:57.509974 14607 raft_consensus.cc:3060] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.510906 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1a597bed4c64a10a9f8b50e72c7b611" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
W20260709 12:27:57.512498 14647 leader_election.cc:343] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.502291 14878 ts_tablet_manager.cc:1434] T 8848d1ae1c0143efa3af13914871a009 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:27:57.513788 14878 tablet_bootstrap.cc:492] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:57.514290 14879 tablet_bootstrap.cc:492] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:57.514858 14879 ts_tablet_manager.cc:1403] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.244s	user 0.026s	sys 0.005s
I20260709 12:27:57.515172 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8848d1ae1c0143efa3af13914871a009" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:57.515843 14828 raft_consensus.cc:3060] T 8848d1ae1c0143efa3af13914871a009 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.521664 14879 raft_consensus.cc:359] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.522377 14879 raft_consensus.cc:385] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.522678 14879 raft_consensus.cc:740] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.523234 14878 tablet_bootstrap.cc:654] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.523342 14879 consensus_queue.cc:260] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.516742 14992 leader_election.cc:290] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:57.529179 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1a597bed4c64a10a9f8b50e72c7b611" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:57.529820 14831 raft_consensus.cc:3060] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.527913 14989 leader_election.cc:290] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:57.527855 14828 raft_consensus.cc:2468] T 8848d1ae1c0143efa3af13914871a009 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:57.530550 14879 ts_tablet_manager.cc:1434] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:27:57.531869 14877 tablet_bootstrap.cc:492] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:57.532474 14877 ts_tablet_manager.cc:1403] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.106s	user 0.021s	sys 0.007s
I20260709 12:27:57.532867 14879 tablet_bootstrap.cc:492] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:57.535107 14649 leader_election.cc:304] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:27:57.535398 14607 raft_consensus.cc:2468] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:57.538787 14877 raft_consensus.cc:359] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.539546 14877 raft_consensus.cc:385] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.539821 14877 raft_consensus.cc:740] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.542362 14831 raft_consensus.cc:2468] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:57.543038 14877 consensus_queue.cc:260] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.543780 14649 leader_election.cc:304] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:27:57.545159 14929 raft_consensus.cc:2804] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:57.545663 14929 raft_consensus.cc:697] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:27:57.545241 14502 catalog_manager.cc:5697] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.546373 14877 ts_tablet_manager.cc:1434] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:27:57.547449 14877 tablet_bootstrap.cc:492] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:57.548801 14929 consensus_queue.cc:237] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.538599 14989 raft_consensus.cc:2804] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:57.553071 14989 raft_consensus.cc:697] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:27:57.553397 14877 tablet_bootstrap.cc:654] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.553905 14989 consensus_queue.cc:237] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.556087 14984 consensus_queue.cc:1048] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.560523 14976 consensus_queue.cc:1048] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.564040 14876 tablet_bootstrap.cc:492] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:57.564610 14876 ts_tablet_manager.cc:1403] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.122s	user 0.014s	sys 0.004s
I20260709 12:27:57.567529 14876 raft_consensus.cc:359] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.568181 14876 raft_consensus.cc:385] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.568463 14876 raft_consensus.cc:740] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.569109 14876 consensus_queue.cc:260] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.571169 14876 ts_tablet_manager.cc:1434] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.008s	sys 0.000s
I20260709 12:27:57.572306 14876 tablet_bootstrap.cc:492] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:57.576104 14879 tablet_bootstrap.cc:654] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.584575 14876 tablet_bootstrap.cc:654] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.597028 14755 raft_consensus.cc:3060] T 4fed1c5a7249449bb4b8c8a3543ba599 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.604967 14876 tablet_bootstrap.cc:492] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:57.605549 14876 ts_tablet_manager.cc:1403] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.033s	user 0.010s	sys 0.000s
I20260709 12:27:57.608122 14878 tablet_bootstrap.cc:492] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:57.608778 14878 ts_tablet_manager.cc:1403] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.095s	user 0.008s	sys 0.005s
I20260709 12:27:57.609076 14984 consensus_queue.cc:1048] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:57.611685 14878 raft_consensus.cc:359] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.612425 14878 raft_consensus.cc:385] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.612684 14878 raft_consensus.cc:740] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.613574 14878 consensus_queue.cc:260] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.617657 14938 consensus_queue.cc:1048] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:57.620319 14879 tablet_bootstrap.cc:492] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:57.620860 14879 ts_tablet_manager.cc:1403] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.088s	user 0.012s	sys 0.003s
I20260709 12:27:57.623498 14879 raft_consensus.cc:359] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.624181 14879 raft_consensus.cc:385] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.624478 14879 raft_consensus.cc:740] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.625092 14879 consensus_queue.cc:260] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.617862 14876 raft_consensus.cc:359] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.625725 14877 tablet_bootstrap.cc:492] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:57.630120 14877 ts_tablet_manager.cc:1403] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.083s	user 0.027s	sys 0.022s
I20260709 12:27:57.628924 14876 raft_consensus.cc:385] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.631516 14876 raft_consensus.cc:740] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.632211 14876 consensus_queue.cc:260] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.629379 14878 ts_tablet_manager.cc:1434] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:27:57.638652 14878 tablet_bootstrap.cc:492] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:57.635989 14876 ts_tablet_manager.cc:1434] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.030s	user 0.006s	sys 0.001s
I20260709 12:27:57.632848 14877 raft_consensus.cc:359] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.645133 14877 raft_consensus.cc:385] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.645494 14877 raft_consensus.cc:740] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.646199 14877 consensus_queue.cc:260] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.648734 14877 ts_tablet_manager.cc:1434] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.001s
I20260709 12:27:57.649766 14877 tablet_bootstrap.cc:492] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:57.637574 14879 ts_tablet_manager.cc:1434] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:27:57.652168 14876 tablet_bootstrap.cc:492] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:57.651522 14505 catalog_manager.cc:5697] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:57.653734 14505 catalog_manager.cc:5697] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.658368 14876 tablet_bootstrap.cc:654] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.663074 14878 tablet_bootstrap.cc:654] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.670851 14877 tablet_bootstrap.cc:654] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.658630 14879 tablet_bootstrap.cc:492] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:57.679832 14879 tablet_bootstrap.cc:654] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:57.685781 14554 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:57.688169 14876 tablet_bootstrap.cc:492] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:57.688711 14876 ts_tablet_manager.cc:1403] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.038s	user 0.009s	sys 0.004s
I20260709 12:27:57.688827 14877 tablet_bootstrap.cc:492] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:57.689363 14877 ts_tablet_manager.cc:1403] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.007s
I20260709 12:27:57.690165 14879 tablet_bootstrap.cc:492] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:57.690760 14879 ts_tablet_manager.cc:1403] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.039s	user 0.009s	sys 0.004s
I20260709 12:27:57.691545 14876 raft_consensus.cc:359] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.692271 14876 raft_consensus.cc:385] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.691953 14877 raft_consensus.cc:359] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.692572 14876 raft_consensus.cc:740] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.692689 14877 raft_consensus.cc:385] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.693034 14877 raft_consensus.cc:740] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.693676 14878 tablet_bootstrap.cc:492] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:57.693461 14876 consensus_queue.cc:260] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.693825 14877 consensus_queue.cc:260] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.693710 14879 raft_consensus.cc:359] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.694715 14879 raft_consensus.cc:385] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.695003 14879 raft_consensus.cc:740] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.695668 14876 ts_tablet_manager.cc:1434] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.001s
I20260709 12:27:57.696056 14878 ts_tablet_manager.cc:1403] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.058s	user 0.014s	sys 0.001s
I20260709 12:27:57.697062 14876 tablet_bootstrap.cc:492] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:57.698938 14878 raft_consensus.cc:359] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.699625 14878 raft_consensus.cc:385] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.699904 14878 raft_consensus.cc:740] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.695629 14879 consensus_queue.cc:260] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.700829 14877 ts_tablet_manager.cc:1434] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.000s
I20260709 12:27:57.701211 14878 consensus_queue.cc:260] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.701917 14877 tablet_bootstrap.cc:492] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:57.704051 14876 tablet_bootstrap.cc:654] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.708146 14877 tablet_bootstrap.cc:654] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.715476 14984 raft_consensus.cc:493] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.716027 14878 ts_tablet_manager.cc:1434] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.020s	user 0.005s	sys 0.001s
I20260709 12:27:57.717314 14878 tablet_bootstrap.cc:492] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:57.718667 14919 raft_consensus.cc:493] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.719250 14919 raft_consensus.cc:515] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.716140 14984 raft_consensus.cc:515] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.743902 14755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1bdc8f0d36475f87c7da7d8a998240" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:27:57.745787 14795 leader_election.cc:343] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.723572 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1bdc8f0d36475f87c7da7d8a998240" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:57.747239 14683 raft_consensus.cc:2468] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 0.
I20260709 12:27:57.748764 14796 leader_election.cc:304] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:27:57.750281 14879 ts_tablet_manager.cc:1434] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.059s	user 0.005s	sys 0.000s
I20260709 12:27:57.723932 14919 leader_election.cc:290] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:27:57.753407 14884 raft_consensus.cc:2804] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:57.753859 14884 raft_consensus.cc:493] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.754181 14884 raft_consensus.cc:3060] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.757509 14878 tablet_bootstrap.cc:654] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.757885 14984 leader_election.cc:290] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:57.763036 14877 tablet_bootstrap.cc:492] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:57.763363 14878 tablet_bootstrap.cc:492] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:57.763563 14877 ts_tablet_manager.cc:1403] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.062s	user 0.027s	sys 0.022s
I20260709 12:27:57.763792 14878 ts_tablet_manager.cc:1403] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.047s	user 0.010s	sys 0.001s
I20260709 12:27:57.766382 14877 raft_consensus.cc:359] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.767159 14877 raft_consensus.cc:385] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.767462 14877 raft_consensus.cc:740] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.768121 14877 consensus_queue.cc:260] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.766706 14878 raft_consensus.cc:359] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.770676 14878 raft_consensus.cc:385] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.771083 14878 raft_consensus.cc:740] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.771987 14877 ts_tablet_manager.cc:1434] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:27:57.771783 14878 consensus_queue.cc:260] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.724526 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf96c15d37c4522ab37cf6e48555598" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:57.778479 14681 raft_consensus.cc:2393] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c95afda23abe49318972444cc68998a7 in current term 1: Already voted for candidate c0cbbdf206b5458e9af48c22b862264a in this term.
I20260709 12:27:57.779253 14919 consensus_queue.cc:1048] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.733945 14989 raft_consensus.cc:493] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.780845 14989 raft_consensus.cc:515] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.784955 14878 ts_tablet_manager.cc:1434] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.001s
I20260709 12:27:57.785687 14605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5fcaa8194c4e4d8edfc076579b7629" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:57.786481 14605 raft_consensus.cc:2468] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:57.787838 14989 leader_election.cc:290] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:57.788766 14646 leader_election.cc:304] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:57.791587 14984 consensus_queue.cc:1048] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:27:57.794888 14796 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:46705, user_credentials={real_user=slave}} blocked reactor thread for 46236.4us
I20260709 12:27:57.804956 14877 tablet_bootstrap.cc:492] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:57.806232 14984 consensus_queue.cc:1048] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:57.807511 15018 raft_consensus.cc:493] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.808118 15018 raft_consensus.cc:515] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.808494 14919 consensus_queue.cc:1048] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:57.795322 14878 tablet_bootstrap.cc:492] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:57.810551 14989 raft_consensus.cc:2804] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:57.811040 14989 raft_consensus.cc:493] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.811409 14989 raft_consensus.cc:3060] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.816309 15018 leader_election.cc:290] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:57.819681 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2e9afe81394f0daa8b09695c7a43ae" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:57.820432 14608 raft_consensus.cc:2468] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 0.
I20260709 12:27:57.821955 14794 leader_election.cc:304] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:57.822930 15018 raft_consensus.cc:2804] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:57.823323 15018 raft_consensus.cc:493] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.823658 15018 raft_consensus.cc:3060] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.824973 15016 raft_consensus.cc:493] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.825578 15016 raft_consensus.cc:515] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.829092 15016 leader_election.cc:290] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:57.830044 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:57.830852 14828 raft_consensus.cc:2468] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:27:57.832350 14574 leader_election.cc:304] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:57.832715 15018 raft_consensus.cc:515] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.834947 15016 raft_consensus.cc:2804] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:57.836345 15016 raft_consensus.cc:493] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.836817 15016 raft_consensus.cc:3060] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.835867 14929 raft_consensus.cc:493] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.837291 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2e9afe81394f0daa8b09695c7a43ae" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:57.837368 14929 raft_consensus.cc:515] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.838032 14608 raft_consensus.cc:3060] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.838788 14877 tablet_bootstrap.cc:654] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.839787 14929 leader_election.cc:290] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:57.845517 14608 raft_consensus.cc:2468] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:27:57.846966 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55019c611cb74a908cb633373c6b502b" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:57.846324 15018 leader_election.cc:290] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:57.847795 14828 raft_consensus.cc:2468] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:57.847815 14794 leader_election.cc:304] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:57.849061 15018 raft_consensus.cc:2804] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:57.849536 15018 raft_consensus.cc:697] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:27:57.849781 14649 leader_election.cc:304] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:27:57.848058 14878 tablet_bootstrap.cc:654] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.850373 15018 consensus_queue.cc:237] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.854368 14929 raft_consensus.cc:2804] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:57.854957 14929 raft_consensus.cc:493] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:57.855363 14929 raft_consensus.cc:3060] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.722738 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf96c15d37c4522ab37cf6e48555598" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:57.860172 14879 tablet_bootstrap.cc:492] T 8c2e9afe81394f0daa8b09695c7a43ae P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:57.862922 14720 leader_election.cc:304] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:27:57.878232 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55019c611cb74a908cb633373c6b502b" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:57.890175 14938 consensus_queue.cc:1048] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:57.891536 14876 tablet_bootstrap.cc:492] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:57.892083 14876 ts_tablet_manager.cc:1403] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.195s	user 0.057s	sys 0.038s
I20260709 12:27:57.893807 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2e9afe81394f0daa8b09695c7a43ae" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:57.881830 14919 raft_consensus.cc:3060] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:57.897796 14795 leader_election.cc:343] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.899056 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5fcaa8194c4e4d8edfc076579b7629" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:57.890213 14884 raft_consensus.cc:515] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.901629 14879 tablet_bootstrap.cc:654] T 8c2e9afe81394f0daa8b09695c7a43ae P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.903153 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:57.903883 14753 raft_consensus.cc:2468] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:27:57.904198 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1bdc8f0d36475f87c7da7d8a998240" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:57.905378 14683 raft_consensus.cc:3060] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.908331 14884 leader_election.cc:290] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:57.912722 14989 raft_consensus.cc:515] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
W20260709 12:27:57.912410 14647 leader_election.cc:343] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.886523 14752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2e9afe81394f0daa8b09695c7a43ae" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:57.921270 14606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5fcaa8194c4e4d8edfc076579b7629" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:57.922288 14606 raft_consensus.cc:3060] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:57.922818 14795 leader_election.cc:343] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.927546 14876 raft_consensus.cc:359] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.928635 14876 raft_consensus.cc:385] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.929015 14876 raft_consensus.cc:740] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.929185 14877 tablet_bootstrap.cc:492] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:57.929793 14877 ts_tablet_manager.cc:1403] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.125s	user 0.011s	sys 0.004s
I20260709 12:27:57.926625 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1bdc8f0d36475f87c7da7d8a998240" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:57.940253 14876 consensus_queue.cc:260] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.927196 14608 raft_consensus.cc:2468] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:57.939146 14683 raft_consensus.cc:2468] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:27:57.953558 14506 catalog_manager.cc:5697] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 0 to 1, leader changed from <none> to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 1 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:57.960081 14796 leader_election.cc:304] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:27:57.958809 14989 leader_election.cc:290] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:57.962189 14878 tablet_bootstrap.cc:492] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:57.962927 14878 ts_tablet_manager.cc:1403] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.168s	user 0.015s	sys 0.003s
I20260709 12:27:57.943850 14929 raft_consensus.cc:515] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:57.967749 14929 leader_election.cc:290] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
W20260709 12:27:57.965798 14795 leader_election.cc:343] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.971524 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5fcaa8194c4e4d8edfc076579b7629" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
W20260709 12:27:57.973019 14647 leader_election.cc:343] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.973668 14878 raft_consensus.cc:359] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.974084 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55019c611cb74a908cb633373c6b502b" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:57.974380 14878 raft_consensus.cc:385] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.974679 14878 raft_consensus.cc:740] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.974717 14607 raft_consensus.cc:3060] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.975171 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55019c611cb74a908cb633373c6b502b" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:57.975405 14878 consensus_queue.cc:260] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.975805 14829 raft_consensus.cc:3060] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.977249 14945 raft_consensus.cc:493] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:57.977737 14945 raft_consensus.cc:515] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:57.968727 15016 raft_consensus.cc:515] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:57.978657 14754 raft_consensus.cc:3060] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:57.980572 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bdea069a44b42d099e6fc3f6c6333cc" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:57.980983 15016 leader_election.cc:290] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:57.982038 14752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:57.982632 14752 raft_consensus.cc:3060] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:57.983858 14647 leader_election.cc:343] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:57.985792 14945 leader_election.cc:290] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:57.986024 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bdea069a44b42d099e6fc3f6c6333cc" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:57.988808 14831 raft_consensus.cc:2468] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:57.990314 14878 ts_tablet_manager.cc:1434] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.027s	user 0.005s	sys 0.000s
I20260709 12:27:57.990679 14649 leader_election.cc:304] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:27:57.991322 14878 tablet_bootstrap.cc:492] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:57.977636 14877 raft_consensus.cc:359] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.993089 14877 raft_consensus.cc:385] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:57.993379 14877 raft_consensus.cc:740] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:57.994149 14877 consensus_queue.cc:260] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:57.995074 14919 raft_consensus.cc:2749] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:57.997391 14878 tablet_bootstrap.cc:654] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:57.999300 14829 raft_consensus.cc:2468] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:57.987082 14876 ts_tablet_manager.cc:1434] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.094s	user 0.007s	sys 0.000s
I20260709 12:27:57.964569 14984 raft_consensus.cc:2804] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:57.986830 14607 raft_consensus.cc:2468] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:58.001768 14876 tablet_bootstrap.cc:492] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:58.014161 14938 consensus_queue.cc:1048] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:58.024317 14877 ts_tablet_manager.cc:1434] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.094s	user 0.010s	sys 0.005s
I20260709 12:27:58.025359 14887 raft_consensus.cc:493] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.025949 14887 raft_consensus.cc:515] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:58.027340 14606 raft_consensus.cc:2468] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:58.028136 14887 leader_election.cc:290] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:58.029443 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1a597bed4c64a10a9f8b50e72c7b611" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:58.030081 14992 consensus_queue.cc:1048] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:58.030099 14829 raft_consensus.cc:2468] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:27:58.032009 14723 leader_election.cc:304] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:27:58.034821 14646 leader_election.cc:304] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:58.038729 14887 raft_consensus.cc:2804] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:27:58.039271 14887 raft_consensus.cc:493] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.039700 14887 raft_consensus.cc:3060] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:58.008388 14945 raft_consensus.cc:2804] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:58.041698 14945 raft_consensus.cc:493] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.042085 14945 raft_consensus.cc:3060] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.043597 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1a597bed4c64a10a9f8b50e72c7b611" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:58.047318 14989 raft_consensus.cc:2804] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.047955 14989 raft_consensus.cc:697] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:27:58.048791 14989 consensus_queue.cc:237] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:58.050793 14646 leader_election.cc:304] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:27:58.025377 14877 tablet_bootstrap.cc:492] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:58.012523 14984 raft_consensus.cc:697] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:27:58.023131 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
W20260709 12:27:58.080785 14647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:42945, user_credentials={real_user=slave}} blocked reactor thread for 64627.9us
I20260709 12:27:58.077630 14831 raft_consensus.cc:3060] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.075017 14929 consensus_queue.cc:1048] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:27:58.085294 14752 raft_consensus.cc:2468] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:58.086863 15067 raft_consensus.cc:2804] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.105911 14887 raft_consensus.cc:515] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:58.109993 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1a597bed4c64a10a9f8b50e72c7b611" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:58.113765 14876 tablet_bootstrap.cc:654] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.117343 14572 leader_election.cc:304] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:27:58.118567 14938 raft_consensus.cc:2804] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.119166 14938 raft_consensus.cc:697] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:27:58.120787 14887 leader_election.cc:290] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:58.120486 14938 consensus_queue.cc:237] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:58.122845 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c1a597bed4c64a10a9f8b50e72c7b611" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:58.123551 14829 raft_consensus.cc:3060] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:58.127904 14879 tablet_bootstrap.cc:492] T 8c2e9afe81394f0daa8b09695c7a43ae P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:58.128450 14879 ts_tablet_manager.cc:1403] T 8c2e9afe81394f0daa8b09695c7a43ae P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.269s	user 0.028s	sys 0.030s
I20260709 12:27:58.097230 14884 raft_consensus.cc:493] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:58.132772 15064 log.cc:927] Time spent T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f: Append to log took a long time: real 0.064s	user 0.004s	sys 0.000s
I20260709 12:27:58.125998 14945 raft_consensus.cc:515] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:58.148260 14829 raft_consensus.cc:2468] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 2.
I20260709 12:27:58.138700 14884 raft_consensus.cc:515] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:58.150669 14879 raft_consensus.cc:359] T 8c2e9afe81394f0daa8b09695c7a43ae P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:58.153818 14879 raft_consensus.cc:385] T 8c2e9afe81394f0daa8b09695c7a43ae P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.154241 14879 raft_consensus.cc:740] T 8c2e9afe81394f0daa8b09695c7a43ae P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.155519 14879 consensus_queue.cc:260] T 8c2e9afe81394f0daa8b09695c7a43ae P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:58.095037 14984 consensus_queue.cc:237] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:58.152645 15067 raft_consensus.cc:697] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:27:58.171202 14879 ts_tablet_manager.cc:1434] T 8c2e9afe81394f0daa8b09695c7a43ae P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.042s	user 0.009s	sys 0.000s
I20260709 12:27:58.172478 14879 tablet_bootstrap.cc:492] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:58.184875 14877 tablet_bootstrap.cc:654] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.187076 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bdea069a44b42d099e6fc3f6c6333cc" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:58.187136 14752 raft_consensus.cc:1240] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Rejecting Update request from peer 9a105adb44fb47078d6cb03a6c02026f for earlier term 1. Current term is 2. Ops: [1.1-1.1]
I20260709 12:27:58.188908 14884 leader_election.cc:290] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:58.162609 14723 leader_election.cc:304] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:27:58.193707 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d83f753ff274231bf05990f4eda9551" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:58.195827 14887 raft_consensus.cc:2804] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election won for term 2
W20260709 12:27:58.193691 14647 leader_election.cc:343] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.203742 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1bdea069a44b42d099e6fc3f6c6333cc" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:58.196233 14945 leader_election.cc:290] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:58.204645 14829 raft_consensus.cc:3060] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.205700 14606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d83f753ff274231bf05990f4eda9551" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:58.206550 14887 raft_consensus.cc:697] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
W20260709 12:27:58.198493 14723 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:35543, user_credentials={real_user=slave}} blocked reactor thread for 43631.1us
W20260709 12:27:58.207535 14794 leader_election.cc:343] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.207610 14887 consensus_queue.cc:237] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
W20260709 12:27:58.209589 14795 leader_election.cc:343] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.210085 14795 leader_election.cc:304] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:27:58.210410 14929 consensus_queue.cc:1059] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: INVALID_TERM, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:58.211815 15073 raft_consensus.cc:3055] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:27:58.212168 15073 raft_consensus.cc:740] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:27:58.212978 15073 consensus_queue.cc:260] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:58.213534 14829 raft_consensus.cc:2468] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:58.193783 15067 consensus_queue.cc:237] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.216140 15070 raft_consensus.cc:2749] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:58.216168 15073 raft_consensus.cc:3060] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:27:58.218847 14649 leader_election.cc:304] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:27:58.204281 14504 catalog_manager.cc:5697] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.221084 14929 raft_consensus.cc:2804] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.221721 14929 raft_consensus.cc:697] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:27:58.222728 14929 consensus_queue.cc:237] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:58.224141 14879 tablet_bootstrap.cc:654] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.240309 15068 raft_consensus.cc:493] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.245159 15068 raft_consensus.cc:515] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.244536 14506 catalog_manager.cc:5697] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.247556 15068 leader_election.cc:290] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:58.237824 14505 catalog_manager.cc:5697] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 0 to 1, leader changed from <none> to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 1 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:58.247975 14506 catalog_manager.cc:5697] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:58.255141 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78415090b3b941069b3cc1a7540a8542" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:58.245057 14877 tablet_bootstrap.cc:492] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:58.257323 14877 ts_tablet_manager.cc:1403] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.232s	user 0.009s	sys 0.003s
I20260709 12:27:58.260882 14877 raft_consensus.cc:359] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:58.261565 14877 raft_consensus.cc:385] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.262291 14877 raft_consensus.cc:740] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.262966 14877 consensus_queue.cc:260] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
W20260709 12:27:58.256778 14647 leader_election.cc:343] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.230382 14831 raft_consensus.cc:2468] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:58.268429 14877 ts_tablet_manager.cc:1434] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:27:58.269999 14829 raft_consensus.cc:1240] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Rejecting Update request from peer 9a105adb44fb47078d6cb03a6c02026f for earlier term 1. Current term is 2. Ops: []
I20260709 12:27:58.271070 14877 tablet_bootstrap.cc:492] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:58.275290 14929 consensus_queue.cc:1048] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:58.266256 14878 tablet_bootstrap.cc:492] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:58.279139 14606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78415090b3b941069b3cc1a7540a8542" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:58.284276 14878 ts_tablet_manager.cc:1403] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.293s	user 0.011s	sys 0.016s
I20260709 12:27:58.284286 14606 raft_consensus.cc:2468] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:58.286322 14879 tablet_bootstrap.cc:492] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:58.286881 14879 ts_tablet_manager.cc:1403] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.115s	user 0.014s	sys 0.002s
I20260709 12:27:58.287385 14878 raft_consensus.cc:359] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:58.288175 14878 raft_consensus.cc:385] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.288430 14878 raft_consensus.cc:740] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.289404 14877 tablet_bootstrap.cc:654] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.289255 14878 consensus_queue.cc:260] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:58.289736 14879 raft_consensus.cc:359] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:58.280079 14876 tablet_bootstrap.cc:492] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:58.290810 14876 ts_tablet_manager.cc:1403] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.289s	user 0.019s	sys 0.006s
I20260709 12:27:58.291559 14878 ts_tablet_manager.cc:1434] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:27:58.290452 14879 raft_consensus.cc:385] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.305414 14879 raft_consensus.cc:740] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.306079 14878 tablet_bootstrap.cc:492] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:58.306252 14879 consensus_queue.cc:260] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:58.308427 14879 ts_tablet_manager.cc:1434] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:27:58.309227 14879 tablet_bootstrap.cc:492] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:58.312011 14878 tablet_bootstrap.cc:654] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.312067 14877 tablet_bootstrap.cc:492] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:58.293597 14876 raft_consensus.cc:359] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:58.312897 14877 ts_tablet_manager.cc:1403] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.042s	user 0.019s	sys 0.004s
I20260709 12:27:58.313040 14876 raft_consensus.cc:385] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.313441 14876 raft_consensus.cc:740] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.314131 14876 consensus_queue.cc:260] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:58.316218 14876 ts_tablet_manager.cc:1434] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.025s	user 0.005s	sys 0.000s
I20260709 12:27:58.304700 14646 leader_election.cc:304] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:27:58.317428 14876 tablet_bootstrap.cc:492] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:58.318746 15068 raft_consensus.cc:2804] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:58.281876 14504 catalog_manager.cc:5697] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 1 to 2, leader changed from 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66) to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:58.319212 15068 raft_consensus.cc:493] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.323876 15068 raft_consensus.cc:3060] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.324774 14879 tablet_bootstrap.cc:654] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.326489 14503 catalog_manager.cc:5697] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:58.329641 14876 tablet_bootstrap.cc:654] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.316183 14877 raft_consensus.cc:359] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.335593 14877 raft_consensus.cc:385] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.335922 14877 raft_consensus.cc:740] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.336558 14877 consensus_queue.cc:260] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.338315 14877 ts_tablet_manager.cc:1434] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.000s
I20260709 12:27:58.339905 14751 raft_consensus.cc:3060] T 8c2e9afe81394f0daa8b09695c7a43ae P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.343480 14877 tablet_bootstrap.cc:492] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:58.347664 15068 raft_consensus.cc:515] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.349725 14877 tablet_bootstrap.cc:654] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.350013 15068 leader_election.cc:290] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:58.350802 14606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78415090b3b941069b3cc1a7540a8542" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:58.351483 14606 raft_consensus.cc:3060] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.351744 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78415090b3b941069b3cc1a7540a8542" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:58.353871 14879 tablet_bootstrap.cc:492] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:58.354399 14879 ts_tablet_manager.cc:1403] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.045s	user 0.010s	sys 0.002s
W20260709 12:27:58.355258 14647 leader_election.cc:343] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.357566 14879 raft_consensus.cc:359] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.358322 14879 raft_consensus.cc:385] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.358611 14879 raft_consensus.cc:740] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.359272 14879 consensus_queue.cc:260] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.361069 14879 ts_tablet_manager.cc:1434] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:27:58.362052 14879 tablet_bootstrap.cc:492] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:58.362897 14878 tablet_bootstrap.cc:492] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:58.367233 14878 ts_tablet_manager.cc:1403] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.061s	user 0.015s	sys 0.000s
I20260709 12:27:58.368528 14606 raft_consensus.cc:2468] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:58.369894 14984 consensus_queue.cc:1048] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:58.368618 14879 tablet_bootstrap.cc:654] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.372387 14646 leader_election.cc:304] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:27:58.372864 14877 tablet_bootstrap.cc:492] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:58.373379 14877 ts_tablet_manager.cc:1403] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.034s	user 0.006s	sys 0.005s
I20260709 12:27:58.373548 15068 raft_consensus.cc:2804] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.374090 15068 raft_consensus.cc:697] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:27:58.375005 15068 consensus_queue.cc:237] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.376303 14877 raft_consensus.cc:359] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:58.377000 14877 raft_consensus.cc:385] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.377265 14877 raft_consensus.cc:740] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.379657 14878 raft_consensus.cc:359] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:58.380347 14878 raft_consensus.cc:385] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.380592 14878 raft_consensus.cc:740] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.381261 14878 consensus_queue.cc:260] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:58.383396 14878 ts_tablet_manager.cc:1434] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:27:58.384989 14945 raft_consensus.cc:493] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.385620 14945 raft_consensus.cc:515] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:58.386021 14876 tablet_bootstrap.cc:492] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:58.386658 14876 ts_tablet_manager.cc:1403] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.069s	user 0.011s	sys 0.000s
I20260709 12:27:58.377928 14877 consensus_queue.cc:260] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:58.388041 14945 leader_election.cc:290] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:58.389803 14877 ts_tablet_manager.cc:1434] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:27:58.389650 14876 raft_consensus.cc:359] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:58.391206 14876 raft_consensus.cc:385] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.391381 14877 tablet_bootstrap.cc:492] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:58.391601 14876 raft_consensus.cc:740] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.392406 14876 consensus_queue.cc:260] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:58.393386 14984 raft_consensus.cc:493] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.394536 14884 consensus_queue.cc:1048] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:58.395985 14606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03b11e4110e41ec830cee6e3f1a88db" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:58.396718 14606 raft_consensus.cc:2468] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:58.393878 14984 raft_consensus.cc:515] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:58.397400 14877 tablet_bootstrap.cc:654] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.398350 14646 leader_election.cc:304] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:58.390424 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03b11e4110e41ec830cee6e3f1a88db" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:58.400206 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c423e2343f442c79ab8cecd3cb76d57" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:58.400210 14606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c423e2343f442c79ab8cecd3cb76d57" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:58.401775 14945 raft_consensus.cc:2804] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:58.400202 14829 raft_consensus.cc:2468] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:27:58.400336 14984 leader_election.cc:290] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:58.404968 14878 tablet_bootstrap.cc:492] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:58.402192 14945 raft_consensus.cc:493] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.402762 14929 raft_consensus.cc:493] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:27:58.402844 14794 leader_election.cc:343] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.413275 14929 raft_consensus.cc:515] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.414033 15071 raft_consensus.cc:493] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.414775 14879 tablet_bootstrap.cc:492] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:58.414574 15071 raft_consensus.cc:515] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:58.415261 14879 ts_tablet_manager.cc:1403] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.053s	user 0.015s	sys 0.021s
I20260709 12:27:58.416252 14929 leader_election.cc:290] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:58.416751 15071 leader_election.cc:290] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:58.417761 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8777b3a550644b50835c268da566aee7" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:27:58.419075 14795 leader_election.cc:343] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:58.419656 14647 leader_election.cc:343] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.411490 14945 raft_consensus.cc:3060] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.419005 14752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93f4e1359094f6ba6afc3148d28df68" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:58.421446 14795 leader_election.cc:304] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:27:58.423118 14606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8777b3a550644b50835c268da566aee7" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:58.424019 14984 raft_consensus.cc:2749] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:27:58.421635 14647 leader_election.cc:343] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:27:58.425069 14646 leader_election.cc:343] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.424963 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93f4e1359094f6ba6afc3148d28df68" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:58.418110 14879 raft_consensus.cc:359] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.426316 14876 ts_tablet_manager.cc:1434] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.039s	user 0.006s	sys 0.000s
W20260709 12:27:58.426671 14649 leader_election.cc:343] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.427160 14649 leader_election.cc:304] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:27:58.427563 14876 tablet_bootstrap.cc:492] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:58.428562 15071 raft_consensus.cc:2749] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:58.426259 14646 leader_election.cc:304] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:27:58.426241 14879 raft_consensus.cc:385] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.430721 14879 raft_consensus.cc:740] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.431123 15071 raft_consensus.cc:2749] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:58.431631 14879 consensus_queue.cc:260] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.436865 14879 ts_tablet_manager.cc:1434] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.021s	user 0.003s	sys 0.004s
I20260709 12:27:58.437953 14879 tablet_bootstrap.cc:492] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:58.461436 14945 raft_consensus.cc:515] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:58.471187 14879 tablet_bootstrap.cc:654] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.471902 14887 raft_consensus.cc:493] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.479333 14887 raft_consensus.cc:515] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.482575 14887 leader_election.cc:290] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:27:58.524302 14877 tablet_bootstrap.cc:492] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:58.524884 14877 ts_tablet_manager.cc:1403] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.134s	user 0.010s	sys 0.020s
I20260709 12:27:58.534191 14606 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5fcaa8194c4e4d8edfc076579b7629" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:58.526412 14945 leader_election.cc:290] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:58.536103 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03b11e4110e41ec830cee6e3f1a88db" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:58.540882 14608 raft_consensus.cc:3060] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.536975 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df5fcaa8194c4e4d8edfc076579b7629" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:58.550019 14945 consensus_queue.cc:1048] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:58.522707 14878 tablet_bootstrap.cc:654] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.554836 14606 raft_consensus.cc:2393] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c95afda23abe49318972444cc68998a7 in current term 1: Already voted for candidate 9a105adb44fb47078d6cb03a6c02026f in this term.
I20260709 12:27:58.528190 14877 raft_consensus.cc:359] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.556566 14877 raft_consensus.cc:385] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.557030 14877 raft_consensus.cc:740] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.557461 14720 leader_election.cc:304] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:27:58.559054 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03b11e4110e41ec830cee6e3f1a88db" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:58.560171 14831 raft_consensus.cc:3060] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.557801 14877 consensus_queue.cc:260] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.561273 14876 tablet_bootstrap.cc:654] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.565507 14877 ts_tablet_manager.cc:1434] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.040s	user 0.004s	sys 0.004s
I20260709 12:27:58.560607 14929 consensus_queue.cc:1048] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:27:58.566669 14919 raft_consensus.cc:493] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.567186 14919 raft_consensus.cc:515] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:58.569247 14919 leader_election.cc:290] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:58.570207 14887 raft_consensus.cc:3060] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.577178 14877 tablet_bootstrap.cc:492] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:58.570686 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d83f753ff274231bf05990f4eda9551" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:58.574230 15071 raft_consensus.cc:493] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.580317 14879 tablet_bootstrap.cc:492] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:58.580389 15071 raft_consensus.cc:515] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.581044 14879 ts_tablet_manager.cc:1403] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.143s	user 0.012s	sys 0.012s
I20260709 12:27:58.596940 14878 tablet_bootstrap.cc:492] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:58.597759 14878 ts_tablet_manager.cc:1403] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.193s	user 0.014s	sys 0.001s
I20260709 12:27:58.581112 14829 raft_consensus.cc:2468] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:27:58.584375 15071 leader_election.cc:290] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:58.600804 14879 raft_consensus.cc:359] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:58.602927 14879 raft_consensus.cc:385] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.603271 14879 raft_consensus.cc:740] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.603966 14879 consensus_queue.cc:260] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:58.633172 14879 ts_tablet_manager.cc:1434] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.052s	user 0.010s	sys 0.013s
I20260709 12:27:58.634346 14879 tablet_bootstrap.cc:492] T 1bdea069a44b42d099e6fc3f6c6333cc P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:58.674515 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a425949e144909995513a045d40199" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:58.678052 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d83f753ff274231bf05990f4eda9551" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:58.678722 14608 raft_consensus.cc:2468] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:58.679327 14607 raft_consensus.cc:2468] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
W20260709 12:27:58.688630 14646 leader_election.cc:343] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.690286 14646 leader_election.cc:304] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:58.697297 14506 catalog_manager.cc:5697] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:58.618701 14723 leader_election.cc:304] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 
W20260709 12:27:58.716090 14723 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:35543, user_credentials={real_user=slave}} blocked reactor thread for 100013us
I20260709 12:27:58.720640 14831 raft_consensus.cc:2468] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:27:58.739265 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a425949e144909995513a045d40199" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:58.741781 15102 raft_consensus.cc:2804] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:58.742413 15102 raft_consensus.cc:493] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:58.759279 15102 raft_consensus.cc:3060] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:58.764461 14876 tablet_bootstrap.cc:492] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:58.765761 14876 ts_tablet_manager.cc:1403] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.338s	user 0.013s	sys 0.000s
I20260709 12:27:58.767168 15067 raft_consensus.cc:2804] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:58.768010 15067 raft_consensus.cc:697] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:27:58.769639 15067 consensus_queue.cc:237] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
W20260709 12:27:58.786002 14720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:39063, user_credentials={real_user=slave}} blocked reactor thread for 72345.4us
I20260709 12:27:58.798743 14945 consensus_queue.cc:1048] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:58.809216 14879 tablet_bootstrap.cc:654] T 1bdea069a44b42d099e6fc3f6c6333cc P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.813422 14878 raft_consensus.cc:359] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:58.816440 14876 raft_consensus.cc:359] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.818055 14876 raft_consensus.cc:385] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.818259 14877 tablet_bootstrap.cc:654] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:58.819643 14976 consensus_queue.cc:1048] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:27:58.822633 14876 raft_consensus.cc:740] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.823534 14876 consensus_queue.cc:260] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.814232 14878 raft_consensus.cc:385] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.829360 14878 raft_consensus.cc:740] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.895347 14757 raft_consensus.cc:3060] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:27:58.911561 14647 leader_election.cc:343] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:58.912230 14647 leader_election.cc:304] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:27:58.913277 14929 raft_consensus.cc:2749] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:58.923147 14876 ts_tablet_manager.cc:1434] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.156s	user 0.008s	sys 0.001s
I20260709 12:27:58.925107 14876 tablet_bootstrap.cc:492] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:58.916944 14878 consensus_queue.cc:260] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:58.926445 14877 tablet_bootstrap.cc:492] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:58.927244 14877 ts_tablet_manager.cc:1403] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.350s	user 0.023s	sys 0.011s
I20260709 12:27:58.928061 14919 raft_consensus.cc:493] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.928772 14919 raft_consensus.cc:515] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:58.938241 14681 raft_consensus.cc:1275] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c95afda23abe49318972444cc68998a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 1. (term mismatch)
I20260709 12:27:58.945783 14681 pending_rounds.cc:85] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f: Aborting all ops after (but not including) 0
I20260709 12:27:58.946194 14681 pending_rounds.cc:107] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f: Aborting uncommitted NO_OP operation due to leader change: 1.1
I20260709 12:27:58.946609 14681 raft_consensus.cc:2889] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20260709 12:27:58.946249 14877 raft_consensus.cc:359] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:58.947242 14877 raft_consensus.cc:385] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:58.947590 14877 raft_consensus.cc:740] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:58.948412 14877 consensus_queue.cc:260] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:58.906199 15102 raft_consensus.cc:515] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:58.958076 15070 consensus_queue.cc:1048] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
W20260709 12:27:58.961335 14647 consensus_peers.cc:597] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:27:58.966190 14984 raft_consensus.cc:493] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:58.980083 14984 raft_consensus.cc:515] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:58.978808 14919 leader_election.cc:290] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:27:58.979543 14878 ts_tablet_manager.cc:1434] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.381s	user 0.008s	sys 0.003s
I20260709 12:27:58.987762 14878 tablet_bootstrap.cc:492] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:58.989248 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78415090b3b941069b3cc1a7540a8542" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:58.983218 14887 raft_consensus.cc:2749] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:58.992539 14992 consensus_queue.cc:1048] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:58.996798 14877 ts_tablet_manager.cc:1434] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.069s	user 0.009s	sys 0.000s
I20260709 12:27:58.998834 15102 leader_election.cc:290] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:59.000118 14830 raft_consensus.cc:1275] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Refusing update from remote peer c95afda23abe49318972444cc68998a7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20260709 12:27:59.001261 14608 raft_consensus.cc:2393] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c95afda23abe49318972444cc68998a7 in current term 1: Already voted for candidate 9a105adb44fb47078d6cb03a6c02026f in this term.
I20260709 12:27:59.007021 15111 consensus_queue.cc:1048] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:59.008839 15071 raft_consensus.cc:493] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.009020 14919 consensus_queue.cc:1048] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.009518 15071 raft_consensus.cc:515] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.011955 15071 leader_election.cc:290] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:59.016832 15102 raft_consensus.cc:493] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.017432 15102 raft_consensus.cc:515] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
W20260709 12:27:59.018222 14554 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:27:59.019766 14989 consensus_queue.cc:1048] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:59.021437 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "78415090b3b941069b3cc1a7540a8542" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:59.022826 14679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93f4e1359094f6ba6afc3148d28df68" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:59.023571 14679 raft_consensus.cc:2468] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 0.
I20260709 12:27:59.025024 14876 tablet_bootstrap.cc:654] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.028792 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d83f753ff274231bf05990f4eda9551" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:59.029112 14984 leader_election.cc:290] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:59.029500 14604 raft_consensus.cc:3060] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.030429 14796 leader_election.cc:304] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:27:59.032187 14984 raft_consensus.cc:2804] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:59.032564 14984 raft_consensus.cc:493] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.032943 14984 raft_consensus.cc:3060] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.037352 14877 tablet_bootstrap.cc:492] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:59.038444 15112 consensus_queue.cc:1048] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:59.052115 15018 consensus_queue.cc:1048] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:59.054136 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7acba2c9fabb41d6b3b6c382fd7d19c8" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:59.054503 14604 raft_consensus.cc:2468] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:27:59.057003 15102 leader_election.cc:290] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:59.059195 14720 leader_election.cc:304] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:27:59.060153 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93f4e1359094f6ba6afc3148d28df68" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:59.060910 14753 raft_consensus.cc:3060] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.061755 15102 raft_consensus.cc:2804] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:59.062408 15102 raft_consensus.cc:697] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:27:59.063660 15102 consensus_queue.cc:237] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.115239 14722 leader_election.cc:304] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:27:59.116096 14876 tablet_bootstrap.cc:492] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:59.116640 14876 ts_tablet_manager.cc:1403] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.192s	user 0.012s	sys 0.043s
I20260709 12:27:59.119962 14876 raft_consensus.cc:359] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.120854 14876 raft_consensus.cc:385] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.121172 14876 raft_consensus.cc:740] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.121517 14984 raft_consensus.cc:515] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.121912 14876 consensus_queue.cc:260] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.124624 14876 ts_tablet_manager.cc:1434] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
W20260709 12:27:59.126082 14573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:46705, user_credentials={real_user=slave}} blocked reactor thread for 414442us
I20260709 12:27:59.126590 15108 consensus_queue.cc:1048] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:59.133455 14877 tablet_bootstrap.cc:654] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.135668 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1bdc8f0d36475f87c7da7d8a998240" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:59.137385 14878 tablet_bootstrap.cc:654] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:59.149643 14649 leader_election.cc:343] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.155200 14876 tablet_bootstrap.cc:492] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:59.156077 14879 tablet_bootstrap.cc:492] T 1bdea069a44b42d099e6fc3f6c6333cc P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:59.157862 14879 ts_tablet_manager.cc:1403] T 1bdea069a44b42d099e6fc3f6c6333cc P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.524s	user 0.042s	sys 0.029s
W20260709 12:27:59.158126 14795 leader_election.cc:343] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.159010 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d83f753ff274231bf05990f4eda9551" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:27:59.159850 14831 raft_consensus.cc:3060] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.161060 14879 raft_consensus.cc:359] T 1bdea069a44b42d099e6fc3f6c6333cc P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.163000 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ef1bdc8f0d36475f87c7da7d8a998240" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:59.172343 14984 leader_election.cc:290] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:59.185930 14879 raft_consensus.cc:385] T 1bdea069a44b42d099e6fc3f6c6333cc P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.188410 14879 raft_consensus.cc:740] T 1bdea069a44b42d099e6fc3f6c6333cc P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.189141 14879 consensus_queue.cc:260] T 1bdea069a44b42d099e6fc3f6c6333cc P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.203569 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7acba2c9fabb41d6b3b6c382fd7d19c8" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:59.206882 14723 leader_election.cc:304] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:27:59.207414 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93f4e1359094f6ba6afc3148d28df68" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:59.208257 14680 raft_consensus.cc:3060] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.209265 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93f4e1359094f6ba6afc3148d28df68" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:59.208317 15102 raft_consensus.cc:2749] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:27:59.215845 14795 leader_election.cc:343] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.243964 14878 tablet_bootstrap.cc:492] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:59.244666 14878 ts_tablet_manager.cc:1403] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.257s	user 0.021s	sys 0.001s
I20260709 12:27:59.247924 14878 raft_consensus.cc:359] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.248711 14878 raft_consensus.cc:385] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.248973 14878 raft_consensus.cc:740] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
W20260709 12:27:59.249409 14646 leader_election.cc:343] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.258263 14877 tablet_bootstrap.cc:492] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:59.258983 14877 ts_tablet_manager.cc:1403] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.222s	user 0.010s	sys 0.028s
I20260709 12:27:59.265746 14646 leader_election.cc:304] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:27:59.266705 15071 raft_consensus.cc:2749] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.270592 15071 consensus_queue.cc:1048] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:27:59.262980 14877 raft_consensus.cc:359] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.272222 14877 raft_consensus.cc:385] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.272545 14877 raft_consensus.cc:740] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.273455 14877 consensus_queue.cc:260] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.276317 14877 ts_tablet_manager.cc:1434] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.004s
I20260709 12:27:59.249733 14878 consensus_queue.cc:260] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.282367 14879 ts_tablet_manager.cc:1434] T 1bdea069a44b42d099e6fc3f6c6333cc P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.124s	user 0.007s	sys 0.000s
I20260709 12:27:59.284068 14879 tablet_bootstrap.cc:492] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:59.284309 14876 tablet_bootstrap.cc:654] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.288033 14887 raft_consensus.cc:2749] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.294914 14878 ts_tablet_manager.cc:1434] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.050s	user 0.008s	sys 0.000s
I20260709 12:27:59.295730 14831 raft_consensus.cc:2468] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:27:59.310640 14877 tablet_bootstrap.cc:492] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:59.297014 15071 consensus_queue.cc:1048] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:27:59.317896 14878 tablet_bootstrap.cc:492] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:59.332499 15071 raft_consensus.cc:493] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.333078 15071 raft_consensus.cc:515] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.336380 15071 leader_election.cc:290] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:59.337607 14879 tablet_bootstrap.cc:654] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.340132 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:27:59.341881 14647 leader_election.cc:343] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.342718 14680 raft_consensus.cc:2468] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:27:59.344002 15071 consensus_queue.cc:1048] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:27:59.368260 14877 tablet_bootstrap.cc:654] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.369220 14505 catalog_manager.cc:5697] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:59.373991 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:59.376051 14796 leader_election.cc:304] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:27:59.377353 14878 tablet_bootstrap.cc:654] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.398214 15018 raft_consensus.cc:2804] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:59.399142 15018 raft_consensus.cc:697] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
W20260709 12:27:59.404258 14646 leader_election.cc:343] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.405128 14646 leader_election.cc:304] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:27:59.406710 14989 raft_consensus.cc:2749] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.400344 15018 consensus_queue.cc:237] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.445389 14877 tablet_bootstrap.cc:492] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:59.445955 14877 ts_tablet_manager.cc:1403] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.145s	user 0.007s	sys 0.017s
I20260709 12:27:59.449066 14877 raft_consensus.cc:359] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.450515 14877 raft_consensus.cc:385] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.450832 14877 raft_consensus.cc:740] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.453554 14876 tablet_bootstrap.cc:492] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:59.454154 14876 ts_tablet_manager.cc:1403] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.328s	user 0.030s	sys 0.025s
I20260709 12:27:59.453963 14877 consensus_queue.cc:260] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.454721 14879 tablet_bootstrap.cc:492] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:59.455274 14879 ts_tablet_manager.cc:1403] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.172s	user 0.016s	sys 0.008s
I20260709 12:27:59.456502 14877 ts_tablet_manager.cc:1434] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.002s
I20260709 12:27:59.458715 14877 tablet_bootstrap.cc:492] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:59.459002 14878 tablet_bootstrap.cc:492] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:59.458177 14879 raft_consensus.cc:359] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.460219 14879 raft_consensus.cc:385] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.460557 14879 raft_consensus.cc:740] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.461567 14878 ts_tablet_manager.cc:1403] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.144s	user 0.010s	sys 0.003s
I20260709 12:27:59.462080 14879 consensus_queue.cc:260] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.465119 14989 raft_consensus.cc:493] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.465023 14878 raft_consensus.cc:359] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.466195 14877 tablet_bootstrap.cc:654] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.465848 14989 raft_consensus.cc:515] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.467960 14879 ts_tablet_manager.cc:1434] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:27:59.469189 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82a93abcc0d49fe8790a150daf9accc" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:27:59.474049 14647 leader_election.cc:343] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.471205 14989 leader_election.cc:290] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:59.471596 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82a93abcc0d49fe8790a150daf9accc" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:59.477026 14879 tablet_bootstrap.cc:492] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
W20260709 12:27:59.477321 14649 leader_election.cc:343] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.477901 14649 leader_election.cc:304] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:27:59.479439 15071 raft_consensus.cc:2749] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.465830 14878 raft_consensus.cc:385] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.485375 14878 raft_consensus.cc:740] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.488435 14911 raft_consensus.cc:493] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.488797 14877 tablet_bootstrap.cc:492] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:59.486073 14876 raft_consensus.cc:359] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.489029 14911 raft_consensus.cc:515] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.489359 14877 ts_tablet_manager.cc:1403] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.031s	user 0.011s	sys 0.012s
I20260709 12:27:59.488634 14878 consensus_queue.cc:260] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.491765 14911 leader_election.cc:290] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:59.492523 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8777b3a550644b50835c268da566aee7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:59.492936 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8777b3a550644b50835c268da566aee7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:59.493310 14680 raft_consensus.cc:2468] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:27:59.493641 14753 raft_consensus.cc:2468] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:27:59.489918 14876 raft_consensus.cc:385] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.494313 14876 raft_consensus.cc:740] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.494798 14573 leader_election.cc:304] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:59.496044 14911 raft_consensus.cc:2804] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:59.496433 14911 raft_consensus.cc:493] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.496886 14911 raft_consensus.cc:3060] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.496284 14877 raft_consensus.cc:359] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.497675 14753 raft_consensus.cc:3060] T 1bdea069a44b42d099e6fc3f6c6333cc P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.498090 14879 tablet_bootstrap.cc:654] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.497713 14877 raft_consensus.cc:385] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.501514 14877 raft_consensus.cc:740] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.502413 14877 consensus_queue.cc:260] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.504794 14877 ts_tablet_manager.cc:1434] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:27:59.506307 14911 raft_consensus.cc:515] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.509388 14877 tablet_bootstrap.cc:492] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:59.513286 14878 ts_tablet_manager.cc:1434] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.000s
I20260709 12:27:59.514542 14878 tablet_bootstrap.cc:492] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:59.518214 14877 tablet_bootstrap.cc:654] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.495038 14876 consensus_queue.cc:260] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.520067 14879 tablet_bootstrap.cc:492] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:59.520578 14879 ts_tablet_manager.cc:1403] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.044s	user 0.013s	sys 0.000s
I20260709 12:27:59.522342 14876 ts_tablet_manager.cc:1434] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.068s	user 0.007s	sys 0.000s
I20260709 12:27:59.522926 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8777b3a550644b50835c268da566aee7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:59.523599 14876 tablet_bootstrap.cc:492] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:59.523540 14680 raft_consensus.cc:3060] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.523519 14879 raft_consensus.cc:359] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.528322 14879 raft_consensus.cc:385] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.528589 14879 raft_consensus.cc:740] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.529366 14879 consensus_queue.cc:260] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.531381 14879 ts_tablet_manager.cc:1434] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:27:59.532346 14879 tablet_bootstrap.cc:492] T 446076fe225641ee8d6ad7fe5a4777ee P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:59.535679 14876 tablet_bootstrap.cc:654] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.539654 14503 catalog_manager.cc:5697] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } }
I20260709 12:27:59.545796 14878 tablet_bootstrap.cc:654] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.550643 15112 raft_consensus.cc:493] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.551268 15112 raft_consensus.cc:515] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.553010 14887 consensus_queue.cc:1048] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.554877 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a425949e144909995513a045d40199" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:59.553435 15112 leader_election.cc:290] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:59.554955 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a425949e144909995513a045d40199" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:59.556833 14682 raft_consensus.cc:2468] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:27:59.556957 14877 tablet_bootstrap.cc:492] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:59.558070 14877 ts_tablet_manager.cc:1403] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.051s	user 0.022s	sys 0.019s
I20260709 12:27:59.558226 14573 leader_election.cc:304] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:59.560949 14877 raft_consensus.cc:359] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.561687 14877 raft_consensus.cc:385] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.561964 14877 raft_consensus.cc:740] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.562355 15112 raft_consensus.cc:2804] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:59.562800 15112 raft_consensus.cc:493] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.563217 15112 raft_consensus.cc:3060] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.562866 14877 consensus_queue.cc:260] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.565176 14877 ts_tablet_manager.cc:1434] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.005s
I20260709 12:27:59.566308 14877 tablet_bootstrap.cc:492] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:59.567039 14879 tablet_bootstrap.cc:654] T 446076fe225641ee8d6ad7fe5a4777ee P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
W20260709 12:27:59.567549 14572 leader_election.cc:343] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.576570 15112 raft_consensus.cc:515] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.578521 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8777b3a550644b50835c268da566aee7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:59.579134 14751 raft_consensus.cc:3060] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.579704 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a425949e144909995513a045d40199" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:59.580324 14682 raft_consensus.cc:3060] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.586514 14911 leader_election.cc:290] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:59.588207 14751 raft_consensus.cc:2468] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:59.590003 14572 leader_election.cc:304] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:27:59.591044 14938 raft_consensus.cc:2804] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:59.591503 14938 raft_consensus.cc:697] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:27:59.592262 14938 consensus_queue.cc:237] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.592927 14682 raft_consensus.cc:2468] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:59.594353 14573 leader_election.cc:304] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:59.595494 15105 raft_consensus.cc:2804] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:59.576540 14680 raft_consensus.cc:2468] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:27:59.595974 15105 raft_consensus.cc:697] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:27:59.596864 15105 consensus_queue.cc:237] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.604130 14877 tablet_bootstrap.cc:654] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.606027 15018 raft_consensus.cc:493] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.606942 15112 leader_election.cc:290] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:59.606688 15018 raft_consensus.cc:515] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.609584 14876 tablet_bootstrap.cc:492] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:59.611400 14752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446076fe225641ee8d6ad7fe5a4777ee" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:59.610069 14876 ts_tablet_manager.cc:1403] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.087s	user 0.011s	sys 0.006s
W20260709 12:27:59.613094 14795 leader_election.cc:343] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.616115 14876 raft_consensus.cc:359] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.616801 14876 raft_consensus.cc:385] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.617046 14876 raft_consensus.cc:740] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.617812 14876 consensus_queue.cc:260] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.619938 14876 ts_tablet_manager.cc:1434] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:59.621335 14876 tablet_bootstrap.cc:492] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:59.629532 14879 tablet_bootstrap.cc:492] T 446076fe225641ee8d6ad7fe5a4777ee P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:59.630131 14879 ts_tablet_manager.cc:1403] T 446076fe225641ee8d6ad7fe5a4777ee P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.098s	user 0.011s	sys 0.003s
I20260709 12:27:59.632479 14878 tablet_bootstrap.cc:492] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:59.633664 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446076fe225641ee8d6ad7fe5a4777ee" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:59.634722 15018 leader_election.cc:290] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:59.638191 14876 tablet_bootstrap.cc:654] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.640468 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a425949e144909995513a045d40199" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:59.643080 14607 raft_consensus.cc:2468] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 0.
W20260709 12:27:59.644456 14572 leader_election.cc:343] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.645047 14877 tablet_bootstrap.cc:492] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:59.645581 14877 ts_tablet_manager.cc:1403] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.080s	user 0.006s	sys 0.005s
I20260709 12:27:59.645673 14794 leader_election.cc:304] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:27:59.646958 15018 raft_consensus.cc:2804] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:59.647408 15018 raft_consensus.cc:493] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.647825 15018 raft_consensus.cc:3060] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.656009 14878 ts_tablet_manager.cc:1403] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.142s	user 0.020s	sys 0.000s
I20260709 12:27:59.656558 14877 raft_consensus.cc:359] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.657305 14877 raft_consensus.cc:385] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.657581 14877 raft_consensus.cc:740] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.658397 14877 consensus_queue.cc:260] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.659094 14878 raft_consensus.cc:359] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.659837 14878 raft_consensus.cc:385] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.660051 14877 ts_tablet_manager.cc:1434] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.013s	user 0.005s	sys 0.000s
I20260709 12:27:59.660100 14878 raft_consensus.cc:740] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.661252 14878 consensus_queue.cc:260] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.666735 14877 tablet_bootstrap.cc:492] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:59.671422 14879 raft_consensus.cc:359] T 446076fe225641ee8d6ad7fe5a4777ee P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.671978 15110 consensus_queue.cc:1048] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.674400 14876 tablet_bootstrap.cc:492] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:59.675024 14876 ts_tablet_manager.cc:1403] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.054s	user 0.011s	sys 0.001s
I20260709 12:27:59.677834 14876 raft_consensus.cc:359] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.678638 14876 raft_consensus.cc:385] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.681459 14877 tablet_bootstrap.cc:654] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.679325 14876 raft_consensus.cc:740] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.683791 14876 consensus_queue.cc:260] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.686162 14876 ts_tablet_manager.cc:1434] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:27:59.688657 14876 tablet_bootstrap.cc:492] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:59.687211 14878 ts_tablet_manager.cc:1434] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.031s	user 0.006s	sys 0.001s
I20260709 12:27:59.689432 15018 raft_consensus.cc:515] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.690521 14878 tablet_bootstrap.cc:492] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:59.699568 15070 raft_consensus.cc:493] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.700156 15070 raft_consensus.cc:515] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.702615 15070 leader_election.cc:290] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:27:59.701934 14503 catalog_manager.cc:5697] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:59.703918 15071 raft_consensus.cc:493] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.672093 14879 raft_consensus.cc:385] T 446076fe225641ee8d6ad7fe5a4777ee P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.704452 15071 raft_consensus.cc:515] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.705915 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7acba2c9fabb41d6b3b6c382fd7d19c8" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:59.706643 14682 raft_consensus.cc:2468] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 0.
I20260709 12:27:59.706810 15071 leader_election.cc:290] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:27:59.707319 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7acba2c9fabb41d6b3b6c382fd7d19c8" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:59.707993 14607 raft_consensus.cc:2468] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 0.
I20260709 12:27:59.708542 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd3630b48e04f27bb2a681c2b329e2f" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:59.704522 14879 raft_consensus.cc:740] T 446076fe225641ee8d6ad7fe5a4777ee P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.708060 14796 leader_election.cc:304] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
W20260709 12:27:59.709975 14649 leader_election.cc:343] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.712175 14876 tablet_bootstrap.cc:654] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.713438 15070 raft_consensus.cc:2804] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:27:59.713896 15070 raft_consensus.cc:493] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:27:59.714254 15070 raft_consensus.cc:3060] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.704423 14878 tablet_bootstrap.cc:654] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.714779 14503 catalog_manager.cc:5697] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:27:59.710222 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd3630b48e04f27bb2a681c2b329e2f" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:59.719065 14879 consensus_queue.cc:260] T 446076fe225641ee8d6ad7fe5a4777ee P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
W20260709 12:27:59.720036 14647 leader_election.cc:343] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.720528 14647 leader_election.cc:304] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:27:59.722098 15071 raft_consensus.cc:2749] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.722517 15070 raft_consensus.cc:515] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.724898 14879 ts_tablet_manager.cc:1434] T 446076fe225641ee8d6ad7fe5a4777ee P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.094s	user 0.008s	sys 0.000s
I20260709 12:27:59.725811 15070 leader_election.cc:290] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:27:59.726063 14879 tablet_bootstrap.cc:492] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:59.731773 15018 leader_election.cc:290] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:59.736145 14504 catalog_manager.cc:5697] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 0 to 1, leader changed from <none> to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 1 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } }
I20260709 12:27:59.740612 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446076fe225641ee8d6ad7fe5a4777ee" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:59.741361 14608 raft_consensus.cc:3060] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.748301 14879 tablet_bootstrap.cc:654] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.748984 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7acba2c9fabb41d6b3b6c382fd7d19c8" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:27:59.749624 14682 raft_consensus.cc:3060] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.755661 14876 tablet_bootstrap.cc:492] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:59.756183 14876 ts_tablet_manager.cc:1403] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.068s	user 0.020s	sys 0.017s
I20260709 12:27:59.758261 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7acba2c9fabb41d6b3b6c382fd7d19c8" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:27:59.758966 14607 raft_consensus.cc:3060] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.761011 14876 raft_consensus.cc:359] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.761811 14876 raft_consensus.cc:385] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.762120 14876 raft_consensus.cc:740] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.763005 14876 consensus_queue.cc:260] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.765635 14876 ts_tablet_manager.cc:1434] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:27:59.766660 14876 tablet_bootstrap.cc:492] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:59.772487 14879 tablet_bootstrap.cc:492] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:59.772282 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446076fe225641ee8d6ad7fe5a4777ee" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:27:59.772887 14876 tablet_bootstrap.cc:654] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.773047 14879 ts_tablet_manager.cc:1403] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.047s	user 0.012s	sys 0.000s
I20260709 12:27:59.780455 15071 raft_consensus.cc:493] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.781035 15071 raft_consensus.cc:515] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.781716 14879 raft_consensus.cc:359] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.782532 14879 raft_consensus.cc:385] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.782805 14879 raft_consensus.cc:740] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.783648 14879 consensus_queue.cc:260] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.784603 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:27:59.787197 14879 ts_tablet_manager.cc:1434] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
W20260709 12:27:59.787772 14647 leader_election.cc:343] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.787400 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
W20260709 12:27:59.790540 14646 leader_election.cc:343] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.790962 14646 leader_election.cc:304] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:27:59.791330 14879 tablet_bootstrap.cc:492] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:59.789052 15071 leader_election.cc:290] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:59.777537 14753 raft_consensus.cc:3060] T 446076fe225641ee8d6ad7fe5a4777ee P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.788655 14876 tablet_bootstrap.cc:492] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:59.800014 14876 ts_tablet_manager.cc:1403] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.034s	user 0.017s	sys 0.004s
I20260709 12:27:59.791682 14989 raft_consensus.cc:2749] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.802819 14876 raft_consensus.cc:359] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.803462 14876 raft_consensus.cc:385] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.803694 14876 raft_consensus.cc:740] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.803993 14877 tablet_bootstrap.cc:492] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:27:59.804507 14877 ts_tablet_manager.cc:1403] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.138s	user 0.008s	sys 0.010s
I20260709 12:27:59.804333 14876 consensus_queue.cc:260] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.806721 14876 ts_tablet_manager.cc:1434] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.002s	sys 0.005s
I20260709 12:27:59.807894 14876 tablet_bootstrap.cc:492] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:59.807616 14877 raft_consensus.cc:359] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.808511 14877 raft_consensus.cc:385] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.808830 14877 raft_consensus.cc:740] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.809684 14877 consensus_queue.cc:260] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.814162 14876 tablet_bootstrap.cc:654] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.793854 15018 consensus_queue.cc:1048] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.816277 14877 ts_tablet_manager.cc:1434] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:27:59.814190 14879 tablet_bootstrap.cc:654] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.821622 14989 raft_consensus.cc:493] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.822139 14989 raft_consensus.cc:515] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.825479 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c22c8f015eb4f498db641dca9ea7900" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
W20260709 12:27:59.827054 14646 leader_election.cc:343] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.827390 14876 tablet_bootstrap.cc:492] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:59.827931 14876 ts_tablet_manager.cc:1403] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.020s	user 0.016s	sys 0.000s
I20260709 12:27:59.828835 14989 leader_election.cc:290] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:59.828895 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c22c8f015eb4f498db641dca9ea7900" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:27:59.830736 14876 raft_consensus.cc:359] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.831440 14876 raft_consensus.cc:385] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.831692 14876 raft_consensus.cc:740] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.836170 14682 raft_consensus.cc:2468] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
W20260709 12:27:59.837919 14649 leader_election.cc:343] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:27:59.832547 14876 consensus_queue.cc:260] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.842475 14649 leader_election.cc:304] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:27:59.844278 14876 ts_tablet_manager.cc:1434] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.000s
I20260709 12:27:59.845299 14876 tablet_bootstrap.cc:492] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:59.850762 14876 tablet_bootstrap.cc:654] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.861438 14989 raft_consensus.cc:2749] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:27:59.869788 14876 tablet_bootstrap.cc:492] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:59.791744 14608 raft_consensus.cc:2468] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:27:59.870359 14876 ts_tablet_manager.cc:1403] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.025s	user 0.019s	sys 0.003s
I20260709 12:27:59.871546 14796 leader_election.cc:304] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:27:59.872541 15018 raft_consensus.cc:2804] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:59.873170 14876 raft_consensus.cc:359] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.873988 14876 raft_consensus.cc:385] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.874246 14876 raft_consensus.cc:740] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.873241 15018 raft_consensus.cc:697] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:27:59.874861 14879 tablet_bootstrap.cc:492] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:59.875344 14879 ts_tablet_manager.cc:1403] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.086s	user 0.014s	sys 0.007s
I20260709 12:27:59.875012 14876 consensus_queue.cc:260] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.875380 15018 consensus_queue.cc:237] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.876857 14876 ts_tablet_manager.cc:1434] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:27:59.877839 14876 tablet_bootstrap.cc:492] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:59.884657 14794 leader_election.cc:304] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:27:59.884589 14879 raft_consensus.cc:359] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.885289 14879 raft_consensus.cc:385] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.885556 14879 raft_consensus.cc:740] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.885695 15070 raft_consensus.cc:2804] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:27:59.885864 14878 tablet_bootstrap.cc:492] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:27:59.886420 14878 ts_tablet_manager.cc:1403] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.196s	user 0.007s	sys 0.004s
I20260709 12:27:59.886317 15070 raft_consensus.cc:697] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:27:59.886312 14879 consensus_queue.cc:260] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:27:59.887566 15070 consensus_queue.cc:237] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.888532 14879 ts_tablet_manager.cc:1434] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.000s
I20260709 12:27:59.889616 14879 tablet_bootstrap.cc:492] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:59.889268 14878 raft_consensus.cc:359] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.890535 14878 raft_consensus.cc:385] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.890821 14878 raft_consensus.cc:740] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.841800 14877 tablet_bootstrap.cc:492] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:27:59.894173 14876 tablet_bootstrap.cc:654] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.896014 14878 consensus_queue.cc:260] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.897277 14879 tablet_bootstrap.cc:654] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.898393 14878 ts_tablet_manager.cc:1434] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.001s
I20260709 12:27:59.899528 14878 tablet_bootstrap.cc:492] T 9e6cc46cc8484c24aef89febc4a0da98 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:27:59.908731 14876 tablet_bootstrap.cc:492] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:59.909345 14876 ts_tablet_manager.cc:1403] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.005s
I20260709 12:27:59.909821 14751 raft_consensus.cc:3060] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:27:59.912331 14876 raft_consensus.cc:359] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.913118 14876 raft_consensus.cc:385] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.913426 14876 raft_consensus.cc:740] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.914143 14876 consensus_queue.cc:260] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:27:59.915994 14876 ts_tablet_manager.cc:1434] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:27:59.917116 14876 tablet_bootstrap.cc:492] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:59.923799 14876 tablet_bootstrap.cc:654] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.936333 14876 tablet_bootstrap.cc:492] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:59.936908 14876 ts_tablet_manager.cc:1403] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.020s	user 0.012s	sys 0.004s
I20260709 12:27:59.938180 14879 tablet_bootstrap.cc:492] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:27:59.938927 14879 ts_tablet_manager.cc:1403] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.050s	user 0.011s	sys 0.002s
I20260709 12:27:59.939906 14876 raft_consensus.cc:359] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.940912 14876 raft_consensus.cc:385] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.941220 14876 raft_consensus.cc:740] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.941627 14984 consensus_queue.cc:1048] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.942026 14876 consensus_queue.cc:260] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:27:59.942797 14879 raft_consensus.cc:359] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.943444 14879 raft_consensus.cc:385] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:27:59.943727 14879 raft_consensus.cc:740] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:27:59.944097 14876 ts_tablet_manager.cc:1434] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:27:59.944397 14879 consensus_queue.cc:260] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:27:59.945175 14876 tablet_bootstrap.cc:492] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:27:59.950210 14879 ts_tablet_manager.cc:1434] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:27:59.951303 14879 tablet_bootstrap.cc:492] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:27:59.951629 14876 tablet_bootstrap.cc:654] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:27:59.965898 14753 raft_consensus.cc:2468] T 446076fe225641ee8d6ad7fe5a4777ee P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:27:59.966326 15112 raft_consensus.cc:493] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.000245 15112 raft_consensus.cc:515] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:00.002432 15112 leader_election.cc:290] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:27:59.967047 15111 raft_consensus.cc:493] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:27:59.968847 14876 tablet_bootstrap.cc:492] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:27:59.970604 15108 raft_consensus.cc:493] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.003114 15111 raft_consensus.cc:515] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.003647 15108 raft_consensus.cc:515] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:00.005739 14876 ts_tablet_manager.cc:1403] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.061s	user 0.014s	sys 0.003s
I20260709 12:28:00.006198 15111 leader_election.cc:290] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:59.972842 14607 raft_consensus.cc:2468] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:28:00.007823 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6cc46cc8484c24aef89febc4a0da98" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:00.008285 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c423e2343f442c79ab8cecd3cb76d57" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:00.008665 14876 raft_consensus.cc:359] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:00.008973 14831 raft_consensus.cc:2468] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:27:59.974823 14879 tablet_bootstrap.cc:654] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.005851 15108 leader_election.cc:290] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:27:59.984716 14938 consensus_queue.cc:1048] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:27:59.980357 14878 tablet_bootstrap.cc:654] T 9e6cc46cc8484c24aef89febc4a0da98 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:00.011849 14649 leader_election.cc:343] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.009128 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:00.009382 14876 raft_consensus.cc:385] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.013566 14876 raft_consensus.cc:740] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.013195 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6cc46cc8484c24aef89febc4a0da98" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:00.014616 14607 raft_consensus.cc:2468] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:28:00.015338 14723 leader_election.cc:304] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:00.015944 14646 leader_election.cc:304] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
W20260709 12:28:00.016526 14572 leader_election.cc:343] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.017271 15111 raft_consensus.cc:2804] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.017693 15111 raft_consensus.cc:493] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.018110 15111 raft_consensus.cc:3060] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.017611 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:27:59.999694 14877 tablet_bootstrap.cc:654] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.018721 15108 raft_consensus.cc:2804] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.019272 15108 raft_consensus.cc:493] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.019474 14680 raft_consensus.cc:2468] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:28:00.020570 15108 raft_consensus.cc:3060] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.021247 14573 leader_election.cc:304] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:28:00.014266 14876 consensus_queue.cc:260] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:00.022343 15112 raft_consensus.cc:2804] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.023546 14876 ts_tablet_manager.cc:1434] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.017s	user 0.003s	sys 0.003s
I20260709 12:28:00.023873 15112 raft_consensus.cc:493] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.024783 15113 raft_consensus.cc:493] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.025214 14876 tablet_bootstrap.cc:492] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:00.025285 15113 raft_consensus.cc:515] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:00.026259 15105 consensus_queue.cc:1048] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.027616 15113 leader_election.cc:290] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:00.029165 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a425949e144909995513a045d40199" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:00.030179 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a425949e144909995513a045d40199" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:00.032166 14876 tablet_bootstrap.cc:654] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.032541 14722 leader_election.cc:304] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:00.034209 15110 raft_consensus.cc:2749] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:00.018805 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c423e2343f442c79ab8cecd3cb76d57" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:27:59.988050 14506 catalog_manager.cc:5697] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 0 to 1, leader changed from <none> to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 1 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.024386 15112 raft_consensus.cc:3060] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.054998 14877 tablet_bootstrap.cc:492] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:28:00.055691 14877 ts_tablet_manager.cc:1403] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.214s	user 0.007s	sys 0.006s
I20260709 12:28:00.070477 14984 raft_consensus.cc:493] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.071095 14984 raft_consensus.cc:515] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:00.073194 14984 leader_election.cc:290] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:00.076363 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4e4a9a715c4425a25afa8c34b1dd2a" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:28:00.077812 14795 leader_election.cc:343] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.087344 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4e4a9a715c4425a25afa8c34b1dd2a" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:00.088246 14607 raft_consensus.cc:2468] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 0.
I20260709 12:28:00.043143 14608 raft_consensus.cc:2468] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:28:00.090747 14751 raft_consensus.cc:3060] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.099843 14794 leader_election.cc:304] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:28:00.100975 14984 raft_consensus.cc:2804] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.101392 14984 raft_consensus.cc:493] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.101735 14984 raft_consensus.cc:3060] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.100979 14976 consensus_queue.cc:1048] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:28:00.118597 14984 raft_consensus.cc:515] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:00.105880 14877 raft_consensus.cc:359] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.119843 14877 raft_consensus.cc:385] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.120183 14877 raft_consensus.cc:740] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.121199 14877 consensus_queue.cc:260] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.123786 14877 ts_tablet_manager.cc:1434] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.068s	user 0.006s	sys 0.001s
I20260709 12:28:00.123540 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4e4a9a715c4425a25afa8c34b1dd2a" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
W20260709 12:28:00.125375 14795 leader_election.cc:343] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.125332 14984 leader_election.cc:290] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:00.125999 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "df4e4a9a715c4425a25afa8c34b1dd2a" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:00.126986 14608 raft_consensus.cc:3060] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.127903 15108 raft_consensus.cc:515] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:00.131320 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c423e2343f442c79ab8cecd3cb76d57" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:00.132207 14831 raft_consensus.cc:3060] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.132754 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c423e2343f442c79ab8cecd3cb76d57" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:00.133507 14607 raft_consensus.cc:3060] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.126891 15112 raft_consensus.cc:515] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:00.136659 15112 leader_election.cc:290] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:00.118808 15111 raft_consensus.cc:515] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.138512 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
W20260709 12:28:00.140111 14572 leader_election.cc:343] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.141095 14831 raft_consensus.cc:2468] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:00.143198 14911 raft_consensus.cc:493] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.143962 14911 raft_consensus.cc:515] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:00.146452 14911 leader_election.cc:290] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:00.149626 14879 tablet_bootstrap.cc:492] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:00.150341 14879 ts_tablet_manager.cc:1403] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.199s	user 0.012s	sys 0.001s
I20260709 12:28:00.156457 14608 raft_consensus.cc:2468] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:28:00.157056 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca6238c0f244dd1a911e44a703e0f8b" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:00.158144 14794 leader_election.cc:304] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:28:00.158838 14878 tablet_bootstrap.cc:492] T 9e6cc46cc8484c24aef89febc4a0da98 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:00.159345 14878 ts_tablet_manager.cc:1403] T 9e6cc46cc8484c24aef89febc4a0da98 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.260s	user 0.029s	sys 0.033s
I20260709 12:28:00.159587 14984 raft_consensus.cc:2804] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.160159 14984 raft_consensus.cc:697] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:28:00.161134 14984 consensus_queue.cc:237] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:00.156399 14879 raft_consensus.cc:359] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:00.163589 14879 raft_consensus.cc:385] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.164012 14879 raft_consensus.cc:740] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.161989 14723 leader_election.cc:304] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 
W20260709 12:28:00.165343 14572 leader_election.cc:343] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.166124 15110 raft_consensus.cc:2804] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.166666 15110 raft_consensus.cc:697] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:00.161206 14607 raft_consensus.cc:2468] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:00.167737 14879 consensus_queue.cc:260] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:00.175736 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:00.175554 15110 consensus_queue.cc:237] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:00.176411 14682 raft_consensus.cc:3060] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.178097 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca6238c0f244dd1a911e44a703e0f8b" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
W20260709 12:28:00.180526 14574 leader_election.cc:343] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.180998 14574 leader_election.cc:304] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:28:00.182344 14976 raft_consensus.cc:2749] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:00.131264 15108 leader_election.cc:290] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:00.187980 14878 raft_consensus.cc:359] T 9e6cc46cc8484c24aef89febc4a0da98 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.188614 14878 raft_consensus.cc:385] T 9e6cc46cc8484c24aef89febc4a0da98 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.188858 14878 raft_consensus.cc:740] T 9e6cc46cc8484c24aef89febc4a0da98 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.189435 14878 consensus_queue.cc:260] T 9e6cc46cc8484c24aef89febc4a0da98 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.209692 14876 tablet_bootstrap.cc:492] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:28:00.210299 14876 ts_tablet_manager.cc:1403] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.185s	user 0.023s	sys 0.023s
I20260709 12:28:00.212106 14877 tablet_bootstrap.cc:492] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:28:00.215618 15111 leader_election.cc:290] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:00.228575 14878 ts_tablet_manager.cc:1434] T 9e6cc46cc8484c24aef89febc4a0da98 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.069s	user 0.013s	sys 0.003s
I20260709 12:28:00.229794 14878 tablet_bootstrap.cc:492] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:28:00.233596 14682 raft_consensus.cc:2468] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:28:00.235615 14573 leader_election.cc:304] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:28:00.238075 14938 raft_consensus.cc:2804] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.240332 14876 raft_consensus.cc:359] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.241061 14876 raft_consensus.cc:385] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.241338 14876 raft_consensus.cc:740] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.243024 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6cc46cc8484c24aef89febc4a0da98" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:00.243703 14607 raft_consensus.cc:3060] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.241988 14876 consensus_queue.cc:260] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.246371 14938 raft_consensus.cc:697] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:00.248306 14938 consensus_queue.cc:237] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:00.235957 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e6cc46cc8484c24aef89febc4a0da98" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:00.250900 14830 raft_consensus.cc:3060] T 9e6cc46cc8484c24aef89febc4a0da98 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.262259 14877 tablet_bootstrap.cc:654] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.263429 15108 raft_consensus.cc:493] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.266039 14879 ts_tablet_manager.cc:1434] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.112s	user 0.019s	sys 0.021s
I20260709 12:28:00.269294 14878 tablet_bootstrap.cc:654] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.270656 14911 consensus_queue.cc:1048] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:28:00.276192 14830 raft_consensus.cc:2468] T 9e6cc46cc8484c24aef89febc4a0da98 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:00.267014 15108 raft_consensus.cc:515] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:00.277936 14649 leader_election.cc:304] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:28:00.279160 15111 raft_consensus.cc:2804] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.279647 15108 leader_election.cc:290] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:00.281116 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:00.281894 14682 raft_consensus.cc:2468] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:28:00.282362 15070 consensus_queue.cc:1048] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.279707 14876 ts_tablet_manager.cc:1434] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.069s	user 0.006s	sys 0.000s
I20260709 12:28:00.283293 14879 tablet_bootstrap.cc:492] T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:28:00.279732 15111 raft_consensus.cc:697] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:00.287557 14976 raft_consensus.cc:493] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.294987 14876 tablet_bootstrap.cc:492] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:00.297612 14976 raft_consensus.cc:515] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:00.297988 14722 leader_election.cc:304] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:00.299067 14607 raft_consensus.cc:2468] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:00.299253 15181 raft_consensus.cc:2804] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.299876 15181 raft_consensus.cc:493] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.300302 15181 raft_consensus.cc:3060] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.302762 14976 leader_election.cc:290] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:00.303970 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:00.304718 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:00.304726 14608 raft_consensus.cc:2468] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:28:00.303615 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:00.306707 14682 raft_consensus.cc:2468] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:28:00.309010 14505 catalog_manager.cc:5697] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.313140 14573 leader_election.cc:304] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:00.314626 14976 raft_consensus.cc:2804] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.315017 14976 raft_consensus.cc:493] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.315333 14976 raft_consensus.cc:3060] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.306562 15111 consensus_queue.cc:237] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.326836 14503 catalog_manager.cc:5697] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 0 to 1, leader changed from <none> to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 1 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.329092 14503 catalog_manager.cc:5697] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 0 to 1, leader changed from <none> to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 1 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.334810 14876 tablet_bootstrap.cc:654] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.331732 14506 catalog_manager.cc:5697] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.334733 15018 raft_consensus.cc:493] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.343236 15018 raft_consensus.cc:515] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.344951 14879 tablet_bootstrap.cc:654] T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.345724 15018 leader_election.cc:290] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:00.347332 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82a93abcc0d49fe8790a150daf9accc" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:00.348017 14682 raft_consensus.cc:2468] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 0.
I20260709 12:28:00.349289 14796 leader_election.cc:304] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:28:00.349052 14976 raft_consensus.cc:515] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:00.352284 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:00.352867 14682 raft_consensus.cc:3060] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.375492 14984 raft_consensus.cc:2804] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.375844 14682 raft_consensus.cc:2468] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:28:00.380384 14573 leader_election.cc:304] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:00.381364 14911 raft_consensus.cc:2804] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.381737 14984 raft_consensus.cc:493] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.381889 14911 raft_consensus.cc:697] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:00.381498 15070 consensus_queue.cc:1048] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:00.382970 14911 consensus_queue.cc:237] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:00.383829 15070 consensus_queue.cc:1048] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.387202 14984 raft_consensus.cc:3060] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.398236 15110 raft_consensus.cc:493] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.398895 15110 raft_consensus.cc:515] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.403254 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd3630b48e04f27bb2a681c2b329e2f" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:00.404481 14938 raft_consensus.cc:493] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.397964 14976 leader_election.cc:290] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:00.417378 14878 tablet_bootstrap.cc:492] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:00.417802 14878 ts_tablet_manager.cc:1403] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.188s	user 0.013s	sys 0.000s
I20260709 12:28:00.415472 14503 catalog_manager.cc:5697] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:00.406039 15110 leader_election.cc:290] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
W20260709 12:28:00.416541 14723 leader_election.cc:343] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.418145 15181 raft_consensus.cc:515] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:00.427652 14753 raft_consensus.cc:2393] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0cbbdf206b5458e9af48c22b862264a in current term 1: Already voted for candidate c95afda23abe49318972444cc68998a7 in this term.
I20260709 12:28:00.408550 14938 raft_consensus.cc:515] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.432991 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82a93abcc0d49fe8790a150daf9accc" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:00.435984 14878 raft_consensus.cc:359] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.436753 14878 raft_consensus.cc:385] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.437016 14878 raft_consensus.cc:740] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.439713 14877 tablet_bootstrap.cc:492] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:28:00.440238 14877 ts_tablet_manager.cc:1403] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.250s	user 0.011s	sys 0.001s
I20260709 12:28:00.442230 14878 consensus_queue.cc:260] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.419541 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd3630b48e04f27bb2a681c2b329e2f" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:00.453711 14682 raft_consensus.cc:2468] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:28:00.469616 14876 tablet_bootstrap.cc:492] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:28:00.470499 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:00.471366 14753 raft_consensus.cc:2393] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c0cbbdf206b5458e9af48c22b862264a in current term 1: Already voted for candidate c95afda23abe49318972444cc68998a7 in this term.
I20260709 12:28:00.470104 14876 ts_tablet_manager.cc:1403] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.180s	user 0.020s	sys 0.009s
I20260709 12:28:00.471992 14722 leader_election.cc:304] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:28:00.475692 15110 raft_consensus.cc:2804] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.476213 15110 raft_consensus.cc:493] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.476605 15110 raft_consensus.cc:3060] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:00.484478 14795 leader_election.cc:343] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.488675 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80b946940f485e813a69a1ed96c203" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:00.492107 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80b946940f485e813a69a1ed96c203" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
W20260709 12:28:00.495038 14574 leader_election.cc:343] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:00.511041 14573 leader_election.cc:343] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.512799 14976 raft_consensus.cc:493] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.513127 14573 leader_election.cc:304] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:28:00.513391 14976 raft_consensus.cc:515] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:00.495718 14938 leader_election.cc:290] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:00.498248 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:00.516569 14938 raft_consensus.cc:2749] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:00.496201 15193 consensus_queue.cc:1048] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20260709 12:28:00.517057 14680 raft_consensus.cc:2393] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c95afda23abe49318972444cc68998a7 in current term 1: Already voted for candidate c0cbbdf206b5458e9af48c22b862264a in this term.
I20260709 12:28:00.519711 14976 leader_election.cc:290] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:00.520071 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:00.499095 14605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:00.499405 14877 raft_consensus.cc:359] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.522258 14720 leader_election.cc:304] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:00.502024 14878 ts_tablet_manager.cc:1434] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.084s	user 0.008s	sys 0.000s
I20260709 12:28:00.523798 15108 raft_consensus.cc:2749] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:00.498332 15181 leader_election.cc:290] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
W20260709 12:28:00.524135 14573 leader_election.cc:343] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.523169 14877 raft_consensus.cc:385] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.524353 14878 tablet_bootstrap.cc:492] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:28:00.493479 15110 raft_consensus.cc:515] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.506683 14984 raft_consensus.cc:515] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.507302 14879 tablet_bootstrap.cc:492] T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:00.528761 14879 ts_tablet_manager.cc:1403] T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.246s	user 0.047s	sys 0.033s
I20260709 12:28:00.528650 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd3630b48e04f27bb2a681c2b329e2f" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:00.529227 14682 raft_consensus.cc:3060] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.529731 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:28:00.531106 14572 leader_election.cc:343] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.531522 14572 leader_election.cc:304] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7
I20260709 12:28:00.531705 14879 raft_consensus.cc:359] T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.532450 14879 raft_consensus.cc:385] T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.533869 14879 raft_consensus.cc:740] T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.534602 14879 consensus_queue.cc:260] T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.535665 14989 raft_consensus.cc:493] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.536171 14989 raft_consensus.cc:515] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.537107 14682 raft_consensus.cc:2468] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:00.537127 14879 ts_tablet_manager.cc:1434] T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:00.538235 14989 leader_election.cc:290] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:00.539405 14722 leader_election.cc:304] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:00.541077 15113 raft_consensus.cc:2804] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.541551 15113 raft_consensus.cc:697] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:00.542357 15113 consensus_queue.cc:237] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.539721 15110 leader_election.cc:290] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:00.543377 14879 tablet_bootstrap.cc:492] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:28:00.545550 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd3630b48e04f27bb2a681c2b329e2f" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:00.546326 14831 raft_consensus.cc:3060] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.548624 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb08a1bd554c4287aab87fc068c0039d" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:28:00.513006 14554 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:00.553088 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb08a1bd554c4287aab87fc068c0039d" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:00.525254 14877 raft_consensus.cc:740] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.535044 14938 raft_consensus.cc:2749] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:00.552552 14647 leader_election.cc:343] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.555542 14877 consensus_queue.cc:260] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.561098 14879 tablet_bootstrap.cc:654] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.561789 14877 ts_tablet_manager.cc:1434] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.121s	user 0.007s	sys 0.002s
I20260709 12:28:00.504868 14876 raft_consensus.cc:359] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:00.570123 14876 raft_consensus.cc:385] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.570595 14876 raft_consensus.cc:740] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.573815 15200 consensus_queue.cc:1048] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.574512 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82a93abcc0d49fe8790a150daf9accc" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
W20260709 12:28:00.574657 14649 leader_election.cc:343] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.575088 14682 raft_consensus.cc:3060] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.575202 14649 leader_election.cc:304] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:28:00.576418 15111 raft_consensus.cc:2749] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:00.583439 14976 raft_consensus.cc:493] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.584038 14976 raft_consensus.cc:515] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.586537 14976 leader_election.cc:290] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:00.588244 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c22c8f015eb4f498db641dca9ea7900" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
W20260709 12:28:00.590159 14574 leader_election.cc:343] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.592198 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c22c8f015eb4f498db641dca9ea7900" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:00.592943 14683 raft_consensus.cc:2468] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:28:00.594061 14573 leader_election.cc:304] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:28:00.595590 15112 raft_consensus.cc:2804] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.596004 15112 raft_consensus.cc:493] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:00.596338 15112 raft_consensus.cc:3060] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.597592 14682 raft_consensus.cc:2468] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:28:00.601744 14796 leader_election.cc:304] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:28:00.602720 15196 raft_consensus.cc:2804] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.603237 15196 raft_consensus.cc:697] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:28:00.604077 15196 consensus_queue.cc:237] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.611871 15181 consensus_queue.cc:1048] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:00.634555 14572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:42945, user_credentials={real_user=slave}} blocked reactor thread for 46941.6us
I20260709 12:28:00.635465 14984 leader_election.cc:290] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:00.606177 15112 raft_consensus.cc:515] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.641678 14877 tablet_bootstrap.cc:492] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:28:00.571504 14876 consensus_queue.cc:260] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:00.566947 14831 raft_consensus.cc:2468] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:00.659092 14876 ts_tablet_manager.cc:1434] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.186s	user 0.006s	sys 0.000s
I20260709 12:28:00.660478 14876 tablet_bootstrap.cc:492] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:00.663353 15196 consensus_queue.cc:1048] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.663573 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c22c8f015eb4f498db641dca9ea7900" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:00.664747 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c22c8f015eb4f498db641dca9ea7900" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
W20260709 12:28:00.665166 14574 leader_election.cc:343] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.668218 15112 leader_election.cc:290] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:00.665566 14682 raft_consensus.cc:3060] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.702837 14911 consensus_queue.cc:1048] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.637689 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a82a93abcc0d49fe8790a150daf9accc" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
W20260709 12:28:00.707783 14795 consensus_peers.cc:597] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:00.708007 14751 raft_consensus.cc:3060] T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.715672 14505 catalog_manager.cc:5697] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.722747 14878 tablet_bootstrap.cc:654] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.731168 14503 catalog_manager.cc:5697] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.748672 14682 raft_consensus.cc:2468] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:28:00.736837 14506 catalog_manager.cc:5697] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 0 to 1, leader changed from <none> to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 1 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:00.752707 14877 tablet_bootstrap.cc:654] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.754130 14573 leader_election.cc:304] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:28:00.762517 14938 raft_consensus.cc:2804] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.763062 14938 raft_consensus.cc:697] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:00.763892 14938 consensus_queue.cc:237] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.738644 15194 raft_consensus.cc:493] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.769937 15194 raft_consensus.cc:515] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.776139 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5cdf241a9849819398d5d313152db6" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:28:00.777907 14647 leader_election.cc:343] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:00.786226 14572 consensus_peers.cc:597] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:00.792479 14879 tablet_bootstrap.cc:492] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:00.793007 14879 ts_tablet_manager.cc:1403] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.250s	user 0.046s	sys 0.065s
I20260709 12:28:00.795565 14876 tablet_bootstrap.cc:654] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.796022 14879 raft_consensus.cc:359] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.799301 14879 raft_consensus.cc:385] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.799573 14879 raft_consensus.cc:740] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.802492 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5cdf241a9849819398d5d313152db6" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:00.800384 14879 consensus_queue.cc:260] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.805184 14879 ts_tablet_manager.cc:1434] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:28:00.806847 15071 consensus_queue.cc:1048] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.807860 15194 leader_election.cc:290] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
W20260709 12:28:00.810184 14649 leader_election.cc:343] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.814143 15111 consensus_queue.cc:1048] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.004s
I20260709 12:28:00.810657 14649 leader_election.cc:304] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:28:00.821532 15111 raft_consensus.cc:2749] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:00.836686 14751 raft_consensus.cc:2468] T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:28:00.846733 14878 tablet_bootstrap.cc:492] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:00.847301 14878 ts_tablet_manager.cc:1403] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.323s	user 0.012s	sys 0.004s
I20260709 12:28:00.853629 14506 catalog_manager.cc:5697] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:00.850060 14878 raft_consensus.cc:359] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.858043 14878 raft_consensus.cc:385] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.858449 14878 raft_consensus.cc:740] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.859259 14878 consensus_queue.cc:260] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.861974 14878 ts_tablet_manager.cc:1434] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.000s
I20260709 12:28:00.866426 14879 tablet_bootstrap.cc:492] T df4e4a9a715c4425a25afa8c34b1dd2a P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:28:00.870016 15113 raft_consensus.cc:493] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.871269 14878 tablet_bootstrap.cc:492] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:28:00.871803 14877 tablet_bootstrap.cc:492] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:28:00.872550 14877 ts_tablet_manager.cc:1403] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.310s	user 0.016s	sys 0.035s
I20260709 12:28:00.870571 15113 raft_consensus.cc:515] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.884912 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb08a1bd554c4287aab87fc068c0039d" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:00.885659 14680 raft_consensus.cc:2468] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:28:00.886449 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb08a1bd554c4287aab87fc068c0039d" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:00.886914 14722 leader_election.cc:304] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:00.884788 15113 leader_election.cc:290] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:00.888437 15110 raft_consensus.cc:2804] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:00.888809 15110 raft_consensus.cc:493] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:00.889040 14723 leader_election.cc:343] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.892223 14877 raft_consensus.cc:359] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.892951 14877 raft_consensus.cc:385] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.893198 14877 raft_consensus.cc:740] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.893376 14879 tablet_bootstrap.cc:654] T df4e4a9a715c4425a25afa8c34b1dd2a P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.897591 14877 consensus_queue.cc:260] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.889146 15110 raft_consensus.cc:3060] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.905879 14878 tablet_bootstrap.cc:654] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.910125 14877 ts_tablet_manager.cc:1434] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.037s	user 0.005s	sys 0.000s
I20260709 12:28:00.911352 14877 tablet_bootstrap.cc:492] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:28:00.912741 15110 raft_consensus.cc:515] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.916100 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb08a1bd554c4287aab87fc068c0039d" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:00.916657 15110 leader_election.cc:290] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:00.916898 14877 tablet_bootstrap.cc:654] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:00.917994 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb08a1bd554c4287aab87fc068c0039d" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:00.919647 14879 tablet_bootstrap.cc:492] T df4e4a9a715c4425a25afa8c34b1dd2a P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:00.916689 14680 raft_consensus.cc:3060] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:00.920306 14879 ts_tablet_manager.cc:1403] T df4e4a9a715c4425a25afa8c34b1dd2a P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.054s	user 0.012s	sys 0.006s
W20260709 12:28:00.919603 14723 leader_election.cc:343] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:00.939380 14879 raft_consensus.cc:359] T df4e4a9a715c4425a25afa8c34b1dd2a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:00.940115 14879 raft_consensus.cc:385] T df4e4a9a715c4425a25afa8c34b1dd2a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.940402 14879 raft_consensus.cc:740] T df4e4a9a715c4425a25afa8c34b1dd2a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.941203 14879 consensus_queue.cc:260] T df4e4a9a715c4425a25afa8c34b1dd2a P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:00.943809 14878 tablet_bootstrap.cc:492] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:00.944424 14878 ts_tablet_manager.cc:1403] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.081s	user 0.009s	sys 0.005s
I20260709 12:28:00.947732 14878 raft_consensus.cc:359] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.942919 14938 consensus_queue.cc:1048] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
I20260709 12:28:00.965329 15200 consensus_queue.cc:1048] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:00.916127 14876 tablet_bootstrap.cc:492] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:28:00.972100 14876 ts_tablet_manager.cc:1403] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.312s	user 0.017s	sys 0.003s
I20260709 12:28:00.970570 14680 raft_consensus.cc:2468] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:00.948503 14878 raft_consensus.cc:385] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:00.975103 14722 leader_election.cc:304] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:28:00.975519 14878 raft_consensus.cc:740] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:00.976451 15113 raft_consensus.cc:2804] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:00.976361 14878 consensus_queue.cc:260] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:00.978112 15113 raft_consensus.cc:697] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:00.981428 15113 consensus_queue.cc:237] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:00.971076 14938 raft_consensus.cc:493] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:00.985126 14938 raft_consensus.cc:515] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:00.993418 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2429c63bff3418fa4b6e9e734cc5b04" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:00.987780 14878 ts_tablet_manager.cc:1434] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.000s
I20260709 12:28:00.988648 14879 ts_tablet_manager.cc:1434] T df4e4a9a715c4425a25afa8c34b1dd2a P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.068s	user 0.004s	sys 0.003s
I20260709 12:28:00.995424 14879 tablet_bootstrap.cc:492] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7: Bootstrap starting.
W20260709 12:28:00.996587 14572 leader_election.cc:343] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.000010 14878 tablet_bootstrap.cc:492] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:28:01.004235 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2429c63bff3418fa4b6e9e734cc5b04" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
W20260709 12:28:01.005757 14574 leader_election.cc:343] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.006327 14574 leader_election.cc:304] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:28:01.007179 15105 raft_consensus.cc:2749] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:01.008060 14938 leader_election.cc:290] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:01.008764 15200 consensus_queue.cc:1048] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:01.014602 14938 consensus_queue.cc:1048] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:01.015684 15070 raft_consensus.cc:493] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.016330 15070 raft_consensus.cc:515] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:01.018862 15070 leader_election.cc:290] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:01.021271 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c22c8f015eb4f498db641dca9ea7900" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:01.022025 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c22c8f015eb4f498db641dca9ea7900" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:01.023145 14683 raft_consensus.cc:2393] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 420d5d7b2b504ff7923b7f4098c0fcce in current term 1: Already voted for candidate c0cbbdf206b5458e9af48c22b862264a in this term.
I20260709 12:28:01.025468 14879 tablet_bootstrap.cc:654] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.032879 14878 tablet_bootstrap.cc:654] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.039036 14796 leader_election.cc:304] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:01.040733 15070 raft_consensus.cc:3060] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.051783 14876 raft_consensus.cc:359] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:01.052762 14876 raft_consensus.cc:385] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.053071 14876 raft_consensus.cc:740] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.065353 14984 consensus_queue.cc:1048] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:01.069495 14876 consensus_queue.cc:260] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:01.070648 14878 tablet_bootstrap.cc:492] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:01.071182 14878 ts_tablet_manager.cc:1403] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.072s	user 0.014s	sys 0.000s
I20260709 12:28:01.079854 14878 raft_consensus.cc:359] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:01.080756 14878 raft_consensus.cc:385] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.083339 14878 raft_consensus.cc:740] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.085558 14876 ts_tablet_manager.cc:1434] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.106s	user 0.005s	sys 0.002s
I20260709 12:28:01.084817 14878 consensus_queue.cc:260] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:01.089200 14878 ts_tablet_manager.cc:1434] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.018s	user 0.007s	sys 0.000s
I20260709 12:28:01.090484 14878 tablet_bootstrap.cc:492] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:28:01.093593 15070 raft_consensus.cc:2749] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:01.121299 14876 tablet_bootstrap.cc:492] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:01.122000 14877 tablet_bootstrap.cc:492] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:28:01.122709 14877 ts_tablet_manager.cc:1403] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.212s	user 0.069s	sys 0.025s
I20260709 12:28:01.124048 14879 tablet_bootstrap.cc:492] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:01.124642 14879 ts_tablet_manager.cc:1403] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.129s	user 0.015s	sys 0.011s
I20260709 12:28:01.127831 14879 raft_consensus.cc:359] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:01.128588 14879 raft_consensus.cc:385] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.128872 14879 raft_consensus.cc:740] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.128981 14876 tablet_bootstrap.cc:654] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.129575 14878 tablet_bootstrap.cc:654] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.132761 14879 consensus_queue.cc:260] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:01.136970 14879 ts_tablet_manager.cc:1434] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.012s	user 0.003s	sys 0.006s
I20260709 12:28:01.137238 14877 raft_consensus.cc:359] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:01.138002 14877 raft_consensus.cc:385] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.138094 14879 tablet_bootstrap.cc:492] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:28:01.138317 14877 raft_consensus.cc:740] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.139290 14877 consensus_queue.cc:260] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:01.141691 14877 ts_tablet_manager.cc:1434] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.019s	user 0.005s	sys 0.000s
I20260709 12:28:01.143256 14877 tablet_bootstrap.cc:492] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:28:01.151084 15070 raft_consensus.cc:493] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.152097 14877 tablet_bootstrap.cc:654] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.151892 15070 raft_consensus.cc:515] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:01.158500 15070 leader_election.cc:290] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:01.162024 14878 tablet_bootstrap.cc:492] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:01.162839 14878 ts_tablet_manager.cc:1403] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.073s	user 0.015s	sys 0.000s
I20260709 12:28:01.166620 14878 raft_consensus.cc:359] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:01.170768 14878 raft_consensus.cc:385] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.171268 14878 raft_consensus.cc:740] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.171471 14879 tablet_bootstrap.cc:654] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.170351 14876 tablet_bootstrap.cc:492] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:28:01.172217 14878 consensus_queue.cc:260] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:01.173070 14876 ts_tablet_manager.cc:1403] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.052s	user 0.016s	sys 0.029s
I20260709 12:28:01.174957 14878 ts_tablet_manager.cc:1434] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.000s
I20260709 12:28:01.175161 14752 raft_consensus.cc:3060] T df4e4a9a715c4425a25afa8c34b1dd2a P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.176102 14878 tablet_bootstrap.cc:492] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:28:01.185573 14878 tablet_bootstrap.cc:654] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.189672 14877 tablet_bootstrap.cc:492] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:28:01.190289 14877 ts_tablet_manager.cc:1403] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.047s	user 0.011s	sys 0.005s
I20260709 12:28:01.193317 14877 raft_consensus.cc:359] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:01.194064 14877 raft_consensus.cc:385] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.194334 14877 raft_consensus.cc:740] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.195055 14877 consensus_queue.cc:260] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:01.197636 14877 ts_tablet_manager.cc:1434] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:01.198818 14877 tablet_bootstrap.cc:492] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:28:01.205516 14877 tablet_bootstrap.cc:654] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.219564 14877 tablet_bootstrap.cc:492] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:28:01.220181 14877 ts_tablet_manager.cc:1403] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.012s
W20260709 12:28:01.221030 14574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:35543, user_credentials={real_user=slave}} blocked reactor thread for 148796us
W20260709 12:28:01.224057 14573 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:46705, user_credentials={real_user=slave}} blocked reactor thread for 150609us
I20260709 12:28:01.225360 14876 raft_consensus.cc:359] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:01.226115 14876 raft_consensus.cc:385] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.226380 14876 raft_consensus.cc:740] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.227139 14876 consensus_queue.cc:260] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:01.237075 14938 raft_consensus.cc:493] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.237641 14938 raft_consensus.cc:515] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:01.250311 14938 leader_election.cc:290] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:01.253471 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318e36a972bd4f25a06acdfea9b1bfe9" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:01.254325 14829 raft_consensus.cc:2468] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:28:01.256348 14574 leader_election.cc:304] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:01.257323 14938 raft_consensus.cc:2804] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:01.257688 14938 raft_consensus.cc:493] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:01.258006 14938 raft_consensus.cc:3060] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.274264 14756 raft_consensus.cc:3060] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.270566 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb08a1bd554c4287aab87fc068c0039d" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:01.302963 14984 raft_consensus.cc:493] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.303548 14984 raft_consensus.cc:515] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:01.319293 14976 raft_consensus.cc:493] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.323582 15112 consensus_queue.cc:1048] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:01.461303 15111 raft_consensus.cc:493] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.465251 15111 raft_consensus.cc:515] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:01.542912 14877 raft_consensus.cc:359] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:01.543710 14877 raft_consensus.cc:385] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.544008 14877 raft_consensus.cc:740] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.544834 15194 raft_consensus.cc:493] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:01.545431 15194 raft_consensus.cc:515] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:01.268460 14504 catalog_manager.cc:5697] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:01.551152 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318e36a972bd4f25a06acdfea9b1bfe9" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:01.551909 14682 raft_consensus.cc:2468] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:28:01.554672 14976 raft_consensus.cc:515] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:01.557461 14976 leader_election.cc:290] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:01.561476 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "645a95a66395468daa1986ee77838eaa" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:01.567320 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "645a95a66395468daa1986ee77838eaa" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
W20260709 12:28:01.593339 14574 leader_election.cc:343] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.593634 14830 raft_consensus.cc:3060] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:01.626921 15238 log.cc:927] Time spent T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7: Append to log took a long time: real 0.050s	user 0.000s	sys 0.000s
I20260709 12:28:01.629916 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bb08a1bd554c4287aab87fc068c0039d" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:01.630839 14682 raft_consensus.cc:2393] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 420d5d7b2b504ff7923b7f4098c0fcce in current term 1: Already voted for candidate c95afda23abe49318972444cc68998a7 in this term.
I20260709 12:28:01.655094 14878 tablet_bootstrap.cc:492] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:01.655771 14878 ts_tablet_manager.cc:1403] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.480s	user 0.046s	sys 0.036s
W20260709 12:28:01.706938 14794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:39063, user_credentials={real_user=slave}} blocked reactor thread for 49191.5us
I20260709 12:28:01.713126 14984 leader_election.cc:290] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:01.716648 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca6238c0f244dd1a911e44a703e0f8b" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:01.717489 14608 raft_consensus.cc:2468] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 0.
W20260709 12:28:01.718417 14573 leader_election.cc:343] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.718741 14911 consensus_queue.cc:1048] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:01.719012 14573 leader_election.cc:304] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:28:01.722517 15233 raft_consensus.cc:2749] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:01.714352 14878 raft_consensus.cc:359] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:01.727078 14878 raft_consensus.cc:385] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.727380 14878 raft_consensus.cc:740] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.729996 14878 consensus_queue.cc:260] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:01.747161 14878 ts_tablet_manager.cc:1434] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.091s	user 0.008s	sys 0.000s
W20260709 12:28:01.753651 14795 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:42945, user_credentials={real_user=slave}} blocked reactor thread for 75275.6us
W20260709 12:28:01.752539 14722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:46705, user_credentials={real_user=slave}} blocked reactor thread for 99587.2us
I20260709 12:28:01.736224 14794 leader_election.cc:304] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:01.769682 14752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca6238c0f244dd1a911e44a703e0f8b" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:01.763825 15241 raft_consensus.cc:493] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
W20260709 12:28:01.772054 14795 leader_election.cc:343] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.770812 15241 raft_consensus.cc:515] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
W20260709 12:28:01.779735 14646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:39063, user_credentials={real_user=slave}} blocked reactor thread for 102501us
I20260709 12:28:01.785827 15194 leader_election.cc:290] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:01.778617 15247 consensus_queue.cc:1048] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.022s
I20260709 12:28:01.797302 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80b946940f485e813a69a1ed96c203" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:01.807058 14608 raft_consensus.cc:2468] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:28:01.813253 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80b946940f485e813a69a1ed96c203" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:01.815680 14879 tablet_bootstrap.cc:492] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:01.816272 14879 ts_tablet_manager.cc:1403] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.678s	user 0.046s	sys 0.039s
I20260709 12:28:01.803628 15242 consensus_queue.cc:1048] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.015s
I20260709 12:28:01.814004 14646 leader_election.cc:304] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
W20260709 12:28:01.793660 14720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:39063, user_credentials={real_user=slave}} blocked reactor thread for 123847us
I20260709 12:28:01.835041 15210 raft_consensus.cc:2804] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:01.836607 15210 raft_consensus.cc:493] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:01.837193 15210 raft_consensus.cc:3060] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.841562 15245 consensus_queue.cc:1048] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:28:01.829113 14796 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:46705, user_credentials={real_user=slave}} blocked reactor thread for 57856.6us
I20260709 12:28:01.844899 14796 leader_election.cc:304] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7
W20260709 12:28:01.848982 14938 consensus_meta.cc:287] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a: Time spent flushing consensus metadata: real 0.591s	user 0.012s	sys 0.000s
W20260709 12:28:01.836531 14649 leader_election.cc:343] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.851766 14938 raft_consensus.cc:515] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:01.859453 14879 raft_consensus.cc:359] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:01.860579 14879 raft_consensus.cc:385] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:01.860862 14879 raft_consensus.cc:740] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:01.862900 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318e36a972bd4f25a06acdfea9b1bfe9" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:01.863533 14831 raft_consensus.cc:3060] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.864682 15111 leader_election.cc:290] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:01.865855 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:28:01.867823 14647 leader_election.cc:343] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.867983 15255 raft_consensus.cc:2749] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:01.869606 14938 leader_election.cc:290] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:01.872748 14831 raft_consensus.cc:2468] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:28:01.874292 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:01.875155 14607 raft_consensus.cc:2468] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:28:01.883846 14646 leader_election.cc:304] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:28:01.889410 15237 raft_consensus.cc:2804] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:28:01.889705 15252 log.cc:927] Time spent T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7: Append to log took a long time: real 0.112s	user 0.001s	sys 0.000s
I20260709 12:28:01.890189 14574 leader_election.cc:304] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:01.891865 15112 raft_consensus.cc:2804] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:01.892457 15112 raft_consensus.cc:697] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:01.893280 15112 consensus_queue.cc:237] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:01.894338 15237 raft_consensus.cc:493] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:01.894802 15237 raft_consensus.cc:3060] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.885962 14879 consensus_queue.cc:260] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:01.902204 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318e36a972bd4f25a06acdfea9b1bfe9" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:01.903059 14680 raft_consensus.cc:3060] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:01.912490 14876 thread.cc:641] raft [worker] (thread pool) Time spent creating pthread: real 0.684s	user 0.027s	sys 0.026s
W20260709 12:28:01.912889 14876 thread.cc:608] raft [worker] (thread pool) Time spent starting thread: real 0.685s	user 0.028s	sys 0.026s
I20260709 12:28:01.914502 14876 ts_tablet_manager.cc:1434] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.741s	user 0.033s	sys 0.026s
W20260709 12:28:01.914776 14876 ts_tablet_manager.cc:1467] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a: Tablet startup took 741ms
W20260709 12:28:01.915050 14876 ts_tablet_manager.cc:1469] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a: Trace:
0709 12:27:55.911590 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:55.911945 (+   355us) service_pool.cc:224] Handling call
0709 12:27:55.918319 (+  6374us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:27:55.918422 (+   103us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:27:55.934126 (+ 15704us) tablet_metadata.cc:665] Metadata flushed
0709 12:27:56.041043 (+106917us) tablet_replica.cc:206] Creating consensus instance
0709 12:27:56.066734 (+ 25691us) inbound_call.cc:177] Queueing success response
0709 12:28:01.120870 (+5054136us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:28:01.173404 (+ 52534us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:28:01.173940 (+   536us) tablet_replica.cc:261] Starting instrumentation
0709 12:28:01.174521 (+   581us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":49128,"raft.queue_time_us":3319,"raft.run_cpu_time_us":126,"raft.run_wall_time_us":126,"tablet-open.queue_time_us":5068512,"thread_start_us":685013,"threads_started":1}
I20260709 12:28:01.909555 15210 raft_consensus.cc:515] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:01.919996 15210 leader_election.cc:290] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:01.920209 14876 tablet_bootstrap.cc:492] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:01.923096 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80b946940f485e813a69a1ed96c203" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:01.899001 15251 raft_consensus.cc:2804] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:01.924533 15251 raft_consensus.cc:493] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:01.924880 15251 raft_consensus.cc:3060] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:01.926178 14649 leader_election.cc:343] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:01.927443 15241 leader_election.cc:290] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:01.928967 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:01.929594 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80b946940f485e813a69a1ed96c203" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:01.930171 14607 raft_consensus.cc:3060] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:01.922065 14877 consensus_queue.cc:260] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:01.933096 14877 ts_tablet_manager.cc:1434] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.713s	user 0.010s	sys 0.001s
W20260709 12:28:01.945284 14877 ts_tablet_manager.cc:1467] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f: Tablet startup took 724ms
W20260709 12:28:01.945715 14877 ts_tablet_manager.cc:1469] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f: Trace:
0709 12:27:55.868278 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:27:55.890092 (+ 21814us) service_pool.cc:224] Handling call
0709 12:27:55.906498 (+ 16406us) ts_tablet_manager.cc:669] Acquired tablet manager lock
0709 12:27:55.906599 (+   101us) ts_tablet_manager.cc:682] Creating new metadata...
0709 12:27:55.935241 (+ 28642us) tablet_metadata.cc:665] Metadata flushed
0709 12:27:55.941058 (+  5817us) tablet_replica.cc:206] Creating consensus instance
0709 12:27:55.941418 (+   360us) inbound_call.cc:177] Queueing success response
0709 12:28:01.198365 (+5256947us) ts_tablet_manager.cc:1379] Bootstrapping tablet
0709 12:28:01.220472 (+ 22107us) ts_tablet_manager.cc:1435] Starting tablet replica
0709 12:28:01.221042 (+   570us) tablet_replica.cc:261] Starting instrumentation
0709 12:28:01.221709 (+   667us) tablet_replica.cc:280] Starting consensus
Metrics: {"mutex_wait_us":46153,"raft.queue_time_us":1054,"raft.run_cpu_time_us":94,"raft.run_wall_time_us":94,"tablet-open.queue_time_us":5256969}
I20260709 12:28:01.948246 14877 tablet_bootstrap.cc:492] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:28:01.933771 15237 raft_consensus.cc:515] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:01.934664 14878 tablet_bootstrap.cc:492] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:28:01.956050 14879 ts_tablet_manager.cc:1434] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.139s	user 0.006s	sys 0.001s
I20260709 12:28:01.935508 14680 raft_consensus.cc:2468] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:28:01.937058 14607 raft_consensus.cc:2468] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:01.938328 14876 tablet_bootstrap.cc:654] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:01.952714 14679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:01.962167 14646 leader_election.cc:304] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:28:01.963078 14989 raft_consensus.cc:2804] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:01.963661 14989 raft_consensus.cc:697] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:01.964545 14989 consensus_queue.cc:237] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:01.981277 15237 leader_election.cc:290] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:01.987504 14879 tablet_bootstrap.cc:492] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:28:02.020324 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:02.021013 14607 raft_consensus.cc:3060] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.018242 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:02.026446 15237 raft_consensus.cc:493] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.040407 14877 tablet_bootstrap.cc:654] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.018441 14722 leader_election.cc:304] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:02.045567 15200 raft_consensus.cc:2749] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:02.056941 15237 raft_consensus.cc:515] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.068778 15237 leader_election.cc:290] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:02.056849 15251 raft_consensus.cc:515] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.081969 14876 tablet_bootstrap.cc:492] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
W20260709 12:28:02.082125 14554 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:02.083029 14876 ts_tablet_manager.cc:1403] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.163s	user 0.019s	sys 0.004s
I20260709 12:28:02.065560 14607 raft_consensus.cc:2468] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:02.083858 14878 tablet_bootstrap.cc:654] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.086258 14646 leader_election.cc:304] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:02.088313 14879 tablet_bootstrap.cc:654] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.094807 15251 leader_election.cc:290] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:02.096068 14607 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca6238c0f244dd1a911e44a703e0f8b" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:02.096717 14607 raft_consensus.cc:3060] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.100790 14877 tablet_bootstrap.cc:492] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:28:02.102139 14877 ts_tablet_manager.cc:1403] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.154s	user 0.016s	sys 0.002s
I20260709 12:28:02.086905 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca6238c0f244dd1a911e44a703e0f8b" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:02.105811 14607 raft_consensus.cc:2468] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:28:02.092602 15237 raft_consensus.cc:2804] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.103462 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f54d9f158426396fa7e71a63ce964" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:02.116106 15243 raft_consensus.cc:493] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.116833 15243 raft_consensus.cc:515] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
W20260709 12:28:02.118036 14647 leader_election.cc:343] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.137899 14876 raft_consensus.cc:359] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.138897 14876 raft_consensus.cc:385] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.139194 14876 raft_consensus.cc:740] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.139961 14876 consensus_queue.cc:260] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.141796 14794 leader_election.cc:304] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:02.122008 15237 raft_consensus.cc:697] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:02.143128 15251 raft_consensus.cc:2804] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.143608 15237 consensus_queue.cc:237] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.143640 15251 raft_consensus.cc:697] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:28:02.152661 14876 ts_tablet_manager.cc:1434] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.069s	user 0.007s	sys 0.001s
W20260709 12:28:02.156164 14647 leader_election.cc:343] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.156328 15246 raft_consensus.cc:493] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.156958 15246 raft_consensus.cc:515] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
W20260709 12:28:02.161240 15267 log.cc:927] Time spent T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce: Append to log took a long time: real 0.054s	user 0.002s	sys 0.000s
W20260709 12:28:02.163754 14795 leader_election.cc:343] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.166973 15251 consensus_queue.cc:237] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.169479 14876 tablet_bootstrap.cc:492] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:02.161541 14877 raft_consensus.cc:359] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.175325 14877 raft_consensus.cc:385] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.175612 14877 raft_consensus.cc:740] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.176223 14877 consensus_queue.cc:260] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.179109 15243 leader_election.cc:290] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:02.187014 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f54d9f158426396fa7e71a63ce964" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:02.187608 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2429c63bff3418fa4b6e9e734cc5b04" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:02.188452 14829 raft_consensus.cc:2468] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:28:02.187124 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2429c63bff3418fa4b6e9e734cc5b04" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:02.190155 14608 raft_consensus.cc:2468] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:28:02.195287 15246 leader_election.cc:290] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:02.197090 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2429c63bff3418fa4b6e9e734cc5b04" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:02.197841 14751 raft_consensus.cc:2468] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 0.
I20260709 12:28:02.199491 14795 leader_election.cc:304] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:02.201915 15246 raft_consensus.cc:2804] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:02.202317 15246 raft_consensus.cc:493] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.202667 15246 raft_consensus.cc:3060] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:02.208595 14646 leader_election.cc:343] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.209085 14646 leader_election.cc:304] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:28:02.209684 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2429c63bff3418fa4b6e9e734cc5b04" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:02.209951 15209 raft_consensus.cc:2749] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.210506 14608 raft_consensus.cc:2468] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 0.
I20260709 12:28:02.197139 14720 leader_election.cc:304] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:02.224906 15108 raft_consensus.cc:2804] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:02.224666 15246 raft_consensus.cc:515] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.225356 15108 raft_consensus.cc:493] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.225725 15108 raft_consensus.cc:3060] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.227710 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2429c63bff3418fa4b6e9e734cc5b04" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:02.231406 14877 ts_tablet_manager.cc:1434] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.129s	user 0.005s	sys 0.001s
I20260709 12:28:02.232671 14877 tablet_bootstrap.cc:492] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:28:02.229813 15209 raft_consensus.cc:493] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.244498 15209 raft_consensus.cc:515] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.251096 14506 catalog_manager.cc:5697] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:02.258186 15209 leader_election.cc:290] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:02.260154 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596dc92cc2c45838a165addea430360" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:28:02.262035 14647 leader_election.cc:343] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.262336 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596dc92cc2c45838a165addea430360" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:02.264464 14608 raft_consensus.cc:2468] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:28:02.267095 14876 tablet_bootstrap.cc:654] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.267652 14646 leader_election.cc:304] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:28:02.268622 15209 raft_consensus.cc:2804] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:02.269027 15209 raft_consensus.cc:493] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.269371 15209 raft_consensus.cc:3060] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.275516 15246 leader_election.cc:290] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:02.276351 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2429c63bff3418fa4b6e9e734cc5b04" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:02.277212 14608 raft_consensus.cc:3060] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:02.284847 14723 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:35543, user_credentials={real_user=slave}} blocked reactor thread for 84734.7us
I20260709 12:28:02.286671 14877 tablet_bootstrap.cc:654] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.288189 15108 raft_consensus.cc:515] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.291028 14751 raft_consensus.cc:2393] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 420d5d7b2b504ff7923b7f4098c0fcce in current term 1: Already voted for candidate c95afda23abe49318972444cc68998a7 in this term.
I20260709 12:28:02.292949 14879 tablet_bootstrap.cc:492] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:02.293498 14879 ts_tablet_manager.cc:1403] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.306s	user 0.020s	sys 0.011s
I20260709 12:28:02.296689 14608 raft_consensus.cc:2468] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:28:02.314872 14878 tablet_bootstrap.cc:492] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:02.315455 14878 ts_tablet_manager.cc:1403] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.381s	user 0.019s	sys 0.007s
I20260709 12:28:02.316064 14794 leader_election.cc:304] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:28:02.310678 15235 consensus_queue.cc:1048] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.008s
I20260709 12:28:02.319428 14879 raft_consensus.cc:359] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:02.320135 14879 raft_consensus.cc:385] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.320405 14879 raft_consensus.cc:740] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.321014 14879 consensus_queue.cc:260] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:02.325480 14879 ts_tablet_manager.cc:1434] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.032s	user 0.007s	sys 0.000s
I20260709 12:28:02.325959 15112 consensus_queue.cc:1048] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:02.326848 14503 catalog_manager.cc:5697] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 0 to 1, leader changed from <none> to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 1 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:02.335037 14879 tablet_bootstrap.cc:492] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:28:02.339723 14878 raft_consensus.cc:359] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:02.340440 14878 raft_consensus.cc:385] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.340731 14878 raft_consensus.cc:740] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.341449 14878 consensus_queue.cc:260] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:02.343781 14878 ts_tablet_manager.cc:1434] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.028s	user 0.003s	sys 0.004s
I20260709 12:28:02.344764 14878 tablet_bootstrap.cc:492] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:28:02.345134 15196 raft_consensus.cc:2804] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.344568 14504 catalog_manager.cc:5697] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:02.345660 15196 raft_consensus.cc:697] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:28:02.346500 15196 consensus_queue.cc:237] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.346490 14504 catalog_manager.cc:5697] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:02.358248 15108 leader_election.cc:290] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:02.364148 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2429c63bff3418fa4b6e9e734cc5b04" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:02.365226 14608 raft_consensus.cc:2393] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate c95afda23abe49318972444cc68998a7 in current term 1: Already voted for candidate 420d5d7b2b504ff7923b7f4098c0fcce in this term.
I20260709 12:28:02.371023 15209 raft_consensus.cc:515] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.386245 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596dc92cc2c45838a165addea430360" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
W20260709 12:28:02.388375 14647 leader_election.cc:343] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.389698 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c2429c63bff3418fa4b6e9e734cc5b04" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:02.390436 15209 leader_election.cc:290] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:02.394131 14723 leader_election.cc:304] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:02.397359 14878 tablet_bootstrap.cc:654] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.405376 15241 raft_consensus.cc:2749] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.410115 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596dc92cc2c45838a165addea430360" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:02.410791 14608 raft_consensus.cc:3060] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.410135 14876 tablet_bootstrap.cc:492] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:28:02.413278 14876 ts_tablet_manager.cc:1403] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.244s	user 0.014s	sys 0.005s
I20260709 12:28:02.414491 14879 tablet_bootstrap.cc:654] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.420696 14876 raft_consensus.cc:359] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.421430 14876 raft_consensus.cc:385] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.421698 14876 raft_consensus.cc:740] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.428012 15194 consensus_queue.cc:1048] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:02.422421 14876 consensus_queue.cc:260] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.432049 14876 ts_tablet_manager.cc:1434] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.018s	user 0.005s	sys 0.000s
I20260709 12:28:02.433267 14876 tablet_bootstrap.cc:492] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:02.437871 15241 raft_consensus.cc:493] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.437474 15237 raft_consensus.cc:493] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.438390 15241 raft_consensus.cc:515] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:02.439052 15237 raft_consensus.cc:515] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:02.440768 15241 leader_election.cc:290] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:02.441110 15237 leader_election.cc:290] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:02.437472 14503 catalog_manager.cc:5697] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 0 to 1, leader changed from <none> to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 1 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:02.442309 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5cdf241a9849819398d5d313152db6" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:02.442754 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5cdf241a9849819398d5d313152db6" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:02.443032 14680 raft_consensus.cc:2468] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
W20260709 12:28:02.444226 14649 leader_election.cc:343] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.444994 14722 leader_election.cc:304] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:02.452826 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5cdf241a9849819398d5d313152db6" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:02.448989 15241 raft_consensus.cc:2804] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:02.458212 15241 raft_consensus.cc:493] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.461074 14876 tablet_bootstrap.cc:654] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.461454 15241 raft_consensus.cc:3060] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.465030 14877 tablet_bootstrap.cc:492] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:28:02.465668 14877 ts_tablet_manager.cc:1403] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.233s	user 0.036s	sys 0.042s
I20260709 12:28:02.460942 14608 raft_consensus.cc:2468] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:02.468312 14646 leader_election.cc:304] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:28:02.468566 14877 raft_consensus.cc:359] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:02.469307 14877 raft_consensus.cc:385] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.469601 14877 raft_consensus.cc:740] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
W20260709 12:28:02.470208 14649 consensus_peers.cc:597] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f -> Peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Couldn't send request to peer 420d5d7b2b504ff7923b7f4098c0fcce. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.472697 15237 raft_consensus.cc:2804] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.473320 15237 raft_consensus.cc:697] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:02.473562 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5cdf241a9849819398d5d313152db6" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:02.474218 15237 consensus_queue.cc:237] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.476377 14877 consensus_queue.cc:260] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:02.478865 14879 tablet_bootstrap.cc:492] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:02.479432 14879 ts_tablet_manager.cc:1403] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.145s	user 0.010s	sys 0.004s
I20260709 12:28:02.483937 14877 ts_tablet_manager.cc:1434] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.001s
I20260709 12:28:02.484964 14877 tablet_bootstrap.cc:492] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:28:02.482296 14879 raft_consensus.cc:359] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.491261 14879 raft_consensus.cc:385] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.491746 14879 raft_consensus.cc:740] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.492393 14879 consensus_queue.cc:260] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.495868 15209 raft_consensus.cc:493] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.496505 15209 raft_consensus.cc:515] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
W20260709 12:28:02.479490 14723 leader_election.cc:343] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.506892 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f4c8c6619b4856afad5d98d9cec315" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:28:02.509406 14647 leader_election.cc:343] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.515836 15209 leader_election.cc:290] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:02.516431 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f4c8c6619b4856afad5d98d9cec315" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:02.517086 14876 tablet_bootstrap.cc:492] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:28:02.517513 14876 ts_tablet_manager.cc:1403] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.085s	user 0.009s	sys 0.001s
I20260709 12:28:02.522221 14829 raft_consensus.cc:2468] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:28:02.523336 14649 leader_election.cc:304] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:28:02.524454 15237 raft_consensus.cc:2804] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:02.524863 15237 raft_consensus.cc:493] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.525167 15237 raft_consensus.cc:3060] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.525777 14878 tablet_bootstrap.cc:492] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
W20260709 12:28:02.526878 14723 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:35543, user_credentials={real_user=slave}} blocked reactor thread for 47437.9us
I20260709 12:28:02.527122 14878 ts_tablet_manager.cc:1403] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.183s	user 0.016s	sys 0.010s
I20260709 12:28:02.533233 15237 raft_consensus.cc:515] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:02.536237 14755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f4c8c6619b4856afad5d98d9cec315" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:02.536847 14503 catalog_manager.cc:5697] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:02.540040 14877 tablet_bootstrap.cc:654] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.542577 15241 raft_consensus.cc:515] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:02.524274 14876 raft_consensus.cc:359] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
W20260709 12:28:02.537657 14647 leader_election.cc:343] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.539232 14879 ts_tablet_manager.cc:1434] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.059s	user 0.007s	sys 0.000s
I20260709 12:28:02.543704 14876 raft_consensus.cc:385] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.544854 14876 raft_consensus.cc:740] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.545634 14756 raft_consensus.cc:2393] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a105adb44fb47078d6cb03a6c02026f in current term 1: Already voted for candidate c95afda23abe49318972444cc68998a7 in this term.
I20260709 12:28:02.549788 14879 tablet_bootstrap.cc:492] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:28:02.551998 14876 consensus_queue.cc:260] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.554698 14647 leader_election.cc:304] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:28:02.555946 15210 raft_consensus.cc:3060] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.559316 15241 leader_election.cc:290] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:02.560480 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5cdf241a9849819398d5d313152db6" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:02.562354 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5cdf241a9849819398d5d313152db6" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:02.566140 14878 raft_consensus.cc:359] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:02.569108 14878 raft_consensus.cc:385] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.563580 14876 ts_tablet_manager.cc:1434] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.046s	user 0.007s	sys 0.001s
I20260709 12:28:02.570555 14876 tablet_bootstrap.cc:492] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
W20260709 12:28:02.571013 14723 leader_election.cc:343] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.569443 14878 raft_consensus.cc:740] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
W20260709 12:28:02.572409 14778 debug-util.cc:398] Leaking SignalData structure 0x7b08001086a0 after lost signal to thread 4824
I20260709 12:28:02.573107 14878 consensus_queue.cc:260] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
W20260709 12:28:02.573571 14778 debug-util.cc:398] Leaking SignalData structure 0x7b080014ad20 after lost signal to thread 14540
I20260709 12:28:02.577607 14879 tablet_bootstrap.cc:654] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:02.578296 14778 debug-util.cc:398] Leaking SignalData structure 0x7b080022f500 after lost signal to thread 14632
I20260709 12:28:02.578584 14878 ts_tablet_manager.cc:1434] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.051s	user 0.006s	sys 0.001s
I20260709 12:28:02.579523 14878 tablet_bootstrap.cc:492] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
W20260709 12:28:02.579537 14778 debug-util.cc:398] Leaking SignalData structure 0x7b0800337ea0 after lost signal to thread 14707
I20260709 12:28:02.580498 14876 tablet_bootstrap.cc:654] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:02.581050 14778 debug-util.cc:398] Leaking SignalData structure 0x7b08001f8aa0 after lost signal to thread 14781
W20260709 12:28:02.582271 14778 debug-util.cc:398] Leaking SignalData structure 0x7b08002f4ae0 after lost signal to thread 14855
I20260709 12:28:02.576300 15210 raft_consensus.cc:2749] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.592129 14878 tablet_bootstrap.cc:654] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:02.587849 14778 debug-util.cc:398] Leaking SignalData structure 0x7b08000e6c80 after lost signal to thread 14878
I20260709 12:28:02.622598 14683 raft_consensus.cc:2468] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:02.624719 14877 tablet_bootstrap.cc:492] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:28:02.625725 15237 leader_election.cc:290] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:02.627204 14877 ts_tablet_manager.cc:1403] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.142s	user 0.004s	sys 0.016s
I20260709 12:28:02.628743 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f4c8c6619b4856afad5d98d9cec315" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:02.629550 14829 raft_consensus.cc:3060] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.630908 14878 tablet_bootstrap.cc:492] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:02.631417 14878 ts_tablet_manager.cc:1403] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.052s	user 0.021s	sys 0.002s
I20260709 12:28:02.632794 14722 leader_election.cc:304] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:28:02.636811 15241 raft_consensus.cc:2804] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.637367 15241 raft_consensus.cc:697] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
W20260709 12:28:02.611241 14778 debug-util.cc:398] Leaking SignalData structure 0x7b0800136dc0 after lost signal to thread 14997
W20260709 12:28:02.638419 14778 debug-util.cc:398] Leaking SignalData structure 0x7b080014dbe0 after lost signal to thread 15018
I20260709 12:28:02.638263 15241 consensus_queue.cc:237] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
W20260709 12:28:02.639062 14778 debug-util.cc:398] Leaking SignalData structure 0x7b0800136ca0 after lost signal to thread 15110
W20260709 12:28:02.639400 14778 debug-util.cc:398] Leaking SignalData structure 0x7b08001497e0 after lost signal to thread 15138
W20260709 12:28:02.639628 14778 debug-util.cc:398] Leaking SignalData structure 0x7b0800136960 after lost signal to thread 15141
W20260709 12:28:02.639875 14778 debug-util.cc:398] Leaking SignalData structure 0x7b08001ec7c0 after lost signal to thread 15167
W20260709 12:28:02.640110 14778 debug-util.cc:398] Leaking SignalData structure 0x7b0800193fe0 after lost signal to thread 15180
W20260709 12:28:02.640331 14778 debug-util.cc:398] Leaking SignalData structure 0x7b08002070c0 after lost signal to thread 15181
W20260709 12:28:02.640583 14778 debug-util.cc:398] Leaking SignalData structure 0x7b0800254500 after lost signal to thread 15185
W20260709 12:28:02.640801 14778 debug-util.cc:398] Leaking SignalData structure 0x7b0800207180 after lost signal to thread 15186
W20260709 12:28:02.641028 14778 debug-util.cc:398] Leaking SignalData structure 0x7b0800217740 after lost signal to thread 15191
W20260709 12:28:02.641361 14778 debug-util.cc:398] Leaking SignalData structure 0x7b0800335b20 after lost signal to thread 15202
W20260709 12:28:02.641655 14778 debug-util.cc:398] Leaking SignalData structure 0x7b08001951a0 after lost signal to thread 15208
I20260709 12:28:02.647835 15255 consensus_queue.cc:1048] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:02.648116 14878 raft_consensus.cc:359] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:02.648916 14878 raft_consensus.cc:385] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.649221 14878 raft_consensus.cc:740] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.649915 14878 consensus_queue.cc:260] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
W20260709 12:28:02.650883 14778 debug-util.cc:398] Leaking SignalData structure 0x7b0800222e40 after lost signal to thread 15212
W20260709 12:28:02.651276 14778 debug-util.cc:398] Leaking SignalData structure 0x7b08000465e0 after lost signal to thread 15214
W20260709 12:28:02.651587 14778 debug-util.cc:398] Leaking SignalData structure 0x7b080014e1e0 after lost signal to thread 15216
W20260709 12:28:02.651829 14778 debug-util.cc:398] Leaking SignalData structure 0x7b080012c7c0 after lost signal to thread 15217
I20260709 12:28:02.653764 14877 raft_consensus.cc:359] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:02.657259 14877 raft_consensus.cc:385] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.657569 14877 raft_consensus.cc:740] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.658878 14877 consensus_queue.cc:260] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:02.661114 14877 ts_tablet_manager.cc:1434] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.033s	user 0.000s	sys 0.004s
I20260709 12:28:02.661587 14878 ts_tablet_manager.cc:1434] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.030s	user 0.007s	sys 0.000s
I20260709 12:28:02.662850 14878 tablet_bootstrap.cc:492] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:28:02.674695 14829 raft_consensus.cc:2468] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:02.676288 14649 leader_election.cc:304] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:28:02.677428 15254 raft_consensus.cc:2804] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.677472 14877 tablet_bootstrap.cc:492] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:28:02.682720 14879 tablet_bootstrap.cc:492] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:02.683367 14879 ts_tablet_manager.cc:1403] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.135s	user 0.036s	sys 0.031s
I20260709 12:28:02.677907 15254 raft_consensus.cc:697] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:02.686370 15254 consensus_queue.cc:237] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
W20260709 12:28:02.693325 14795 consensus_peers.cc:597] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:02.693090 14879 raft_consensus.cc:359] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.693789 14879 raft_consensus.cc:385] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.694667 14878 tablet_bootstrap.cc:654] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.695008 14879 raft_consensus.cc:740] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.697930 14876 tablet_bootstrap.cc:492] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:28:02.698504 14876 ts_tablet_manager.cc:1403] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.128s	user 0.028s	sys 0.010s
I20260709 12:28:02.700631 14879 consensus_queue.cc:260] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.711685 14879 ts_tablet_manager.cc:1434] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.028s	user 0.008s	sys 0.005s
I20260709 12:28:02.716081 14876 raft_consensus.cc:359] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.716897 14876 raft_consensus.cc:385] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.717152 14876 raft_consensus.cc:740] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.717829 14876 consensus_queue.cc:260] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.723382 15251 raft_consensus.cc:493] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.723984 14504 catalog_manager.cc:5697] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:02.726398 15108 raft_consensus.cc:493] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.734119 14877 tablet_bootstrap.cc:654] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.753656 15251 raft_consensus.cc:515] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:02.758163 14876 ts_tablet_manager.cc:1434] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.059s	user 0.006s	sys 0.000s
I20260709 12:28:02.761602 14879 tablet_bootstrap.cc:492] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:28:02.757350 15108 raft_consensus.cc:515] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.766484 14878 tablet_bootstrap.cc:492] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:02.767092 14878 ts_tablet_manager.cc:1403] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.105s	user 0.012s	sys 0.010s
I20260709 12:28:02.769919 14878 raft_consensus.cc:359] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.772362 14756 raft_consensus.cc:3060] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.777964 14976 raft_consensus.cc:493] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.772408 14679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80b946940f485e813a69a1ed96c203" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:02.778517 14976 raft_consensus.cc:515] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.778813 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "7b80b946940f485e813a69a1ed96c203" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:02.759720 15251 leader_election.cc:290] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:02.780944 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596dc92cc2c45838a165addea430360" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:02.784897 15108 leader_election.cc:290] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:02.785048 14604 raft_consensus.cc:2393] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c95afda23abe49318972444cc68998a7 in current term 1: Already voted for candidate 9a105adb44fb47078d6cb03a6c02026f in this term.
I20260709 12:28:02.791712 14878 raft_consensus.cc:385] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.792042 14878 raft_consensus.cc:740] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.795678 14876 tablet_bootstrap.cc:492] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:02.794399 14976 leader_election.cc:290] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:02.794706 14878 consensus_queue.cc:260] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.799335 14976 raft_consensus.cc:493] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.802639 14976 raft_consensus.cc:515] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.802001 14679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f54d9f158426396fa7e71a63ce964" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:02.803542 14679 raft_consensus.cc:2468] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:28:02.805917 14976 leader_election.cc:290] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:02.791478 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596dc92cc2c45838a165addea430360" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:02.794399 14796 leader_election.cc:304] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:02.807811 15255 raft_consensus.cc:2749] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.809202 14504 catalog_manager.cc:5697] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:02.811510 14722 leader_election.cc:304] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:02.812143 14877 tablet_bootstrap.cc:492] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:28:02.814693 14573 leader_election.cc:304] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:02.815254 14877 ts_tablet_manager.cc:1403] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.138s	user 0.008s	sys 0.014s
I20260709 12:28:02.815637 15210 consensus_queue.cc:1048] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:02.812548 15243 raft_consensus.cc:3060] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.821259 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742010a70c40456a920924c8339a6e26" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:02.814394 14755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f54d9f158426396fa7e71a63ce964" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:02.821749 14879 tablet_bootstrap.cc:654] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.823457 15105 raft_consensus.cc:2804] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:02.823868 15105 raft_consensus.cc:493] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:02.824193 15105 raft_consensus.cc:3060] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.818035 14877 raft_consensus.cc:359] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.845553 14877 raft_consensus.cc:385] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.851308 14878 ts_tablet_manager.cc:1434] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.084s	user 0.006s	sys 0.000s
I20260709 12:28:02.836944 15253 raft_consensus.cc:493] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.851269 14877 raft_consensus.cc:740] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
W20260709 12:28:02.863363 14572 leader_election.cc:343] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.844290 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742010a70c40456a920924c8339a6e26" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:02.871585 14877 consensus_queue.cc:260] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.859248 15243 raft_consensus.cc:2749] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.874940 14878 tablet_bootstrap.cc:492] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:28:02.843140 15210 consensus_queue.cc:1048] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
W20260709 12:28:02.834839 14574 leader_election.cc:343] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.881701 14877 ts_tablet_manager.cc:1434] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.066s	user 0.007s	sys 0.000s
I20260709 12:28:02.883594 14877 tablet_bootstrap.cc:492] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:28:02.889045 15105 raft_consensus.cc:515] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.891264 15105 leader_election.cc:290] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:02.892324 15237 consensus_queue.cc:1048] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:02.895040 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f54d9f158426396fa7e71a63ce964" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:02.895759 14683 raft_consensus.cc:3060] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:02.869340 15253 raft_consensus.cc:515] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.909366 14876 tablet_bootstrap.cc:654] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.911763 14608 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:02.912449 14608 raft_consensus.cc:2468] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:02.915577 14720 leader_election.cc:304] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:02.917339 14879 tablet_bootstrap.cc:492] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:02.917393 15235 raft_consensus.cc:493] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.917932 15235 raft_consensus.cc:515] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.919965 15235 leader_election.cc:290] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:02.920428 14683 raft_consensus.cc:2468] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:28:02.921717 14573 leader_election.cc:304] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
W20260709 12:28:02.881343 14574 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:35543, user_credentials={real_user=slave}} blocked reactor thread for 46735.6us
I20260709 12:28:02.922514 14984 consensus_queue.cc:1048] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:02.923621 15112 raft_consensus.cc:2804] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:02.924098 15112 raft_consensus.cc:697] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:02.925009 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da938990b3ec47338496f5764c730ccb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:02.924896 15112 consensus_queue.cc:237] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:02.925683 14830 raft_consensus.cc:2468] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:28:02.925983 15253 leader_election.cc:290] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:02.925055 14879 ts_tablet_manager.cc:1403] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.168s	user 0.015s	sys 0.019s
I20260709 12:28:02.929308 14879 raft_consensus.cc:359] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.929952 14879 raft_consensus.cc:385] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:02.930208 14879 raft_consensus.cc:740] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:02.932790 14879 consensus_queue.cc:260] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:02.944211 14879 ts_tablet_manager.cc:1434] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.017s	user 0.005s	sys 0.001s
I20260709 12:28:02.945308 14879 tablet_bootstrap.cc:492] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
W20260709 12:28:02.947294 14572 leader_election.cc:343] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:02.947841 14572 leader_election.cc:304] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:28:02.949954 15255 raft_consensus.cc:493] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.946382 15254 consensus_queue.cc:1048] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20260709 12:28:02.950510 15255 raft_consensus.cc:515] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:02.952617 15255 leader_election.cc:290] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:02.945344 14878 tablet_bootstrap.cc:654] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:02.958611 15235 raft_consensus.cc:2749] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:02.961947 15243 raft_consensus.cc:2804] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:02.967545 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f54d9f158426396fa7e71a63ce964" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:02.975169 14755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da938990b3ec47338496f5764c730ccb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:02.983165 14989 raft_consensus.cc:493] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:02.985805 14679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5cdf241a9849819398d5d313152db6" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:02.997099 14679 raft_consensus.cc:2393] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 420d5d7b2b504ff7923b7f4098c0fcce in current term 1: Already voted for candidate c95afda23abe49318972444cc68998a7 in this term.
I20260709 12:28:02.999367 15243 raft_consensus.cc:493] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 9a105adb44fb47078d6cb03a6c02026f)
I20260709 12:28:02.999897 15243 raft_consensus.cc:3060] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:03.002592 14989 raft_consensus.cc:515] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:03.004242 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:03.004794 14989 leader_election.cc:290] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:03.006706 14749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5cdf241a9849819398d5d313152db6" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:03.009195 14755 raft_consensus.cc:2468] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:28:03.036772 14989 raft_consensus.cc:493] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:03.038735 14572 leader_election.cc:343] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.037380 14989 raft_consensus.cc:515] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:03.041637 14574 leader_election.cc:304] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:03.060566 14938 raft_consensus.cc:2804] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.061087 14938 raft_consensus.cc:493] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.061462 14938 raft_consensus.cc:3060] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.075572 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8780aab4e49fc9b697191f4fde170" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:03.075553 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8780aab4e49fc9b697191f4fde170" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:03.082674 14989 leader_election.cc:290] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:03.105285 14938 raft_consensus.cc:515] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
W20260709 12:28:03.108803 14646 leader_election.cc:343] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.118177 14938 leader_election.cc:290] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:03.073325 15243 raft_consensus.cc:515] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:03.141610 14876 tablet_bootstrap.cc:492] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:28:03.142266 14876 ts_tablet_manager.cc:1403] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.379s	user 0.017s	sys 0.018s
I20260709 12:28:03.144130 15243 leader_election.cc:290] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:03.146088 14877 tablet_bootstrap.cc:654] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:03.133157 14647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:42945, user_credentials={real_user=slave}} blocked reactor thread for 82297us
I20260709 12:28:03.156257 14879 tablet_bootstrap.cc:654] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:03.170997 14554 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:03.170243 14795 leader_election.cc:304] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7
I20260709 12:28:03.190037 15255 raft_consensus.cc:3060] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:03.190220 14795 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:42945, user_credentials={real_user=slave}} blocked reactor thread for 159724us
I20260709 12:28:03.193902 14827 raft_consensus.cc:3060] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.195060 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da938990b3ec47338496f5764c730ccb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:03.195909 14830 raft_consensus.cc:3060] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:03.197582 15298 log.cc:927] Time spent T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a: Append to log took a long time: real 0.151s	user 0.001s	sys 0.001s
I20260709 12:28:03.199060 14826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "645a95a66395468daa1986ee77838eaa" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
W20260709 12:28:03.214147 14649 leader_election.cc:343] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:03.214339 14572 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:42945, user_credentials={real_user=slave}} blocked reactor thread for 97107.4us
I20260709 12:28:03.212545 15255 raft_consensus.cc:2749] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.238991 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da938990b3ec47338496f5764c730ccb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:03.239662 14757 raft_consensus.cc:3060] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.242933 14830 raft_consensus.cc:2468] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:28:03.259678 14574 leader_election.cc:304] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:03.258442 14605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:03.262769 15112 raft_consensus.cc:2804] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.263365 15112 raft_consensus.cc:697] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:03.264257 15112 consensus_queue.cc:237] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:03.264878 14756 raft_consensus.cc:1240] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Rejecting Update request from peer 9a105adb44fb47078d6cb03a6c02026f for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:03.272308 14876 raft_consensus.cc:359] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:03.275743 14876 raft_consensus.cc:385] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.276036 14876 raft_consensus.cc:740] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.277487 15255 consensus_queue.cc:1048] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:03.281038 14757 raft_consensus.cc:2468] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:28:03.287258 15253 consensus_queue.cc:1048] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:03.288403 14876 consensus_queue.cc:260] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:03.291527 14504 catalog_manager.cc:5697] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:03.298125 14876 ts_tablet_manager.cc:1434] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.151s	user 0.005s	sys 0.001s
I20260709 12:28:03.295698 15235 raft_consensus.cc:493] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.328972 14876 tablet_bootstrap.cc:492] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:03.335980 14605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "645a95a66395468daa1986ee77838eaa" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:03.351559 14879 tablet_bootstrap.cc:492] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:03.324035 15235 raft_consensus.cc:515] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:03.352458 14879 ts_tablet_manager.cc:1403] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.407s	user 0.033s	sys 0.010s
I20260709 12:28:03.359026 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:03.343907 14976 raft_consensus.cc:493] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.378029 14876 tablet_bootstrap.cc:654] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.384665 14877 tablet_bootstrap.cc:492] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:28:03.369592 14976 raft_consensus.cc:515] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:03.398411 14877 ts_tablet_manager.cc:1403] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.516s	user 0.023s	sys 0.058s
I20260709 12:28:03.409662 14722 leader_election.cc:304] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:03.413591 14878 tablet_bootstrap.cc:492] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:03.414233 14878 ts_tablet_manager.cc:1403] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.543s	user 0.024s	sys 0.029s
I20260709 12:28:03.415413 14605 raft_consensus.cc:2468] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:28:03.413012 15243 raft_consensus.cc:2749] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:03.426424 14879 raft_consensus.cc:359] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:03.429872 14879 raft_consensus.cc:385] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.430174 14879 raft_consensus.cc:740] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
W20260709 12:28:03.427382 14647 leader_election.cc:343] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.431058 15253 consensus_queue.cc:1048] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20260709 12:28:03.442399 15235 leader_election.cc:290] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:03.446918 14646 leader_election.cc:304] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:28:03.449555 14879 consensus_queue.cc:260] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:03.452062 14976 leader_election.cc:290] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:03.468816 15237 raft_consensus.cc:2804] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.469341 15237 raft_consensus.cc:493] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.469785 15237 raft_consensus.cc:3060] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.474188 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8780aab4e49fc9b697191f4fde170" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:03.474934 14682 raft_consensus.cc:2468] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 0.
I20260709 12:28:03.477023 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "645a95a66395468daa1986ee77838eaa" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:03.477916 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "645a95a66395468daa1986ee77838eaa" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:03.469406 15319 consensus_queue.cc:1048] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20260709 12:28:03.479554 14574 leader_election.cc:343] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.480842 14879 ts_tablet_manager.cc:1434] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.127s	user 0.008s	sys 0.001s
I20260709 12:28:03.484661 14879 tablet_bootstrap.cc:492] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:28:03.488526 14878 raft_consensus.cc:359] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:03.507779 14878 raft_consensus.cc:385] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.493009 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8780aab4e49fc9b697191f4fde170" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:03.465255 14647 leader_election.cc:304] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:28:03.503891 14573 leader_election.cc:304] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:03.504595 14879 tablet_bootstrap.cc:654] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.516228 14976 raft_consensus.cc:2804] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.516688 14976 raft_consensus.cc:493] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:03.517692 14572 leader_election.cc:343] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.518380 14877 raft_consensus.cc:359] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:03.519260 14877 raft_consensus.cc:385] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.519582 14877 raft_consensus.cc:740] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.520206 14877 consensus_queue.cc:260] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:03.508247 14878 raft_consensus.cc:740] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.522202 14878 consensus_queue.cc:260] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:03.517042 14976 raft_consensus.cc:3060] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.524793 15313 consensus_queue.cc:1048] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:03.525684 14647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:42945, user_credentials={real_user=slave}} blocked reactor thread for 100195us
I20260709 12:28:03.527088 15194 raft_consensus.cc:2749] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.527698 15194 consensus_queue.cc:1059] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:03.528559 15210 raft_consensus.cc:3055] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:03.528911 15210 raft_consensus.cc:740] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:03.529677 15210 consensus_queue.cc:260] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:03.531075 15210 raft_consensus.cc:3060] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:03.540160 14572 consensus_peers.cc:597] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:03.540860 15237 raft_consensus.cc:515] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:03.542037 14683 raft_consensus.cc:2393] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0cbbdf206b5458e9af48c22b862264a in current term 1: Already voted for candidate 9a105adb44fb47078d6cb03a6c02026f in this term.
I20260709 12:28:03.545979 14976 raft_consensus.cc:515] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
W20260709 12:28:03.548439 14647 consensus_peers.cc:597] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:03.505971 14506 catalog_manager.cc:5697] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:03.550788 14878 ts_tablet_manager.cc:1434] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.136s	user 0.007s	sys 0.000s
I20260709 12:28:03.557406 14878 tablet_bootstrap.cc:492] T 742010a70c40456a920924c8339a6e26 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:28:03.561374 14877 ts_tablet_manager.cc:1434] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.154s	user 0.005s	sys 0.001s
I20260709 12:28:03.562510 14877 tablet_bootstrap.cc:492] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f: Bootstrap starting.
I20260709 12:28:03.565901 14876 tablet_bootstrap.cc:492] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:28:03.568172 14879 tablet_bootstrap.cc:492] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:03.568840 14879 ts_tablet_manager.cc:1403] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.084s	user 0.013s	sys 0.000s
I20260709 12:28:03.566531 14876 ts_tablet_manager.cc:1403] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.241s	user 0.011s	sys 0.019s
I20260709 12:28:03.574680 14573 leader_election.cc:304] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:28:03.579491 15235 raft_consensus.cc:3060] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.580509 14877 tablet_bootstrap.cc:654] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.585915 14976 leader_election.cc:290] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:03.587888 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8780aab4e49fc9b697191f4fde170" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
W20260709 12:28:03.589568 14572 leader_election.cc:343] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.573815 14879 raft_consensus.cc:359] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:03.599160 14879 raft_consensus.cc:385] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.599576 14879 raft_consensus.cc:740] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.600404 14879 consensus_queue.cc:260] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:03.602617 14879 ts_tablet_manager.cc:1434] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.032s	user 0.006s	sys 0.001s
I20260709 12:28:03.607328 14879 tablet_bootstrap.cc:492] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:28:03.604173 15235 raft_consensus.cc:2749] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.611865 15237 leader_election.cc:290] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:03.614998 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "645a95a66395468daa1986ee77838eaa" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
W20260709 12:28:03.616314 14649 leader_election.cc:343] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.594035 14876 raft_consensus.cc:359] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:03.617111 14876 raft_consensus.cc:385] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.617403 14876 raft_consensus.cc:740] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.618434 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8780aab4e49fc9b697191f4fde170" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:03.619112 14680 raft_consensus.cc:3060] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.619257 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "645a95a66395468daa1986ee77838eaa" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:03.635295 14879 tablet_bootstrap.cc:654] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.637498 14876 consensus_queue.cc:260] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:03.639566 14876 ts_tablet_manager.cc:1434] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.068s	user 0.005s	sys 0.002s
I20260709 12:28:03.640558 14878 tablet_bootstrap.cc:654] T 742010a70c40456a920924c8339a6e26 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.640786 14876 tablet_bootstrap.cc:492] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:03.647822 14604 raft_consensus.cc:2468] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:03.659744 14879 tablet_bootstrap.cc:492] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:03.660339 14879 ts_tablet_manager.cc:1403] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.053s	user 0.007s	sys 0.004s
I20260709 12:28:03.665169 14876 tablet_bootstrap.cc:654] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.665750 14680 raft_consensus.cc:2468] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 1.
I20260709 12:28:03.667984 14573 leader_election.cc:304] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: c95afda23abe49318972444cc68998a7
I20260709 12:28:03.668771 15235 raft_consensus.cc:2804] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.669238 15235 raft_consensus.cc:697] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:03.670149 14646 leader_election.cc:304] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:28:03.670935 15237 raft_consensus.cc:2804] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.671465 15235 consensus_queue.cc:237] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:03.671602 15237 raft_consensus.cc:697] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:03.674507 15237 consensus_queue.cc:237] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:03.677991 14879 raft_consensus.cc:359] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:03.682663 14879 raft_consensus.cc:385] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.682963 14879 raft_consensus.cc:740] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.683670 14879 consensus_queue.cc:260] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:03.687942 14879 ts_tablet_manager.cc:1434] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.027s	user 0.007s	sys 0.000s
I20260709 12:28:03.692418 14879 tablet_bootstrap.cc:492] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:28:03.701596 14877 tablet_bootstrap.cc:492] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f: No bootstrap required, opened a new log
I20260709 12:28:03.702272 14877 ts_tablet_manager.cc:1403] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f: Time spent bootstrapping tablet: real 0.140s	user 0.015s	sys 0.003s
I20260709 12:28:03.704301 14879 tablet_bootstrap.cc:654] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.703868 14506 catalog_manager.cc:5697] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 0 to 1, leader changed from <none> to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 1 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:03.705154 14877 raft_consensus.cc:359] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:03.706162 14877 raft_consensus.cc:385] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.706539 14877 raft_consensus.cc:740] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.707371 14877 consensus_queue.cc:260] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:03.707981 14503 catalog_manager.cc:5697] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:03.712745 14877 ts_tablet_manager.cc:1434] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.003s
I20260709 12:28:03.735523 15253 raft_consensus.cc:493] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.736860 15253 raft_consensus.cc:515] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:03.738960 15253 leader_election.cc:290] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:03.742816 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f4c8c6619b4856afad5d98d9cec315" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:03.745852 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f4c8c6619b4856afad5d98d9cec315" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:03.747834 14722 leader_election.cc:304] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:28:03.749254 15253 raft_consensus.cc:2749] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.749792 14976 consensus_queue.cc:1048] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:03.751232 15235 consensus_queue.cc:1048] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:03.764675 14876 tablet_bootstrap.cc:492] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a: No bootstrap required, opened a new log
I20260709 12:28:03.765225 14876 ts_tablet_manager.cc:1403] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.125s	user 0.009s	sys 0.006s
I20260709 12:28:03.779739 14879 tablet_bootstrap.cc:492] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:03.783907 14878 tablet_bootstrap.cc:492] T 742010a70c40456a920924c8339a6e26 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:03.784463 14878 ts_tablet_manager.cc:1403] T 742010a70c40456a920924c8339a6e26 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.227s	user 0.013s	sys 0.022s
I20260709 12:28:03.791525 15108 raft_consensus.cc:493] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.792104 15108 raft_consensus.cc:515] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:03.798259 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742010a70c40456a920924c8339a6e26" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:03.800352 14601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742010a70c40456a920924c8339a6e26" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:03.801035 14601 raft_consensus.cc:2468] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:28:03.803303 14876 raft_consensus.cc:359] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:03.804049 14876 raft_consensus.cc:385] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.804100 14720 leader_election.cc:304] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:03.805210 15253 raft_consensus.cc:2804] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.805626 15253 raft_consensus.cc:493] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.805953 15253 raft_consensus.cc:3060] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.799031 15108 leader_election.cc:290] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:03.780319 14879 ts_tablet_manager.cc:1403] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.088s	user 0.010s	sys 0.004s
W20260709 12:28:03.815420 14723 leader_election.cc:343] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.815315 14879 raft_consensus.cc:359] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:03.816043 14879 raft_consensus.cc:385] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.816327 14879 raft_consensus.cc:740] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.817045 14879 consensus_queue.cc:260] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:03.819357 14879 ts_tablet_manager.cc:1434] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.003s
I20260709 12:28:03.820349 14879 tablet_bootstrap.cc:492] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:28:03.826700 15253 raft_consensus.cc:515] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:03.832746 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742010a70c40456a920924c8339a6e26" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:03.833120 14878 raft_consensus.cc:359] T 742010a70c40456a920924c8339a6e26 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:03.833861 14878 raft_consensus.cc:385] T 742010a70c40456a920924c8339a6e26 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.834156 14878 raft_consensus.cc:740] T 742010a70c40456a920924c8339a6e26 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.838676 15253 leader_election.cc:290] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:03.839848 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742010a70c40456a920924c8339a6e26" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:03.841871 14878 consensus_queue.cc:260] T 742010a70c40456a920924c8339a6e26 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:03.842296 14604 raft_consensus.cc:3060] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.804349 14876 raft_consensus.cc:740] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.828531 14879 tablet_bootstrap.cc:654] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.851245 14831 raft_consensus.cc:3060] T 742010a70c40456a920924c8339a6e26 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.851567 14604 raft_consensus.cc:2468] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:03.855765 14720 leader_election.cc:304] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:03.857486 14757 raft_consensus.cc:3060] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.859668 14831 raft_consensus.cc:2468] T 742010a70c40456a920924c8339a6e26 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:03.863639 14878 ts_tablet_manager.cc:1434] T 742010a70c40456a920924c8339a6e26 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.079s	user 0.008s	sys 0.000s
I20260709 12:28:03.864775 14876 consensus_queue.cc:260] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:03.864369 15237 raft_consensus.cc:493] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.866717 15253 raft_consensus.cc:2804] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:03.867774 14876 ts_tablet_manager.cc:1434] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.102s	user 0.006s	sys 0.002s
I20260709 12:28:03.866631 15237 raft_consensus.cc:515] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:03.874962 15237 leader_election.cc:290] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:03.874327 15253 raft_consensus.cc:697] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:03.875967 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf0c9a7101d45abbba0a1109b880e41" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:03.876096 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf0c9a7101d45abbba0a1109b880e41" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:03.876729 14604 raft_consensus.cc:2468] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:28:03.876560 15253 consensus_queue.cc:237] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:03.877733 14646 leader_election.cc:304] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:03.877923 14878 tablet_bootstrap.cc:492] T 645a95a66395468daa1986ee77838eaa P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:28:03.879868 15237 raft_consensus.cc:2804] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:03.880259 15237 raft_consensus.cc:493] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:03.880609 15237 raft_consensus.cc:3060] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:03.885705 14831 raft_consensus.cc:2468] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:28:03.901165 14878 tablet_bootstrap.cc:654] T 645a95a66395468daa1986ee77838eaa P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:03.909224 14879 tablet_bootstrap.cc:492] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:03.909746 14879 ts_tablet_manager.cc:1403] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.090s	user 0.016s	sys 0.005s
I20260709 12:28:03.921830 14504 catalog_manager.cc:5697] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:03.947474 15235 raft_consensus.cc:493] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:03.948128 15235 raft_consensus.cc:515] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:03.941457 14879 raft_consensus.cc:359] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:03.952451 14879 raft_consensus.cc:385] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:03.952785 14879 raft_consensus.cc:740] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:03.956656 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee6c60580642cd8bb2d1941ea0be79" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:03.950415 15235 leader_election.cc:290] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:03.961803 14879 consensus_queue.cc:260] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
W20260709 12:28:03.963075 14572 leader_election.cc:343] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.964345 14879 ts_tablet_manager.cc:1434] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.054s	user 0.004s	sys 0.002s
I20260709 12:28:03.966034 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee6c60580642cd8bb2d1941ea0be79" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
W20260709 12:28:03.967727 14574 leader_election.cc:343] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:03.968186 14574 leader_election.cc:304] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:28:03.969578 15235 raft_consensus.cc:2749] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:03.971468 14879 tablet_bootstrap.cc:492] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:28:03.988276 15237 raft_consensus.cc:515] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:04.000145 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf0c9a7101d45abbba0a1109b880e41" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:04.000790 14831 raft_consensus.cc:3060] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.002151 14878 tablet_bootstrap.cc:492] T 645a95a66395468daa1986ee77838eaa P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:04.002705 14878 ts_tablet_manager.cc:1403] T 645a95a66395468daa1986ee77838eaa P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.127s	user 0.013s	sys 0.014s
I20260709 12:28:04.004745 14879 tablet_bootstrap.cc:654] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.016451 15237 leader_election.cc:290] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:04.017717 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf0c9a7101d45abbba0a1109b880e41" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:04.018216 14831 raft_consensus.cc:2468] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:04.018391 14604 raft_consensus.cc:3060] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.018940 14879 tablet_bootstrap.cc:492] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:04.019557 14879 ts_tablet_manager.cc:1403] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.048s	user 0.011s	sys 0.006s
I20260709 12:28:04.019488 14649 leader_election.cc:304] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:28:04.022909 15237 raft_consensus.cc:2804] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:04.023445 15237 raft_consensus.cc:697] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:04.024250 15237 consensus_queue.cc:237] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:04.022536 14879 raft_consensus.cc:359] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:04.027225 14879 raft_consensus.cc:385] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.027575 14879 raft_consensus.cc:740] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.028294 14879 consensus_queue.cc:260] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:04.030809 15241 raft_consensus.cc:493] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.031282 15241 raft_consensus.cc:515] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:04.036839 14600 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f54d9f158426396fa7e71a63ce964" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:04.036964 15241 leader_election.cc:290] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:04.038041 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f54d9f158426396fa7e71a63ce964" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:04.039731 14879 ts_tablet_manager.cc:1434] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.020s	user 0.002s	sys 0.004s
I20260709 12:28:04.042088 14604 raft_consensus.cc:2468] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:04.005645 14878 raft_consensus.cc:359] T 645a95a66395468daa1986ee77838eaa P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:04.043421 14878 raft_consensus.cc:385] T 645a95a66395468daa1986ee77838eaa P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.043689 14878 raft_consensus.cc:740] T 645a95a66395468daa1986ee77838eaa P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.044405 14878 consensus_queue.cc:260] T 645a95a66395468daa1986ee77838eaa P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:04.046641 14878 ts_tablet_manager.cc:1434] T 645a95a66395468daa1986ee77838eaa P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.044s	user 0.005s	sys 0.001s
I20260709 12:28:04.041146 14722 leader_election.cc:304] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:04.047673 14878 tablet_bootstrap.cc:492] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:28:04.050624 15241 raft_consensus.cc:2749] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:04.055320 14878 tablet_bootstrap.cc:654] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.058696 14879 tablet_bootstrap.cc:492] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7: Bootstrap starting.
I20260709 12:28:04.063006 14757 raft_consensus.cc:3060] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.070374 14879 tablet_bootstrap.cc:654] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.073009 15241 raft_consensus.cc:493] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.080447 14504 catalog_manager.cc:5697] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:04.078635 15108 raft_consensus.cc:493] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.089069 15108 raft_consensus.cc:515] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:04.091307 15108 leader_election.cc:290] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:04.083220 15241 raft_consensus.cc:515] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:04.092345 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8780aab4e49fc9b697191f4fde170" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:04.093830 15241 leader_election.cc:290] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:04.094980 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca6238c0f244dd1a911e44a703e0f8b" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:04.096350 14604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0ca6238c0f244dd1a911e44a703e0f8b" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:04.098912 14720 leader_election.cc:304] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:04.099704 15108 raft_consensus.cc:2749] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:04.108832 14831 raft_consensus.cc:3060] T 645a95a66395468daa1986ee77838eaa P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.101500 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8780aab4e49fc9b697191f4fde170" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:04.125398 15237 consensus_queue.cc:1048] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:04.116400 14681 raft_consensus.cc:2393] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c95afda23abe49318972444cc68998a7 in current term 1: Already voted for candidate c0cbbdf206b5458e9af48c22b862264a in this term.
I20260709 12:28:04.158874 14722 leader_election.cc:304] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:04.161484 15108 raft_consensus.cc:3060] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.170806 14878 tablet_bootstrap.cc:492] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:04.171391 14878 ts_tablet_manager.cc:1403] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.124s	user 0.015s	sys 0.040s
I20260709 12:28:04.174255 14879 tablet_bootstrap.cc:492] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7: No bootstrap required, opened a new log
I20260709 12:28:04.174851 14879 ts_tablet_manager.cc:1403] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7: Time spent bootstrapping tablet: real 0.116s	user 0.021s	sys 0.010s
I20260709 12:28:04.178156 14879 raft_consensus.cc:359] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:04.179921 14879 raft_consensus.cc:385] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.180243 14879 raft_consensus.cc:740] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.180903 14879 consensus_queue.cc:260] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:04.183478 14879 ts_tablet_manager.cc:1434] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.001s
I20260709 12:28:04.184763 15309 consensus_queue.cc:1048] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.188119 15108 raft_consensus.cc:2749] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:04.174309 14878 raft_consensus.cc:359] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:04.189642 14878 raft_consensus.cc:385] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.190034 14878 raft_consensus.cc:740] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.190773 14878 consensus_queue.cc:260] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:04.192847 14878 ts_tablet_manager.cc:1434] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.000s
I20260709 12:28:04.195123 15194 raft_consensus.cc:493] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.195683 15194 raft_consensus.cc:515] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:04.197824 15194 leader_election.cc:290] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:04.205955 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2190ef737a2471ab10213a5ea05bf40" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:04.206768 14828 raft_consensus.cc:2468] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:28:04.208098 14649 leader_election.cc:304] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:28:04.209344 14878 tablet_bootstrap.cc:492] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce: Bootstrap starting.
I20260709 12:28:04.237602 15194 raft_consensus.cc:2804] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Leader pre-election won for term 1
W20260709 12:28:04.253979 14554 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:04.254854 15194 raft_consensus.cc:493] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.278331 14976 consensus_queue.cc:1048] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:04.266661 15194 raft_consensus.cc:3060] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.264582 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2190ef737a2471ab10213a5ea05bf40" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:04.300518 14757 raft_consensus.cc:2468] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 0.
I20260709 12:28:04.312264 14878 tablet_bootstrap.cc:654] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:04.316398 15235 consensus_queue.cc:1048] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:04.387697 14756 raft_consensus.cc:3060] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.401211 14878 tablet_bootstrap.cc:492] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce: No bootstrap required, opened a new log
I20260709 12:28:04.401774 14878 ts_tablet_manager.cc:1403] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent bootstrapping tablet: real 0.193s	user 0.008s	sys 0.008s
I20260709 12:28:04.404891 14878 raft_consensus.cc:359] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:04.405572 14878 raft_consensus.cc:385] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:04.405855 14878 raft_consensus.cc:740] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Initialized, Role: FOLLOWER
I20260709 12:28:04.407356 14878 consensus_queue.cc:260] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:04.407853 15194 raft_consensus.cc:515] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:04.408739 15108 consensus_queue.cc:1048] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.410069 15194 leader_election.cc:290] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:04.411572 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2190ef737a2471ab10213a5ea05bf40" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:04.414108 14753 raft_consensus.cc:3060] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.421492 14753 raft_consensus.cc:2468] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:04.422730 14647 leader_election.cc:304] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:04.423676 15309 raft_consensus.cc:2804] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:04.424443 15309 raft_consensus.cc:697] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:04.425288 15309 consensus_queue.cc:237] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:04.445865 15253 raft_consensus.cc:493] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.446372 15253 raft_consensus.cc:515] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:04.449043 15253 leader_election.cc:290] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:04.452142 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee6c60580642cd8bb2d1941ea0be79" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:04.456362 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b2190ef737a2471ab10213a5ea05bf40" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:04.459841 14831 raft_consensus.cc:3060] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.467720 14828 raft_consensus.cc:2468] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:28:04.462387 14878 ts_tablet_manager.cc:1434] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce: Time spent starting tablet: real 0.060s	user 0.006s	sys 0.001s
I20260709 12:28:04.471185 14831 raft_consensus.cc:2468] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:04.471724 14601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee6c60580642cd8bb2d1941ea0be79" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:04.472414 14601 raft_consensus.cc:2468] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 0.
I20260709 12:28:04.472456 15253 consensus_queue.cc:1048] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.473685 14720 leader_election.cc:304] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:04.474501 15253 raft_consensus.cc:2804] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:04.474836 15253 raft_consensus.cc:493] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.475102 15253 raft_consensus.cc:3060] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.456233 14504 catalog_manager.cc:5697] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 0 to 1, leader changed from <none> to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 1 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:04.499311 15253 raft_consensus.cc:515] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:04.511833 14605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee6c60580642cd8bb2d1941ea0be79" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:04.512502 14605 raft_consensus.cc:3060] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.512494 15194 consensus_queue.cc:1048] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:04.521956 14605 raft_consensus.cc:2468] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:04.523856 14824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dcee6c60580642cd8bb2d1941ea0be79" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:04.524534 14824 raft_consensus.cc:3060] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:04.527545 15253 leader_election.cc:290] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:04.534184 14720 leader_election.cc:304] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:04.535147 15241 raft_consensus.cc:2804] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:04.535669 15241 raft_consensus.cc:697] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:04.536532 15241 consensus_queue.cc:237] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:04.558943 14824 raft_consensus.cc:2468] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:04.568069 15210 consensus_queue.cc:1048] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.577872 14505 catalog_manager.cc:5697] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:04.708446 15210 raft_consensus.cc:493] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:04.708962 15210 raft_consensus.cc:515] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:04.711601 14601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:04.711757 15210 leader_election.cc:290] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:04.711892 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:04.712498 14756 raft_consensus.cc:2468] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 2.
I20260709 12:28:04.713805 14647 leader_election.cc:304] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:04.714695 15210 raft_consensus.cc:2804] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:04.715085 15210 raft_consensus.cc:493] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:04.715409 15210 raft_consensus.cc:3060] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:04.722379 15210 raft_consensus.cc:515] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:04.724383 15210 leader_election.cc:290] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 3 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:04.725585 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:04.725745 14601 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:04.726089 14756 raft_consensus.cc:3060] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:04.731182 14756 raft_consensus.cc:2468] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 3.
I20260709 12:28:04.732105 14647 leader_election.cc:304] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:04.733058 15210 raft_consensus.cc:2804] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:04.733505 15210 raft_consensus.cc:697] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 3 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:04.734203 15210 consensus_queue.cc:237] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:04.750325 14505 catalog_manager.cc:5697] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:04.852036 14938 raft_consensus.cc:493] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 9a105adb44fb47078d6cb03a6c02026f)
I20260709 12:28:04.853042 14938 raft_consensus.cc:515] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:04.855020 14938 leader_election.cc:290] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:04.856359 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:04.857106 14756 raft_consensus.cc:2368] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0cbbdf206b5458e9af48c22b862264a for earlier term 2. Current term is 3.
I20260709 12:28:04.858388 14572 leader_election.cc:400] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Vote denied by peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945) with higher term. Message: Invalid argument: T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0cbbdf206b5458e9af48c22b862264a for earlier term 2. Current term is 3.
I20260709 12:28:04.858700 14572 leader_election.cc:403] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20260709 12:28:04.856390 15349 consensus_queue.cc:1048] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:28:04.859509 14938 raft_consensus.cc:3060] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:04.864121 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:04.871414 14938 raft_consensus.cc:2749] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945) with higher term. Message: Invalid argument: T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0cbbdf206b5458e9af48c22b862264a for earlier term 2. Current term is 3.
I20260709 12:28:04.881925 15349 consensus_queue.cc:1048] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:04.928172 15305 consensus_queue.cc:1048] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:04.944458 15305 consensus_queue.cc:1048] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:05.351316 14756 raft_consensus.cc:1275] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Refusing update from remote peer 9a105adb44fb47078d6cb03a6c02026f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:05.352584 15194 consensus_queue.cc:1048] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:05.364720 14601 raft_consensus.cc:1275] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Refusing update from remote peer 9a105adb44fb47078d6cb03a6c02026f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:05.366568 15194 consensus_queue.cc:1048] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:06.262655  4821 tablet_server.cc:179] TabletServer@127.4.181.65:0 shutting down...
W20260709 12:28:06.278371 14646 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20260709 12:28:06.289090 14646 consensus_peers.cc:597] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:06.303591 14646 consensus_peers.cc:597] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:06.316084 14794 consensus_peers.cc:597] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.327867  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
W20260709 12:28:06.329437 14794 consensus_peers.cc:597] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.331120  4821 tablet_replica.cc:333] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.331925  4821 raft_consensus.cc:2243] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.332460  4821 raft_consensus.cc:2272] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.334996  4821 tablet_replica.cc:333] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.335693  4821 raft_consensus.cc:2243] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.336496  4821 raft_consensus.cc:2272] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.339195  4821 tablet_replica.cc:333] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.340010  4821 raft_consensus.cc:2243] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.341101  4821 raft_consensus.cc:2272] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.343581  4821 tablet_replica.cc:333] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.344457  4821 raft_consensus.cc:2243] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.344987  4821 raft_consensus.cc:2272] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.347477  4821 tablet_replica.cc:333] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.348292  4821 raft_consensus.cc:2243] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.349255  4821 raft_consensus.cc:2272] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:06.362190 14646 consensus_peers.cc:597] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.356185  4821 tablet_replica.cc:333] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.371614  4821 raft_consensus.cc:2243] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.372843  4821 raft_consensus.cc:2272] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.375717  4821 tablet_replica.cc:333] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.376659  4821 raft_consensus.cc:2243] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.378270  4821 raft_consensus.cc:2272] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.382042  4821 tablet_replica.cc:333] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.383466  4821 raft_consensus.cc:2243] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.383950  4821 raft_consensus.cc:2272] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.386018  4821 tablet_replica.cc:333] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.386729  4821 raft_consensus.cc:2243] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.387152  4821 raft_consensus.cc:2272] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.389206  4821 tablet_replica.cc:333] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.389955  4821 raft_consensus.cc:2243] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.390388  4821 raft_consensus.cc:2272] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.394209  4821 tablet_replica.cc:333] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.395301  4821 raft_consensus.cc:2243] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:06.398806 14646 consensus_peers.cc:597] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:06.407222 14646 consensus_peers.cc:597] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.396353  4821 raft_consensus.cc:2272] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:06.413235 14646 consensus_peers.cc:597] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.414170  4821 tablet_replica.cc:333] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.416800  4821 raft_consensus.cc:2243] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.417954  4821 raft_consensus.cc:2272] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:06.419420 14646 consensus_peers.cc:597] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.420842  4821 tablet_replica.cc:333] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.421751  4821 raft_consensus.cc:2243] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.422696  4821 raft_consensus.cc:2272] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.425239  4821 tablet_replica.cc:333] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.426015  4821 raft_consensus.cc:2243] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.426554  4821 raft_consensus.cc:2272] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.428948  4821 tablet_replica.cc:333] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
W20260709 12:28:06.429601 14794 consensus_peers.cc:597] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.429662  4821 raft_consensus.cc:2243] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.430377  4821 raft_consensus.cc:2272] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.433317  4821 tablet_replica.cc:333] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.434145  4821 raft_consensus.cc:2243] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.434690  4821 raft_consensus.cc:2272] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.437060  4821 tablet_replica.cc:333] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.438095  4821 raft_consensus.cc:2243] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.438687  4821 raft_consensus.cc:2272] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.441329  4821 tablet_replica.cc:333] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.442122  4821 raft_consensus.cc:2243] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.443264  4821 raft_consensus.cc:2272] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.446096  4821 tablet_replica.cc:333] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.446996  4821 raft_consensus.cc:2243] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.447621  4821 raft_consensus.cc:2272] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.450449  4821 tablet_replica.cc:333] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.451342  4821 raft_consensus.cc:2243] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.451862  4821 raft_consensus.cc:2272] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:06.454373 14720 consensus_peers.cc:597] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.454532  4821 tablet_replica.cc:333] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.455511  4821 raft_consensus.cc:2243] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.456506  4821 raft_consensus.cc:2272] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:06.458745 14794 consensus_peers.cc:597] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.459167  4821 tablet_replica.cc:333] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.460116  4821 raft_consensus.cc:2243] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:06.460371 14720 consensus_peers.cc:597] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.461098  4821 raft_consensus.cc:2272] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.463701  4821 tablet_replica.cc:333] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.464541  4821 raft_consensus.cc:2243] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.465068  4821 raft_consensus.cc:2272] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.467532  4821 tablet_replica.cc:333] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.468302  4821 raft_consensus.cc:2243] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.469301  4821 raft_consensus.cc:2272] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.471619  4821 tablet_replica.cc:333] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.472198  4821 raft_consensus.cc:2243] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.472600  4821 raft_consensus.cc:2272] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.474251  4821 tablet_replica.cc:333] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.474992  4821 raft_consensus.cc:2243] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.475461  4821 raft_consensus.cc:2272] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.477929  4821 tablet_replica.cc:333] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
W20260709 12:28:06.478400 14646 consensus_peers.cc:597] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.478675  4821 raft_consensus.cc:2243] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.479871  4821 raft_consensus.cc:2272] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.481909  4821 tablet_replica.cc:333] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.482506  4821 raft_consensus.cc:2243] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.482923  4821 raft_consensus.cc:2272] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.484887  4821 tablet_replica.cc:333] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.485415  4821 raft_consensus.cc:2243] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.485800  4821 raft_consensus.cc:2272] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.487528  4821 tablet_replica.cc:333] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.488063  4821 raft_consensus.cc:2243] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.488461  4821 raft_consensus.cc:2272] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.490376  4821 tablet_replica.cc:333] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.490969  4821 raft_consensus.cc:2243] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.491356  4821 raft_consensus.cc:2272] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.493113  4821 tablet_replica.cc:333] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.493647  4821 raft_consensus.cc:2243] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.494553  4821 raft_consensus.cc:2272] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.497088  4821 tablet_replica.cc:333] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.497745  4821 raft_consensus.cc:2243] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.498337  4821 raft_consensus.cc:2272] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:06.498343 14646 consensus_peers.cc:597] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.501005  4821 tablet_replica.cc:333] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.501614  4821 raft_consensus.cc:2243] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.502020  4821 raft_consensus.cc:2272] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.503739  4821 tablet_replica.cc:333] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.504266  4821 raft_consensus.cc:2243] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.504657  4821 raft_consensus.cc:2272] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.506644  4821 tablet_replica.cc:333] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.507148  4821 raft_consensus.cc:2243] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.507535  4821 raft_consensus.cc:2272] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.509620  4821 tablet_replica.cc:333] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.510269  4821 raft_consensus.cc:2243] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.511266  4821 raft_consensus.cc:2272] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.513796  4821 tablet_replica.cc:333] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.514590  4821 raft_consensus.cc:2243] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.515080  4821 raft_consensus.cc:2272] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:06.515810 14646 consensus_peers.cc:597] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.517194  4821 tablet_replica.cc:333] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.517988  4821 raft_consensus.cc:2243] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.518994  4821 raft_consensus.cc:2272] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.521652  4821 tablet_replica.cc:333] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.522387  4821 raft_consensus.cc:2243] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:06.523362  4821 raft_consensus.cc:2272] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.525671  4821 tablet_replica.cc:333] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
W20260709 12:28:06.526155 14646 consensus_peers.cc:597] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.526364  4821 raft_consensus.cc:2243] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.527148  4821 raft_consensus.cc:2272] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.529942  4821 tablet_replica.cc:333] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.530474  4821 raft_consensus.cc:2243] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.530921  4821 raft_consensus.cc:2272] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.532752  4821 tablet_replica.cc:333] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.533222  4821 raft_consensus.cc:2243] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.533588  4821 raft_consensus.cc:2272] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.535223  4821 tablet_replica.cc:333] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.535676  4821 raft_consensus.cc:2243] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:06.536044  4821 raft_consensus.cc:2272] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:06.538563  4821 tablet_replica.cc:333] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a: stopping tablet replica
I20260709 12:28:06.539167  4821 raft_consensus.cc:2243] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:06.540887 14794 consensus_peers.cc:597] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.541736  4821 raft_consensus.cc:2272] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:06.542328 14646 consensus_peers.cc:597] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:06.576364 14646 consensus_peers.cc:597] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.619545  4821 tablet_server.cc:196] TabletServer@127.4.181.65:0 shutdown complete.
W20260709 12:28:06.638813 14720 consensus_peers.cc:597] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:06.684160 14794 consensus_peers.cc:597] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.705284  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:06.732393 15381 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:06.733337 14720 consensus_peers.cc:597] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:06.736497 14720 consensus_peers.cc:597] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:06.738390 15382 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:06.748968 14794 consensus_peers.cc:597] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:06.749750 14646 consensus_peers.cc:597] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.750512  4821 server_base.cc:1061] running on GCE node
W20260709 12:28:06.751014 15384 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:06.753657  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:06.753868  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:06.754050  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600086754030 us; error 0 us; skew 500 ppm
I20260709 12:28:06.754621  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:06.757754  4821 webserver.cc:533] Webserver started at http://127.4.181.65:43625/ using document root <none> and password file <none>
I20260709 12:28:06.758251  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:06.758447  4821 fs_manager.cc:365] Using existing metadata directory in first data directory
W20260709 12:28:06.762054 14720 consensus_peers.cc:597] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:06.763626  4821 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.003s	sys 0.000s
I20260709 12:28:06.771720 15389 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:06.772571  4821 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.001s
I20260709 12:28:06.772982  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-0-root
uuid: "c0cbbdf206b5458e9af48c22b862264a"
format_stamp: "Formatted at 2026-07-09 12:27:53 on dist-test-slave-k014"
I20260709 12:28:06.773494  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1783599758264527-4821-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:06.793238  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:06.794610  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:06.796264  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:06.817355 15396 ts_tablet_manager.cc:548] Loading tablet metadata (0/45 complete)
W20260709 12:28:06.907475 14646 consensus_peers.cc:597] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:07.133718  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20260709 12:28:07.134179  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.329s	user 0.014s	sys 0.004s
I20260709 12:28:07.134584  4821 ts_tablet_manager.cc:600] Registering tablets (0/45 complete)
I20260709 12:28:07.147076 15396 tablet_bootstrap.cc:492] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.194617 15396 tablet_bootstrap.cc:492] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:07.195727 15396 tablet_bootstrap.cc:492] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:07.196525 15396 ts_tablet_manager.cc:1403] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.050s	user 0.015s	sys 0.005s
I20260709 12:28:07.200306 15396 raft_consensus.cc:359] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.201066 15396 raft_consensus.cc:740] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.202363 15396 consensus_queue.cc:260] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.207624 15396 ts_tablet_manager.cc:1434] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:28:07.208534 15396 tablet_bootstrap.cc:492] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.236114 15396 tablet_bootstrap.cc:492] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:07.237218 15396 tablet_bootstrap.cc:492] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:07.237900 15396 ts_tablet_manager.cc:1403] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.008s
I20260709 12:28:07.240339 15396 raft_consensus.cc:359] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.241039 15396 raft_consensus.cc:740] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.241859 15396 consensus_queue.cc:260] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.243736 15396 ts_tablet_manager.cc:1434] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.000s	sys 0.008s
I20260709 12:28:07.244565 15396 tablet_bootstrap.cc:492] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.267470 15396 tablet_bootstrap.cc:492] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:07.268501 15396 tablet_bootstrap.cc:492] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:07.269164 15396 ts_tablet_manager.cc:1403] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.025s	user 0.014s	sys 0.006s
I20260709 12:28:07.271807 15396 raft_consensus.cc:359] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.272480 15396 raft_consensus.cc:740] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.273413 15396 consensus_queue.cc:260] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.275656 15396 ts_tablet_manager.cc:1434] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.002s
I20260709 12:28:07.276592 15396 tablet_bootstrap.cc:492] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.297642 15396 tablet_bootstrap.cc:492] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:07.298602 15396 tablet_bootstrap.cc:492] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:07.299260 15396 ts_tablet_manager.cc:1403] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 12:28:07.301574 15396 raft_consensus.cc:359] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:07.302266 15396 raft_consensus.cc:740] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.303194 15396 consensus_queue.cc:260] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:07.305359 15396 ts_tablet_manager.cc:1434] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:28:07.306151 15396 tablet_bootstrap.cc:492] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.326778 15396 tablet_bootstrap.cc:492] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:07.327788 15396 tablet_bootstrap.cc:492] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:07.328451 15396 ts_tablet_manager.cc:1403] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.022s	user 0.015s	sys 0.004s
I20260709 12:28:07.330943 15396 raft_consensus.cc:359] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.331612 15396 raft_consensus.cc:740] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.332522 15396 consensus_queue.cc:260] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.334645 15396 ts_tablet_manager.cc:1434] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:28:07.335440 15396 tablet_bootstrap.cc:492] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.356350 15396 tablet_bootstrap.cc:492] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:07.357262 15396 tablet_bootstrap.cc:492] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:07.358184 15396 ts_tablet_manager.cc:1403] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.023s	user 0.022s	sys 0.000s
I20260709 12:28:07.360934 15396 raft_consensus.cc:359] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.361627 15396 raft_consensus.cc:740] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.362398 15396 consensus_queue.cc:260] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.364560 15396 ts_tablet_manager.cc:1434] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:28:07.365410 15396 tablet_bootstrap.cc:492] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.386341 15396 tablet_bootstrap.cc:492] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:07.387380 15396 tablet_bootstrap.cc:492] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:07.388182 15396 ts_tablet_manager.cc:1403] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.023s	user 0.017s	sys 0.004s
I20260709 12:28:07.390439 15396 raft_consensus.cc:359] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.391141 15396 raft_consensus.cc:740] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.391916 15396 consensus_queue.cc:260] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.393997 15396 ts_tablet_manager.cc:1434] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.005s	user 0.000s	sys 0.004s
I20260709 12:28:07.394830 15396 tablet_bootstrap.cc:492] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.415578 15396 tablet_bootstrap.cc:492] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:07.416682 15396 tablet_bootstrap.cc:492] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:07.417470 15396 ts_tablet_manager.cc:1403] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.023s	user 0.013s	sys 0.008s
I20260709 12:28:07.418516 15369 raft_consensus.cc:493] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.419117 15369 raft_consensus.cc:515] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:07.424707 15369 leader_election.cc:290] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:07.419982 15396 raft_consensus.cc:359] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.425328 15396 raft_consensus.cc:740] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.358278 15401 raft_consensus.cc:493] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.427265 15401 raft_consensus.cc:515] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.430758 15396 consensus_queue.cc:260] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.435808 15396 ts_tablet_manager.cc:1434] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.018s	user 0.001s	sys 0.004s
W20260709 12:28:07.436635 14720 leader_election.cc:336] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:07.440387 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8777b3a550644b50835c268da566aee7" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:07.441929 14722 leader_election.cc:304] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:07.444006 15400 raft_consensus.cc:2749] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:07.445084 15401 leader_election.cc:290] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
W20260709 12:28:07.458408 14794 leader_election.cc:336] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:07.436656 15396 tablet_bootstrap.cc:492] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.460558 15397 raft_consensus.cc:493] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.461092 15397 raft_consensus.cc:515] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:07.463423 15397 leader_election.cc:290] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:07.464408 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c22c8f015eb4f498db641dca9ea7900" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:07.465154 14831 raft_consensus.cc:2468] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:07.467756 14649 leader_election.cc:304] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:28:07.468665 15397 raft_consensus.cc:2804] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:07.469087 15397 raft_consensus.cc:493] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.471058 15397 raft_consensus.cc:3060] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:07.475560 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c22c8f015eb4f498db641dca9ea7900" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:07.475759 15401 raft_consensus.cc:493] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.476289 15401 raft_consensus.cc:515] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.478331 15401 leader_election.cc:290] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:07.479858 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8780aab4e49fc9b697191f4fde170" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
W20260709 12:28:07.481561 14646 leader_election.cc:336] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:07.486631 14720 leader_election.cc:336] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:07.487120 14720 leader_election.cc:304] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:07.493199 15401 raft_consensus.cc:2749] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:07.494918 15255 raft_consensus.cc:493] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.495851 15255 raft_consensus.cc:515] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.500311 15255 leader_election.cc:290] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:07.503187 15396 tablet_bootstrap.cc:492] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:07.504138 15396 tablet_bootstrap.cc:492] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
W20260709 12:28:07.504362 14794 leader_election.cc:336] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:07.504762 15396 ts_tablet_manager.cc:1403] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.068s	user 0.012s	sys 0.008s
I20260709 12:28:07.506107 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8190b1186645b4aa61fbd5207622cf" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:07.507282 15396 raft_consensus.cc:359] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.508055 14795 leader_election.cc:304] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:28:07.509213 15369 raft_consensus.cc:2749] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:07.508044 15396 raft_consensus.cc:740] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.510650 15396 consensus_queue.cc:260] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.512746 15396 ts_tablet_manager.cc:1434] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:07.513494 15396 tablet_bootstrap.cc:492] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.518006 15254 raft_consensus.cc:493] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.518584 15254 raft_consensus.cc:515] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.520705 15254 leader_election.cc:290] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:07.523185 15369 raft_consensus.cc:493] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.523746 15369 raft_consensus.cc:515] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:07.525746 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:07.527767 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318e36a972bd4f25a06acdfea9b1bfe9" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:07.525806 15369 leader_election.cc:290] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
W20260709 12:28:07.533653 14794 leader_election.cc:336] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:07.538645 14646 leader_election.cc:336] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:07.540578 14646 leader_election.cc:304] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:28:07.539569 15396 tablet_bootstrap.cc:492] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:07.541313 15398 raft_consensus.cc:493] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.541841 15396 tablet_bootstrap.cc:492] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:07.542629 15396 ts_tablet_manager.cc:1403] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.029s	user 0.018s	sys 0.003s
I20260709 12:28:07.543221 15254 raft_consensus.cc:2749] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:07.541929 15398 raft_consensus.cc:515] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.548391 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a425949e144909995513a045d40199" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:07.549045 15396 raft_consensus.cc:359] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:07.549772 15396 raft_consensus.cc:740] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.546366 15398 leader_election.cc:290] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:07.550552 15396 consensus_queue.cc:260] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:07.551581  4821 ts_tablet_manager.cc:616] Registered 45 tablets
I20260709 12:28:07.551983  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.417s	user 0.271s	sys 0.000s
I20260709 12:28:07.552764 15396 ts_tablet_manager.cc:1434] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:28:07.553568 15396 tablet_bootstrap.cc:492] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.553861 14796 leader_election.cc:304] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:07.554631 15369 raft_consensus.cc:2749] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:07.568506 15210 raft_consensus.cc:493] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.569778 15210 raft_consensus.cc:515] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.579535 15396 tablet_bootstrap.cc:492] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:07.585945 15396 tablet_bootstrap.cc:492] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:07.586652 15396 ts_tablet_manager.cc:1403] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.033s	user 0.018s	sys 0.004s
I20260709 12:28:07.589422 15396 raft_consensus.cc:359] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.590086 15396 raft_consensus.cc:740] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.592981 15396 consensus_queue.cc:260] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.595189 15396 ts_tablet_manager.cc:1434] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:28:07.595980 15396 tablet_bootstrap.cc:492] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.597504 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:07.586606 15401 raft_consensus.cc:493] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.606766 15401 raft_consensus.cc:515] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.610321 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f54d9f158426396fa7e71a63ce964" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:07.620596 15253 raft_consensus.cc:493] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.621182 15253 raft_consensus.cc:515] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.623257 15253 leader_election.cc:290] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:07.626600 15401 leader_election.cc:290] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:07.627262 15210 leader_election.cc:290] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:07.631186 15254 raft_consensus.cc:493] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
W20260709 12:28:07.631938 14646 leader_election.cc:336] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:07.631767 15254 raft_consensus.cc:515] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.632395 14646 leader_election.cc:304] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:28:07.633831 15254 leader_election.cc:290] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:07.634399 15254 raft_consensus.cc:2749] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:07.636535 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:07.637532 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6c65eac6134e59bf2b86cb44ca7a4f" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:07.630158 15397 raft_consensus.cc:515] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:07.646067 15397 leader_election.cc:290] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:07.646917 14681 raft_consensus.cc:2393] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 420d5d7b2b504ff7923b7f4098c0fcce in current term 2: Already voted for candidate 9a105adb44fb47078d6cb03a6c02026f in this term.
I20260709 12:28:07.650714 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0c22c8f015eb4f498db641dca9ea7900" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:07.651360 14831 raft_consensus.cc:3060] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:07.640273 15398 raft_consensus.cc:493] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.644222 15396 tablet_bootstrap.cc:492] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:07.653023 15396 tablet_bootstrap.cc:492] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:07.653779 15396 ts_tablet_manager.cc:1403] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.058s	user 0.021s	sys 0.003s
I20260709 12:28:07.657289 15396 raft_consensus.cc:359] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.658113 15396 raft_consensus.cc:740] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.658994 15396 consensus_queue.cc:260] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.659688 14831 raft_consensus.cc:2468] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 2.
I20260709 12:28:07.661314 14649 leader_election.cc:304] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:28:07.661324 15396 ts_tablet_manager.cc:1434] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:28:07.662142 15397 raft_consensus.cc:2804] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:07.663314 15396 tablet_bootstrap.cc:492] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.663700 15397 raft_consensus.cc:697] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:07.664808 15397 consensus_queue.cc:237] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:07.661808 15398 raft_consensus.cc:515] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.681155 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f54d9f158426396fa7e71a63ce964" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:07.681835 14756 raft_consensus.cc:2468] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:07.683279 14647 leader_election.cc:304] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:07.684136 15210 raft_consensus.cc:2804] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:07.684487 15210 raft_consensus.cc:493] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.684791 15210 raft_consensus.cc:3060] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:07.686961 15401 raft_consensus.cc:493] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.687309 15396 tablet_bootstrap.cc:492] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:07.687613 15401 raft_consensus.cc:515] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.688367 15396 tablet_bootstrap.cc:492] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:07.689050 15396 ts_tablet_manager.cc:1403] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.026s	user 0.018s	sys 0.003s
I20260709 12:28:07.691756 15396 raft_consensus.cc:359] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.692330 15396 raft_consensus.cc:740] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.695093 15396 consensus_queue.cc:260] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.699522 15401 leader_election.cc:290] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:07.700400 15396 ts_tablet_manager.cc:1434] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.011s	user 0.007s	sys 0.000s
I20260709 12:28:07.701275 15396 tablet_bootstrap.cc:492] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.708276 14680 raft_consensus.cc:2468] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:07.709457 15401 raft_consensus.cc:493] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.710213 15401 raft_consensus.cc:515] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.716099 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da938990b3ec47338496f5764c730ccb" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:07.718396 15210 raft_consensus.cc:515] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.721517 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5d7f54d9f158426396fa7e71a63ce964" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:07.722114 14756 raft_consensus.cc:3060] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:07.731721 15401 leader_election.cc:290] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:07.732990 15398 leader_election.cc:290] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:07.740218 15369 raft_consensus.cc:493] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.740926 15369 raft_consensus.cc:515] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.743956 15369 leader_election.cc:290] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:07.745564 14755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:07.747855 15210 leader_election.cc:290] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:07.758388 15396 tablet_bootstrap.cc:492] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:07.759684 15396 tablet_bootstrap.cc:492] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
W20260709 12:28:07.759907 14720 leader_election.cc:336] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:07.760465 15396 ts_tablet_manager.cc:1403] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.059s	user 0.018s	sys 0.024s
I20260709 12:28:07.760592 15401 raft_consensus.cc:493] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.761415 15401 raft_consensus.cc:515] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.763329 15396 raft_consensus.cc:359] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.764120 15396 raft_consensus.cc:740] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:07.764596 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8190b1186645b4aa61fbd5207622cf" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:07.764940 15396 consensus_queue.cc:260] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.765342 14831 raft_consensus.cc:2468] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:07.766896 14723 leader_election.cc:304] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:07.767330 15396 ts_tablet_manager.cc:1434] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:28:07.768277 15396 tablet_bootstrap.cc:492] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:07.769819 15400 raft_consensus.cc:2804] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:07.770320 15400 raft_consensus.cc:493] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.770742 15400 raft_consensus.cc:3060] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:07.776455 14796 leader_election.cc:304] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:07.778605 15369 raft_consensus.cc:2749] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:07.780539 14756 raft_consensus.cc:2468] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 2.
I20260709 12:28:07.760514 14720 leader_election.cc:304] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:07.783402 15253 raft_consensus.cc:493] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.783986 15253 raft_consensus.cc:515] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.781491 14647 leader_election.cc:304] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:07.790184 15253 leader_election.cc:290] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:07.791486 15400 raft_consensus.cc:515] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.792987 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:07.793660 14831 raft_consensus.cc:2468] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:07.795275 14723 leader_election.cc:304] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:07.796700 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9e8190b1186645b4aa61fbd5207622cf" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:07.797319 14831 raft_consensus.cc:3060] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:07.802945 15210 raft_consensus.cc:2804] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:07.803592 15210 raft_consensus.cc:697] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:07.807049 14831 raft_consensus.cc:2468] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 2.
I20260709 12:28:07.810891 14723 leader_election.cc:304] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:07.804425 15210 consensus_queue.cc:237] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.793767 15400 leader_election.cc:290] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:07.791349 15369 raft_consensus.cc:493] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.822551 15253 raft_consensus.cc:2804] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:07.768273 15401 leader_election.cc:290] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
W20260709 12:28:07.870303 14720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:39063, user_credentials={real_user=slave}} blocked reactor thread for 110422us
I20260709 12:28:07.826191 15437 raft_consensus.cc:493] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.845014 15255 raft_consensus.cc:493] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.869796 15253 raft_consensus.cc:493] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.881927 15253 raft_consensus.cc:3060] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:07.876212 14722 leader_election.cc:304] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:07.884358 15437 raft_consensus.cc:515] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.881160 15255 raft_consensus.cc:515] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.901168 15437 leader_election.cc:290] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
W20260709 12:28:07.918005 14794 leader_election.cc:336] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:07.927986 14794 leader_election.cc:304] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:28:07.906606 15254 raft_consensus.cc:493] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.931070 15255 leader_election.cc:290] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:07.871251 15369 raft_consensus.cc:515] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
W20260709 12:28:07.934552 14722 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.66:46705, user_credentials={real_user=slave}} blocked reactor thread for 58433.8us
I20260709 12:28:07.931818 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a425949e144909995513a045d40199" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:07.931778 15443 raft_consensus.cc:2749] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:07.935614 15254 raft_consensus.cc:515] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.937130 15255 raft_consensus.cc:493] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.956627 15255 raft_consensus.cc:515] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:07.938135 14680 raft_consensus.cc:2468] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:07.938338 15441 raft_consensus.cc:2804] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:07.959503 15441 raft_consensus.cc:697] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:07.944237 15443 raft_consensus.cc:2804] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:07.949862 15253 raft_consensus.cc:515] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.960783 15255 leader_election.cc:290] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:07.942757 15440 raft_consensus.cc:493] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
W20260709 12:28:07.965842 14720 leader_election.cc:336] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:07.944160 15369 leader_election.cc:290] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:07.947312 14506 catalog_manager.cc:5697] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 2 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:07.971369 15253 leader_election.cc:290] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:07.951526 15397 raft_consensus.cc:493] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.943962 15445 raft_consensus.cc:2749] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:07.949983 15442 raft_consensus.cc:493] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.938241 15448 raft_consensus.cc:493] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.973122 15442 raft_consensus.cc:515] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.972590 15440 raft_consensus.cc:515] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:07.974182 15441 consensus_queue.cc:237] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:07.975504 15440 leader_election.cc:290] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
W20260709 12:28:07.955133 14723 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:35543, user_credentials={real_user=slave}} blocked reactor thread for 144337us
W20260709 12:28:07.975793 14646 leader_election.cc:336] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:07.976276 14646 leader_election.cc:304] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
W20260709 12:28:07.977355 14646 leader_election.cc:336] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:07.972262 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d4c5596d44c5ebc68130616ef1ddb" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:07.977945 14646 leader_election.cc:304] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
W20260709 12:28:07.979044 14794 leader_election.cc:336] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:07.986701 14794 leader_election.cc:336] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:07.937302 15437 raft_consensus.cc:493] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.988505 15444 raft_consensus.cc:2749] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:07.967656 15443 raft_consensus.cc:493] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.995533 15443 raft_consensus.cc:3060] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:07.997537 15437 raft_consensus.cc:515] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
W20260709 12:28:07.998497 14794 leader_election.cc:336] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.003189 14722 leader_election.cc:304] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:08.007911 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf96c15d37c4522ab37cf6e48555598" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:08.008755 14681 raft_consensus.cc:2468] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:07.945544 15452 raft_consensus.cc:493] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.951321 15254 leader_election.cc:290] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:08.012202 15253 raft_consensus.cc:493] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:07.972307 15397 raft_consensus.cc:515] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:07.975550 15442 leader_election.cc:290] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:08.019321 14824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:08.012157 15400 raft_consensus.cc:493] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.025267 15400 raft_consensus.cc:515] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.026661 15452 raft_consensus.cc:515] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.027647 15400 leader_election.cc:290] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:08.018879 15437 leader_election.cc:290] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:08.028820 15452 leader_election.cc:290] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:08.029944 15396 tablet_bootstrap.cc:492] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:08.030970 15396 tablet_bootstrap.cc:492] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:08.031703 15396 ts_tablet_manager.cc:1403] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.264s	user 0.017s	sys 0.002s
I20260709 12:28:08.032887 15450 raft_consensus.cc:2804] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:08.020313 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318e36a972bd4f25a06acdfea9b1bfe9" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:08.033381 15450 raft_consensus.cc:493] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.033667 14828 raft_consensus.cc:2468] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:08.033803 15450 raft_consensus.cc:3060] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.024351 14824 raft_consensus.cc:3060] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:08.033916 14720 leader_election.cc:336] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.035818 14720 leader_election.cc:336] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.036218 14720 leader_election.cc:304] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:08.036387 14722 leader_election.cc:304] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:08.038096 15401 raft_consensus.cc:2804] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:08.038822 15401 raft_consensus.cc:493] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.038338 15253 raft_consensus.cc:515] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:08.039196 15401 raft_consensus.cc:3060] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:08.040814 14720 leader_election.cc:336] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.041419 14720 leader_election.cc:336] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.041916 14720 leader_election.cc:336] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.044844 15253 leader_election.cc:290] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:08.000100 15438 raft_consensus.cc:2749] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:07.973220 15448 raft_consensus.cc:515] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:08.048951 14649 leader_election.cc:304] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:28:08.057649 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:08.063815 14681 raft_consensus.cc:2468] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:08.049782 15396 raft_consensus.cc:359] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:08.065575 15396 raft_consensus.cc:740] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:08.066672 14824 raft_consensus.cc:2468] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 2.
I20260709 12:28:08.063198 15456 raft_consensus.cc:493] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.038102 15455 raft_consensus.cc:2749] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:08.068200 15456 raft_consensus.cc:515] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.068214 15438 raft_consensus.cc:2804] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:08.070573 15438 raft_consensus.cc:493] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.070967 15438 raft_consensus.cc:3060] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.072475 15448 leader_election.cc:290] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:08.070715 14682 raft_consensus.cc:2468] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:28:08.056457 15397 leader_election.cc:290] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:08.077551 15456 leader_election.cc:290] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:08.079840 15450 raft_consensus.cc:515] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.083775 14824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d4c5596d44c5ebc68130616ef1ddb" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:08.086133 14824 raft_consensus.cc:2468] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:08.086834 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6c65eac6134e59bf2b86cb44ca7a4f" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:08.087706 14649 leader_election.cc:304] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:28:08.088649 15397 raft_consensus.cc:2804] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:08.089139 15397 raft_consensus.cc:493] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.089330 15443 raft_consensus.cc:515] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
W20260709 12:28:08.089757 14720 leader_election.cc:336] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.089560 15397 raft_consensus.cc:3060] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:08.090306 14720 leader_election.cc:336] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.092072 14720 leader_election.cc:336] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.092597 14720 leader_election.cc:336] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.093019 14720 leader_election.cc:336] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.044746 15458 raft_consensus.cc:493] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.087729 14681 raft_consensus.cc:2468] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:08.102133 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242076f4476b46f1a12a0a07ced33d27" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:08.103263 14682 raft_consensus.cc:2468] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:08.107618 15456 raft_consensus.cc:493] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.107877 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:08.108364 15456 raft_consensus.cc:515] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:08.108705 14682 raft_consensus.cc:2468] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:08.109853 15396 consensus_queue.cc:260] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:08.110636 14503 catalog_manager.cc:5697] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:08.112787 15396 ts_tablet_manager.cc:1434] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.081s	user 0.005s	sys 0.001s
I20260709 12:28:08.113705 15396 tablet_bootstrap.cc:492] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:08.117208 14722 leader_election.cc:304] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:08.118568 15463 raft_consensus.cc:2804] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:08.119315 15463 raft_consensus.cc:493] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.119660 14722 leader_election.cc:304] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:08.119719 15463 raft_consensus.cc:3060] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.099017 15458 raft_consensus.cc:515] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.124141 14722 leader_election.cc:304] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:08.123407 15440 raft_consensus.cc:2804] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:08.125174 15440 raft_consensus.cc:493] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.125553 15440 raft_consensus.cc:3060] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.127885 15450 leader_election.cc:290] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:08.110841 15456 leader_election.cc:290] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:08.130527 15443 leader_election.cc:290] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:08.134087 14722 leader_election.cc:304] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:08.135306 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a425949e144909995513a045d40199" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:08.137126 14681 raft_consensus.cc:3060] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.132570 14723 leader_election.cc:304] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: c0cbbdf206b5458e9af48c22b862264a
W20260709 12:28:08.138228 14646 leader_election.cc:336] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.138940 15253 raft_consensus.cc:2804] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:08.139354 15253 raft_consensus.cc:493] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.139675 15253 raft_consensus.cc:3060] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.141549 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:08.142345 14682 raft_consensus.cc:3060] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:08.145387 14720 leader_election.cc:336] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.145689 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:08.146488 14756 raft_consensus.cc:2468] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:28:08.148017 15400 raft_consensus.cc:2804] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:08.152489 15400 raft_consensus.cc:697] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:08.153680 15400 consensus_queue.cc:237] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:08.154575 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da938990b3ec47338496f5764c730ccb" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:08.155344 14756 raft_consensus.cc:2468] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:28:08.154628 14681 raft_consensus.cc:2468] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 2.
I20260709 12:28:08.141137 15456 raft_consensus.cc:2804] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:08.161211 14722 leader_election.cc:304] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:08.162556 15443 raft_consensus.cc:2804] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:08.164196 14824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:08.164976 14824 raft_consensus.cc:2468] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 1.
I20260709 12:28:08.167392 14795 leader_election.cc:304] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:08.168527 15445 raft_consensus.cc:2804] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:08.168929 15445 raft_consensus.cc:493] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.169273 15445 raft_consensus.cc:3060] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.171927 14723 leader_election.cc:304] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:08.172645 15443 raft_consensus.cc:697] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:08.173796 15443 consensus_queue.cc:237] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.178565 15455 raft_consensus.cc:2804] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:08.179075 15455 raft_consensus.cc:493] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.179442 15455 raft_consensus.cc:3060] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:08.181640 14720 leader_election.cc:336] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.182621 14720 leader_election.cc:336] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.185261 14720 leader_election.cc:336] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.188768 15455 raft_consensus.cc:515] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:08.191635 14795 leader_election.cc:304] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:08.192472 15369 raft_consensus.cc:2804] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:08.192952 15369 raft_consensus.cc:493] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.193373 15369 raft_consensus.cc:3060] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.178558 15445 raft_consensus.cc:515] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:08.195323 15401 raft_consensus.cc:515] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.118784 15438 raft_consensus.cc:515] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:08.198220 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8777b3a550644b50835c268da566aee7" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
W20260709 12:28:08.200348 14646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:39063, user_credentials={real_user=slave}} blocked reactor thread for 62432.6us
I20260709 12:28:08.201912 14756 raft_consensus.cc:2468] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
W20260709 12:28:08.205823 14646 leader_election.cc:336] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.208066 14646 leader_election.cc:336] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.213141 14796 leader_election.cc:304] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:08.216636 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242076f4476b46f1a12a0a07ced33d27" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:08.161296 15456 raft_consensus.cc:493] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.219700 15253 raft_consensus.cc:515] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.226121 14682 raft_consensus.cc:2468] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 2.
I20260709 12:28:08.216655 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:08.230002 15455 leader_election.cc:290] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:08.230967 15453 raft_consensus.cc:2804] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:08.231492 15453 raft_consensus.cc:493] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.231885 15453 raft_consensus.cc:3060] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.218753 15440 raft_consensus.cc:515] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:08.234483 15440 leader_election.cc:290] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:08.236191 14751 raft_consensus.cc:2393] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a105adb44fb47078d6cb03a6c02026f in current term 2: Already voted for candidate c95afda23abe49318972444cc68998a7 in this term.
I20260709 12:28:08.236038 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:08.236934 14828 raft_consensus.cc:2393] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate c95afda23abe49318972444cc68998a7 in current term 2: Already voted for candidate 420d5d7b2b504ff7923b7f4098c0fcce in this term.
I20260709 12:28:08.237715 15401 leader_election.cc:290] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:08.238000 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "242076f4476b46f1a12a0a07ced33d27" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:08.238992 14681 raft_consensus.cc:3060] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.239593 15458 leader_election.cc:290] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:08.240058 15438 leader_election.cc:290] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:08.225618 15456 raft_consensus.cc:3060] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.243402 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf96c15d37c4522ab37cf6e48555598" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:08.244192 14680 raft_consensus.cc:3060] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.248310 14827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "318e36a972bd4f25a06acdfea9b1bfe9" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:08.249169 14827 raft_consensus.cc:3060] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.205435 15397 raft_consensus.cc:515] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:08.223989 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8780aab4e49fc9b697191f4fde170" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:08.251844 14757 raft_consensus.cc:2468] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 1.
I20260709 12:28:08.251945 14681 raft_consensus.cc:2468] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 2.
I20260709 12:28:08.253876 15397 leader_election.cc:290] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:08.255594 14722 leader_election.cc:304] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:08.257187 15253 leader_election.cc:290] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:08.257165 14722 leader_election.cc:304] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:08.259651 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f6c65eac6134e59bf2b86cb44ca7a4f" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:08.260349 14683 raft_consensus.cc:3060] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.255056 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2cf96c15d37c4522ab37cf6e48555598" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:08.261925 14753 raft_consensus.cc:2393] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a105adb44fb47078d6cb03a6c02026f in current term 2: Already voted for candidate c95afda23abe49318972444cc68998a7 in this term.
I20260709 12:28:08.270390 15445 leader_election.cc:290] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:08.263346 15401 raft_consensus.cc:2804] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:08.272145 15401 raft_consensus.cc:697] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:08.273041 15401 consensus_queue.cc:237] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.273293 15369 raft_consensus.cc:515] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:08.263477 15452 raft_consensus.cc:2804] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:08.275486 15452 raft_consensus.cc:697] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:08.276336 15452 consensus_queue.cc:237] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:08.282917 14753 raft_consensus.cc:1275] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Refusing update from remote peer 9a105adb44fb47078d6cb03a6c02026f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:08.279266 14647 leader_election.cc:304] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
W20260709 12:28:08.282419 14646 leader_election.cc:336] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.285979 14824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d4c5596d44c5ebc68130616ef1ddb" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:08.296557 15456 raft_consensus.cc:515] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
W20260709 12:28:08.297787 14720 leader_election.cc:336] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.298316 14720 leader_election.cc:304] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c95afda23abe49318972444cc68998a7; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a
W20260709 12:28:08.299242 14720 leader_election.cc:336] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.299454 15443 raft_consensus.cc:2749] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:08.303084 14647 leader_election.cc:304] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:08.304466 14680 raft_consensus.cc:2468] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 2.
I20260709 12:28:08.306195 15458 raft_consensus.cc:2804] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:08.308912 15458 raft_consensus.cc:493] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.309353 15458 raft_consensus.cc:3060] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:08.309602 14720 leader_election.cc:336] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.312779 15463 raft_consensus.cc:515] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.314390 14754 raft_consensus.cc:2393] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 9a105adb44fb47078d6cb03a6c02026f in current term 2: Already voted for candidate c95afda23abe49318972444cc68998a7 in this term.
I20260709 12:28:08.315824 15456 leader_election.cc:290] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
W20260709 12:28:08.317685 14720 leader_election.cc:336] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.319144 14683 raft_consensus.cc:2468] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 2.
I20260709 12:28:08.324924 15454 raft_consensus.cc:2804] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:08.325460 15454 raft_consensus.cc:493] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting leader election (detected failure of leader c0cbbdf206b5458e9af48c22b862264a)
I20260709 12:28:08.329003 14722 leader_election.cc:304] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:08.334555 15253 raft_consensus.cc:2804] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:08.335126 15253 raft_consensus.cc:697] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:08.336117 14722 leader_election.cc:304] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:08.344627 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:08.345398 14681 raft_consensus.cc:3060] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.344941 15253 consensus_queue.cc:237] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.356240 14681 raft_consensus.cc:2468] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 2.
I20260709 12:28:08.358210 14722 leader_election.cc:304] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:08.334362 15454 raft_consensus.cc:3060] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.345719 15443 raft_consensus.cc:2804] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:08.361573 14827 raft_consensus.cc:2468] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 2.
W20260709 12:28:08.366453 14720 leader_election.cc:336] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.370285 15210 consensus_queue.cc:1048] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:08.361799 15456 raft_consensus.cc:2804] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:08.372853 15443 raft_consensus.cc:697] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:08.378398 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:08.412009 14649 leader_election.cc:304] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:28:08.415834 14754 raft_consensus.cc:2393] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 420d5d7b2b504ff7923b7f4098c0fcce in current term 2: Already voted for candidate c95afda23abe49318972444cc68998a7 in this term.
I20260709 12:28:08.419904 15369 leader_election.cc:290] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:08.422015 15397 raft_consensus.cc:2804] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:08.422663 15397 raft_consensus.cc:697] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
W20260709 12:28:08.423033 14646 leader_election.cc:336] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.423720 15463 leader_election.cc:290] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:08.423552 15397 consensus_queue.cc:237] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:08.425380 14680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:08.426107 14680 raft_consensus.cc:3060] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.426278 15458 raft_consensus.cc:515] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.380033 14755 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da938990b3ec47338496f5764c730ccb" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:08.429205 14755 raft_consensus.cc:3060] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.428615 15458 leader_election.cc:290] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:08.430187 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d7c8780aab4e49fc9b697191f4fde170" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:08.423514 14646 leader_election.cc:304] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:28:08.380960 15456 raft_consensus.cc:697] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
W20260709 12:28:08.435547 14646 leader_election.cc:336] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.433054 14794 leader_election.cc:336] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.439216 14646 leader_election.cc:336] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.440402 14646 leader_election.cc:336] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.441376 14646 leader_election.cc:336] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.441756 14646 leader_election.cc:304] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:28:08.432942 14754 raft_consensus.cc:3060] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.437055 15444 raft_consensus.cc:2749] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:08.431245 14827 raft_consensus.cc:1275] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Refusing update from remote peer c95afda23abe49318972444cc68998a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:08.448697 15456 consensus_queue.cc:237] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
W20260709 12:28:08.452636 14794 leader_election.cc:336] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.456928 15396 tablet_bootstrap.cc:492] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:08.443985 15453 raft_consensus.cc:515] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
W20260709 12:28:08.470233 14646 leader_election.cc:336] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.470789 14795 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:42945, user_credentials={real_user=slave}} blocked reactor thread for 62089us
W20260709 12:28:08.471302 14646 leader_election.cc:336] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.471804 14795 leader_election.cc:304] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
W20260709 12:28:08.471836 14720 leader_election.cc:336] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
W20260709 12:28:08.472183 14646 consensus_peers.cc:597] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.473626 14824 raft_consensus.cc:2393] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 9a105adb44fb47078d6cb03a6c02026f in current term 2: Already voted for candidate 420d5d7b2b504ff7923b7f4098c0fcce in this term.
I20260709 12:28:08.477337 15379 raft_consensus.cc:2749] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:08.478981 14827 raft_consensus.cc:1275] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Refusing update from remote peer 9a105adb44fb47078d6cb03a6c02026f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:08.480685 15464 consensus_queue.cc:1048] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:08.474963 15441 consensus_queue.cc:1048] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20260709 12:28:08.482851 15453 leader_election.cc:290] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:08.484011 15396 tablet_bootstrap.cc:492] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:08.484877 15396 ts_tablet_manager.cc:1403] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.371s	user 0.027s	sys 0.018s
I20260709 12:28:08.491313 14754 raft_consensus.cc:2468] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 2.
I20260709 12:28:08.425437 15443 consensus_queue.cc:237] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.493458 14647 leader_election.cc:304] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:08.496035 15464 raft_consensus.cc:2804] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:08.496592 15464 raft_consensus.cc:697] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
W20260709 12:28:08.498569 14646 leader_election.cc:336] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.499193 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d4c5596d44c5ebc68130616ef1ddb" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
W20260709 12:28:08.499522 14646 consensus_peers.cc:597] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.499971 14681 raft_consensus.cc:2393] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 420d5d7b2b504ff7923b7f4098c0fcce in current term 2: Already voted for candidate 9a105adb44fb47078d6cb03a6c02026f in this term.
W20260709 12:28:08.500105 14646 leader_election.cc:336] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.504238 15464 consensus_queue.cc:237] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.506727 14646 leader_election.cc:304] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7
I20260709 12:28:08.507623 14649 leader_election.cc:304] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:08.513387 15448 raft_consensus.cc:2749] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
W20260709 12:28:08.515573 14720 consensus_peers.cc:597] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:08.516170 15444 raft_consensus.cc:2749] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:08.589730 15396 raft_consensus.cc:359] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:08.590312 15396 raft_consensus.cc:740] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
W20260709 12:28:08.592840 14794 leader_election.cc:336] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.593358 14794 leader_election.cc:304] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce; no voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:08.593227 15396 consensus_queue.cc:260] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:08.594655 15255 raft_consensus.cc:2749] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260709 12:28:08.594013 14680 raft_consensus.cc:2468] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 2.
I20260709 12:28:08.492902 15454 raft_consensus.cc:515] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.589030 14755 raft_consensus.cc:2468] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 2.
I20260709 12:28:08.596536 14722 leader_election.cc:304] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:08.605350 14795 leader_election.cc:304] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:08.582784 15404 raft_consensus.cc:493] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.608295 15255 raft_consensus.cc:2804] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:08.608731 15255 raft_consensus.cc:697] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:28:08.609418 15255 consensus_queue.cc:237] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:08.596669 15458 raft_consensus.cc:2749] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:08.607546 15401 raft_consensus.cc:2804] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:08.628252 15401 raft_consensus.cc:697] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:08.629140 15401 consensus_queue.cc:237] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.634961 15454 leader_election.cc:290] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:08.646624 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8777b3a550644b50835c268da566aee7" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:08.647248 14753 raft_consensus.cc:3060] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:08.672334 15396 ts_tablet_manager.cc:1434] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.187s	user 0.032s	sys 0.019s
I20260709 12:28:08.616418 15404 raft_consensus.cc:515] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:08.727607 15396 tablet_bootstrap.cc:492] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:08.750300 14753 raft_consensus.cc:2468] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 2.
I20260709 12:28:08.752949 14647 leader_election.cc:304] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:08.759748 15210 raft_consensus.cc:2804] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:08.760259 15210 raft_consensus.cc:697] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:08.767197 15210 consensus_queue.cc:237] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
W20260709 12:28:08.781107 14646 leader_election.cc:336] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111)
I20260709 12:28:08.830914 15404 leader_election.cc:290] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:08.831594 15404 raft_consensus.cc:493] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.832059 15404 raft_consensus.cc:515] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:08.822182 15486 raft_consensus.cc:493] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.847775 14827 raft_consensus.cc:1275] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Refusing update from remote peer 9a105adb44fb47078d6cb03a6c02026f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:08.848243 15486 raft_consensus.cc:515] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:08.850948 15486 leader_election.cc:290] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
W20260709 12:28:08.861243 15487 log.cc:927] Time spent T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce: Append to log took a long time: real 0.180s	user 0.001s	sys 0.000s
I20260709 12:28:08.856215 15464 consensus_queue.cc:1048] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.009s
W20260709 12:28:08.872009 15480 log.cc:927] Time spent T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce: Append to log took a long time: real 0.236s	user 0.004s	sys 0.001s
I20260709 12:28:08.916801 15404 leader_election.cc:290] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:08.924247 15404 raft_consensus.cc:493] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.935015 15497 raft_consensus.cc:493] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:08.933977 14794 consensus_peers.cc:597] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:08.938675 14794 consensus_peers.cc:597] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:08.927038 15404 raft_consensus.cc:515] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:08.940505 15497 raft_consensus.cc:515] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
W20260709 12:28:08.943442 14794 consensus_peers.cc:597] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:08.944453 15404 leader_election.cc:290] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
W20260709 12:28:08.940532 14647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:42945, user_credentials={real_user=slave}} blocked reactor thread for 174172us
I20260709 12:28:08.960970 15486 raft_consensus.cc:493] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.962186 15486 raft_consensus.cc:515] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:08.968786 15486 leader_election.cc:290] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:08.974823 15503 raft_consensus.cc:493] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.975781 15497 leader_election.cc:290] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:08.975843 15503 raft_consensus.cc:515] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
W20260709 12:28:08.980226 14646 consensus_peers.cc:597] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:08.980613 15503 leader_election.cc:290] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
W20260709 12:28:08.950994 15510 log.cc:927] Time spent T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7: Append to log took a long time: real 0.071s	user 0.000s	sys 0.001s
I20260709 12:28:08.986183 15486 raft_consensus.cc:493] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.960542 15404 raft_consensus.cc:493] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:08.987107 15486 raft_consensus.cc:515] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:09.000620 15404 raft_consensus.cc:515] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:09.023633 14680 raft_consensus.cc:1275] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c95afda23abe49318972444cc68998a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:09.030228 14678 raft_consensus.cc:1275] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c95afda23abe49318972444cc68998a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:09.032044 14757 raft_consensus.cc:1275] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Refusing update from remote peer 9a105adb44fb47078d6cb03a6c02026f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:09.043473 15396 tablet_bootstrap.cc:492] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:09.045341 15486 leader_election.cc:290] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
W20260709 12:28:09.034824 15482 log.cc:927] Time spent T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7: Append to log took a long time: real 0.406s	user 0.000s	sys 0.005s
I20260709 12:28:09.044993 14503 catalog_manager.cc:5697] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 2 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:09.053614 15456 consensus_queue.cc:1048] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:09.054209 15443 consensus_queue.cc:1048] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20260709 12:28:09.074170 14646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:39063, user_credentials={real_user=slave}} blocked reactor thread for 83434.8us
I20260709 12:28:09.045264 15396 tablet_bootstrap.cc:492] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:09.075836 15396 ts_tablet_manager.cc:1403] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.348s	user 0.024s	sys 0.012s
I20260709 12:28:09.026399 15404 leader_election.cc:290] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:09.081516 15404 raft_consensus.cc:493] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.082422 15404 raft_consensus.cc:515] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:09.086091 14824 raft_consensus.cc:1275] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Refusing update from remote peer c95afda23abe49318972444cc68998a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:09.092394 14754 raft_consensus.cc:1275] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Refusing update from remote peer 420d5d7b2b504ff7923b7f4098c0fcce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:09.090160 15404 leader_election.cc:290] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:09.113363 15443 consensus_queue.cc:1048] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:09.123939 15404 raft_consensus.cc:493] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.135322 15486 raft_consensus.cc:493] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.148229 14506 catalog_manager.cc:5697] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:09.150944 15448 consensus_queue.cc:1048] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:09.151346 15396 raft_consensus.cc:359] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:09.149242 15486 raft_consensus.cc:515] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:09.159849 14683 raft_consensus.cc:1275] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c95afda23abe49318972444cc68998a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:09.152318 15396 raft_consensus.cc:740] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.179318 14678 raft_consensus.cc:1275] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c95afda23abe49318972444cc68998a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:09.167860 15486 leader_election.cc:290] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:09.198755 14683 raft_consensus.cc:1275] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c95afda23abe49318972444cc68998a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:09.149119 15404 raft_consensus.cc:515] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:09.209067 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da938990b3ec47338496f5764c730ccb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:09.209648 15486 raft_consensus.cc:493] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:09.202637 14646 consensus_peers.cc:597] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:09.211270 14646 consensus_peers.cc:597] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:09.209106 14794 consensus_peers.cc:597] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:09.213488 15486 raft_consensus.cc:515] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
W20260709 12:28:09.211918 14646 consensus_peers.cc:597] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:09.213497 15521 consensus_queue.cc:1048] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.018s
I20260709 12:28:09.201822 15396 consensus_queue.cc:260] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:09.177232 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a425949e144909995513a045d40199" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:09.231870 14753 raft_consensus.cc:2393] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0cbbdf206b5458e9af48c22b862264a in current term 2: Already voted for candidate 420d5d7b2b504ff7923b7f4098c0fcce in this term.
I20260709 12:28:09.243148 14749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2e9afe81394f0daa8b09695c7a43ae" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:09.246564 14683 raft_consensus.cc:1275] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c95afda23abe49318972444cc68998a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:09.181100 15440 consensus_queue.cc:1048] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.051s
I20260709 12:28:09.251315 15463 consensus_queue.cc:1048] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.019s
I20260709 12:28:09.200423 14506 catalog_manager.cc:5697] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:09.271036 14506 catalog_manager.cc:5697] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:09.230095 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446076fe225641ee8d6ad7fe5a4777ee" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:09.274403 14749 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:09.275002 14752 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:09.276445 14751 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742010a70c40456a920924c8339a6e26" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:09.276651 14750 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f70df459ff44f5b95b6a780b4d2a596" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:09.277458 15486 leader_election.cc:290] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:09.278448 14676 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:09.279176 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f50744c152c4f22b65828c60d9d2974" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:09.280809 14675 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:09.281999 14675 raft_consensus.cc:2393] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0cbbdf206b5458e9af48c22b862264a in current term 2: Already voted for candidate c95afda23abe49318972444cc68998a7 in this term.
I20260709 12:28:09.285461 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:09.287493 14681 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:09.288113 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03b11e4110e41ec830cee6e3f1a88db" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:09.285529 14757 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c423e2343f442c79ab8cecd3cb76d57" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:09.291935 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "99a425949e144909995513a045d40199" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:09.292987 14683 raft_consensus.cc:2393] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0cbbdf206b5458e9af48c22b862264a in current term 2: Already voted for candidate c95afda23abe49318972444cc68998a7 in this term.
I20260709 12:28:09.265988 15404 leader_election.cc:290] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:09.266324 15446 consensus_queue.cc:1048] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.014s
I20260709 12:28:09.320505 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:09.273237 14506 catalog_manager.cc:5697] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:09.335853 15396 ts_tablet_manager.cc:1434] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.260s	user 0.008s	sys 0.004s
I20260709 12:28:09.337731 15396 tablet_bootstrap.cc:492] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
W20260709 12:28:09.338606 14796 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:46705, user_credentials={real_user=slave}} blocked reactor thread for 95594.5us
I20260709 12:28:09.339751 15392 leader_election.cc:304] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7
I20260709 12:28:09.340941 15486 raft_consensus.cc:3060] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:09.346999 15455 consensus_queue.cc:1048] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.029s
W20260709 12:28:09.346987 15466 log.cc:927] Time spent T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374: Append to log took a long time: real 0.054s	user 0.001s	sys 0.000s
W20260709 12:28:09.349509 14794 consensus_peers.cc:597] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:09.350116 14794 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:39063, user_credentials={real_user=slave}} blocked reactor thread for 89852.8us
W20260709 12:28:09.327134 14720 consensus_peers.cc:597] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:09.351701 14720 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:39063, user_credentials={real_user=slave}} blocked reactor thread for 150244us
W20260709 12:28:09.352221 14720 consensus_peers.cc:597] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:09.350637 14794 consensus_peers.cc:597] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:09.354841 14646 consensus_peers.cc:597] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:09.358927 14720 consensus_peers.cc:597] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:09.362025 14720 consensus_peers.cc:597] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:09.367647 14720 consensus_peers.cc:597] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:09.344015 15404 raft_consensus.cc:493] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:09.359666 14646 consensus_peers.cc:597] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:09.360589 14506 catalog_manager.cc:5697] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:09.368096 14720 consensus_peers.cc:597] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:09.373701 14720 consensus_peers.cc:597] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:09.371372 14646 consensus_peers.cc:597] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:09.362673 15391 leader_election.cc:304] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7
I20260709 12:28:09.382634 15404 raft_consensus.cc:515] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:09.383471 15391 leader_election.cc:304] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7
I20260709 12:28:09.385030 15391 leader_election.cc:304] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7
I20260709 12:28:09.385207 15404 leader_election.cc:290] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:09.385804 15404 raft_consensus.cc:2749] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:09.374279 14646 consensus_peers.cc:597] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:09.403393 14682 raft_consensus.cc:1275] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c95afda23abe49318972444cc68998a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:09.391088 15404 raft_consensus.cc:2749] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
W20260709 12:28:09.409713 14720 consensus_peers.cc:597] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:09.392839 15503 raft_consensus.cc:3060] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:09.411504 14720 consensus_peers.cc:597] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:09.418780 14755 raft_consensus.cc:1275] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Refusing update from remote peer 9a105adb44fb47078d6cb03a6c02026f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:09.420588 15521 consensus_queue.cc:1048] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:09.400992 14506 catalog_manager.cc:5697] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:09.423188 14682 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8777b3a550644b50835c268da566aee7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:09.423905 14506 catalog_manager.cc:5697] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:09.425763 14506 catalog_manager.cc:5697] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 2 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } }
I20260709 12:28:09.455711 15507 consensus_queue.cc:1048] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:09.480260 15404 raft_consensus.cc:493] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:09.485579 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8777b3a550644b50835c268da566aee7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c95afda23abe49318972444cc68998a7" is_pre_election: true
I20260709 12:28:09.486531 14753 raft_consensus.cc:2393] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate c0cbbdf206b5458e9af48c22b862264a in current term 2: Already voted for candidate 9a105adb44fb47078d6cb03a6c02026f in this term.
W20260709 12:28:09.490998 14720 consensus_peers.cc:597] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:09.510483 14720 consensus_peers.cc:597] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:09.512900 14646 consensus_peers.cc:597] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:09.520579 14646 consensus_peers.cc:597] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:09.527112 14794 consensus_peers.cc:597] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:09.509522 15404 raft_consensus.cc:515] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:09.527257 15486 raft_consensus.cc:2749] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:09.514928 15391 leader_election.cc:304] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7
I20260709 12:28:09.588320 14824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "da938990b3ec47338496f5764c730ccb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:09.598730 14824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3c423e2343f442c79ab8cecd3cb76d57" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:09.602766 14827 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c2e9afe81394f0daa8b09695c7a43ae" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:09.602924 14831 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "446076fe225641ee8d6ad7fe5a4777ee" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:09.604895 14826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "742010a70c40456a920924c8339a6e26" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:09.605300 14825 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f50744c152c4f22b65828c60d9d2974" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:09.603453 14823 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8f70df459ff44f5b95b6a780b4d2a596" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:09.603866 15393 leader_election.cc:304] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:28:09.593470 15497 raft_consensus.cc:3060] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:09.612061 15486 raft_consensus.cc:3060] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:09.603905 14830 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03b11e4110e41ec830cee6e3f1a88db" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:09.604256 14829 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
W20260709 12:28:09.593408 15391 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:42945, user_credentials={real_user=slave}} blocked reactor thread for 83947.2us
I20260709 12:28:09.605178 15404 leader_election.cc:290] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:09.627175 14824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf0c9a7101d45abbba0a1109b880e41" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:09.622581 15393 leader_election.cc:304] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:28:09.629464 15393 leader_election.cc:304] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:28:09.631951 15503 raft_consensus.cc:2749] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:09.637213 15404 raft_consensus.cc:2749] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:09.667122 15503 raft_consensus.cc:2749] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:09.672467 14646 consensus_peers.cc:597] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:09.682520 14720 consensus_peers.cc:597] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:09.704072 15486 raft_consensus.cc:2749] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:09.705415 15497 raft_consensus.cc:2749] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:09.706106 14506 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:52244 (request call id 115) took 1046 ms. Trace:
W20260709 12:28:09.698894 14794 consensus_peers.cc:597] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:09.707302 14505 catalog_manager.cc:5697] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 2 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:09.717069 14505 catalog_manager.cc:5697] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 2 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:09.713443 14506 rpcz_store.cc:276] 0709 12:28:08.659668 (+     0us) service_pool.cc:167] Inserting onto call queue
0709 12:28:08.659788 (+   120us) service_pool.cc:224] Handling call
0709 12:28:09.706040 (+1046252us) inbound_call.cc:177] Queueing success response
Related trace 'op':
0709 12:28:09.524540 (+     0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0709 12:28:09.525098 (+   558us) write_op.cc:432] Acquiring schema lock in shared mode
0709 12:28:09.525126 (+    28us) write_op.cc:435] Acquired schema lock
0709 12:28:09.525159 (+    33us) tablet.cc:662] Decoding operations
0709 12:28:09.526069 (+   910us) write_op.cc:620] Acquiring the partition lock for write op
0709 12:28:09.526119 (+    50us) write_op.cc:641] Partition lock acquired for write op
0709 12:28:09.526148 (+    29us) tablet.cc:685] Acquiring locks for 8 operations
0709 12:28:09.530710 (+  4562us) tablet.cc:701] Row locks acquired
0709 12:28:09.531589 (+   879us) write_op.cc:260] PREPARE: finished
0709 12:28:09.545432 (+ 13843us) write_op.cc:270] Start()
0709 12:28:09.580531 (+ 35099us) write_op.cc:276] Timestamp: P: 1783600089543690 usec, L: 0
0709 12:28:09.583922 (+  3391us) op_driver.cc:348] REPLICATION: starting
0709 12:28:09.610318 (+ 26396us) log.cc:844] Serialized 3233 byte log entry
0709 12:28:09.623411 (+ 13093us) op_driver.cc:464] REPLICATION: finished
0709 12:28:09.643850 (+ 20439us) write_op.cc:301] APPLY: starting
0709 12:28:09.643943 (+    93us) tablet.cc:1367] starting BulkCheckPresence
0709 12:28:09.644159 (+   216us) tablet.cc:1370] finished BulkCheckPresence
0709 12:28:09.644258 (+    99us) tablet.cc:1372] starting ApplyRowOperation cycle
0709 12:28:09.689036 (+ 44778us) tablet.cc:1383] finished ApplyRowOperation cycle
0709 12:28:09.689233 (+   197us) tablet_metrics.cc:581] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=8
0709 12:28:09.689292 (+    59us) write_op.cc:312] APPLY: finished
0709 12:28:09.689605 (+   313us) log.cc:844] Serialized 64 byte log entry
0709 12:28:09.689839 (+   234us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:09.689977 (+   138us) write_op.cc:454] Released schema lock
0709 12:28:09.690032 (+    55us) write_op.cc:341] FINISH: Updating metrics
0709 12:28:09.690427 (+   395us) write_op.cc:489] Releasing partition, row and schema locks
0709 12:28:09.690477 (+    50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":163782,"reported_tablets":8,"child_traces":[["op",{"apply.queue_time_us":20209,"apply.run_cpu_time_us":3249,"apply.run_wall_time_us":46536,"num_ops":8,"prepare.queue_time_us":1352,"prepare.run_cpu_time_us":4050,"prepare.run_wall_time_us":86099,"replication_time_us":39332,"thread_start_us":48460,"threads_started":1}]]}
I20260709 12:28:09.723691 15396 tablet_bootstrap.cc:492] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:09.724959 15396 tablet_bootstrap.cc:492] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:09.725660 15396 ts_tablet_manager.cc:1403] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.388s	user 0.022s	sys 0.011s
I20260709 12:28:09.728915 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf0c9a7101d45abbba0a1109b880e41" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
W20260709 12:28:09.735538 14720 consensus_peers.cc:597] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:09.774600 15396 raft_consensus.cc:359] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:09.776446 15396 raft_consensus.cc:740] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
W20260709 12:28:09.778112 14646 consensus_peers.cc:597] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:09.783399 15396 consensus_queue.cc:260] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
W20260709 12:28:09.809347 14646 consensus_peers.cc:597] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:09.812701 14646 consensus_peers.cc:597] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:09.819139 14649 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.68:35543, user_credentials={real_user=slave}} blocked reactor thread for 44528.6us
I20260709 12:28:09.810232 15497 raft_consensus.cc:493] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:28:09.818673 15393 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.68:35543, user_credentials={real_user=slave}} blocked reactor thread for 189297us
I20260709 12:28:09.827105 15396 ts_tablet_manager.cc:1434] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.101s	user 0.007s	sys 0.004s
I20260709 12:28:09.828342 15396 tablet_bootstrap.cc:492] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:09.827097 15393 leader_election.cc:304] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:28:09.839785 15393 leader_election.cc:304] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:28:09.840981 15393 leader_election.cc:304] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f
W20260709 12:28:09.842815 14720 consensus_peers.cc:597] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:09.846742 15486 raft_consensus.cc:2749] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:09.859150 15553 raft_consensus.cc:2749] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:09.861948 15393 leader_election.cc:304] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:28:09.847028 15497 raft_consensus.cc:515] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:09.863283 15393 leader_election.cc:304] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
I20260709 12:28:09.864248 15497 leader_election.cc:290] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:09.864792 15497 raft_consensus.cc:2749] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:09.854527 15404 raft_consensus.cc:2749] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:09.865953 15404 raft_consensus.cc:2749] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:09.864428 15393 leader_election.cc:304] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7
W20260709 12:28:09.877012 14647 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:42945, user_credentials={real_user=slave}} blocked reactor thread for 56726.4us
I20260709 12:28:09.879180 15553 raft_consensus.cc:2749] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:09.868974 15393 leader_election.cc:304] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:28:09.902998 15553 raft_consensus.cc:2749] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:09.904889 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f24860ec9a043a491db9afb3516eedd" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
W20260709 12:28:09.908417 14646 consensus_peers.cc:597] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:09.931448 14646 consensus_peers.cc:597] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:09.934787 14679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f24860ec9a043a491db9afb3516eedd" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:09.936657 15392 leader_election.cc:304] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a; no voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:28:09.937994 15553 raft_consensus.cc:2749] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20260709 12:28:09.952143 14646 consensus_peers.cc:597] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:09.957989 15396 tablet_bootstrap.cc:492] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:09.959079 15396 tablet_bootstrap.cc:492] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:09.959818 15396 ts_tablet_manager.cc:1403] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.132s	user 0.016s	sys 0.009s
I20260709 12:28:09.962744 15396 raft_consensus.cc:359] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:09.963532 15396 raft_consensus.cc:740] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:09.964444 15396 consensus_queue.cc:260] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:09.967257 14505 catalog_manager.cc:5697] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:09.973006 14646 consensus_peers.cc:597] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:09.974581 14505 catalog_manager.cc:5697] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 1 to 2, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 2 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } }
I20260709 12:28:09.980244 15396 ts_tablet_manager.cc:1434] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.020s	user 0.006s	sys 0.001s
I20260709 12:28:09.981338 15396 tablet_bootstrap.cc:492] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:10.005766 15396 tablet_bootstrap.cc:492] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:10.006747 15396 tablet_bootstrap.cc:492] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:10.007491 15396 ts_tablet_manager.cc:1403] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.026s	user 0.016s	sys 0.000s
I20260709 12:28:10.011556 15396 raft_consensus.cc:359] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.013947 15396 raft_consensus.cc:740] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.014732 15396 consensus_queue.cc:260] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.017544 15396 ts_tablet_manager.cc:1434] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.010s	user 0.005s	sys 0.000s
I20260709 12:28:10.018440 15396 tablet_bootstrap.cc:492] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:10.047268 15396 tablet_bootstrap.cc:492] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:10.048243 15396 tablet_bootstrap.cc:492] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:10.048902 15396 ts_tablet_manager.cc:1403] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.031s	user 0.013s	sys 0.011s
I20260709 12:28:10.051612 15396 raft_consensus.cc:359] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:10.052314 15396 raft_consensus.cc:740] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.053097 15396 consensus_queue.cc:260] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:10.055557 15396 ts_tablet_manager.cc:1434] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.000s
I20260709 12:28:10.056696 15396 tablet_bootstrap.cc:492] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:10.079048 15396 tablet_bootstrap.cc:492] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:10.080031 15396 tablet_bootstrap.cc:492] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:10.080696 15396 ts_tablet_manager.cc:1403] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.024s	user 0.009s	sys 0.012s
I20260709 12:28:10.083379 15396 raft_consensus.cc:359] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.085036 15396 raft_consensus.cc:740] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.085899 15396 consensus_queue.cc:260] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.088379 15396 ts_tablet_manager.cc:1434] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:28:10.091928 15583 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.65:39063 every 8 connection(s)
I20260709 12:28:10.093173  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.65:39063
I20260709 12:28:10.106163 15396 tablet_bootstrap.cc:492] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:10.155414 15443 raft_consensus.cc:493] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.156183 15443 raft_consensus.cc:515] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:10.162928 14826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" is_pre_election: true
I20260709 12:28:10.163630 14826 raft_consensus.cc:2468] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 2.
I20260709 12:28:10.167713 14723 leader_election.cc:304] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:10.169354 15463 raft_consensus.cc:2804] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:10.169765 15463 raft_consensus.cc:493] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.171742 15443 leader_election.cc:290] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:10.170518 15463 raft_consensus.cc:3060] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:10.179754 15495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
W20260709 12:28:10.181412 14720 leader_election.cc:343] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 3 pre-election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.228823 15463 raft_consensus.cc:515] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:10.234858 15463 leader_election.cc:290] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 3 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:10.236174 15495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
W20260709 12:28:10.239709 14720 leader_election.cc:343] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:10.238498 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "82ff441d536243878e4f32c69217a59a" candidate_uuid: "c95afda23abe49318972444cc68998a7" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:10.242980 14828 raft_consensus.cc:3060] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:10.246290 15396 tablet_bootstrap.cc:492] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:10.248437 15396 tablet_bootstrap.cc:492] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:10.249135 15396 ts_tablet_manager.cc:1403] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.143s	user 0.038s	sys 0.015s
I20260709 12:28:10.258714 15396 raft_consensus.cc:359] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.260159 15396 raft_consensus.cc:740] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.260820 15396 consensus_queue.cc:260] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.263013 15396 ts_tablet_manager.cc:1434] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.000s
I20260709 12:28:10.263866 15396 tablet_bootstrap.cc:492] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:10.257279 14828 raft_consensus.cc:2468] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c95afda23abe49318972444cc68998a7 in term 3.
I20260709 12:28:10.267760 14723 leader_election.cc:304] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:10.268893 15463 raft_consensus.cc:2804] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:10.273523 15463 raft_consensus.cc:697] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 3 LEADER]: Becoming Leader. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:10.274663 15463 consensus_queue.cc:237] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:10.279884 15586 heartbeater.cc:344] Connected to a master server at 127.4.181.126:42487
I20260709 12:28:10.281757 15586 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:10.282737 15586 heartbeater.cc:507] Master 127.4.181.126:42487 requested a full tablet report, sending...
I20260709 12:28:10.289431 15513 raft_consensus.cc:3060] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.313593 15478 raft_consensus.cc:493] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:10.314182 15478 raft_consensus.cc:515] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.317373 15495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d4c5596d44c5ebc68130616ef1ddb" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a" is_pre_election: true
I20260709 12:28:10.318017 15495 raft_consensus.cc:2468] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 1.
I20260709 12:28:10.319329 14794 leader_election.cc:304] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:10.320210 15379 raft_consensus.cc:2804] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260709 12:28:10.320582 15379 raft_consensus.cc:493] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:10.320648 15478 leader_election.cc:290] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:10.320953 15379 raft_consensus.cc:3060] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:10.328567 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d4c5596d44c5ebc68130616ef1ddb" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f" is_pre_election: true
I20260709 12:28:10.329473 14678 raft_consensus.cc:2468] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 2.
I20260709 12:28:10.343657 15379 raft_consensus.cc:515] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.348718 15495 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d4c5596d44c5ebc68130616ef1ddb" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
I20260709 12:28:10.349514 15495 raft_consensus.cc:3060] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:10.348829 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4c3d4c5596d44c5ebc68130616ef1ddb" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:10.350754 14678 raft_consensus.cc:3060] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:10.350600 15379 leader_election.cc:290] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 3 election: Requested vote from peers c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:10.357673 14505 catalog_manager.cc:5697] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 reported cstate change: term changed from 1 to 3, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to c95afda23abe49318972444cc68998a7 (127.4.181.67). New cstate: current_term: 3 leader_uuid: "c95afda23abe49318972444cc68998a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.369776 15495 raft_consensus.cc:2468] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 3.
I20260709 12:28:10.387056 14678 raft_consensus.cc:2468] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 3.
I20260709 12:28:10.388985 15396 tablet_bootstrap.cc:492] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:10.390571 15396 tablet_bootstrap.cc:492] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:10.391207 15396 ts_tablet_manager.cc:1403] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.128s	user 0.032s	sys 0.045s
I20260709 12:28:10.392725 14796 leader_election.cc:304] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:28:10.395079 15379 raft_consensus.cc:2804] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:10.398675 15379 raft_consensus.cc:697] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 3 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:28:10.402379 15495 raft_consensus.cc:3060] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.402302 15379 consensus_queue.cc:237] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.408794 15396 raft_consensus.cc:359] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:10.410436 15396 raft_consensus.cc:740] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.411157 15396 consensus_queue.cc:260] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:10.413825 15396 ts_tablet_manager.cc:1434] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.022s	user 0.002s	sys 0.004s
I20260709 12:28:10.415024 15396 tablet_bootstrap.cc:492] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:10.415848 14505 ts_manager.cc:194] Re-registered known tserver with Master: c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063)
I20260709 12:28:10.543053 14505 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60714
I20260709 12:28:10.559376 14506 catalog_manager.cc:5697] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 1 to 3, leader changed from c0cbbdf206b5458e9af48c22b862264a (127.4.181.65) to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 3 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:10.583974 15586 heartbeater.cc:499] Master 127.4.181.126:42487 was elected leader, sending a full tablet report...
I20260709 12:28:10.584622 15512 raft_consensus.cc:3060] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.612951 15396 tablet_bootstrap.cc:492] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:10.613898 15396 tablet_bootstrap.cc:492] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:10.614580 15396 ts_tablet_manager.cc:1403] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.200s	user 0.018s	sys 0.015s
I20260709 12:28:10.617890 15396 raft_consensus.cc:359] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.618819 15396 raft_consensus.cc:740] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.619526 15396 consensus_queue.cc:260] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.621217 15396 ts_tablet_manager.cc:1434] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:10.621847 15396 tablet_bootstrap.cc:492] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:10.637343 15396 tablet_bootstrap.cc:492] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:10.638303 15396 tablet_bootstrap.cc:492] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:10.638994 15396 ts_tablet_manager.cc:1403] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.005s
I20260709 12:28:10.640854 15396 raft_consensus.cc:359] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:10.641338 15396 raft_consensus.cc:740] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.641978 15396 consensus_queue.cc:260] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:10.645084 15396 ts_tablet_manager.cc:1434] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.001s	sys 0.003s
I20260709 12:28:10.646176 15396 tablet_bootstrap.cc:492] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:10.653875 15512 raft_consensus.cc:3060] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.668654 15396 tablet_bootstrap.cc:492] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:10.669642 15396 tablet_bootstrap.cc:492] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:10.670264 15396 ts_tablet_manager.cc:1403] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.003s
I20260709 12:28:10.672695 15396 raft_consensus.cc:359] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:10.673346 15396 raft_consensus.cc:740] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.674064 15396 consensus_queue.cc:260] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:10.676352 15396 ts_tablet_manager.cc:1434] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:10.677160 15396 tablet_bootstrap.cc:492] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:10.694402 15495 raft_consensus.cc:3060] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:10.700757 15396 tablet_bootstrap.cc:492] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:10.702914 15396 tablet_bootstrap.cc:492] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:10.703681 15396 ts_tablet_manager.cc:1403] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.027s	user 0.015s	sys 0.004s
I20260709 12:28:10.708261 15396 raft_consensus.cc:359] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:10.708946 15396 raft_consensus.cc:740] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.709653 15396 consensus_queue.cc:260] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:10.713279 15396 ts_tablet_manager.cc:1434] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.000s
I20260709 12:28:10.714051 15396 tablet_bootstrap.cc:492] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:10.738175 15396 tablet_bootstrap.cc:492] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:10.738971 15396 tablet_bootstrap.cc:492] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:10.739496 15396 ts_tablet_manager.cc:1403] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.000s
I20260709 12:28:10.741662 15396 raft_consensus.cc:359] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.742273 15396 raft_consensus.cc:740] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.743175 15396 consensus_queue.cc:260] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.745440 15396 ts_tablet_manager.cc:1434] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:28:10.746236 15396 tablet_bootstrap.cc:492] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
W20260709 12:28:10.783203 14720 consensus_peers.cc:597] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:10.785333 15396 tablet_bootstrap.cc:492] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:10.786353 15396 tablet_bootstrap.cc:492] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:10.787004 15396 ts_tablet_manager.cc:1403] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.004s
I20260709 12:28:10.789590 15396 raft_consensus.cc:359] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:10.790243 15396 raft_consensus.cc:740] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.792105 15396 consensus_queue.cc:260] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:10.794346 15396 ts_tablet_manager.cc:1434] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:10.796821 15396 tablet_bootstrap.cc:492] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:10.852301 14828 raft_consensus.cc:1275] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 3 FOLLOWER]: Refusing update from remote peer c95afda23abe49318972444cc68998a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:10.854629 15605 consensus_queue.cc:1048] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:10.855124 15396 tablet_bootstrap.cc:492] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:10.856161 15396 tablet_bootstrap.cc:492] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:10.856804 15396 ts_tablet_manager.cc:1403] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.011s
I20260709 12:28:10.859436 15396 raft_consensus.cc:359] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:10.872170 15396 raft_consensus.cc:740] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.872948 15396 consensus_queue.cc:260] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:10.875260 15396 ts_tablet_manager.cc:1434] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.018s	user 0.009s	sys 0.000s
I20260709 12:28:10.876103 15396 tablet_bootstrap.cc:492] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:10.876955 14678 raft_consensus.cc:1275] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Refusing update from remote peer 420d5d7b2b504ff7923b7f4098c0fcce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:10.890597 15453 consensus_queue.cc:1048] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:10.929493 15495 raft_consensus.cc:1275] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Refusing update from remote peer 420d5d7b2b504ff7923b7f4098c0fcce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20260709 12:28:10.931104 15478 consensus_queue.cc:1048] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:10.958691 15396 tablet_bootstrap.cc:492] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:10.959674 15396 tablet_bootstrap.cc:492] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:10.960408 15396 ts_tablet_manager.cc:1403] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.085s	user 0.020s	sys 0.001s
I20260709 12:28:10.970453 15396 raft_consensus.cc:359] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.971208 15396 raft_consensus.cc:740] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:10.971899 15396 consensus_queue.cc:260] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:10.974268 15396 ts_tablet_manager.cc:1434] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:28:10.975164 15396 tablet_bootstrap.cc:492] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:11.063819 15512 raft_consensus.cc:3060] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.083035 15396 tablet_bootstrap.cc:492] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.084134 15396 tablet_bootstrap.cc:492] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:11.088213 15396 ts_tablet_manager.cc:1403] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.113s	user 0.020s	sys 0.019s
I20260709 12:28:11.100627 15396 raft_consensus.cc:359] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:11.101445 15396 raft_consensus.cc:740] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.102252 15396 consensus_queue.cc:260] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:11.112387 15396 ts_tablet_manager.cc:1434] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.024s	user 0.006s	sys 0.000s
I20260709 12:28:11.113413 15396 tablet_bootstrap.cc:492] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
W20260709 12:28:11.141148 14720 consensus_peers.cc:597] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:11.172124 15396 tablet_bootstrap.cc:492] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.172930 15396 tablet_bootstrap.cc:492] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:11.173720 15396 ts_tablet_manager.cc:1403] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.061s	user 0.044s	sys 0.014s
I20260709 12:28:11.176000 15396 raft_consensus.cc:359] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:11.176573 15396 raft_consensus.cc:740] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.177210 15396 consensus_queue.cc:260] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:11.179087 15512 raft_consensus.cc:3060] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.179143 15396 ts_tablet_manager.cc:1434] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:28:11.180099 15396 tablet_bootstrap.cc:492] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:11.202116 15396 tablet_bootstrap.cc:492] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.203111 15396 tablet_bootstrap.cc:492] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:11.203817 15396 ts_tablet_manager.cc:1403] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.008s
I20260709 12:28:11.206323 15396 raft_consensus.cc:359] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:11.207018 15396 raft_consensus.cc:740] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.207679 15396 consensus_queue.cc:260] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:11.209664 15396 ts_tablet_manager.cc:1434] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:11.210525 15396 tablet_bootstrap.cc:492] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:11.231730 15396 tablet_bootstrap.cc:492] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.232517 15396 tablet_bootstrap.cc:492] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:11.233131 15396 ts_tablet_manager.cc:1403] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.023s	user 0.012s	sys 0.007s
I20260709 12:28:11.235944 15396 raft_consensus.cc:359] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:11.236618 15396 raft_consensus.cc:740] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.237334 15396 consensus_queue.cc:260] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:11.240590 15396 ts_tablet_manager.cc:1434] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.001s
I20260709 12:28:11.244733 15396 tablet_bootstrap.cc:492] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:11.266949 15396 tablet_bootstrap.cc:492] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.267840 15396 tablet_bootstrap.cc:492] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:11.268553 15396 ts_tablet_manager.cc:1403] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.005s
I20260709 12:28:11.271335 15396 raft_consensus.cc:359] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:11.271929 15396 raft_consensus.cc:740] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.272449 15396 consensus_queue.cc:260] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:11.274137 15396 ts_tablet_manager.cc:1434] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:11.275303 15396 tablet_bootstrap.cc:492] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:11.317605 15396 tablet_bootstrap.cc:492] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.319011 15396 tablet_bootstrap.cc:492] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:11.320061 15396 ts_tablet_manager.cc:1403] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.045s	user 0.021s	sys 0.020s
I20260709 12:28:11.322656 15396 raft_consensus.cc:359] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:11.323328 15396 raft_consensus.cc:740] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.323997 15396 consensus_queue.cc:260] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:11.338903 15512 raft_consensus.cc:3060] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.341624 15396 ts_tablet_manager.cc:1434] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.021s	user 0.006s	sys 0.000s
I20260709 12:28:11.342577 15396 tablet_bootstrap.cc:492] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:11.388443 15396 tablet_bootstrap.cc:492] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.389613 15396 tablet_bootstrap.cc:492] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:11.390352 15396 ts_tablet_manager.cc:1403] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.048s	user 0.009s	sys 0.010s
I20260709 12:28:11.392954 15396 raft_consensus.cc:359] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:11.393635 15396 raft_consensus.cc:740] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.394539 15396 consensus_queue.cc:260] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:11.395996 15396 ts_tablet_manager.cc:1434] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:11.396723 15396 tablet_bootstrap.cc:492] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:11.447624 15396 tablet_bootstrap.cc:492] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.448621 15396 tablet_bootstrap.cc:492] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:11.449338 15396 ts_tablet_manager.cc:1403] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.053s	user 0.009s	sys 0.011s
I20260709 12:28:11.452268 15396 raft_consensus.cc:359] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:11.452947 15396 raft_consensus.cc:740] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.453598 15396 consensus_queue.cc:260] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:11.455924 15396 ts_tablet_manager.cc:1434] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:28:11.456768 15396 tablet_bootstrap.cc:492] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:11.456730 15512 raft_consensus.cc:3060] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.479188 15396 tablet_bootstrap.cc:492] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.480140 15396 tablet_bootstrap.cc:492] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:11.480805 15396 ts_tablet_manager.cc:1403] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.024s	user 0.016s	sys 0.005s
I20260709 12:28:11.483389 15396 raft_consensus.cc:359] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:11.484155 15396 raft_consensus.cc:740] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.485073 15396 consensus_queue.cc:260] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:11.487788 15396 ts_tablet_manager.cc:1434] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:28:11.488744 15396 tablet_bootstrap.cc:492] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:11.505642 15396 tablet_bootstrap.cc:492] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.506681 15396 tablet_bootstrap.cc:492] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:11.507452 15396 ts_tablet_manager.cc:1403] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.019s	user 0.015s	sys 0.002s
I20260709 12:28:11.509958 15396 raft_consensus.cc:359] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:11.510637 15396 raft_consensus.cc:740] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.511310 15396 consensus_queue.cc:260] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:11.513332 15396 ts_tablet_manager.cc:1434] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.001s
I20260709 12:28:11.514084 15396 tablet_bootstrap.cc:492] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:11.547953 15396 tablet_bootstrap.cc:492] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.548902 15396 tablet_bootstrap.cc:492] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:11.549624 15396 ts_tablet_manager.cc:1403] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.036s	user 0.015s	sys 0.013s
I20260709 12:28:11.552567 15396 raft_consensus.cc:359] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:11.553225 15396 raft_consensus.cc:740] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.553990 15396 consensus_queue.cc:260] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:11.556744 15396 ts_tablet_manager.cc:1434] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.002s
I20260709 12:28:11.557498 15396 tablet_bootstrap.cc:492] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:11.578981 15396 tablet_bootstrap.cc:492] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.581350 15396 tablet_bootstrap.cc:492] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:11.585000 15396 ts_tablet_manager.cc:1403] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.028s	user 0.017s	sys 0.005s
I20260709 12:28:11.588714 15396 raft_consensus.cc:359] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:11.589404 15396 raft_consensus.cc:740] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.590068 15396 consensus_queue.cc:260] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:11.592283 15396 ts_tablet_manager.cc:1434] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:28:11.593030 15396 tablet_bootstrap.cc:492] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap starting.
I20260709 12:28:11.657784 15396 tablet_bootstrap.cc:492] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:11.659296 15396 tablet_bootstrap.cc:492] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a: Bootstrap complete.
I20260709 12:28:11.664901 15513 raft_consensus.cc:3060] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:11.670049 15396 ts_tablet_manager.cc:1403] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a: Time spent bootstrapping tablet: real 0.077s	user 0.013s	sys 0.023s
I20260709 12:28:11.679559 15396 raft_consensus.cc:359] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:11.681859 15396 raft_consensus.cc:740] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Initialized, Role: FOLLOWER
I20260709 12:28:11.683089 15396 consensus_queue.cc:260] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
W20260709 12:28:11.681030 14646 consensus_peers.cc:597] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 6: this message will repeat every 5th retry.
I20260709 12:28:11.697084 15396 ts_tablet_manager.cc:1434] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a: Time spent starting tablet: real 0.025s	user 0.006s	sys 0.000s
I20260709 12:28:11.797179 15513 raft_consensus.cc:3060] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:12.287809 15513 raft_consensus.cc:3060] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:19.115605 14646 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:39063, user_credentials={real_user=slave}} blocked reactor thread for 51762.9us
I20260709 12:28:20.123466  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:20.186605 14678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "13f4c8c6619b4856afad5d98d9cec315"
dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
mode: GRACEFUL
new_leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
 from {username='slave'} at 127.0.0.1:56068
I20260709 12:28:20.187691 14678 raft_consensus.cc:606] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Received request to transfer leadership to TS 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:28:20.192042 14679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "1f50744c152c4f22b65828c60d9d2974"
dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
mode: GRACEFUL
new_leader_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:56068
I20260709 12:28:20.192620 14679 raft_consensus.cc:606] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Received request to transfer leadership to TS c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:20.195293 14678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8777b3a550644b50835c268da566aee7"
dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
mode: GRACEFUL
new_leader_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:56068
I20260709 12:28:20.195971 14678 raft_consensus.cc:606] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Received request to transfer leadership to TS c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:20.198359 14678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9f24860ec9a043a491db9afb3516eedd"
dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
mode: GRACEFUL
new_leader_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:56068
I20260709 12:28:20.198844 14678 raft_consensus.cc:606] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Received request to transfer leadership to TS c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:20.211408 14756 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec"
dest_uuid: "c95afda23abe49318972444cc68998a7"
mode: GRACEFUL
new_leader_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:38716
I20260709 12:28:20.212189 14756 raft_consensus.cc:606] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Received request to transfer leadership to TS c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:20.215958 14678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "edf0c9a7101d45abbba0a1109b880e41"
dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
mode: GRACEFUL
new_leader_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:56068
I20260709 12:28:20.216498 14678 raft_consensus.cc:606] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Received request to transfer leadership to TS c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:20.218173  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 6
I20260709 12:28:20.219720  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:20.220662  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:20.275316 15667 raft_consensus.cc:993] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f: : Instructing follower c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:20.275919 15667 raft_consensus.cc:1081] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Signalling peer c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:20.279381 15495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8777b3a550644b50835c268da566aee7"
dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:41840
I20260709 12:28:20.280017 15495 raft_consensus.cc:493] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:20.280408 15495 raft_consensus.cc:3060] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:20.290333 15495 raft_consensus.cc:515] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:20.292728 15495 leader_election.cc:290] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 3 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:20.294142 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8777b3a550644b50835c268da566aee7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:20.294741 14756 raft_consensus.cc:3060] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:20.293905 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8777b3a550644b50835c268da566aee7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:20.295298 14678 raft_consensus.cc:3055] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:20.295639 14678 raft_consensus.cc:740] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:20.296428 14678 consensus_queue.cc:260] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:20.297961 14678 raft_consensus.cc:3060] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:20.300997 14756 raft_consensus.cc:2468] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 3.
I20260709 12:28:20.302798 15391 leader_election.cc:304] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:20.305653 14678 raft_consensus.cc:2468] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 3.
I20260709 12:28:20.306751 15677 raft_consensus.cc:2804] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:20.308468 15677 raft_consensus.cc:697] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 3 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:20.309332 15677 consensus_queue.cc:237] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:20.316835 15672 raft_consensus.cc:993] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f: : Instructing follower c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:20.317289 15672 raft_consensus.cc:1081] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Signalling peer c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:20.319128 15495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "1f50744c152c4f22b65828c60d9d2974"
dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:41840
I20260709 12:28:20.319679 15495 raft_consensus.cc:493] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:20.320022 15495 raft_consensus.cc:3060] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.321722 14505 catalog_manager.cc:5697] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 2 to 3, leader changed from 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66) to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 3 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:20.327054 15495 raft_consensus.cc:515] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:20.329957 15495 leader_election.cc:290] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:20.330077 14826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f50744c152c4f22b65828c60d9d2974" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:20.330827 14826 raft_consensus.cc:3060] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.330235 14679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "1f50744c152c4f22b65828c60d9d2974" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:20.331919 14679 raft_consensus.cc:3055] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:20.332265 14679 raft_consensus.cc:740] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:20.332659 15667 raft_consensus.cc:993] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f: : Instructing follower 420d5d7b2b504ff7923b7f4098c0fcce to start an election
I20260709 12:28:20.333177 14679 consensus_queue.cc:260] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:20.333199 15667 raft_consensus.cc:1081] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Signalling peer 420d5d7b2b504ff7923b7f4098c0fcce to start an election
I20260709 12:28:20.334681 14679 raft_consensus.cc:3060] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.336124 14828 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "13f4c8c6619b4856afad5d98d9cec315"
dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
 from {username='slave'} at 127.0.0.1:60064
I20260709 12:28:20.336719 14828 raft_consensus.cc:493] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:20.337051 14828 raft_consensus.cc:3060] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.338804 14826 raft_consensus.cc:2468] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:20.340538 15393 leader_election.cc:304] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:20.343300 15677 raft_consensus.cc:2804] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:20.345584 15677 raft_consensus.cc:697] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:20.346115 14828 raft_consensus.cc:515] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:20.349623 15677 consensus_queue.cc:237] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:20.351588 14679 raft_consensus.cc:2468] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:20.353282 14828 leader_election.cc:290] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:20.354403 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f4c8c6619b4856afad5d98d9cec315" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:20.355083 14753 raft_consensus.cc:3060] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.354494 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "13f4c8c6619b4856afad5d98d9cec315" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:20.356369 14683 raft_consensus.cc:3055] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:20.356637 14683 raft_consensus.cc:740] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:20.357494 14683 consensus_queue.cc:260] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:20.359022 14683 raft_consensus.cc:3060] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.365751 14753 raft_consensus.cc:2468] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 2.
I20260709 12:28:20.367249 14795 leader_election.cc:304] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:20.367983 14683 raft_consensus.cc:2468] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 2.
I20260709 12:28:20.368386 15665 raft_consensus.cc:2804] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:20.368912 15665 raft_consensus.cc:697] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:28:20.369793 15665 consensus_queue.cc:237] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:20.372606 14505 catalog_manager.cc:5697] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 1 to 2, leader changed from 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66) to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 2 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:20.384100 14503 catalog_manager.cc:5697] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 1 to 2, leader changed from 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66) to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 2 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:20.418601 15671 raft_consensus.cc:993] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f: : Instructing follower c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:20.419116 15667 raft_consensus.cc:1081] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Signalling peer c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:20.420596 15495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "edf0c9a7101d45abbba0a1109b880e41"
dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:41840
I20260709 12:28:20.421062 15495 raft_consensus.cc:493] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:20.421327 15495 raft_consensus.cc:3060] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.425848 15495 raft_consensus.cc:515] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:20.427587 15495 leader_election.cc:290] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:20.428998 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf0c9a7101d45abbba0a1109b880e41" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:20.429556 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "edf0c9a7101d45abbba0a1109b880e41" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:20.429611 14683 raft_consensus.cc:3055] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:20.430281 14828 raft_consensus.cc:3060] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.430379 14683 raft_consensus.cc:740] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:20.431703 14683 consensus_queue.cc:260] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:20.432651 14683 raft_consensus.cc:3060] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.436163 14828 raft_consensus.cc:2468] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:20.437237 15393 leader_election.cc:304] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:20.438122 15677 raft_consensus.cc:2804] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:20.438151 14683 raft_consensus.cc:2468] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:20.438688 15677 raft_consensus.cc:697] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:20.439540 15677 consensus_queue.cc:237] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:20.449769 14503 catalog_manager.cc:5697] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 1 to 2, leader changed from 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66) to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 2 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:20.505546 15672 raft_consensus.cc:993] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f: : Instructing follower c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:20.506045 15672 raft_consensus.cc:1081] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Signalling peer c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:20.510535 15495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9f24860ec9a043a491db9afb3516eedd"
dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:41840
I20260709 12:28:20.512042 15495 raft_consensus.cc:493] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:20.512480 15495 raft_consensus.cc:3060] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.517957 15495 raft_consensus.cc:515] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:20.519629 15495 leader_election.cc:290] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:20.520318 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f24860ec9a043a491db9afb3516eedd" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:20.520849 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9f24860ec9a043a491db9afb3516eedd" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:20.521739 14828 raft_consensus.cc:3060] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.520942 14683 raft_consensus.cc:3055] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:20.522261 14683 raft_consensus.cc:740] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:20.524629 14683 consensus_queue.cc:260] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:20.528613 14683 raft_consensus.cc:3060] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:20.533941 14828 raft_consensus.cc:2468] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:20.535244 14683 raft_consensus.cc:2468] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:20.535363 15393 leader_election.cc:304] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:20.536221 15677 raft_consensus.cc:2804] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:20.536707 15677 raft_consensus.cc:697] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:20.537601 15677 consensus_queue.cc:237] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:20.546933 14503 catalog_manager.cc:5697] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 1 to 2, leader changed from 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66) to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 2 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:20.781248 15463 raft_consensus.cc:993] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7: : Instructing follower c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:20.781780 15669 raft_consensus.cc:1081] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Signalling peer c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:20.783267 15513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec"
dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 12:28:20.783751 15513 raft_consensus.cc:493] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:20.784016 15513 raft_consensus.cc:3060] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:20.790608 15513 raft_consensus.cc:515] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:20.792680 15513 leader_election.cc:290] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 3 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:20.793304 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:20.793958 14683 raft_consensus.cc:3060] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:20.794531 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a40ba67c52d8403bbaaac500b1b803ec" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:20.795110 14753 raft_consensus.cc:3055] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:20.795387 14753 raft_consensus.cc:740] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:20.796168 14753 consensus_queue.cc:260] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:20.797386 14753 raft_consensus.cc:3060] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:20.800980 14683 raft_consensus.cc:2468] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 3.
I20260709 12:28:20.802379 15392 leader_election.cc:304] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:20.803156 15677 raft_consensus.cc:2804] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:20.803650 15677 raft_consensus.cc:697] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 3 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:20.804518 15677 consensus_queue.cc:237] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:20.804858 14753 raft_consensus.cc:2468] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 3.
I20260709 12:28:20.811511 14683 raft_consensus.cc:1275] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:20.813418 15677 consensus_queue.cc:1048] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:20.814730 14503 catalog_manager.cc:5697] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 2 to 3, leader changed from c95afda23abe49318972444cc68998a7 (127.4.181.67) to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 3 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:20.824728 14826 raft_consensus.cc:1275] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:20.826906 15678 consensus_queue.cc:1048] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:20.861663 14753 raft_consensus.cc:1275] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:20.862962 15692 consensus_queue.cc:1048] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:20.872064 14683 raft_consensus.cc:1275] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:20.876026 15678 consensus_queue.cc:1048] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:20.886600 14678 raft_consensus.cc:1275] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer 420d5d7b2b504ff7923b7f4098c0fcce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:20.888185 15665 consensus_queue.cc:1048] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:20.902311 14753 raft_consensus.cc:1275] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Refusing update from remote peer 420d5d7b2b504ff7923b7f4098c0fcce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:20.906893 15661 consensus_queue.cc:1048] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:20.938565 14826 raft_consensus.cc:1275] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:20.939873 15678 consensus_queue.cc:1048] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:20.949826 14678 raft_consensus.cc:1275] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:20.951345 15678 consensus_queue.cc:1048] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:20.987576 14828 raft_consensus.cc:1275] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:20.988663 15678 consensus_queue.cc:1048] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:20.997822 14678 raft_consensus.cc:1275] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:21.001065 15692 consensus_queue.cc:1048] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:21.260344 14678 raft_consensus.cc:1275] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:21.261513 15692 consensus_queue.cc:1048] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:21.273437 14753 raft_consensus.cc:1275] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:21.275030 15692 consensus_queue.cc:1048] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:21.280596  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:21.354497 14678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7"
dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
mode: GRACEFUL
new_leader_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:56068
I20260709 12:28:21.355093 14678 raft_consensus.cc:606] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 3 LEADER]: Received request to transfer leadership to TS c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:21.357921 14678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "55019c611cb74a908cb633373c6b502b"
dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
mode: GRACEFUL
new_leader_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:56068
I20260709 12:28:21.358498 14678 raft_consensus.cc:606] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Received request to transfer leadership to TS c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:21.361104 14753 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a"
dest_uuid: "c95afda23abe49318972444cc68998a7"
mode: GRACEFUL
new_leader_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:38716
I20260709 12:28:21.361689 14753 raft_consensus.cc:606] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Received request to transfer leadership to TS c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:21.365954 14678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b596dc92cc2c45838a165addea430360"
dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
mode: GRACEFUL
new_leader_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:56068
I20260709 12:28:21.366636 14678 raft_consensus.cc:606] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Received request to transfer leadership to TS c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:21.370277 14678 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e03b11e4110e41ec830cee6e3f1a88db"
dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
mode: GRACEFUL
new_leader_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:56068
I20260709 12:28:21.370831 14678 raft_consensus.cc:606] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Received request to transfer leadership to TS c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:21.375301  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:28:21.376809  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:21.377619  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:21.422068 15669 raft_consensus.cc:993] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7: : Instructing follower c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:21.422577 15463 raft_consensus.cc:1081] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Signalling peer c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:21.424191 15495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a"
dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 12:28:21.424647 15495 raft_consensus.cc:493] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:21.424984 15495 raft_consensus.cc:3060] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:21.430868 15495 raft_consensus.cc:515] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:21.432349 15495 leader_election.cc:290] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 3 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:21.433240 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:21.433606 14753 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5e224159bcb74464a91df02dfd2d755a" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:21.433858 14678 raft_consensus.cc:3060] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:21.434314 14753 raft_consensus.cc:3055] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:21.434732 15667 raft_consensus.cc:993] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f: : Instructing follower c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:21.434732 14753 raft_consensus.cc:740] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:21.435312 15667 raft_consensus.cc:1081] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Signalling peer c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:21.435827 14753 consensus_queue.cc:260] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:21.436950 14753 raft_consensus.cc:3060] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:21.439877 15513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e03b11e4110e41ec830cee6e3f1a88db"
dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:41840
I20260709 12:28:21.440440 15513 raft_consensus.cc:493] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:21.440743 15513 raft_consensus.cc:3060] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:21.443703 14753 raft_consensus.cc:2468] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 3.
I20260709 12:28:21.444666 14678 raft_consensus.cc:2468] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 3.
I20260709 12:28:21.444844 15391 leader_election.cc:304] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:21.445920 15692 raft_consensus.cc:2804] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:21.446314 15692 raft_consensus.cc:697] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 3 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:21.447070 15692 consensus_queue.cc:237] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:21.449025 15513 raft_consensus.cc:515] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:21.452911 14826 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03b11e4110e41ec830cee6e3f1a88db" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:21.453327 15513 leader_election.cc:290] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:21.453504 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e03b11e4110e41ec830cee6e3f1a88db" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:21.453460 14826 raft_consensus.cc:3060] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:21.454149 14678 raft_consensus.cc:3055] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:21.454480 14678 raft_consensus.cc:740] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:21.455392 14678 consensus_queue.cc:260] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:21.456367 14678 raft_consensus.cc:3060] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:21.452937 15667 raft_consensus.cc:993] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f: : Instructing follower c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:21.458114 15667 raft_consensus.cc:1081] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Signalling peer c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:21.460428 15495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b596dc92cc2c45838a165addea430360"
dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:41840
I20260709 12:28:21.460930 15495 raft_consensus.cc:493] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:21.461265 15495 raft_consensus.cc:3060] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:21.461472 14826 raft_consensus.cc:2468] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:21.462774 15393 leader_election.cc:304] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:21.461264 14504 catalog_manager.cc:5697] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 2 to 3, leader changed from c95afda23abe49318972444cc68998a7 (127.4.181.67) to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 3 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:21.463764 15692 raft_consensus.cc:2804] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:21.464461 15692 raft_consensus.cc:697] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:21.465642 14678 raft_consensus.cc:2468] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:21.465348 15692 consensus_queue.cc:237] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:21.468945 15495 raft_consensus.cc:515] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:21.472078 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596dc92cc2c45838a165addea430360" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:21.473560 14678 raft_consensus.cc:3055] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:21.473934 14678 raft_consensus.cc:740] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:21.473035 15495 leader_election.cc:290] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:21.475323 14678 consensus_queue.cc:260] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:21.476492 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b596dc92cc2c45838a165addea430360" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:21.476547 14678 raft_consensus.cc:3060] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:21.477133 14756 raft_consensus.cc:3060] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:21.485461 14678 raft_consensus.cc:2468] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:21.488801 15392 leader_election.cc:304] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:21.489668 15677 raft_consensus.cc:2804] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:21.489943 14756 raft_consensus.cc:2468] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:21.490072 15677 raft_consensus.cc:697] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:21.491528 15677 consensus_queue.cc:237] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:21.509572 14504 catalog_manager.cc:5697] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 1 to 2, leader changed from 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66) to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 2 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:21.510721 14504 catalog_manager.cc:5697] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 1 to 2, leader changed from 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66) to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 2 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:21.567507 15671 raft_consensus.cc:993] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f: : Instructing follower c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:21.568014 15667 raft_consensus.cc:1081] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Signalling peer c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:21.569381 15513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "55019c611cb74a908cb633373c6b502b"
dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:41840
I20260709 12:28:21.569911 15513 raft_consensus.cc:493] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:21.570237 15513 raft_consensus.cc:3060] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:21.577152 15513 raft_consensus.cc:515] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:21.579521 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55019c611cb74a908cb633373c6b502b" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:21.580119 14828 raft_consensus.cc:3060] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:21.587082 15513 leader_election.cc:290] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Requested vote from peers 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543), 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705)
I20260709 12:28:21.587111 14828 raft_consensus.cc:2468] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:21.587284 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "55019c611cb74a908cb633373c6b502b" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:21.588093 14678 raft_consensus.cc:3055] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:21.588447 14678 raft_consensus.cc:740] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:21.588488 15393 leader_election.cc:304] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:21.589373 15677 raft_consensus.cc:2804] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:21.589252 14678 consensus_queue.cc:260] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:21.589917 15677 raft_consensus.cc:697] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:21.590420 14678 raft_consensus.cc:3060] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:21.590788 15677 consensus_queue.cc:237] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } }
I20260709 12:28:21.596599 14678 raft_consensus.cc:2468] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:21.598196 15671 raft_consensus.cc:993] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f: : Instructing follower c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:21.598731 15667 raft_consensus.cc:1081] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 3 LEADER]: Signalling peer c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:21.600618 15513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7"
dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:41840
I20260709 12:28:21.601102 15513 raft_consensus.cc:493] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:21.601457 15513 raft_consensus.cc:3060] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:21.605315 14504 catalog_manager.cc:5697] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 1 to 2, leader changed from 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66) to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 2 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:21.608104 15513 raft_consensus.cc:515] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:21.610730 15513 leader_election.cc:290] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 4 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:21.611500 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:21.612107 14756 raft_consensus.cc:3060] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:21.612938 14678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "42f3f72687b04e52af87a05e2f8767d7" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:21.613586 14678 raft_consensus.cc:3055] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:21.613989 14678 raft_consensus.cc:740] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:21.614871 14678 consensus_queue.cc:260] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:21.616137 14678 raft_consensus.cc:3060] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:21.618793 14756 raft_consensus.cc:2468] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 4.
I20260709 12:28:21.619885 15391 leader_election.cc:304] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:21.620499 15677 raft_consensus.cc:2804] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:21.620980 15677 raft_consensus.cc:697] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 4 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:21.622130 14678 raft_consensus.cc:2468] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 4.
I20260709 12:28:21.621934 15677 consensus_queue.cc:237] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:21.630868 14504 catalog_manager.cc:5697] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 3 to 4, leader changed from 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66) to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 4 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:21.846336 14754 raft_consensus.cc:1275] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:21.847524 15677 consensus_queue.cc:1048] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:21.857653 14683 raft_consensus.cc:1275] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:21.859014 15692 consensus_queue.cc:1048] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:21.879142 14756 raft_consensus.cc:1275] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:21.880234 15677 consensus_queue.cc:1048] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:21.900701 14683 raft_consensus.cc:1275] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:21.902094 15678 consensus_queue.cc:1048] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:21.974529 14828 raft_consensus.cc:1275] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:21.975910 15678 consensus_queue.cc:1048] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:21.985860 14683 raft_consensus.cc:1275] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:21.987283 15677 consensus_queue.cc:1048] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:22.076845 14678 raft_consensus.cc:1275] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:22.078563 15677 consensus_queue.cc:1048] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:22.090260 14828 raft_consensus.cc:1275] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:22.094319 15692 consensus_queue.cc:1048] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20260709 12:28:22.097263 14756 raft_consensus.cc:1275] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 4 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:22.098893 15692 consensus_queue.cc:1048] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:22.123941 14678 raft_consensus.cc:1275] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 4 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20260709 12:28:22.126729 15678 consensus_queue.cc:1048] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:22.418927  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:22.466569 14754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0d83f753ff274231bf05990f4eda9551"
dest_uuid: "c95afda23abe49318972444cc68998a7"
mode: GRACEFUL
new_leader_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:38716
I20260709 12:28:22.467113 14754 raft_consensus.cc:606] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Received request to transfer leadership to TS c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:22.469614 14754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "0fd3630b48e04f27bb2a681c2b329e2f"
dest_uuid: "c95afda23abe49318972444cc68998a7"
mode: GRACEFUL
new_leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
 from {username='slave'} at 127.0.0.1:38716
I20260709 12:28:22.470198 14754 raft_consensus.cc:606] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Received request to transfer leadership to TS 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:28:22.472551 14754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2c5cdf241a9849819398d5d313152db6"
dest_uuid: "c95afda23abe49318972444cc68998a7"
mode: GRACEFUL
new_leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
 from {username='slave'} at 127.0.0.1:38716
I20260709 12:28:22.473084 14754 raft_consensus.cc:606] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Received request to transfer leadership to TS 420d5d7b2b504ff7923b7f4098c0fcce
I20260709 12:28:22.475410 14754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb"
dest_uuid: "c95afda23abe49318972444cc68998a7"
mode: GRACEFUL
new_leader_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:38716
I20260709 12:28:22.475919 14754 raft_consensus.cc:606] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Received request to transfer leadership to TS c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:22.478494 14754 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0"
dest_uuid: "c95afda23abe49318972444cc68998a7"
mode: GRACEFUL
new_leader_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:38716
I20260709 12:28:22.479233 14754 raft_consensus.cc:606] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Received request to transfer leadership to TS c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:22.480300  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 5
I20260709 12:28:22.481511  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:22.482095  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:22.488183 15716 raft_consensus.cc:993] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7: : Instructing follower c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:22.488778 15463 raft_consensus.cc:1081] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Signalling peer c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:22.490353 15495 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0"
dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 12:28:22.490937 15495 raft_consensus.cc:493] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:22.491263 15495 raft_consensus.cc:3060] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:22.496573 15495 raft_consensus.cc:515] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:22.498317 15495 leader_election.cc:290] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 3 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:22.498883 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:22.498926 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a3a3209f9d64ed6bc4036a9d8bc0ef0" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:22.499513 14828 raft_consensus.cc:3060] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:22.500106 14754 raft_consensus.cc:3055] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:22.500391 14754 raft_consensus.cc:740] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:22.501179 14754 consensus_queue.cc:260] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:22.502202 14754 raft_consensus.cc:3060] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:22.509375 14754 raft_consensus.cc:2468] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 3.
I20260709 12:28:22.509676 14828 raft_consensus.cc:2468] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 3.
I20260709 12:28:22.510612 15391 leader_election.cc:304] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:22.512131 15732 raft_consensus.cc:2804] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:22.512612 15732 raft_consensus.cc:697] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 3 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:22.513484 15732 consensus_queue.cc:237] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:22.531957 14503 catalog_manager.cc:5697] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 2 to 3, leader changed from c95afda23abe49318972444cc68998a7 (127.4.181.67) to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 3 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:22.633291 15716 raft_consensus.cc:993] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7: : Instructing follower 420d5d7b2b504ff7923b7f4098c0fcce to start an election
I20260709 12:28:22.633838 15716 raft_consensus.cc:1081] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Signalling peer 420d5d7b2b504ff7923b7f4098c0fcce to start an election
I20260709 12:28:22.635660 14826 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2c5cdf241a9849819398d5d313152db6"
dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
 from {username='slave'} at 127.0.0.1:60082
I20260709 12:28:22.636405 14826 raft_consensus.cc:493] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:22.636751 14826 raft_consensus.cc:3060] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.641741 14826 raft_consensus.cc:515] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:22.643416 14826 leader_election.cc:290] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:22.644299 14679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5cdf241a9849819398d5d313152db6" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:22.644701 14754 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2c5cdf241a9849819398d5d313152db6" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:22.644986 14679 raft_consensus.cc:3060] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.645255 14754 raft_consensus.cc:3055] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:22.645576 14754 raft_consensus.cc:740] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:22.646267 14754 consensus_queue.cc:260] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:22.647383 14754 raft_consensus.cc:3060] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.650719 14679 raft_consensus.cc:2468] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 2.
I20260709 12:28:22.652588 14796 leader_election.cc:304] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, 9a105adb44fb47078d6cb03a6c02026f; no voters: 
I20260709 12:28:22.653379 14754 raft_consensus.cc:2468] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 2.
I20260709 12:28:22.654899 15665 raft_consensus.cc:2804] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:22.656888 15665 raft_consensus.cc:697] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:28:22.657737 15665 consensus_queue.cc:237] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:22.667753 14503 catalog_manager.cc:5697] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 1 to 2, leader changed from c95afda23abe49318972444cc68998a7 (127.4.181.67) to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 2 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:22.739352 15716 raft_consensus.cc:993] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7: : Instructing follower 420d5d7b2b504ff7923b7f4098c0fcce to start an election
I20260709 12:28:22.739998 15463 raft_consensus.cc:1081] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Signalling peer 420d5d7b2b504ff7923b7f4098c0fcce to start an election
I20260709 12:28:22.741602 14824 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0fd3630b48e04f27bb2a681c2b329e2f"
dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
 from {username='slave'} at 127.0.0.1:60082
I20260709 12:28:22.742156 14824 raft_consensus.cc:493] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:22.742487 14824 raft_consensus.cc:3060] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.748191 14824 raft_consensus.cc:515] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:22.749842 14824 leader_election.cc:290] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:22.750448 14679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd3630b48e04f27bb2a681c2b329e2f" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:22.750730 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0fd3630b48e04f27bb2a681c2b329e2f" candidate_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:22.751099 14679 raft_consensus.cc:3060] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.751235 14756 raft_consensus.cc:3055] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:22.751619 14756 raft_consensus.cc:740] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:22.752432 14756 consensus_queue.cc:260] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:22.753705 14756 raft_consensus.cc:3060] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.758339 14679 raft_consensus.cc:2468] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 2.
I20260709 12:28:22.761057 14756 raft_consensus.cc:2468] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 420d5d7b2b504ff7923b7f4098c0fcce in term 2.
I20260709 12:28:22.762586 14795 leader_election.cc:304] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:22.763312 15665 raft_consensus.cc:2804] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:22.763768 15665 raft_consensus.cc:697] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 LEADER]: Becoming Leader. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:28:22.764494 15665 consensus_queue.cc:237] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:22.772954 14503 catalog_manager.cc:5697] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce reported cstate change: term changed from 1 to 2, leader changed from c95afda23abe49318972444cc68998a7 (127.4.181.67) to 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68). New cstate: current_term: 2 leader_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:22.776018 15716 raft_consensus.cc:993] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7: : Instructing follower c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:22.776952 15463 raft_consensus.cc:1081] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Signalling peer c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:22.778673 15513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "0d83f753ff274231bf05990f4eda9551"
dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 12:28:22.779222 15513 raft_consensus.cc:493] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:22.779510 15513 raft_consensus.cc:3060] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.785421 15513 raft_consensus.cc:515] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:22.786844 15513 leader_election.cc:290] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:22.787429 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d83f753ff274231bf05990f4eda9551" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:22.788040 14756 raft_consensus.cc:3055] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:22.788106 14824 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "0d83f753ff274231bf05990f4eda9551" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:22.788389 14756 raft_consensus.cc:740] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:22.788705 14824 raft_consensus.cc:3060] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.789124 14756 consensus_queue.cc:260] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:22.790360 14756 raft_consensus.cc:3060] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:22.795341 14824 raft_consensus.cc:2468] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:22.796470 15393 leader_election.cc:304] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 420d5d7b2b504ff7923b7f4098c0fcce, c0cbbdf206b5458e9af48c22b862264a; no voters: 
I20260709 12:28:22.796990 14756 raft_consensus.cc:2468] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:22.797222 15678 raft_consensus.cc:2804] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:22.797801 15678 raft_consensus.cc:697] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:22.798794 15678 consensus_queue.cc:237] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } }
I20260709 12:28:22.803696 15742 raft_consensus.cc:993] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7: : Instructing follower c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:22.804193 15742 raft_consensus.cc:1081] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Signalling peer c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:22.805720 15513 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb"
dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:41856
I20260709 12:28:22.806171 15513 raft_consensus.cc:493] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:22.806520 15513 raft_consensus.cc:3060] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:22.811141 15513 raft_consensus.cc:515] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:22.812631 15513 leader_election.cc:290] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 3 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:22.813169 14503 catalog_manager.cc:5697] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 1 to 2, leader changed from c95afda23abe49318972444cc68998a7 (127.4.181.67) to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 2 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:22.813993 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:22.814580 14756 raft_consensus.cc:3055] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:22.814893 14756 raft_consensus.cc:740] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: c95afda23abe49318972444cc68998a7, State: Running, Role: LEADER
I20260709 12:28:22.814865 14679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "2e708aa2c4bb45e0b3614e6447ef90cb" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:22.815766 14756 consensus_queue.cc:260] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:22.816139 14679 raft_consensus.cc:3060] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:22.816883 14756 raft_consensus.cc:3060] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:22.822244 14756 raft_consensus.cc:2468] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 3.
I20260709 12:28:22.823335 15391 leader_election.cc:304] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:22.824153 15678 raft_consensus.cc:2804] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:22.824658 15678 raft_consensus.cc:697] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 3 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:22.825450 15678 consensus_queue.cc:237] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:22.825752 14679 raft_consensus.cc:2468] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 3.
I20260709 12:28:22.835729 14503 catalog_manager.cc:5697] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 2 to 3, leader changed from c95afda23abe49318972444cc68998a7 (127.4.181.67) to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 3 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:23.003280 14824 raft_consensus.cc:1275] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 3 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:23.004704 15728 consensus_queue.cc:1048] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:23.006371 14756 raft_consensus.cc:1275] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:23.008999 15728 consensus_queue.cc:1048] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:23.154997 14679 raft_consensus.cc:1275] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer 420d5d7b2b504ff7923b7f4098c0fcce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.157747 15738 consensus_queue.cc:1048] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.172654 14756 raft_consensus.cc:1275] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Refusing update from remote peer 420d5d7b2b504ff7923b7f4098c0fcce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.176857 15665 consensus_queue.cc:1048] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.191668 14679 raft_consensus.cc:1275] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer 420d5d7b2b504ff7923b7f4098c0fcce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.193972 15738 consensus_queue.cc:1048] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.215583 14756 raft_consensus.cc:1275] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Refusing update from remote peer 420d5d7b2b504ff7923b7f4098c0fcce: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.217175 15709 consensus_queue.cc:1048] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:23.269039 14824 raft_consensus.cc:1275] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.270328 15728 consensus_queue.cc:1048] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.280128 14756 raft_consensus.cc:1275] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:23.281618 15678 consensus_queue.cc:1048] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:23.333237 14756 raft_consensus.cc:1275] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:23.334496 15678 consensus_queue.cc:1048] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:23.355686 14678 raft_consensus.cc:1275] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:23.357375 15758 consensus_queue.cc:1048] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:23.532579  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:23.581550 14824 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "d93f4e1359094f6ba6afc3148d28df68"
dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
mode: GRACEFUL
new_leader_uuid: "9a105adb44fb47078d6cb03a6c02026f"
 from {username='slave'} at 127.0.0.1:37472
I20260709 12:28:23.582136 14824 raft_consensus.cc:606] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Received request to transfer leadership to TS 9a105adb44fb47078d6cb03a6c02026f
I20260709 12:28:23.583350  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:23.584512  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:23.585139  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:23.998227 15665 raft_consensus.cc:993] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce: : Instructing follower 9a105adb44fb47078d6cb03a6c02026f to start an election
I20260709 12:28:23.998728 15665 raft_consensus.cc:1081] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Signalling peer 9a105adb44fb47078d6cb03a6c02026f to start an election
I20260709 12:28:24.000125 14678 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "d93f4e1359094f6ba6afc3148d28df68"
dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
 from {username='slave'} at 127.0.0.1:47342
I20260709 12:28:24.000528 14678 raft_consensus.cc:493] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:24.000764 14678 raft_consensus.cc:3060] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:24.007243 14678 raft_consensus.cc:515] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:24.009670 14678 leader_election.cc:290] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: Requested vote from peers c95afda23abe49318972444cc68998a7 (127.4.181.67:42945), 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68:35543)
I20260709 12:28:24.011548 14828 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93f4e1359094f6ba6afc3148d28df68" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "420d5d7b2b504ff7923b7f4098c0fcce"
I20260709 12:28:24.012133 14828 raft_consensus.cc:3055] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:24.012205 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d93f4e1359094f6ba6afc3148d28df68" candidate_uuid: "9a105adb44fb47078d6cb03a6c02026f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:24.012395 14828 raft_consensus.cc:740] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 420d5d7b2b504ff7923b7f4098c0fcce, State: Running, Role: LEADER
I20260709 12:28:24.012837 14756 raft_consensus.cc:3060] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:24.013329 14828 consensus_queue.cc:260] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:24.014719 14828 raft_consensus.cc:3060] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:24.019754 14756 raft_consensus.cc:2468] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 2.
I20260709 12:28:24.021090 14828 raft_consensus.cc:2468] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9a105adb44fb47078d6cb03a6c02026f in term 2.
I20260709 12:28:24.023988 14647 leader_election.cc:304] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9a105adb44fb47078d6cb03a6c02026f, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:24.024688 15764 raft_consensus.cc:2804] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:24.025777 15764 raft_consensus.cc:697] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Becoming Leader. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:24.026734 15764 consensus_queue.cc:237] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } }
I20260709 12:28:24.037274 14503 catalog_manager.cc:5697] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f reported cstate change: term changed from 1 to 2, leader changed from 420d5d7b2b504ff7923b7f4098c0fcce (127.4.181.68) to 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66). New cstate: current_term: 2 leader_uuid: "9a105adb44fb47078d6cb03a6c02026f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:24.409065 14756 raft_consensus.cc:1275] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Refusing update from remote peer 9a105adb44fb47078d6cb03a6c02026f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:24.410311 15667 consensus_queue.cc:1048] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:24.418139 14828 raft_consensus.cc:1275] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Refusing update from remote peer 9a105adb44fb47078d6cb03a6c02026f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:24.419996 15667 consensus_queue.cc:1048] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [LEADER]: Connected to new peer: Peer: permanent_uuid: "420d5d7b2b504ff7923b7f4098c0fcce" member_type: VOTER last_known_addr { host: "127.4.181.68" port: 35543 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:24.621471  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:24.654600 14683 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fa8000e051fc45f8a4f3782b144f95a8"
dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
mode: GRACEFUL
new_leader_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:56068
I20260709 12:28:24.655061 14683 raft_consensus.cc:606] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Received request to transfer leadership to TS c0cbbdf206b5458e9af48c22b862264a
I20260709 12:28:24.656144  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 1
I20260709 12:28:24.657262  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:24.657804  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:24.922099 15740 raft_consensus.cc:993] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f: : Instructing follower c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:24.922605 15740 raft_consensus.cc:1081] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Signalling peer c0cbbdf206b5458e9af48c22b862264a to start an election
I20260709 12:28:24.924240 15512 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fa8000e051fc45f8a4f3782b144f95a8"
dest_uuid: "c0cbbdf206b5458e9af48c22b862264a"
 from {username='slave'} at 127.0.0.1:41840
I20260709 12:28:24.924712 15512 raft_consensus.cc:493] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:24.925036 15512 raft_consensus.cc:3060] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:24.932912 15512 raft_consensus.cc:515] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:24.935130 15512 leader_election.cc:290] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Requested vote from peers 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705), c95afda23abe49318972444cc68998a7 (127.4.181.67:42945)
I20260709 12:28:24.935612 14683 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8000e051fc45f8a4f3782b144f95a8" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "9a105adb44fb47078d6cb03a6c02026f"
I20260709 12:28:24.936260 14756 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fa8000e051fc45f8a4f3782b144f95a8" candidate_uuid: "c0cbbdf206b5458e9af48c22b862264a" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "c95afda23abe49318972444cc68998a7"
I20260709 12:28:24.936866 14683 raft_consensus.cc:3055] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:24.936954 14756 raft_consensus.cc:3060] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:24.937135 14683 raft_consensus.cc:740] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 9a105adb44fb47078d6cb03a6c02026f, State: Running, Role: LEADER
I20260709 12:28:24.937816 14683 consensus_queue.cc:260] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:24.938700 14683 raft_consensus.cc:3060] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:24.941865 14756 raft_consensus.cc:2468] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:24.943027 15391 leader_election.cc:304] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: c0cbbdf206b5458e9af48c22b862264a, c95afda23abe49318972444cc68998a7; no voters: 
I20260709 12:28:24.943861 15728 raft_consensus.cc:2804] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:24.944314 14683 raft_consensus.cc:2468] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate c0cbbdf206b5458e9af48c22b862264a in term 2.
I20260709 12:28:24.944377 15728 raft_consensus.cc:697] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Becoming Leader. State: Replica: c0cbbdf206b5458e9af48c22b862264a, State: Running, Role: LEADER
I20260709 12:28:24.945508 15728 consensus_queue.cc:237] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } }
I20260709 12:28:24.961386 14505 catalog_manager.cc:5697] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a reported cstate change: term changed from 1 to 2, leader changed from 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66) to c0cbbdf206b5458e9af48c22b862264a (127.4.181.65). New cstate: current_term: 2 leader_uuid: "c0cbbdf206b5458e9af48c22b862264a" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "c0cbbdf206b5458e9af48c22b862264a" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 39063 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:25.493469 14678 raft_consensus.cc:1275] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:25.494604 15758 consensus_queue.cc:1048] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "9a105adb44fb47078d6cb03a6c02026f" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 46705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:25.505324 14756 raft_consensus.cc:1275] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Refusing update from remote peer c0cbbdf206b5458e9af48c22b862264a: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:25.506975 15728 consensus_queue.cc:1048] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [LEADER]: Connected to new peer: Peer: permanent_uuid: "c95afda23abe49318972444cc68998a7" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42945 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:25.691730  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:25.725371  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:25.726336  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:25.726774  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:25.761708  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:25.800499  4821 tablet_server.cc:179] TabletServer@127.4.181.65:39063 shutting down...
W20260709 12:28:25.813030 14794 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 289 similar messages]
W20260709 12:28:25.834823 14794 consensus_peers.cc:597] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:25.836485 14794 consensus_peers.cc:597] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.852046  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:25.853112  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.854106  4821 raft_consensus.cc:2243] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:28:25.855105 14794 consensus_peers.cc:597] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.855182  4821 raft_consensus.cc:2272] T b596dc92cc2c45838a165addea430360 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.858296  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.859170  4821 raft_consensus.cc:2243] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.859609  4821 raft_consensus.cc:2272] T 242076f4476b46f1a12a0a07ced33d27 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.861977  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.862686  4821 raft_consensus.cc:2243] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.863111  4821 raft_consensus.cc:2272] T 2cf96c15d37c4522ab37cf6e48555598 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.865141  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.865705  4821 raft_consensus.cc:2243] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.866197  4821 raft_consensus.cc:2272] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.868994  4821 tablet_replica.cc:333] stopping tablet replica
W20260709 12:28:25.869834 14794 consensus_peers.cc:597] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.869866  4821 raft_consensus.cc:2243] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.870738  4821 raft_consensus.cc:2272] T dcee6c60580642cd8bb2d1941ea0be79 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.874019  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.875020  4821 raft_consensus.cc:2243] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:25.875938  4821 raft_consensus.cc:2272] T 55019c611cb74a908cb633373c6b502b P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.879012  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.879652  4821 raft_consensus.cc:2243] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.880096  4821 raft_consensus.cc:2272] T 8848d1ae1c0143efa3af13914871a009 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:25.882421 14794 consensus_peers.cc:597] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.882895  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.883567  4821 raft_consensus.cc:2243] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.883975  4821 raft_consensus.cc:2272] T df4e4a9a715c4425a25afa8c34b1dd2a P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.885944  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.886510  4821 raft_consensus.cc:2243] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.886930  4821 raft_consensus.cc:2272] T 78415090b3b941069b3cc1a7540a8542 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.889571  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.890170  4821 raft_consensus.cc:2243] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.890722  4821 raft_consensus.cc:2272] T 5d7f54d9f158426396fa7e71a63ce964 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:25.891666 14720 consensus_peers.cc:597] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.893402  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.894151  4821 raft_consensus.cc:2243] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.894869  4821 raft_consensus.cc:2272] T 318e36a972bd4f25a06acdfea9b1bfe9 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.897926  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.898564  4821 raft_consensus.cc:2243] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.898962  4821 raft_consensus.cc:2272] T 0c22c8f015eb4f498db641dca9ea7900 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.901211  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.901861  4821 raft_consensus.cc:2243] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.902361  4821 raft_consensus.cc:2272] T df5fcaa8194c4e4d8edfc076579b7629 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.905112  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.906102  4821 raft_consensus.cc:2243] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.906709  4821 raft_consensus.cc:2272] T 9e8190b1186645b4aa61fbd5207622cf P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.909116  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.909864  4821 raft_consensus.cc:2243] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:28:25.910120 14720 consensus_peers.cc:597] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.910825  4821 raft_consensus.cc:2272] T 1f50744c152c4f22b65828c60d9d2974 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.913954  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.914884  4821 raft_consensus.cc:2243] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.915508  4821 raft_consensus.cc:2272] T 645a95a66395468daa1986ee77838eaa P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:25.918375 14646 consensus_peers.cc:597] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.918709  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.919607  4821 raft_consensus.cc:2243] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.920167  4821 raft_consensus.cc:2272] T dba1b4acd4da45e7b1eee66ab684bd93 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:25.920470 14720 consensus_peers.cc:597] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.922783  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.923411  4821 raft_consensus.cc:2243] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.923780  4821 raft_consensus.cc:2272] T 7b80b946940f485e813a69a1ed96c203 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.925798  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.926339  4821 raft_consensus.cc:2243] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.926717  4821 raft_consensus.cc:2272] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.928960  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.929672  4821 raft_consensus.cc:2243] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:25.930519  4821 raft_consensus.cc:2272] T 0d83f753ff274231bf05990f4eda9551 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:25.930998 14646 consensus_peers.cc:597] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.932793  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.933409  4821 raft_consensus.cc:2243] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.933750  4821 raft_consensus.cc:2272] T 742010a70c40456a920924c8339a6e26 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.935771  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.936297  4821 raft_consensus.cc:2243] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.936625  4821 raft_consensus.cc:2272] T 6dd7f28a6ca34728b1f3c599fc653c6d P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.938405  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.938979  4821 raft_consensus.cc:2243] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.939317  4821 raft_consensus.cc:2272] T 8c2e9afe81394f0daa8b09695c7a43ae P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.941365  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.942034  4821 raft_consensus.cc:2243] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:25.942845  4821 raft_consensus.cc:2272] T e03b11e4110e41ec830cee6e3f1a88db P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:25.943478 14794 consensus_peers.cc:597] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.945021  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.945875  4821 raft_consensus.cc:2243] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:25.946796  4821 raft_consensus.cc:2272] T 9f24860ec9a043a491db9afb3516eedd P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:25.947809 14794 consensus_peers.cc:597] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.949132  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.949797  4821 raft_consensus.cc:2243] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:25.950587  4821 raft_consensus.cc:2272] T 8777b3a550644b50835c268da566aee7 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.952775  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.953330  4821 raft_consensus.cc:2243] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.953763  4821 raft_consensus.cc:2272] T 4c3d4c5596d44c5ebc68130616ef1ddb P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.956228  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.956809  4821 raft_consensus.cc:2243] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.957259  4821 raft_consensus.cc:2272] T d7c8780aab4e49fc9b697191f4fde170 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.960327  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.961249  4821 raft_consensus.cc:2243] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:25.961272 14794 consensus_peers.cc:597] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.961833  4821 raft_consensus.cc:2272] T 3c423e2343f442c79ab8cecd3cb76d57 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.964772  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.965509  4821 raft_consensus.cc:2243] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:25.966540  4821 raft_consensus.cc:2272] T 2e708aa2c4bb45e0b3614e6447ef90cb P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.969183  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.969738  4821 raft_consensus.cc:2243] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:25.970547  4821 raft_consensus.cc:2272] T edf0c9a7101d45abbba0a1109b880e41 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.973434  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.974220  4821 raft_consensus.cc:2243] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.974874  4821 raft_consensus.cc:2272] T 82ff441d536243878e4f32c69217a59a P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.977207  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.977855  4821 raft_consensus.cc:2243] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:25.978770  4821 raft_consensus.cc:2272] T 42f3f72687b04e52af87a05e2f8767d7 P c0cbbdf206b5458e9af48c22b862264a [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.980679  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.981168  4821 raft_consensus.cc:2243] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.981635  4821 raft_consensus.cc:2272] T 8f70df459ff44f5b95b6a780b4d2a596 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.983610  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.984133  4821 raft_consensus.cc:2243] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.984511  4821 raft_consensus.cc:2272] T 0ca6238c0f244dd1a911e44a703e0f8b P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.986405  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.986992  4821 raft_consensus.cc:2243] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:25.987540  4821 raft_consensus.cc:2272] T 99a425949e144909995513a045d40199 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.990216  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.990902  4821 raft_consensus.cc:2243] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:25.990972 14720 consensus_peers.cc:597] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.991389  4821 raft_consensus.cc:2272] T 9e6cc46cc8484c24aef89febc4a0da98 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.994288  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.994951  4821 raft_consensus.cc:2243] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:25.995309 14720 consensus_peers.cc:597] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:25.995393  4821 raft_consensus.cc:2272] T c2429c63bff3418fa4b6e9e734cc5b04 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:25.997699  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:25.998270  4821 raft_consensus.cc:2243] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:25.999166  4821 raft_consensus.cc:2272] T fa8000e051fc45f8a4f3782b144f95a8 P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.002000  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:26.002761  4821 raft_consensus.cc:2243] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.003211  4821 raft_consensus.cc:2272] T da938990b3ec47338496f5764c730ccb P c0cbbdf206b5458e9af48c22b862264a [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.005597  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:26.006135  4821 raft_consensus.cc:2243] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.006930  4821 raft_consensus.cc:2272] T a40ba67c52d8403bbaaac500b1b803ec P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.009109  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:26.009590  4821 raft_consensus.cc:2243] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.009969  4821 raft_consensus.cc:2272] T 37fcef99f4594e7f9d6132ec5719da49 P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.012648  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:26.013206  4821 raft_consensus.cc:2243] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.013619  4821 raft_consensus.cc:2272] T 446076fe225641ee8d6ad7fe5a4777ee P c0cbbdf206b5458e9af48c22b862264a [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.016566  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:26.017264  4821 raft_consensus.cc:2243] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.018384  4821 raft_consensus.cc:2272] T 5e224159bcb74464a91df02dfd2d755a P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.021212  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:26.021813  4821 raft_consensus.cc:2243] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:28:26.022241 14794 consensus_peers.cc:597] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.022851  4821 raft_consensus.cc:2272] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c0cbbdf206b5458e9af48c22b862264a [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:26.024511 14646 consensus_peers.cc:597] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.053094 14646 consensus_peers.cc:597] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.066812 14720 consensus_peers.cc:597] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.073383 14646 consensus_peers.cc:597] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.099439  4821 tablet_server.cc:196] TabletServer@127.4.181.65:39063 shutdown complete.
W20260709 12:28:26.103668 14720 consensus_peers.cc:597] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.131068 14720 consensus_peers.cc:597] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.158913 14720 consensus_peers.cc:597] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.159451 14720 consensus_peers.cc:597] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.159919 14646 consensus_peers.cc:597] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.189257  4821 tablet_server.cc:179] TabletServer@127.4.181.66:0 shutting down...
W20260709 12:28:26.203719 14722 consensus_peers.cc:597] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.204275 14646 consensus_peers.cc:597] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.208525 14646 consensus_peers.cc:597] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.222299 14646 consensus_peers.cc:597] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.224143 14796 consensus_peers.cc:597] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.229496 14720 consensus_peers.cc:597] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.230232 14646 consensus_peers.cc:597] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f -> Peer c0cbbdf206b5458e9af48c22b862264a (127.4.181.65:39063): Couldn't send request to peer c0cbbdf206b5458e9af48c22b862264a. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:39063: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.242862  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:26.243847  4821 tablet_replica.cc:333] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.244951  4821 raft_consensus.cc:2243] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.246016  4821 raft_consensus.cc:2272] T b2190ef737a2471ab10213a5ea05bf40 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:26.247378 14796 consensus_peers.cc:597] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.248900  4821 tablet_replica.cc:333] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.249567  4821 raft_consensus.cc:2243] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.250350  4821 raft_consensus.cc:2272] T d7c8780aab4e49fc9b697191f4fde170 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.252975  4821 tablet_replica.cc:333] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.253844  4821 raft_consensus.cc:2243] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.254354  4821 raft_consensus.cc:2272] T 13f4c8c6619b4856afad5d98d9cec315 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:26.256218 14796 consensus_peers.cc:597] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.256899  4821 tablet_replica.cc:333] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.257648  4821 raft_consensus.cc:2243] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.258452  4821 raft_consensus.cc:2272] T 318e36a972bd4f25a06acdfea9b1bfe9 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.260667  4821 tablet_replica.cc:333] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.261229  4821 raft_consensus.cc:2243] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.261621  4821 raft_consensus.cc:2272] T 2c5cdf241a9849819398d5d313152db6 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.263633  4821 tablet_replica.cc:333] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.264196  4821 raft_consensus.cc:2243] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.264585  4821 raft_consensus.cc:2272] T bb08a1bd554c4287aab87fc068c0039d P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.266405  4821 tablet_replica.cc:333] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.266995  4821 raft_consensus.cc:2243] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.267426  4821 raft_consensus.cc:2272] T 0fd3630b48e04f27bb2a681c2b329e2f P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.269193  4821 tablet_replica.cc:333] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.269707  4821 raft_consensus.cc:2243] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.270480  4821 raft_consensus.cc:2272] T 0c22c8f015eb4f498db641dca9ea7900 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.272481  4821 tablet_replica.cc:333] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.273231  4821 raft_consensus.cc:2243] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.273684  4821 raft_consensus.cc:2272] T a82a93abcc0d49fe8790a150daf9accc P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.276527  4821 tablet_replica.cc:333] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.277349  4821 raft_consensus.cc:2243] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.278337  4821 raft_consensus.cc:2272] T 7b80b946940f485e813a69a1ed96c203 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.280544  4821 tablet_replica.cc:333] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.281284  4821 raft_consensus.cc:2243] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.281798  4821 raft_consensus.cc:2272] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.284193  4821 tablet_replica.cc:333] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.284795  4821 raft_consensus.cc:2243] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.285202  4821 raft_consensus.cc:2272] T 99a425949e144909995513a045d40199 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.287235  4821 tablet_replica.cc:333] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.288246  4821 raft_consensus.cc:2243] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.288811  4821 raft_consensus.cc:2272] T 4c3d4c5596d44c5ebc68130616ef1ddb P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.291529  4821 tablet_replica.cc:333] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
W20260709 12:28:26.291556 14796 consensus_peers.cc:597] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.292214  4821 raft_consensus.cc:2243] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.292692  4821 raft_consensus.cc:2272] T 8777b3a550644b50835c268da566aee7 P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.294894  4821 tablet_replica.cc:333] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.295506  4821 raft_consensus.cc:2243] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.296285  4821 raft_consensus.cc:2272] T 1bdea069a44b42d099e6fc3f6c6333cc P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.298179  4821 tablet_replica.cc:333] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.298797  4821 raft_consensus.cc:2243] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.299209  4821 raft_consensus.cc:2272] T ef1bdc8f0d36475f87c7da7d8a998240 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.301043  4821 tablet_replica.cc:333] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.301568  4821 raft_consensus.cc:2243] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.302299  4821 raft_consensus.cc:2272] T df5fcaa8194c4e4d8edfc076579b7629 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.304190  4821 tablet_replica.cc:333] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.304760  4821 raft_consensus.cc:2243] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.305540  4821 raft_consensus.cc:2272] T 645a95a66395468daa1986ee77838eaa P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.307605  4821 tablet_replica.cc:333] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.308132  4821 raft_consensus.cc:2243] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.308525  4821 raft_consensus.cc:2272] T 1f50744c152c4f22b65828c60d9d2974 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.310305  4821 tablet_replica.cc:333] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.310911  4821 raft_consensus.cc:2243] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.311328  4821 raft_consensus.cc:2272] T dba1b4acd4da45e7b1eee66ab684bd93 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.313707  4821 tablet_replica.cc:333] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.314548  4821 raft_consensus.cc:2243] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.315035  4821 raft_consensus.cc:2272] T b596dc92cc2c45838a165addea430360 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.317770  4821 tablet_replica.cc:333] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.318591  4821 raft_consensus.cc:2243] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.319121  4821 raft_consensus.cc:2272] T 4fed1c5a7249449bb4b8c8a3543ba599 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:26.321518 14796 consensus_peers.cc:597] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.321681  4821 tablet_replica.cc:333] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.322860  4821 raft_consensus.cc:2243] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.323793  4821 raft_consensus.cc:2272] T 8848d1ae1c0143efa3af13914871a009 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.325697  4821 tablet_replica.cc:333] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.326202  4821 raft_consensus.cc:2243] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.326599  4821 raft_consensus.cc:2272] T edf0c9a7101d45abbba0a1109b880e41 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.328511  4821 tablet_replica.cc:333] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.329104  4821 raft_consensus.cc:2243] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.329584  4821 raft_consensus.cc:2272] T 2e708aa2c4bb45e0b3614e6447ef90cb P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.332286  4821 tablet_replica.cc:333] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
W20260709 12:28:26.332360 14722 consensus_peers.cc:597] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.333017 14722 consensus_peers.cc:597] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.333036  4821 raft_consensus.cc:2243] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.333693  4821 raft_consensus.cc:2272] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.336243  4821 tablet_replica.cc:333] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.336757  4821 raft_consensus.cc:2243] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.337540  4821 raft_consensus.cc:2272] T 9e6cc46cc8484c24aef89febc4a0da98 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.339723  4821 tablet_replica.cc:333] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.340299  4821 raft_consensus.cc:2243] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.340729  4821 raft_consensus.cc:2272] T a40ba67c52d8403bbaaac500b1b803ec P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.342767  4821 tablet_replica.cc:333] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.343348  4821 raft_consensus.cc:2243] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.343744  4821 raft_consensus.cc:2272] T fa8000e051fc45f8a4f3782b144f95a8 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.346217  4821 tablet_replica.cc:333] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.347029  4821 raft_consensus.cc:2243] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.347522  4821 raft_consensus.cc:2272] T 242076f4476b46f1a12a0a07ced33d27 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.349771  4821 tablet_replica.cc:333] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.350447  4821 raft_consensus.cc:2243] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.351091  4821 raft_consensus.cc:2272] T 2cf96c15d37c4522ab37cf6e48555598 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.354722  4821 tablet_replica.cc:333] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.355435  4821 raft_consensus.cc:2243] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.355966  4821 raft_consensus.cc:2272] T 8f6c65eac6134e59bf2b86cb44ca7a4f P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.358482  4821 tablet_replica.cc:333] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.359081  4821 raft_consensus.cc:2243] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.360183  4821 raft_consensus.cc:2272] T 5d7f54d9f158426396fa7e71a63ce964 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.362818  4821 tablet_replica.cc:333] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.363551  4821 raft_consensus.cc:2243] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.364519  4821 raft_consensus.cc:2272] T 78415090b3b941069b3cc1a7540a8542 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.366699  4821 tablet_replica.cc:333] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.367218  4821 raft_consensus.cc:2243] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.367620  4821 raft_consensus.cc:2272] T 55019c611cb74a908cb633373c6b502b P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.369591  4821 tablet_replica.cc:333] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.370077  4821 raft_consensus.cc:2243] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.370836  4821 raft_consensus.cc:2272] T 37fcef99f4594e7f9d6132ec5719da49 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.372679  4821 tablet_replica.cc:333] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.373202  4821 raft_consensus.cc:2243] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.373956  4821 raft_consensus.cc:2272] T e928d444370c4dc49f31e057169dbba0 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.375823  4821 tablet_replica.cc:333] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.376307  4821 raft_consensus.cc:2243] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.376786  4821 raft_consensus.cc:2272] T c1a597bed4c64a10a9f8b50e72c7b611 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.378959  4821 tablet_replica.cc:333] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.379470  4821 raft_consensus.cc:2243] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.379884  4821 raft_consensus.cc:2272] T 9f24860ec9a043a491db9afb3516eedd P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.382661  4821 tablet_replica.cc:333] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.383157  4821 raft_consensus.cc:2243] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.383615  4821 raft_consensus.cc:2272] T e03b11e4110e41ec830cee6e3f1a88db P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.385757  4821 tablet_replica.cc:333] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.386327  4821 raft_consensus.cc:2243] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.386808  4821 raft_consensus.cc:2272] T 42f3f72687b04e52af87a05e2f8767d7 P 9a105adb44fb47078d6cb03a6c02026f [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.389055  4821 tablet_replica.cc:333] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.389549  4821 raft_consensus.cc:2243] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.389946  4821 raft_consensus.cc:2272] T b7c747ce7b704240a1399f870f7b99e0 P 9a105adb44fb47078d6cb03a6c02026f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.392688  4821 tablet_replica.cc:333] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.393324  4821 raft_consensus.cc:2243] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 2 LEADER]: Raft consensus shutting down.
W20260709 12:28:26.393615 14722 consensus_peers.cc:597] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.394294  4821 raft_consensus.cc:2272] T d93f4e1359094f6ba6afc3148d28df68 P 9a105adb44fb47078d6cb03a6c02026f [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.397725  4821 tablet_replica.cc:333] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f: stopping tablet replica
I20260709 12:28:26.398356  4821 raft_consensus.cc:2243] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.398888  4821 raft_consensus.cc:2272] T 5e224159bcb74464a91df02dfd2d755a P 9a105adb44fb47078d6cb03a6c02026f [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:26.404289 14722 consensus_peers.cc:597] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.408676 14722 consensus_peers.cc:597] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.480180  4821 tablet_server.cc:196] TabletServer@127.4.181.66:0 shutdown complete.
W20260709 12:28:26.531220 14722 consensus_peers.cc:597] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:46705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.549825 14796 consensus_peers.cc:597] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:46705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.555418  4821 tablet_server.cc:179] TabletServer@127.4.181.67:0 shutting down...
W20260709 12:28:26.590505 14796 consensus_peers.cc:597] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:46705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.598907  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:26.599833  4821 tablet_replica.cc:333] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.600715  4821 raft_consensus.cc:2243] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.601274  4821 raft_consensus.cc:2272] T b2190ef737a2471ab10213a5ea05bf40 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.603574  4821 tablet_replica.cc:333] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.604215  4821 raft_consensus.cc:2243] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.604661  4821 raft_consensus.cc:2272] T 13f4c8c6619b4856afad5d98d9cec315 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.606676  4821 tablet_replica.cc:333] T df4e4a9a715c4425a25afa8c34b1dd2a P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.607259  4821 raft_consensus.cc:2243] T df4e4a9a715c4425a25afa8c34b1dd2a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.607738  4821 raft_consensus.cc:2272] T df4e4a9a715c4425a25afa8c34b1dd2a P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.609514  4821 tablet_replica.cc:333] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.610014  4821 raft_consensus.cc:2243] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.610371  4821 raft_consensus.cc:2272] T 2c5cdf241a9849819398d5d313152db6 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.612056  4821 tablet_replica.cc:333] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.612529  4821 raft_consensus.cc:2243] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.613212  4821 raft_consensus.cc:2272] T bb08a1bd554c4287aab87fc068c0039d P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.615042  4821 tablet_replica.cc:333] T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.615581  4821 raft_consensus.cc:2243] T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.616007  4821 raft_consensus.cc:2272] T a82a93abcc0d49fe8790a150daf9accc P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.618562  4821 tablet_replica.cc:333] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.619155  4821 raft_consensus.cc:2243] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus shutting down.
W20260709 12:28:26.619491 14722 consensus_peers.cc:597] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:46705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.619602  4821 raft_consensus.cc:2272] T 0fd3630b48e04f27bb2a681c2b329e2f P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.621717  4821 tablet_replica.cc:333] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.622259  4821 raft_consensus.cc:2243] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.622670  4821 raft_consensus.cc:2272] T 0ca6238c0f244dd1a911e44a703e0f8b P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.624610  4821 tablet_replica.cc:333] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.625110  4821 raft_consensus.cc:2243] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.625841  4821 raft_consensus.cc:2272] T 99a425949e144909995513a045d40199 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.627938  4821 tablet_replica.cc:333] T 446076fe225641ee8d6ad7fe5a4777ee P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.628592  4821 raft_consensus.cc:2243] T 446076fe225641ee8d6ad7fe5a4777ee P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.629050  4821 raft_consensus.cc:2272] T 446076fe225641ee8d6ad7fe5a4777ee P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.631628  4821 tablet_replica.cc:333] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.632330  4821 raft_consensus.cc:2243] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.632895  4821 raft_consensus.cc:2272] T 8777b3a550644b50835c268da566aee7 P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.635211  4821 tablet_replica.cc:333] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.635820  4821 raft_consensus.cc:2243] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.636229  4821 raft_consensus.cc:2272] T d7c8780aab4e49fc9b697191f4fde170 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.638145  4821 tablet_replica.cc:333] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.638739  4821 raft_consensus.cc:2243] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.639482  4821 raft_consensus.cc:2272] T 3c423e2343f442c79ab8cecd3cb76d57 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.641345  4821 tablet_replica.cc:333] T 1bdea069a44b42d099e6fc3f6c6333cc P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.641887  4821 raft_consensus.cc:2243] T 1bdea069a44b42d099e6fc3f6c6333cc P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.642287  4821 raft_consensus.cc:2272] T 1bdea069a44b42d099e6fc3f6c6333cc P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.644213  4821 tablet_replica.cc:333] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.644744  4821 raft_consensus.cc:2243] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.645128  4821 raft_consensus.cc:2272] T ef1bdc8f0d36475f87c7da7d8a998240 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.647162  4821 tablet_replica.cc:333] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.647694  4821 raft_consensus.cc:2243] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.648128  4821 raft_consensus.cc:2272] T df5fcaa8194c4e4d8edfc076579b7629 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.650184  4821 tablet_replica.cc:333] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.650756  4821 raft_consensus.cc:2243] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.651605  4821 raft_consensus.cc:2272] T c1a597bed4c64a10a9f8b50e72c7b611 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.653838  4821 tablet_replica.cc:333] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.654597  4821 raft_consensus.cc:2243] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.655042  4821 raft_consensus.cc:2272] T b596dc92cc2c45838a165addea430360 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:26.656644 14795 consensus_peers.cc:597] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.657370  4821 tablet_replica.cc:333] T 4fed1c5a7249449bb4b8c8a3543ba599 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.658022  4821 raft_consensus.cc:2243] T 4fed1c5a7249449bb4b8c8a3543ba599 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.658591  4821 raft_consensus.cc:2272] T 4fed1c5a7249449bb4b8c8a3543ba599 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.660682  4821 tablet_replica.cc:333] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.661303  4821 raft_consensus.cc:2243] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.661814  4821 raft_consensus.cc:2272] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.664443  4821 tablet_replica.cc:333] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.665169  4821 raft_consensus.cc:2243] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.666149  4821 raft_consensus.cc:2272] T 9e8190b1186645b4aa61fbd5207622cf P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.668815  4821 tablet_replica.cc:333] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.669539  4821 raft_consensus.cc:2243] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.670104  4821 raft_consensus.cc:2272] T da938990b3ec47338496f5764c730ccb P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.672678  4821 tablet_replica.cc:333] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.673316  4821 raft_consensus.cc:2243] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.673741  4821 raft_consensus.cc:2272] T c2429c63bff3418fa4b6e9e734cc5b04 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.675699  4821 tablet_replica.cc:333] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.676235  4821 raft_consensus.cc:2243] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.676605  4821 raft_consensus.cc:2272] T a40ba67c52d8403bbaaac500b1b803ec P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.678400  4821 tablet_replica.cc:333] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.678983  4821 raft_consensus.cc:2243] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.679373  4821 raft_consensus.cc:2272] T fa8000e051fc45f8a4f3782b144f95a8 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.681206  4821 tablet_replica.cc:333] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.681694  4821 raft_consensus.cc:2243] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.682446  4821 raft_consensus.cc:2272] T 242076f4476b46f1a12a0a07ced33d27 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.684284  4821 tablet_replica.cc:333] T 8c2e9afe81394f0daa8b09695c7a43ae P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.684775  4821 raft_consensus.cc:2243] T 8c2e9afe81394f0daa8b09695c7a43ae P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.685148  4821 raft_consensus.cc:2272] T 8c2e9afe81394f0daa8b09695c7a43ae P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.686939  4821 tablet_replica.cc:333] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.687472  4821 raft_consensus.cc:2243] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.687951  4821 raft_consensus.cc:2272] T 42f3f72687b04e52af87a05e2f8767d7 P c95afda23abe49318972444cc68998a7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.689898  4821 tablet_replica.cc:333] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.690541  4821 raft_consensus.cc:2243] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.691256  4821 raft_consensus.cc:2272] T 8f70df459ff44f5b95b6a780b4d2a596 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.693143  4821 tablet_replica.cc:333] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.693631  4821 raft_consensus.cc:2243] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.694380  4821 raft_consensus.cc:2272] T b7c747ce7b704240a1399f870f7b99e0 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.696327  4821 tablet_replica.cc:333] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.696835  4821 raft_consensus.cc:2243] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 3 LEADER]: Raft consensus shutting down.
W20260709 12:28:26.697142 14795 consensus_peers.cc:597] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.697577  4821 raft_consensus.cc:2272] T 82ff441d536243878e4f32c69217a59a P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.699563  4821 tablet_replica.cc:333] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.700184  4821 raft_consensus.cc:2243] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.700793  4821 raft_consensus.cc:2272] T e928d444370c4dc49f31e057169dbba0 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.703202  4821 tablet_replica.cc:333] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.703881  4821 raft_consensus.cc:2243] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.704306  4821 raft_consensus.cc:2272] T 2e708aa2c4bb45e0b3614e6447ef90cb P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.706663  4821 tablet_replica.cc:333] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.707283  4821 raft_consensus.cc:2243] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.708253  4821 raft_consensus.cc:2272] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.710429  4821 tablet_replica.cc:333] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.711154  4821 raft_consensus.cc:2243] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.712126  4821 raft_consensus.cc:2272] T 742010a70c40456a920924c8339a6e26 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.714844  4821 tablet_replica.cc:333] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.715401  4821 raft_consensus.cc:2243] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.716291  4821 raft_consensus.cc:2272] T 6dd7f28a6ca34728b1f3c599fc653c6d P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:26.717108 14795 consensus_peers.cc:597] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.718318  4821 tablet_replica.cc:333] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.718981  4821 raft_consensus.cc:2243] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.719379  4821 raft_consensus.cc:2272] T 0d83f753ff274231bf05990f4eda9551 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.721220  4821 tablet_replica.cc:333] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.721719  4821 raft_consensus.cc:2243] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.722430  4821 raft_consensus.cc:2272] T 2cf96c15d37c4522ab37cf6e48555598 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.724865  4821 tablet_replica.cc:333] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.725548  4821 raft_consensus.cc:2243] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.726521  4821 raft_consensus.cc:2272] T dcee6c60580642cd8bb2d1941ea0be79 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.729012  4821 tablet_replica.cc:333] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.729676  4821 raft_consensus.cc:2243] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.730638  4821 raft_consensus.cc:2272] T 8f6c65eac6134e59bf2b86cb44ca7a4f P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.733209  4821 tablet_replica.cc:333] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.733852  4821 raft_consensus.cc:2243] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.734367  4821 raft_consensus.cc:2272] T 5d7f54d9f158426396fa7e71a63ce964 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.736670  4821 tablet_replica.cc:333] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.737318  4821 raft_consensus.cc:2243] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.737761  4821 raft_consensus.cc:2272] T 78415090b3b941069b3cc1a7540a8542 P c95afda23abe49318972444cc68998a7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:26.737890 14795 consensus_peers.cc:597] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.739851  4821 tablet_replica.cc:333] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.740499  4821 raft_consensus.cc:2243] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.740940  4821 raft_consensus.cc:2272] T d93f4e1359094f6ba6afc3148d28df68 P c95afda23abe49318972444cc68998a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.743250  4821 tablet_replica.cc:333] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7: stopping tablet replica
I20260709 12:28:26.743841  4821 raft_consensus.cc:2243] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.744293  4821 raft_consensus.cc:2272] T 5e224159bcb74464a91df02dfd2d755a P c95afda23abe49318972444cc68998a7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:26.762064 14795 consensus_peers.cc:597] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.766711 14795 consensus_peers.cc:597] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.774535 14796 consensus_peers.cc:597] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:46705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.790091 14796 consensus_peers.cc:597] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer 9a105adb44fb47078d6cb03a6c02026f (127.4.181.66:46705): Couldn't send request to peer 9a105adb44fb47078d6cb03a6c02026f. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:46705: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.825098 14795 consensus_peers.cc:597] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:42945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.854012 14795 consensus_peers.cc:597] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:42945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.858593  4821 tablet_server.cc:196] TabletServer@127.4.181.67:0 shutdown complete.
W20260709 12:28:26.905133 14795 consensus_peers.cc:597] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:42945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.924064  4821 tablet_server.cc:179] TabletServer@127.4.181.68:0 shutting down...
W20260709 12:28:26.934835 14795 consensus_peers.cc:597] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:42945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:26.954238 14795 consensus_peers.cc:597] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce -> Peer c95afda23abe49318972444cc68998a7 (127.4.181.67:42945): Couldn't send request to peer c95afda23abe49318972444cc68998a7. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.67:42945: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:26.960104  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:26.960892  4821 tablet_replica.cc:333] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:26.961580  4821 raft_consensus.cc:2243] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.962037  4821 raft_consensus.cc:2272] T dcee6c60580642cd8bb2d1941ea0be79 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.964147  4821 tablet_replica.cc:333] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:26.964730  4821 raft_consensus.cc:2243] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.965173  4821 raft_consensus.cc:2272] T b2190ef737a2471ab10213a5ea05bf40 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.967105  4821 tablet_replica.cc:333] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:26.967669  4821 raft_consensus.cc:2243] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.968408  4821 raft_consensus.cc:2272] T 13f4c8c6619b4856afad5d98d9cec315 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.970266  4821 tablet_replica.cc:333] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:26.970832  4821 raft_consensus.cc:2243] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.971566  4821 raft_consensus.cc:2272] T 0ca6238c0f244dd1a911e44a703e0f8b P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.973652  4821 tablet_replica.cc:333] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:26.974195  4821 raft_consensus.cc:2243] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.974968  4821 raft_consensus.cc:2272] T 2c5cdf241a9849819398d5d313152db6 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.976912  4821 tablet_replica.cc:333] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:26.977450  4821 raft_consensus.cc:2243] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.977841  4821 raft_consensus.cc:2272] T bb08a1bd554c4287aab87fc068c0039d P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.979682  4821 tablet_replica.cc:333] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:26.980209  4821 raft_consensus.cc:2243] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.980608  4821 raft_consensus.cc:2272] T 318e36a972bd4f25a06acdfea9b1bfe9 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.982496  4821 tablet_replica.cc:333] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:26.983004  4821 raft_consensus.cc:2243] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.983704  4821 raft_consensus.cc:2272] T 0fd3630b48e04f27bb2a681c2b329e2f P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.985467  4821 tablet_replica.cc:333] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:26.985984  4821 raft_consensus.cc:2243] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.986716  4821 raft_consensus.cc:2272] T da938990b3ec47338496f5764c730ccb P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.988579  4821 tablet_replica.cc:333] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:26.989112  4821 raft_consensus.cc:2243] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.989776  4821 raft_consensus.cc:2272] T c2429c63bff3418fa4b6e9e734cc5b04 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.992121  4821 tablet_replica.cc:333] T 9e6cc46cc8484c24aef89febc4a0da98 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:26.992699  4821 raft_consensus.cc:2243] T 9e6cc46cc8484c24aef89febc4a0da98 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.993165  4821 raft_consensus.cc:2272] T 9e6cc46cc8484c24aef89febc4a0da98 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.995410  4821 tablet_replica.cc:333] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:26.995898  4821 raft_consensus.cc:2243] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:26.996219  4821 raft_consensus.cc:2272] T 0c22c8f015eb4f498db641dca9ea7900 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:26.997839  4821 tablet_replica.cc:333] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:26.998299  4821 raft_consensus.cc:2243] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:26.999032  4821 raft_consensus.cc:2272] T a82a93abcc0d49fe8790a150daf9accc P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.000846  4821 tablet_replica.cc:333] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.001402  4821 raft_consensus.cc:2243] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.001796  4821 raft_consensus.cc:2272] T 7b80b946940f485e813a69a1ed96c203 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.003674  4821 tablet_replica.cc:333] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.004204  4821 raft_consensus.cc:2243] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:27.005173  4821 raft_consensus.cc:2272] T 7acba2c9fabb41d6b3b6c382fd7d19c8 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.007202  4821 tablet_replica.cc:333] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.007772  4821 raft_consensus.cc:2243] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.008142  4821 raft_consensus.cc:2272] T d93f4e1359094f6ba6afc3148d28df68 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.009877  4821 tablet_replica.cc:333] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.010393  4821 raft_consensus.cc:2243] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.010828  4821 raft_consensus.cc:2272] T 3c423e2343f442c79ab8cecd3cb76d57 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.012523  4821 tablet_replica.cc:333] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.013121  4821 raft_consensus.cc:2243] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:27.013863  4821 raft_consensus.cc:2272] T ef1bdc8f0d36475f87c7da7d8a998240 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.015643  4821 tablet_replica.cc:333] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.016119  4821 raft_consensus.cc:2243] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.016503  4821 raft_consensus.cc:2272] T 1bdea069a44b42d099e6fc3f6c6333cc P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.019550  4821 tablet_replica.cc:333] T 742010a70c40456a920924c8339a6e26 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.020128  4821 raft_consensus.cc:2243] T 742010a70c40456a920924c8339a6e26 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.020668  4821 raft_consensus.cc:2272] T 742010a70c40456a920924c8339a6e26 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.023362  4821 tablet_replica.cc:333] T 6dd7f28a6ca34728b1f3c599fc653c6d P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.024015  4821 raft_consensus.cc:2243] T 6dd7f28a6ca34728b1f3c599fc653c6d P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.024408  4821 raft_consensus.cc:2272] T 6dd7f28a6ca34728b1f3c599fc653c6d P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.026177  4821 tablet_replica.cc:333] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.026717  4821 raft_consensus.cc:2243] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.027103  4821 raft_consensus.cc:2272] T 0d83f753ff274231bf05990f4eda9551 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.028849  4821 tablet_replica.cc:333] T 645a95a66395468daa1986ee77838eaa P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.029392  4821 raft_consensus.cc:2243] T 645a95a66395468daa1986ee77838eaa P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.029764  4821 raft_consensus.cc:2272] T 645a95a66395468daa1986ee77838eaa P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.031531  4821 tablet_replica.cc:333] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.032003  4821 raft_consensus.cc:2243] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.032385  4821 raft_consensus.cc:2272] T 9e8190b1186645b4aa61fbd5207622cf P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.034109  4821 tablet_replica.cc:333] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.034628  4821 raft_consensus.cc:2243] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.034972  4821 raft_consensus.cc:2272] T 1f50744c152c4f22b65828c60d9d2974 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.036628  4821 tablet_replica.cc:333] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.037142  4821 raft_consensus.cc:2243] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:27.037833  4821 raft_consensus.cc:2272] T dba1b4acd4da45e7b1eee66ab684bd93 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.039594  4821 tablet_replica.cc:333] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.040055  4821 raft_consensus.cc:2243] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:27.040729  4821 raft_consensus.cc:2272] T 4fed1c5a7249449bb4b8c8a3543ba599 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.042400  4821 tablet_replica.cc:333] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.042865  4821 raft_consensus.cc:2243] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.043251  4821 raft_consensus.cc:2272] T 9f24860ec9a043a491db9afb3516eedd P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.044895  4821 tablet_replica.cc:333] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.045342  4821 raft_consensus.cc:2243] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.045667  4821 raft_consensus.cc:2272] T e03b11e4110e41ec830cee6e3f1a88db P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.047322  4821 tablet_replica.cc:333] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.047801  4821 raft_consensus.cc:2243] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:27.048450  4821 raft_consensus.cc:2272] T 8c2e9afe81394f0daa8b09695c7a43ae P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.050136  4821 tablet_replica.cc:333] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.050625  4821 raft_consensus.cc:2243] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.051002  4821 raft_consensus.cc:2272] T e928d444370c4dc49f31e057169dbba0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.052909  4821 tablet_replica.cc:333] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.053434  4821 raft_consensus.cc:2243] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.053839  4821 raft_consensus.cc:2272] T b7c747ce7b704240a1399f870f7b99e0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.055727  4821 tablet_replica.cc:333] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.056205  4821 raft_consensus.cc:2243] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.056587  4821 raft_consensus.cc:2272] T 82ff441d536243878e4f32c69217a59a P 420d5d7b2b504ff7923b7f4098c0fcce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.058288  4821 tablet_replica.cc:333] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.058816  4821 raft_consensus.cc:2243] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.059201  4821 raft_consensus.cc:2272] T 8f70df459ff44f5b95b6a780b4d2a596 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.060988  4821 tablet_replica.cc:333] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.061480  4821 raft_consensus.cc:2243] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.061857  4821 raft_consensus.cc:2272] T 55019c611cb74a908cb633373c6b502b P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.063570  4821 tablet_replica.cc:333] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.064049  4821 raft_consensus.cc:2243] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:27.064814  4821 raft_consensus.cc:2272] T 446076fe225641ee8d6ad7fe5a4777ee P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.066638  4821 tablet_replica.cc:333] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.067126  4821 raft_consensus.cc:2243] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.067528  4821 raft_consensus.cc:2272] T 37fcef99f4594e7f9d6132ec5719da49 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.069378  4821 tablet_replica.cc:333] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.069844  4821 raft_consensus.cc:2243] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:27.070607  4821 raft_consensus.cc:2272] T 4c3d4c5596d44c5ebc68130616ef1ddb P 420d5d7b2b504ff7923b7f4098c0fcce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.072553  4821 tablet_replica.cc:333] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.073062  4821 raft_consensus.cc:2243] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.073483  4821 raft_consensus.cc:2272] T c1a597bed4c64a10a9f8b50e72c7b611 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.075428  4821 tablet_replica.cc:333] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.076025  4821 raft_consensus.cc:2243] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:27.077049  4821 raft_consensus.cc:2272] T df4e4a9a715c4425a25afa8c34b1dd2a P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.079208  4821 tablet_replica.cc:333] T 8848d1ae1c0143efa3af13914871a009 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.079751  4821 raft_consensus.cc:2243] T 8848d1ae1c0143efa3af13914871a009 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.080163  4821 raft_consensus.cc:2272] T 8848d1ae1c0143efa3af13914871a009 P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.082229  4821 tablet_replica.cc:333] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.082793  4821 raft_consensus.cc:2243] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.083209  4821 raft_consensus.cc:2272] T edf0c9a7101d45abbba0a1109b880e41 P 420d5d7b2b504ff7923b7f4098c0fcce [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.085139  4821 tablet_replica.cc:333] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.085659  4821 raft_consensus.cc:2243] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.086084  4821 raft_consensus.cc:2272] T 7f9c76cb01cd4cd78bb4a2826b2b06ea P 420d5d7b2b504ff7923b7f4098c0fcce [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.088073  4821 tablet_replica.cc:333] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce: stopping tablet replica
I20260709 12:28:27.088567  4821 raft_consensus.cc:2243] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:27.089016  4821 raft_consensus.cc:2272] T 9a3a3209f9d64ed6bc4036a9d8bc0ef0 P 420d5d7b2b504ff7923b7f4098c0fcce [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.159726  4821 tablet_server.cc:196] TabletServer@127.4.181.68:0 shutdown complete.
I20260709 12:28:27.226094  4821 master.cc:562] Master@127.4.181.126:42487 shutting down...
I20260709 12:28:27.250690  4821 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:27.251286  4821 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:27.251696  4821 tablet_replica.cc:333] T 00000000000000000000000000000000 P 756f49f67389419d9b559e8d3ea56374: stopping tablet replica
I20260709 12:28:27.273265  4821 master.cc:584] Master@127.4.181.126:42487 shutdown complete.
[       OK ] LeaderRebalancerTest.RestartTserver (34039 ms)
[ RUN      ] LeaderRebalancerTest.TestMaintenanceMode
I20260709 12:28:27.358290  4821 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.181.126:43179
I20260709 12:28:27.359691  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:27.365760 15798 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:27.365789 15797 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:27.366652 15800 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:27.367551  4821 server_base.cc:1061] running on GCE node
I20260709 12:28:27.368568  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:27.368760  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:27.368902  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600107368885 us; error 0 us; skew 500 ppm
I20260709 12:28:27.369467  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:27.372148  4821 webserver.cc:533] Webserver started at http://127.4.181.126:41751/ using document root <none> and password file <none>
I20260709 12:28:27.372654  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:27.372835  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:27.373098  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:27.374194  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/master-0-root/instance:
uuid: "6d47f5a064544f44bf1d0e1c2e86e8a5"
format_stamp: "Formatted at 2026-07-09 12:28:27 on dist-test-slave-k014"
I20260709 12:28:27.378667  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.003s	sys 0.001s
I20260709 12:28:27.382113 15805 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:27.382921  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:28:27.383203  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/master-0-root
uuid: "6d47f5a064544f44bf1d0e1c2e86e8a5"
format_stamp: "Formatted at 2026-07-09 12:28:27 on dist-test-slave-k014"
I20260709 12:28:27.383469  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:27.403882  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:27.405107  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:27.443477  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.126:43179
I20260709 12:28:27.443574 15856 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.126:43179 every 8 connection(s)
I20260709 12:28:27.447412 15857 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:27.457748 15857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5: Bootstrap starting.
I20260709 12:28:27.462502 15857 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:27.466745 15857 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5: No bootstrap required, opened a new log
I20260709 12:28:27.468984 15857 raft_consensus.cc:359] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d47f5a064544f44bf1d0e1c2e86e8a5" member_type: VOTER }
I20260709 12:28:27.469367 15857 raft_consensus.cc:385] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:27.469538 15857 raft_consensus.cc:740] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6d47f5a064544f44bf1d0e1c2e86e8a5, State: Initialized, Role: FOLLOWER
I20260709 12:28:27.470041 15857 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d47f5a064544f44bf1d0e1c2e86e8a5" member_type: VOTER }
I20260709 12:28:27.470479 15857 raft_consensus.cc:399] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:27.470665 15857 raft_consensus.cc:493] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:27.470880 15857 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:27.475306 15857 raft_consensus.cc:515] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d47f5a064544f44bf1d0e1c2e86e8a5" member_type: VOTER }
I20260709 12:28:27.475755 15857 leader_election.cc:304] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 6d47f5a064544f44bf1d0e1c2e86e8a5; no voters: 
I20260709 12:28:27.476840 15857 leader_election.cc:290] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:27.477237 15860 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:27.478618 15860 raft_consensus.cc:697] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [term 1 LEADER]: Becoming Leader. State: Replica: 6d47f5a064544f44bf1d0e1c2e86e8a5, State: Running, Role: LEADER
I20260709 12:28:27.479418 15860 consensus_queue.cc:237] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d47f5a064544f44bf1d0e1c2e86e8a5" member_type: VOTER }
I20260709 12:28:27.479962 15857 sys_catalog.cc:565] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:27.483798 15861 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "6d47f5a064544f44bf1d0e1c2e86e8a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d47f5a064544f44bf1d0e1c2e86e8a5" member_type: VOTER } }
I20260709 12:28:27.484400 15861 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:27.485433 15862 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 6d47f5a064544f44bf1d0e1c2e86e8a5. Latest consensus state: current_term: 1 leader_uuid: "6d47f5a064544f44bf1d0e1c2e86e8a5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "6d47f5a064544f44bf1d0e1c2e86e8a5" member_type: VOTER } }
I20260709 12:28:27.485945 15862 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:27.492004 15868 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:27.499145 15868 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:27.500211  4821 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:27.507663 15868 catalog_manager.cc:1383] Generated new cluster ID: 743b9a96305a4e05bf978a7c2dfdec9b
I20260709 12:28:27.507906 15868 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:27.543533 15868 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:27.544826 15868 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:27.565429 15868 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5: Generated new TSK 0
I20260709 12:28:27.566035 15868 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:27.631284  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:27.637032 15878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:27.638441 15879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:27.639124 15881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:27.639919  4821 server_base.cc:1061] running on GCE node
I20260709 12:28:27.640923  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:27.641103  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:27.641263  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600107641248 us; error 0 us; skew 500 ppm
I20260709 12:28:27.641782  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:27.644040  4821 webserver.cc:533] Webserver started at http://127.4.181.65:43733/ using document root <none> and password file <none>
I20260709 12:28:27.644497  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:27.644672  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:27.644925  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:27.646085  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-0-root/instance:
uuid: "7be02246afd94bd48adc21e99b737e72"
format_stamp: "Formatted at 2026-07-09 12:28:27 on dist-test-slave-k014"
I20260709 12:28:27.650661  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.002s	sys 0.001s
I20260709 12:28:27.654058 15886 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:27.654897  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:28:27.655260  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-0-root
uuid: "7be02246afd94bd48adc21e99b737e72"
format_stamp: "Formatted at 2026-07-09 12:28:27 on dist-test-slave-k014"
I20260709 12:28:27.655570  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:27.668365  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:27.669523  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:27.670957  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:27.673187  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:27.673379  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:27.673597  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:27.673761  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:27.713050  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.65:44805
I20260709 12:28:27.713163 15948 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.65:44805 every 8 connection(s)
I20260709 12:28:27.717932  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:27.724690 15953 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:27.725723 15954 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:27.728346 15956 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:27.728399  4821 server_base.cc:1061] running on GCE node
I20260709 12:28:27.729758  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:27.730026  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:27.730178  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600107730163 us; error 0 us; skew 500 ppm
I20260709 12:28:27.730708  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:27.733418  4821 webserver.cc:533] Webserver started at http://127.4.181.66:34483/ using document root <none> and password file <none>
I20260709 12:28:27.733546 15949 heartbeater.cc:344] Connected to a master server at 127.4.181.126:43179
I20260709 12:28:27.733920  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:27.733966 15949 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:27.734208  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:27.734560  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:27.734956 15949 heartbeater.cc:507] Master 127.4.181.126:43179 requested a full tablet report, sending...
I20260709 12:28:27.735649  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-1-root/instance:
uuid: "567275700a8f4015b6b87070a382e735"
format_stamp: "Formatted at 2026-07-09 12:28:27 on dist-test-slave-k014"
I20260709 12:28:27.737042 15822 ts_manager.cc:194] Registered new tserver with Master: 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805)
I20260709 12:28:27.738885 15822 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44284
I20260709 12:28:27.740444  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:28:27.744007 15961 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:27.744815  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:28:27.745121  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-1-root
uuid: "567275700a8f4015b6b87070a382e735"
format_stamp: "Formatted at 2026-07-09 12:28:27 on dist-test-slave-k014"
I20260709 12:28:27.745390  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:27.763665  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:27.765096  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:27.766763  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:27.769171  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:27.769368  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:27.769609  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:27.769749  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:27.810365  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.66:43283
I20260709 12:28:27.810531 16023 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.66:43283 every 8 connection(s)
I20260709 12:28:27.815290  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:27.822822 16027 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:27.825415 16028 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:27.826241  4821 server_base.cc:1061] running on GCE node
W20260709 12:28:27.827545 16030 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:27.828446 16024 heartbeater.cc:344] Connected to a master server at 127.4.181.126:43179
I20260709 12:28:27.828626  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:28:27.828915 16024 heartbeater.cc:461] Registering TS with master...
W20260709 12:28:27.828934  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:27.829300  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600107829275 us; error 0 us; skew 500 ppm
I20260709 12:28:27.829892 16024 heartbeater.cc:507] Master 127.4.181.126:43179 requested a full tablet report, sending...
I20260709 12:28:27.830076  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:27.832229 15822 ts_manager.cc:194] Registered new tserver with Master: 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:27.832887  4821 webserver.cc:533] Webserver started at http://127.4.181.67:39075/ using document root <none> and password file <none>
I20260709 12:28:27.833418  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:27.833596  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:27.833693 15822 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44294
I20260709 12:28:27.833828  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:27.835172  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-2-root/instance:
uuid: "df5dd0a5504d493aa116f002050b6014"
format_stamp: "Formatted at 2026-07-09 12:28:27 on dist-test-slave-k014"
I20260709 12:28:27.839282  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:28:27.842422 16035 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:27.843160  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:28:27.843423  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-2-root
uuid: "df5dd0a5504d493aa116f002050b6014"
format_stamp: "Formatted at 2026-07-09 12:28:27 on dist-test-slave-k014"
I20260709 12:28:27.843691  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:27.867291  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:27.868453  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:27.869907  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:27.872215  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:27.872416  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:27.872632  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:27.872789  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:27.913862  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.67:42111
I20260709 12:28:27.913988 16097 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.67:42111 every 8 connection(s)
I20260709 12:28:27.927305 16098 heartbeater.cc:344] Connected to a master server at 127.4.181.126:43179
I20260709 12:28:27.927745 16098 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:27.928435 16098 heartbeater.cc:507] Master 127.4.181.126:43179 requested a full tablet report, sending...
I20260709 12:28:27.930271 15822 ts_manager.cc:194] Registered new tserver with Master: df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:27.930358  4821 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013311129s
I20260709 12:28:27.931689 15822 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44302
I20260709 12:28:27.955968 15822 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:44306:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:27.958963 15822 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:28.026754 15913 tablet_service.cc:1511] Processing CreateTablet for tablet 00ff7ff1388d47c2bedd6918a068f4f5 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:28:28.027189 15914 tablet_service.cc:1511] Processing CreateTablet for tablet abf7e15c97d74ecc9767944f3a066ea1 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:28:28.028340 15913 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ff7ff1388d47c2bedd6918a068f4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.029481 15914 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf7e15c97d74ecc9767944f3a066ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.029968 15912 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef5b2eb40ec43e28d6375b85d40b58b (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:28:28.031349 15912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef5b2eb40ec43e28d6375b85d40b58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.040140 16063 tablet_service.cc:1511] Processing CreateTablet for tablet abf7e15c97d74ecc9767944f3a066ea1 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:28:28.040577 16062 tablet_service.cc:1511] Processing CreateTablet for tablet 00ff7ff1388d47c2bedd6918a068f4f5 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:28:28.041940 16063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf7e15c97d74ecc9767944f3a066ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.044814 16061 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef5b2eb40ec43e28d6375b85d40b58b (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:28:28.045814 16062 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ff7ff1388d47c2bedd6918a068f4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.046653 16061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef5b2eb40ec43e28d6375b85d40b58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.049609 15911 tablet_service.cc:1511] Processing CreateTablet for tablet 4507dea32ba54b6bb03a9b0a565ef8b5 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:28:28.051152 15911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4507dea32ba54b6bb03a9b0a565ef8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.057729 16060 tablet_service.cc:1511] Processing CreateTablet for tablet 4507dea32ba54b6bb03a9b0a565ef8b5 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:28:28.059504 16060 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4507dea32ba54b6bb03a9b0a565ef8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.066566 15910 tablet_service.cc:1511] Processing CreateTablet for tablet 738994385014430b9c949af13bc8af2b (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:28:28.068212 15910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738994385014430b9c949af13bc8af2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.090181 16059 tablet_service.cc:1511] Processing CreateTablet for tablet 738994385014430b9c949af13bc8af2b (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:28:28.092730 16059 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738994385014430b9c949af13bc8af2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.096122 16058 tablet_service.cc:1511] Processing CreateTablet for tablet 091adde7c7344c9fa2b2c93c41383058 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:28:28.097584 16058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 091adde7c7344c9fa2b2c93c41383058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.100468 15911 tablet_service.cc:1511] Processing CreateTablet for tablet 9a2aa06199c94acbacc89b86a43e4960 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:28:28.102397 15911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a2aa06199c94acbacc89b86a43e4960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.102103 16057 tablet_service.cc:1511] Processing CreateTablet for tablet 9a2aa06199c94acbacc89b86a43e4960 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:28:28.103910 16057 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a2aa06199c94acbacc89b86a43e4960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.111549 16112 tablet_bootstrap.cc:492] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:28.114487 15912 tablet_service.cc:1511] Processing CreateTablet for tablet 56c3bd8af0e648f99f8e976806f29f51 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:28:28.116257 15912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56c3bd8af0e648f99f8e976806f29f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.132417 16112 tablet_bootstrap.cc:654] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.132994 15989 tablet_service.cc:1511] Processing CreateTablet for tablet abf7e15c97d74ecc9767944f3a066ea1 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION VALUES < 214748364
I20260709 12:28:28.134516 15989 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abf7e15c97d74ecc9767944f3a066ea1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.136512 15910 tablet_service.cc:1511] Processing CreateTablet for tablet 091adde7c7344c9fa2b2c93c41383058 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:28:28.136895 15984 tablet_service.cc:1511] Processing CreateTablet for tablet 091adde7c7344c9fa2b2c93c41383058 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20260709 12:28:28.137238 15988 tablet_service.cc:1511] Processing CreateTablet for tablet 00ff7ff1388d47c2bedd6918a068f4f5 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20260709 12:28:28.138270 15910 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 091adde7c7344c9fa2b2c93c41383058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.138705 15984 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 091adde7c7344c9fa2b2c93c41383058. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.139922 15982 tablet_service.cc:1511] Processing CreateTablet for tablet 56c3bd8af0e648f99f8e976806f29f51 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:28:28.138266 15986 tablet_service.cc:1511] Processing CreateTablet for tablet 4507dea32ba54b6bb03a9b0a565ef8b5 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20260709 12:28:28.141968 15983 tablet_service.cc:1511] Processing CreateTablet for tablet 9a2aa06199c94acbacc89b86a43e4960 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20260709 12:28:28.136897 15987 tablet_service.cc:1511] Processing CreateTablet for tablet 5ef5b2eb40ec43e28d6375b85d40b58b (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20260709 12:28:28.143047 15985 tablet_service.cc:1511] Processing CreateTablet for tablet 738994385014430b9c949af13bc8af2b (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20260709 12:28:28.146719 15982 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56c3bd8af0e648f99f8e976806f29f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.151072 15983 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9a2aa06199c94acbacc89b86a43e4960. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.155862 15981 tablet_service.cc:1511] Processing CreateTablet for tablet af1146be7ff349b38af1961af08430dc (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:28:28.158684 15986 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4507dea32ba54b6bb03a9b0a565ef8b5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.159150 15912 tablet_service.cc:1511] Processing CreateTablet for tablet af1146be7ff349b38af1961af08430dc (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:28:28.159662 15985 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 738994385014430b9c949af13bc8af2b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.160611 15981 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1146be7ff349b38af1961af08430dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.160667 15912 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1146be7ff349b38af1961af08430dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.166862 15988 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00ff7ff1388d47c2bedd6918a068f4f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.170912 15987 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ef5b2eb40ec43e28d6375b85d40b58b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.191627 16061 tablet_service.cc:1511] Processing CreateTablet for tablet 56c3bd8af0e648f99f8e976806f29f51 (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20260709 12:28:28.193308 16061 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 56c3bd8af0e648f99f8e976806f29f51. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.198380 16113 tablet_bootstrap.cc:492] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014: Bootstrap starting.
I20260709 12:28:28.207195 16063 tablet_service.cc:1511] Processing CreateTablet for tablet af1146be7ff349b38af1961af08430dc (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20260709 12:28:28.213793 15911 tablet_service.cc:1511] Processing CreateTablet for tablet 38283f7f115a433cb2905faa5b88804f (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:28:28.215255 15911 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38283f7f115a433cb2905faa5b88804f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.217407 16063 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet af1146be7ff349b38af1961af08430dc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.220312 15980 tablet_service.cc:1511] Processing CreateTablet for tablet 38283f7f115a433cb2905faa5b88804f (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:28:28.221803 15980 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38283f7f115a433cb2905faa5b88804f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.246975 16112 tablet_bootstrap.cc:492] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72: No bootstrap required, opened a new log
I20260709 12:28:28.247601 16112 ts_tablet_manager.cc:1403] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.136s	user 0.022s	sys 0.018s
I20260709 12:28:28.249825 16112 raft_consensus.cc:359] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
I20260709 12:28:28.250407 16112 raft_consensus.cc:385] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.250743 16112 raft_consensus.cc:740] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.251556 16112 consensus_queue.cc:260] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
I20260709 12:28:28.255404 16058 tablet_service.cc:1511] Processing CreateTablet for tablet 38283f7f115a433cb2905faa5b88804f (DEFAULT_TABLE table=test-workload [id=57d912158e164164a9b55822b3fc38d6]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20260709 12:28:28.256702 16058 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38283f7f115a433cb2905faa5b88804f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:28.279739 16113 tablet_bootstrap.cc:654] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.286875 16115 tablet_bootstrap.cc:492] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735: Bootstrap starting.
I20260709 12:28:28.292438 15949 heartbeater.cc:499] Master 127.4.181.126:43179 was elected leader, sending a full tablet report...
I20260709 12:28:28.292908 16112 ts_tablet_manager.cc:1434] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.045s	user 0.019s	sys 0.026s
I20260709 12:28:28.294071 16112 tablet_bootstrap.cc:492] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:28.294569 16115 tablet_bootstrap.cc:654] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.300462 16112 tablet_bootstrap.cc:654] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.300536 16113 tablet_bootstrap.cc:492] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014: No bootstrap required, opened a new log
I20260709 12:28:28.301836 16113 ts_tablet_manager.cc:1403] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014: Time spent bootstrapping tablet: real 0.104s	user 0.006s	sys 0.014s
I20260709 12:28:28.303500 16115 tablet_bootstrap.cc:492] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735: No bootstrap required, opened a new log
I20260709 12:28:28.304042 16115 ts_tablet_manager.cc:1403] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735: Time spent bootstrapping tablet: real 0.017s	user 0.011s	sys 0.004s
I20260709 12:28:28.305178 16113 raft_consensus.cc:359] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
I20260709 12:28:28.306049 16113 raft_consensus.cc:385] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.306403 16113 raft_consensus.cc:740] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.307147 16115 raft_consensus.cc:359] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.307967 16115 raft_consensus.cc:385] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.307504 16113 consensus_queue.cc:260] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
I20260709 12:28:28.308272 16115 raft_consensus.cc:740] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.309098 16115 consensus_queue.cc:260] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.326516 16113 ts_tablet_manager.cc:1434] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014: Time spent starting tablet: real 0.024s	user 0.012s	sys 0.011s
I20260709 12:28:28.327292 16098 heartbeater.cc:499] Master 127.4.181.126:43179 was elected leader, sending a full tablet report...
I20260709 12:28:28.327847 16113 tablet_bootstrap.cc:492] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014: Bootstrap starting.
I20260709 12:28:28.328106 16024 heartbeater.cc:499] Master 127.4.181.126:43179 was elected leader, sending a full tablet report...
I20260709 12:28:28.328655 16115 ts_tablet_manager.cc:1434] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735: Time spent starting tablet: real 0.024s	user 0.014s	sys 0.011s
I20260709 12:28:28.329648 16115 tablet_bootstrap.cc:492] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735: Bootstrap starting.
I20260709 12:28:28.326802 16112 tablet_bootstrap.cc:492] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72: No bootstrap required, opened a new log
I20260709 12:28:28.333604 16112 ts_tablet_manager.cc:1403] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.040s	user 0.023s	sys 0.009s
I20260709 12:28:28.334262 16113 tablet_bootstrap.cc:654] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.336023 16115 tablet_bootstrap.cc:654] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.336434 16112 raft_consensus.cc:359] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.337215 16112 raft_consensus.cc:385] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.337518 16112 raft_consensus.cc:740] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.338397 16112 consensus_queue.cc:260] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.341506 16112 ts_tablet_manager.cc:1434] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:28.342562 16112 tablet_bootstrap.cc:492] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:28.349040 16112 tablet_bootstrap.cc:654] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.393827 16113 tablet_bootstrap.cc:492] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014: No bootstrap required, opened a new log
I20260709 12:28:28.394531 16112 tablet_bootstrap.cc:492] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72: No bootstrap required, opened a new log
I20260709 12:28:28.394526 16115 tablet_bootstrap.cc:492] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735: No bootstrap required, opened a new log
I20260709 12:28:28.394524 16113 ts_tablet_manager.cc:1403] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014: Time spent bootstrapping tablet: real 0.067s	user 0.027s	sys 0.038s
I20260709 12:28:28.395110 16112 ts_tablet_manager.cc:1403] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.053s	user 0.029s	sys 0.021s
I20260709 12:28:28.395489 16115 ts_tablet_manager.cc:1403] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735: Time spent bootstrapping tablet: real 0.066s	user 0.033s	sys 0.031s
I20260709 12:28:28.398365 16113 raft_consensus.cc:359] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.398699 16115 raft_consensus.cc:359] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.398936 16112 raft_consensus.cc:359] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.399339 16113 raft_consensus.cc:385] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.399541 16115 raft_consensus.cc:385] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.399658 16112 raft_consensus.cc:385] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.399960 16113 raft_consensus.cc:740] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.400089 16115 raft_consensus.cc:740] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.400136 16112 raft_consensus.cc:740] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.400940 16113 consensus_queue.cc:260] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.401156 16115 consensus_queue.cc:260] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.401156 16112 consensus_queue.cc:260] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.403252 16113 ts_tablet_manager.cc:1434] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014: Time spent starting tablet: real 0.008s	user 0.003s	sys 0.004s
I20260709 12:28:28.403589 16115 ts_tablet_manager.cc:1434] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:28.403620 16112 ts_tablet_manager.cc:1434] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:28.404768 16115 tablet_bootstrap.cc:492] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735: Bootstrap starting.
I20260709 12:28:28.404785 16112 tablet_bootstrap.cc:492] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:28.407176 16113 tablet_bootstrap.cc:492] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014: Bootstrap starting.
I20260709 12:28:28.411214 16112 tablet_bootstrap.cc:654] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.411756 16115 tablet_bootstrap.cc:654] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735: Neither blocks nor log segments found. Creating new log.
W20260709 12:28:28.418603 16099 tablet.cc:2406] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:28:28.420598 16113 tablet_bootstrap.cc:654] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.420948 16115 tablet_bootstrap.cc:492] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735: No bootstrap required, opened a new log
I20260709 12:28:28.421695 16115 ts_tablet_manager.cc:1403] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.004s
I20260709 12:28:28.425326 16115 raft_consensus.cc:359] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.428006 16115 raft_consensus.cc:385] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.428318 16115 raft_consensus.cc:740] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.429229 16112 tablet_bootstrap.cc:492] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72: No bootstrap required, opened a new log
I20260709 12:28:28.429181 16115 consensus_queue.cc:260] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.429819 16112 ts_tablet_manager.cc:1403] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.025s	user 0.012s	sys 0.011s
I20260709 12:28:28.431731 16115 ts_tablet_manager.cc:1434] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735: Time spent starting tablet: real 0.010s	user 0.003s	sys 0.006s
I20260709 12:28:28.432789 16115 tablet_bootstrap.cc:492] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735: Bootstrap starting.
I20260709 12:28:28.432726 16112 raft_consensus.cc:359] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.433651 16112 raft_consensus.cc:385] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.433993 16112 raft_consensus.cc:740] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.434989 16112 consensus_queue.cc:260] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.439400 16115 tablet_bootstrap.cc:654] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.439400 16112 ts_tablet_manager.cc:1434] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.004s
I20260709 12:28:28.440723 16112 tablet_bootstrap.cc:492] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:28.447299 16112 tablet_bootstrap.cc:654] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.448132 16113 tablet_bootstrap.cc:492] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014: No bootstrap required, opened a new log
I20260709 12:28:28.448776 16113 ts_tablet_manager.cc:1403] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014: Time spent bootstrapping tablet: real 0.042s	user 0.025s	sys 0.008s
I20260709 12:28:28.452040 16113 raft_consensus.cc:359] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.452809 16113 raft_consensus.cc:385] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.453131 16113 raft_consensus.cc:740] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.454032 16113 consensus_queue.cc:260] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.458637 16113 ts_tablet_manager.cc:1434] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014: Time spent starting tablet: real 0.010s	user 0.007s	sys 0.001s
I20260709 12:28:28.459542 16112 tablet_bootstrap.cc:492] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72: No bootstrap required, opened a new log
I20260709 12:28:28.459729 16113 tablet_bootstrap.cc:492] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014: Bootstrap starting.
I20260709 12:28:28.460214 16112 ts_tablet_manager.cc:1403] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.007s
I20260709 12:28:28.463541 16112 raft_consensus.cc:359] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.464360 16112 raft_consensus.cc:385] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.464658 16112 raft_consensus.cc:740] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.465662 16112 consensus_queue.cc:260] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.467023 16113 tablet_bootstrap.cc:654] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.470362 16112 ts_tablet_manager.cc:1434] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.010s	user 0.008s	sys 0.000s
I20260709 12:28:28.471618 16112 tablet_bootstrap.cc:492] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:28.478217 16112 tablet_bootstrap.cc:654] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.484352 16116 raft_consensus.cc:493] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.484977 16116 raft_consensus.cc:515] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.490149 16116 leader_election.cc:290] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
W20260709 12:28:28.492777 15870 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:28.493686 16116 raft_consensus.cc:493] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.494252 16116 raft_consensus.cc:515] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.497802 16116 leader_election.cc:290] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:28.498014 16115 tablet_bootstrap.cc:492] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735: No bootstrap required, opened a new log
I20260709 12:28:28.498659 16115 ts_tablet_manager.cc:1403] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735: Time spent bootstrapping tablet: real 0.066s	user 0.026s	sys 0.038s
I20260709 12:28:28.499818 16113 tablet_bootstrap.cc:492] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014: No bootstrap required, opened a new log
I20260709 12:28:28.500419 16113 ts_tablet_manager.cc:1403] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014: Time spent bootstrapping tablet: real 0.041s	user 0.018s	sys 0.017s
I20260709 12:28:28.504418 16115 raft_consensus.cc:359] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.505731 16115 raft_consensus.cc:385] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.506160 16115 raft_consensus.cc:740] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.507506 16115 consensus_queue.cc:260] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.513419 16113 raft_consensus.cc:359] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.514900 16113 raft_consensus.cc:385] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.515204 16115 ts_tablet_manager.cc:1434] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735: Time spent starting tablet: real 0.016s	user 0.010s	sys 0.000s
I20260709 12:28:28.514770 16121 raft_consensus.cc:493] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.515288 16113 raft_consensus.cc:740] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.516194 16121 raft_consensus.cc:515] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.517066 16115 tablet_bootstrap.cc:492] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735: Bootstrap starting.
I20260709 12:28:28.517316 16113 consensus_queue.cc:260] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.519704 16113 ts_tablet_manager.cc:1434] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.003s
I20260709 12:28:28.520706 16113 tablet_bootstrap.cc:492] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014: Bootstrap starting.
I20260709 12:28:28.533322 16134 raft_consensus.cc:493] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.533639 16112 tablet_bootstrap.cc:492] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72: No bootstrap required, opened a new log
I20260709 12:28:28.527079 16121 leader_election.cc:290] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:28.534061 16116 raft_consensus.cc:493] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.534807 16112 ts_tablet_manager.cc:1403] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.063s	user 0.016s	sys 0.004s
I20260709 12:28:28.534667 16116 raft_consensus.cc:515] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
I20260709 12:28:28.544929 16113 tablet_bootstrap.cc:654] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.535612 16134 raft_consensus.cc:515] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.552881 16134 leader_election.cc:290] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:28.554925 16116 leader_election.cc:290] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:28.562495 16073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4507dea32ba54b6bb03a9b0a565ef8b5" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
I20260709 12:28:28.563342 16073 raft_consensus.cc:2468] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 0.
I20260709 12:28:28.564965 16115 tablet_bootstrap.cc:654] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.567265 15888 leader_election.cc:304] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:28.568048 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf7e15c97d74ecc9767944f3a066ea1" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
I20260709 12:28:28.568207 16116 raft_consensus.cc:2804] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:28.568830 16116 raft_consensus.cc:493] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.569171 16116 raft_consensus.cc:3060] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.569366 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4507dea32ba54b6bb03a9b0a565ef8b5" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:28.570103 15999 raft_consensus.cc:2468] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 0.
I20260709 12:28:28.568291 16112 raft_consensus.cc:359] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.571173 16112 raft_consensus.cc:385] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.571463 16112 raft_consensus.cc:740] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.572038 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738994385014430b9c949af13bc8af2b" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:28.572213 16112 consensus_queue.cc:260] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.568851 16072 raft_consensus.cc:2468] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 0.
I20260709 12:28:28.568173 16073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738994385014430b9c949af13bc8af2b" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
I20260709 12:28:28.574271 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf7e15c97d74ecc9767944f3a066ea1" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:28.576838 16073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
I20260709 12:28:28.577441 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
I20260709 12:28:28.577687 15888 leader_election.cc:304] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 
W20260709 12:28:28.578640 15963 leader_election.cc:343] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:28:28.579800 15963 leader_election.cc:343] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.583513 16116 raft_consensus.cc:515] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.585377 16140 raft_consensus.cc:2804] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:28.585762 16115 tablet_bootstrap.cc:492] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735: No bootstrap required, opened a new log
I20260709 12:28:28.586336 16115 ts_tablet_manager.cc:1403] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735: Time spent bootstrapping tablet: real 0.070s	user 0.013s	sys 0.000s
I20260709 12:28:28.587628 16116 leader_election.cc:290] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 election: Requested vote from peers 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:28.588647 16112 ts_tablet_manager.cc:1434] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.053s	user 0.009s	sys 0.001s
I20260709 12:28:28.593906 16112 tablet_bootstrap.cc:492] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:28.589272 16115 raft_consensus.cc:359] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
I20260709 12:28:28.585816 16140 raft_consensus.cc:493] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.594502 16113 tablet_bootstrap.cc:492] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014: No bootstrap required, opened a new log
I20260709 12:28:28.594810 16115 raft_consensus.cc:385] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.594868 16140 raft_consensus.cc:3060] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.595070 16113 ts_tablet_manager.cc:1403] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014: Time spent bootstrapping tablet: real 0.075s	user 0.015s	sys 0.004s
I20260709 12:28:28.595376 16115 raft_consensus.cc:740] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.596215 16115 consensus_queue.cc:260] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
I20260709 12:28:28.598013 16113 raft_consensus.cc:359] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.598796 16113 raft_consensus.cc:385] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.599071 16113 raft_consensus.cc:740] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.600651 16115 ts_tablet_manager.cc:1434] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735: Time spent starting tablet: real 0.014s	user 0.006s	sys 0.001s
I20260709 12:28:28.600817 16113 consensus_queue.cc:260] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.601866 16115 tablet_bootstrap.cc:492] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735: Bootstrap starting.
W20260709 12:28:28.590847 15888 leader_election.cc:343] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.602427 16140 raft_consensus.cc:515] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
W20260709 12:28:28.604874 15888 leader_election.cc:343] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.606897 16140 leader_election.cc:290] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 election: Requested vote from peers df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:28.607023 15888 leader_election.cc:304] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72; no voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014
I20260709 12:28:28.607893 16140 raft_consensus.cc:2749] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:28.608253 15888 leader_election.cc:343] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.608965 16115 tablet_bootstrap.cc:654] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.610002 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4507dea32ba54b6bb03a9b0a565ef8b5" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:28.610729 15999 raft_consensus.cc:3060] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.612588 16113 ts_tablet_manager.cc:1434] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.000s
I20260709 12:28:28.615293 16112 tablet_bootstrap.cc:654] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.620071 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4507dea32ba54b6bb03a9b0a565ef8b5" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014"
I20260709 12:28:28.620523 15998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf7e15c97d74ecc9767944f3a066ea1" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:28.621188 15998 raft_consensus.cc:3060] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.621569 16072 raft_consensus.cc:3060] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.622293 15923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72" is_pre_election: true
I20260709 12:28:28.621050 15924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72" is_pre_election: true
I20260709 12:28:28.620965 16073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf7e15c97d74ecc9767944f3a066ea1" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014"
W20260709 12:28:28.624063 15965 leader_election.cc:343] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.624544 15965 leader_election.cc:304] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567275700a8f4015b6b87070a382e735; no voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014
I20260709 12:28:28.625362 16134 raft_consensus.cc:2749] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20260709 12:28:28.626156 15965 leader_election.cc:343] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.624154 16073 raft_consensus.cc:3060] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.626992 15965 leader_election.cc:304] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567275700a8f4015b6b87070a382e735; no voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014
I20260709 12:28:28.628147 16134 raft_consensus.cc:2749] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:28.628892 16072 raft_consensus.cc:2468] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 1.
I20260709 12:28:28.630201 15888 leader_election.cc:304] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:28.630620 16112 tablet_bootstrap.cc:492] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72: No bootstrap required, opened a new log
I20260709 12:28:28.631006 16115 tablet_bootstrap.cc:492] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735: No bootstrap required, opened a new log
I20260709 12:28:28.621572 16113 tablet_bootstrap.cc:492] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014: Bootstrap starting.
I20260709 12:28:28.631335 16112 ts_tablet_manager.cc:1403] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.038s	user 0.013s	sys 0.000s
I20260709 12:28:28.628849 15998 raft_consensus.cc:2468] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 1.
I20260709 12:28:28.632926 15888 leader_election.cc:304] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72; no voters: 
I20260709 12:28:28.631490 16115 ts_tablet_manager.cc:1403] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735: Time spent bootstrapping tablet: real 0.030s	user 0.016s	sys 0.003s
I20260709 12:28:28.633792 16116 raft_consensus.cc:2804] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:28.633942 16073 raft_consensus.cc:2468] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 1.
I20260709 12:28:28.634502 16116 raft_consensus.cc:697] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 1 LEADER]: Becoming Leader. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Running, Role: LEADER
I20260709 12:28:28.635027 16112 raft_consensus.cc:359] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.635396 16116 consensus_queue.cc:237] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
I20260709 12:28:28.635830 16112 raft_consensus.cc:385] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.636340 16112 raft_consensus.cc:740] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.635730 15999 raft_consensus.cc:2468] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 1.
I20260709 12:28:28.637147 16112 consensus_queue.cc:260] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.631183 16140 raft_consensus.cc:2804] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:28.639029 16140 raft_consensus.cc:697] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 1 LEADER]: Becoming Leader. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Running, Role: LEADER
I20260709 12:28:28.639792 16112 ts_tablet_manager.cc:1434] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:28.641065 16112 tablet_bootstrap.cc:492] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:28.642930 16115 raft_consensus.cc:359] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.643760 16115 raft_consensus.cc:385] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.642855 16140 consensus_queue.cc:237] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.644236 16115 raft_consensus.cc:740] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.645274 16115 consensus_queue.cc:260] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.646116 15821 catalog_manager.cc:5697] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7be02246afd94bd48adc21e99b737e72 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "7be02246afd94bd48adc21e99b737e72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:28.643685 16113 tablet_bootstrap.cc:654] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.647709 16115 ts_tablet_manager.cc:1434] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:28.648947 16115 tablet_bootstrap.cc:492] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735: Bootstrap starting.
I20260709 12:28:28.655503 16115 tablet_bootstrap.cc:654] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.659711 16112 tablet_bootstrap.cc:654] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.667562 16115 tablet_bootstrap.cc:492] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735: No bootstrap required, opened a new log
I20260709 12:28:28.668149 16115 ts_tablet_manager.cc:1403] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.007s
I20260709 12:28:28.669027 16113 tablet_bootstrap.cc:492] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014: No bootstrap required, opened a new log
I20260709 12:28:28.669589 16113 ts_tablet_manager.cc:1403] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014: Time spent bootstrapping tablet: real 0.048s	user 0.005s	sys 0.013s
I20260709 12:28:28.671303 16115 raft_consensus.cc:359] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.672075 16112 tablet_bootstrap.cc:492] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72: No bootstrap required, opened a new log
I20260709 12:28:28.672514 16120 raft_consensus.cc:493] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.672809 16112 ts_tablet_manager.cc:1403] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.032s	user 0.012s	sys 0.007s
I20260709 12:28:28.673010 16120 raft_consensus.cc:515] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.675169 16113 raft_consensus.cc:359] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.675963 16113 raft_consensus.cc:385] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.676403 16113 raft_consensus.cc:740] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.675989 16112 raft_consensus.cc:359] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.676998 16112 raft_consensus.cc:385] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.677331 16112 raft_consensus.cc:740] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.678529 16112 consensus_queue.cc:260] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.672438 16140 raft_consensus.cc:493] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.677242 16113 consensus_queue.cc:260] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.680117 16140 raft_consensus.cc:515] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.682422 16140 leader_election.cc:290] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:28.683625 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ff7ff1388d47c2bedd6918a068f4f5" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:28.684576 16120 leader_election.cc:290] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:28.684697 16112 ts_tablet_manager.cc:1434] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
W20260709 12:28:28.684902 15888 leader_election.cc:343] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.685997 16112 tablet_bootstrap.cc:492] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:28.691344 16113 ts_tablet_manager.cc:1434] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.008s
I20260709 12:28:28.691890 16112 tablet_bootstrap.cc:654] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.692427 16113 tablet_bootstrap.cc:492] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014: Bootstrap starting.
I20260709 12:28:28.695863 15818 catalog_manager.cc:5697] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7be02246afd94bd48adc21e99b737e72 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "7be02246afd94bd48adc21e99b737e72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:28.698812 16140 raft_consensus.cc:493] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.699252 16113 tablet_bootstrap.cc:654] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.699345 16140 raft_consensus.cc:515] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.701601 16140 leader_election.cc:290] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:28.672094 16115 raft_consensus.cc:385] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.702512 16115 raft_consensus.cc:740] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.704316 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:28.705037 15999 raft_consensus.cc:2468] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 0.
I20260709 12:28:28.706390 15888 leader_election.cc:304] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72; no voters: 
I20260709 12:28:28.707293 16140 raft_consensus.cc:2804] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:28.707687 16140 raft_consensus.cc:493] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.708145 16140 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.705225 16115 consensus_queue.cc:260] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.714006 16073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ff7ff1388d47c2bedd6918a068f4f5" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
I20260709 12:28:28.714399 16115 ts_tablet_manager.cc:1434] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735: Time spent starting tablet: real 0.046s	user 0.008s	sys 0.000s
I20260709 12:28:28.715286 16073 raft_consensus.cc:2468] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 0.
I20260709 12:28:28.715642 16115 tablet_bootstrap.cc:492] T af1146be7ff349b38af1961af08430dc P 567275700a8f4015b6b87070a382e735: Bootstrap starting.
I20260709 12:28:28.715440 16140 raft_consensus.cc:515] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.718142 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:28.718724 15999 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.719892 16140 leader_election.cc:290] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 election: Requested vote from peers 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:28.721081 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
I20260709 12:28:28.721714 16072 raft_consensus.cc:2468] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 0.
I20260709 12:28:28.722797 15888 leader_election.cc:304] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 567275700a8f4015b6b87070a382e735
I20260709 12:28:28.723776 16140 raft_consensus.cc:2804] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:28.724159 16140 raft_consensus.cc:493] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.724494 16140 raft_consensus.cc:3060] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.728103 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014"
I20260709 12:28:28.728757 16072 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.734519 16116 raft_consensus.cc:493] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.734676 16140 raft_consensus.cc:515] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.735147 16116 raft_consensus.cc:515] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.736629 16140 leader_election.cc:290] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 election: Requested vote from peers 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:28.734767 15999 raft_consensus.cc:2468] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 1.
I20260709 12:28:28.737221 16116 leader_election.cc:290] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:28.736791 16112 tablet_bootstrap.cc:492] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72: No bootstrap required, opened a new log
I20260709 12:28:28.737948 16112 ts_tablet_manager.cc:1403] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.052s	user 0.013s	sys 0.016s
I20260709 12:28:28.739099 16113 tablet_bootstrap.cc:492] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014: No bootstrap required, opened a new log
I20260709 12:28:28.738909 15888 leader_election.cc:304] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72; no voters: 
I20260709 12:28:28.738973 15998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:28.739784 16113 ts_tablet_manager.cc:1403] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014: Time spent bootstrapping tablet: real 0.048s	user 0.013s	sys 0.005s
I20260709 12:28:28.739897 15998 raft_consensus.cc:2468] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 0.
I20260709 12:28:28.740042 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ff7ff1388d47c2bedd6918a068f4f5" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:28.740849 16116 raft_consensus.cc:2804] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:28.741353 16116 raft_consensus.cc:697] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 1 LEADER]: Becoming Leader. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Running, Role: LEADER
I20260709 12:28:28.741521 15888 leader_election.cc:304] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72; no voters: 
I20260709 12:28:28.742165 16116 consensus_queue.cc:237] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.742362 16112 raft_consensus.cc:359] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.743120 16112 raft_consensus.cc:385] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.742771 16113 raft_consensus.cc:359] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.742601 16142 raft_consensus.cc:2804] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:28.743494 16112 raft_consensus.cc:740] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.743633 16142 raft_consensus.cc:493] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:28:28.743763 15888 leader_election.cc:343] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.744136 16142 raft_consensus.cc:3060] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.744390 16112 consensus_queue.cc:260] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.746492 16112 ts_tablet_manager.cc:1434] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.003s
I20260709 12:28:28.747246 16072 raft_consensus.cc:2468] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 1.
I20260709 12:28:28.747632 16112 tablet_bootstrap.cc:492] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:28.749462 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5b2eb40ec43e28d6375b85d40b58b" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:28.750087 15999 raft_consensus.cc:2468] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 0.
I20260709 12:28:28.750742 16073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
I20260709 12:28:28.751073 16142 raft_consensus.cc:515] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.753685 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:28.754235 15999 raft_consensus.cc:3060] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:28.757143 15888 leader_election.cc:343] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.750676 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ff7ff1388d47c2bedd6918a068f4f5" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014"
I20260709 12:28:28.757025 15822 catalog_manager.cc:5697] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7be02246afd94bd48adc21e99b737e72 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "7be02246afd94bd48adc21e99b737e72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:28.758152 16072 raft_consensus.cc:3060] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.759745 16073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014"
W20260709 12:28:28.760903 15888 leader_election.cc:343] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.761619 16142 leader_election.cc:290] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 election: Requested vote from peers 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:28.758077 16113 raft_consensus.cc:385] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.762239 16113 raft_consensus.cc:740] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.763088 16113 consensus_queue.cc:260] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.763687 15999 raft_consensus.cc:2468] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 1.
I20260709 12:28:28.764791 15888 leader_election.cc:304] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72; no voters: df5dd0a5504d493aa116f002050b6014
I20260709 12:28:28.765251 16113 ts_tablet_manager.cc:1434] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014: Time spent starting tablet: real 0.025s	user 0.004s	sys 0.000s
I20260709 12:28:28.766004 16142 raft_consensus.cc:2804] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:28.766273 16113 tablet_bootstrap.cc:492] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014: Bootstrap starting.
I20260709 12:28:28.766696 16142 raft_consensus.cc:697] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 1 LEADER]: Becoming Leader. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Running, Role: LEADER
I20260709 12:28:28.767550 16142 consensus_queue.cc:237] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.754558 16037 leader_election.cc:304] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:28.770231 16120 raft_consensus.cc:2804] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:28.770620 16120 raft_consensus.cc:493] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.770949 16120 raft_consensus.cc:3060] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.772012 16112 tablet_bootstrap.cc:654] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.773041 16113 tablet_bootstrap.cc:654] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.783756 16112 tablet_bootstrap.cc:492] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72: No bootstrap required, opened a new log
I20260709 12:28:28.784312 16112 ts_tablet_manager.cc:1403] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.004s
I20260709 12:28:28.786939 16120 raft_consensus.cc:515] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.787369 16112 raft_consensus.cc:359] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.788228 16112 raft_consensus.cc:385] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.788545 16112 raft_consensus.cc:740] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.789511 16120 leader_election.cc:290] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:28.789296 16112 consensus_queue.cc:260] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.790723 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5b2eb40ec43e28d6375b85d40b58b" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:28.791477 15999 raft_consensus.cc:3060] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.792544 16112 ts_tablet_manager.cc:1434] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.001s
I20260709 12:28:28.795831 16115 tablet_bootstrap.cc:654] T af1146be7ff349b38af1961af08430dc P 567275700a8f4015b6b87070a382e735: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.796391 15924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5b2eb40ec43e28d6375b85d40b58b" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72" is_pre_election: true
I20260709 12:28:28.797164 15924 raft_consensus.cc:2468] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 0.
I20260709 12:28:28.798256 15923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5b2eb40ec43e28d6375b85d40b58b" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:28.798992 15923 raft_consensus.cc:3060] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.801177 16072 raft_consensus.cc:2468] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7be02246afd94bd48adc21e99b737e72 in term 1.
I20260709 12:28:28.802983 16134 raft_consensus.cc:493] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.803464 16134 raft_consensus.cc:515] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.805949 16134 leader_election.cc:290] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:28.802500 15888 leader_election.cc:304] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 567275700a8f4015b6b87070a382e735
I20260709 12:28:28.808944 15924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738994385014430b9c949af13bc8af2b" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72" is_pre_election: true
I20260709 12:28:28.809511 15923 raft_consensus.cc:2468] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 1.
I20260709 12:28:28.809592 15924 raft_consensus.cc:2468] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 0.
I20260709 12:28:28.811230 16039 leader_election.cc:304] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:28.811575 15965 leader_election.cc:304] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72; no voters: 
I20260709 12:28:28.812276 16120 raft_consensus.cc:2804] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:28.812559 16134 raft_consensus.cc:2804] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:28.813086 16134 raft_consensus.cc:493] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.813429 16134 raft_consensus.cc:3060] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.812680 16120 raft_consensus.cc:697] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Becoming Leader. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:28.815395 16120 consensus_queue.cc:237] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.819439 16140 raft_consensus.cc:2804] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:28.820164 16140 raft_consensus.cc:697] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 1 LEADER]: Becoming Leader. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Running, Role: LEADER
I20260709 12:28:28.821457 16134 raft_consensus.cc:515] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.825776 16140 consensus_queue.cc:237] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.828600 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738994385014430b9c949af13bc8af2b" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
I20260709 12:28:28.829311 16073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738994385014430b9c949af13bc8af2b" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014"
W20260709 12:28:28.833912 15963 leader_election.cc:343] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.829810 16134 leader_election.cc:290] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:28.830534 15923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738994385014430b9c949af13bc8af2b" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:28.835044 16120 raft_consensus.cc:493] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.824631 15999 raft_consensus.cc:2468] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 1.
W20260709 12:28:28.835902 15963 leader_election.cc:343] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.832088 16113 tablet_bootstrap.cc:492] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014: No bootstrap required, opened a new log
I20260709 12:28:28.837152 16113 ts_tablet_manager.cc:1403] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014: Time spent bootstrapping tablet: real 0.071s	user 0.023s	sys 0.014s
I20260709 12:28:28.835081 15923 raft_consensus.cc:3060] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.839694 16113 raft_consensus.cc:359] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.840365 16113 raft_consensus.cc:385] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.840623 16113 raft_consensus.cc:740] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.835969 16120 raft_consensus.cc:515] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.841831 16142 raft_consensus.cc:493] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.842360 16142 raft_consensus.cc:515] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.841291 16113 consensus_queue.cc:260] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.843736 15822 catalog_manager.cc:5697] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7be02246afd94bd48adc21e99b737e72 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "7be02246afd94bd48adc21e99b737e72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:28.844472 15924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1146be7ff349b38af1961af08430dc" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72" is_pre_election: true
I20260709 12:28:28.844894 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1146be7ff349b38af1961af08430dc" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:28.845152 15924 raft_consensus.cc:2468] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 0.
I20260709 12:28:28.844373 16142 leader_election.cc:290] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
W20260709 12:28:28.846338 16037 leader_election.cc:343] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.846012 15998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38283f7f115a433cb2905faa5b88804f" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:28.837924 15818 catalog_manager.cc:5697] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 reported cstate change: term changed from 0 to 1, leader changed from <none> to df5dd0a5504d493aa116f002050b6014 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "df5dd0a5504d493aa116f002050b6014" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:28.847883 15888 leader_election.cc:343] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.848796 16039 leader_election.cc:304] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 567275700a8f4015b6b87070a382e735
I20260709 12:28:28.849120 16120 leader_election.cc:290] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:28.848690 16113 ts_tablet_manager.cc:1434] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014: Time spent starting tablet: real 0.011s	user 0.005s	sys 0.001s
I20260709 12:28:28.849826 16115 tablet_bootstrap.cc:492] T af1146be7ff349b38af1961af08430dc P 567275700a8f4015b6b87070a382e735: No bootstrap required, opened a new log
I20260709 12:28:28.850610 16115 ts_tablet_manager.cc:1403] T af1146be7ff349b38af1961af08430dc P 567275700a8f4015b6b87070a382e735: Time spent bootstrapping tablet: real 0.135s	user 0.026s	sys 0.015s
I20260709 12:28:28.850988 16113 tablet_bootstrap.cc:492] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014: Bootstrap starting.
I20260709 12:28:28.851610 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38283f7f115a433cb2905faa5b88804f" candidate_uuid: "7be02246afd94bd48adc21e99b737e72" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
W20260709 12:28:28.852851 15888 leader_election.cc:343] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:28.853111 16115 raft_consensus.cc:359] T af1146be7ff349b38af1961af08430dc P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.853312 15888 leader_election.cc:304] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72; no voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014
I20260709 12:28:28.854130 16142 raft_consensus.cc:2749] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:28.849879 16155 raft_consensus.cc:2804] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:28.854677 16155 raft_consensus.cc:493] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.854990 16155 raft_consensus.cc:3060] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.856587 16113 tablet_bootstrap.cc:654] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.864317 16115 raft_consensus.cc:385] T af1146be7ff349b38af1961af08430dc P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.864578 16115 raft_consensus.cc:740] T af1146be7ff349b38af1961af08430dc P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.865144 16115 consensus_queue.cc:260] T af1146be7ff349b38af1961af08430dc P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.869992 16155 raft_consensus.cc:515] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.876032 15924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1146be7ff349b38af1961af08430dc" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:28.876094 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "af1146be7ff349b38af1961af08430dc" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:28.876880 15999 raft_consensus.cc:3060] T af1146be7ff349b38af1961af08430dc P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.876844 16155 leader_election.cc:290] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:28.876621 15924 raft_consensus.cc:3060] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.880916 16115 ts_tablet_manager.cc:1434] T af1146be7ff349b38af1961af08430dc P 567275700a8f4015b6b87070a382e735: Time spent starting tablet: real 0.030s	user 0.004s	sys 0.001s
I20260709 12:28:28.882112 16115 tablet_bootstrap.cc:492] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735: Bootstrap starting.
I20260709 12:28:28.863880 15923 raft_consensus.cc:2468] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 1.
I20260709 12:28:28.885895 15965 leader_election.cc:304] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72; no voters: df5dd0a5504d493aa116f002050b6014
I20260709 12:28:28.886080 15999 raft_consensus.cc:2468] T af1146be7ff349b38af1961af08430dc P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 1.
I20260709 12:28:28.887104 16134 raft_consensus.cc:2804] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:28.887655 16134 raft_consensus.cc:697] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 1 LEADER]: Becoming Leader. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:28.888411 16115 tablet_bootstrap.cc:654] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.888484 16134 consensus_queue.cc:237] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.886116 15924 raft_consensus.cc:2468] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 1.
I20260709 12:28:28.890600 16039 leader_election.cc:304] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:28.891460 16155 raft_consensus.cc:2804] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:28.892236 16155 raft_consensus.cc:697] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Becoming Leader. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:28.893852 16155 consensus_queue.cc:237] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.895994 15818 catalog_manager.cc:5697] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7be02246afd94bd48adc21e99b737e72 (127.4.181.65). New cstate: current_term: 1 leader_uuid: "7be02246afd94bd48adc21e99b737e72" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:28.899307 16113 tablet_bootstrap.cc:492] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014: No bootstrap required, opened a new log
I20260709 12:28:28.899863 16113 ts_tablet_manager.cc:1403] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014: Time spent bootstrapping tablet: real 0.049s	user 0.010s	sys 0.016s
I20260709 12:28:28.899940 16120 raft_consensus.cc:493] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.900548 16120 raft_consensus.cc:515] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.905020 16120 leader_election.cc:290] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:28.905946 15924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72" is_pre_election: true
I20260709 12:28:28.906831 15924 raft_consensus.cc:2468] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 0.
I20260709 12:28:28.908277 16039 leader_election.cc:304] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:28.909209 16120 raft_consensus.cc:2804] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:28.909621 16120 raft_consensus.cc:493] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:28.909963 16120 raft_consensus.cc:3060] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.910861 16113 raft_consensus.cc:359] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.911434 16113 raft_consensus.cc:385] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.911604 16113 raft_consensus.cc:740] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.912122 16113 consensus_queue.cc:260] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.912484 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:28.913125 15999 raft_consensus.cc:2468] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 0.
I20260709 12:28:28.918942 15822 catalog_manager.cc:5697] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 reported cstate change: term changed from 0 to 1, leader changed from <none> to 567275700a8f4015b6b87070a382e735 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "567275700a8f4015b6b87070a382e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:28.920805 16120 raft_consensus.cc:515] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.926177 16120 leader_election.cc:290] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:28.927040 16113 ts_tablet_manager.cc:1434] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014: Time spent starting tablet: real 0.027s	user 0.006s	sys 0.009s
I20260709 12:28:28.928139 16113 tablet_bootstrap.cc:492] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014: Bootstrap starting.
I20260709 12:28:28.928735 16115 tablet_bootstrap.cc:492] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735: No bootstrap required, opened a new log
I20260709 12:28:28.929266 16115 ts_tablet_manager.cc:1403] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735: Time spent bootstrapping tablet: real 0.047s	user 0.016s	sys 0.026s
I20260709 12:28:28.929682 15924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:28.930276 15924 raft_consensus.cc:3060] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.931733 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:28.932325 15999 raft_consensus.cc:3060] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.936355 16115 raft_consensus.cc:359] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.936111 15822 catalog_manager.cc:5697] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 reported cstate change: term changed from 0 to 1, leader changed from <none> to df5dd0a5504d493aa116f002050b6014 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "df5dd0a5504d493aa116f002050b6014" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:28.937156 16115 raft_consensus.cc:385] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.937583 16115 raft_consensus.cc:740] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.938383 16115 consensus_queue.cc:260] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.940802 16115 ts_tablet_manager.cc:1434] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735: Time spent starting tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:28:28.941807 16115 tablet_bootstrap.cc:492] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735: Bootstrap starting.
I20260709 12:28:28.941725 15999 raft_consensus.cc:2468] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 1.
I20260709 12:28:28.943567 16037 leader_election.cc:304] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:28.944505 16155 raft_consensus.cc:2804] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:28.945009 16155 raft_consensus.cc:697] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Becoming Leader. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:28.946033 16113 tablet_bootstrap.cc:654] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.945837 16155 consensus_queue.cc:237] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.948448 16115 tablet_bootstrap.cc:654] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:28.955696 15924 raft_consensus.cc:2468] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 1.
I20260709 12:28:28.958443 16115 tablet_bootstrap.cc:492] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735: No bootstrap required, opened a new log
I20260709 12:28:28.959187 16115 ts_tablet_manager.cc:1403] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735: Time spent bootstrapping tablet: real 0.018s	user 0.011s	sys 0.000s
I20260709 12:28:28.959259 16113 tablet_bootstrap.cc:492] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014: No bootstrap required, opened a new log
I20260709 12:28:28.959493 15822 catalog_manager.cc:5697] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 reported cstate change: term changed from 0 to 1, leader changed from <none> to df5dd0a5504d493aa116f002050b6014 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "df5dd0a5504d493aa116f002050b6014" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:28.960421 16113 ts_tablet_manager.cc:1403] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014: Time spent bootstrapping tablet: real 0.032s	user 0.011s	sys 0.003s
I20260709 12:28:28.962231 16115 raft_consensus.cc:359] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.963058 16115 raft_consensus.cc:385] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.963399 16115 raft_consensus.cc:740] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.963208 16113 raft_consensus.cc:359] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.964066 16113 raft_consensus.cc:385] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:28.964349 16113 raft_consensus.cc:740] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Initialized, Role: FOLLOWER
I20260709 12:28:28.964484 16115 consensus_queue.cc:260] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.964951 16113 consensus_queue.cc:260] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.966576 16115 ts_tablet_manager.cc:1434] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:28.967206 16113 ts_tablet_manager.cc:1434] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:28.968122 16134 raft_consensus.cc:493] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:28.968600 16134 raft_consensus.cc:515] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:28.970705 16134 leader_election.cc:290] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:28.971375 15924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ff7ff1388d47c2bedd6918a068f4f5" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72" is_pre_election: true
I20260709 12:28:28.971781 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ff7ff1388d47c2bedd6918a068f4f5" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
I20260709 12:28:28.972532 16072 raft_consensus.cc:2393] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 567275700a8f4015b6b87070a382e735 in current term 1: Already voted for candidate 7be02246afd94bd48adc21e99b737e72 in this term.
I20260709 12:28:28.973477 15963 leader_election.cc:304] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567275700a8f4015b6b87070a382e735; no voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014
I20260709 12:28:28.974188 16134 raft_consensus.cc:3060] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:28.980839 16134 raft_consensus.cc:2749] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:29.077487 16140 consensus_queue.cc:1048] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:29.079370 16142 consensus_queue.cc:1048] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:29.084949 16155 raft_consensus.cc:493] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:29.086125 16155 raft_consensus.cc:515] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:29.088393 16169 raft_consensus.cc:493] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:29.089535 16155 leader_election.cc:290] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:29.089377 16169 raft_consensus.cc:515] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:29.092142 15998 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38283f7f115a433cb2905faa5b88804f" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:29.093611 15998 raft_consensus.cc:2468] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 0.
I20260709 12:28:29.095728 15923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738994385014430b9c949af13bc8af2b" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72" is_pre_election: true
I20260709 12:28:29.095530 15924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38283f7f115a433cb2905faa5b88804f" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72" is_pre_election: true
I20260709 12:28:29.097046 15923 raft_consensus.cc:2393] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df5dd0a5504d493aa116f002050b6014 in current term 1: Already voted for candidate 567275700a8f4015b6b87070a382e735 in this term.
I20260709 12:28:29.097649 15997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738994385014430b9c949af13bc8af2b" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:29.098199 16037 leader_election.cc:304] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:29.099066 16169 leader_election.cc:290] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:29.099624 16120 raft_consensus.cc:2804] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:29.100169 16120 raft_consensus.cc:493] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:29.100515 16120 raft_consensus.cc:3060] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:29.097064 15924 raft_consensus.cc:2468] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 0.
I20260709 12:28:29.104908 16037 leader_election.cc:304] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df5dd0a5504d493aa116f002050b6014; no voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72
I20260709 12:28:29.111614 16169 raft_consensus.cc:3060] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:29.126536 16169 raft_consensus.cc:2749] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:29.132990 16120 raft_consensus.cc:515] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:29.136545 16120 leader_election.cc:290] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:29.137301 15924 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38283f7f115a433cb2905faa5b88804f" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:29.137961 15924 raft_consensus.cc:3060] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:29.139863 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38283f7f115a433cb2905faa5b88804f" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:29.140632 15999 raft_consensus.cc:3060] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:29.149057 15924 raft_consensus.cc:2468] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 1.
I20260709 12:28:29.150537 16039 leader_election.cc:304] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:29.151589 16120 raft_consensus.cc:2804] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:29.152097 16120 raft_consensus.cc:697] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Becoming Leader. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:29.152798 15999 raft_consensus.cc:2468] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 1.
I20260709 12:28:29.153532 16120 consensus_queue.cc:237] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:29.163359 16116 consensus_queue.cc:1048] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:29.162948 15822 catalog_manager.cc:5697] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 reported cstate change: term changed from 0 to 1, leader changed from <none> to df5dd0a5504d493aa116f002050b6014 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "df5dd0a5504d493aa116f002050b6014" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:29.178778 16116 consensus_queue.cc:1048] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:29.197885 16116 consensus_queue.cc:1048] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:29.206635 16120 consensus_queue.cc:1048] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:29.213940 16116 consensus_queue.cc:1048] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20260709 12:28:29.222129 16155 consensus_queue.cc:1048] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:29.272097 16120 raft_consensus.cc:493] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:29.272804 16120 raft_consensus.cc:515] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:29.274809 16120 leader_election.cc:290] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:29.275627 15923 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7be02246afd94bd48adc21e99b737e72" is_pre_election: true
I20260709 12:28:29.275882 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:29.276697 15999 raft_consensus.cc:2393] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df5dd0a5504d493aa116f002050b6014 in current term 1: Already voted for candidate 7be02246afd94bd48adc21e99b737e72 in this term.
I20260709 12:28:29.277685 16037 leader_election.cc:304] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df5dd0a5504d493aa116f002050b6014; no voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72
I20260709 12:28:29.278396 16120 raft_consensus.cc:3060] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:29.284507 16120 raft_consensus.cc:2749] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:29.307871 16142 consensus_queue.cc:1048] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:29.321208 16140 consensus_queue.cc:1048] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:29.342530 16140 consensus_queue.cc:1048] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:29.353648 16140 consensus_queue.cc:1048] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:29.361641 16120 consensus_queue.cc:1048] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:29.375025 16169 consensus_queue.cc:1048] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:29.377628 16120 consensus_queue.cc:1048] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:29.396713 16169 consensus_queue.cc:1048] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:29.399685 16134 consensus_queue.cc:1048] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:29.414665 16134 consensus_queue.cc:1048] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:29.432400  4821 ts_manager.cc:295] Set tserver state for 7be02246afd94bd48adc21e99b737e72 to MAINTENANCE_MODE
I20260709 12:28:29.433507  4821 tablet_server.cc:179] TabletServer@127.4.181.65:0 shutting down...
I20260709 12:28:29.465528  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:29.466307  4821 tablet_replica.cc:333] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72: stopping tablet replica
I20260709 12:28:29.467187  4821 raft_consensus.cc:2243] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:29.467672  4821 raft_consensus.cc:2272] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:29.470235  4821 tablet_replica.cc:333] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72: stopping tablet replica
I20260709 12:28:29.470894  4821 raft_consensus.cc:2243] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:29.471733  4821 raft_consensus.cc:2272] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:29.474241  4821 tablet_replica.cc:333] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72: stopping tablet replica
I20260709 12:28:29.474983  4821 raft_consensus.cc:2243] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:29.475571  4821 raft_consensus.cc:2272] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:29.478050  4821 tablet_replica.cc:333] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72: stopping tablet replica
I20260709 12:28:29.478672  4821 raft_consensus.cc:2243] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:29.479082  4821 raft_consensus.cc:2272] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:29.481571  4821 tablet_replica.cc:333] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72: stopping tablet replica
I20260709 12:28:29.482142  4821 raft_consensus.cc:2243] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:29.483089  4821 raft_consensus.cc:2272] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:29.485951  4821 tablet_replica.cc:333] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72: stopping tablet replica
I20260709 12:28:29.486570  4821 raft_consensus.cc:2243] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:29.487018  4821 raft_consensus.cc:2272] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:29.489521  4821 tablet_replica.cc:333] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72: stopping tablet replica
I20260709 12:28:29.490078  4821 raft_consensus.cc:2243] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:29.490532  4821 raft_consensus.cc:2272] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:29.493065  4821 tablet_replica.cc:333] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72: stopping tablet replica
I20260709 12:28:29.493706  4821 raft_consensus.cc:2243] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:28:29.494012 15870 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:29.494661  4821 raft_consensus.cc:2272] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:29.497299  4821 tablet_replica.cc:333] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72: stopping tablet replica
I20260709 12:28:29.497835  4821 raft_consensus.cc:2243] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:29.498733  4821 raft_consensus.cc:2272] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:29.501183  4821 tablet_replica.cc:333] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72: stopping tablet replica
I20260709 12:28:29.501703  4821 raft_consensus.cc:2243] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:29.502492  4821 raft_consensus.cc:2272] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:29.536137  4821 tablet_server.cc:196] TabletServer@127.4.181.65:0 shutdown complete.
W20260709 12:28:29.553292 16039 consensus_peers.cc:597] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:29.696456 16155 consensus_queue.cc:1048] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260709 12:28:29.798993 16039 consensus_peers.cc:597] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:29.816192 16039 consensus_peers.cc:597] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:29.879083 15965 consensus_peers.cc:597] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:29.910764 16039 consensus_peers.cc:597] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:30.495136 15870 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:30.615732 16121 raft_consensus.cc:493] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7be02246afd94bd48adc21e99b737e72)
I20260709 12:28:30.616294 16121 raft_consensus.cc:515] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
I20260709 12:28:30.618225 16121 leader_election.cc:290] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:30.619529 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf7e15c97d74ecc9767944f3a066ea1" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
W20260709 12:28:30.621722 15965 leader_election.cc:336] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111)
I20260709 12:28:30.622071 15965 leader_election.cc:304] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567275700a8f4015b6b87070a382e735; no voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014
I20260709 12:28:30.622716 16121 raft_consensus.cc:2749] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:30.623636 16120 raft_consensus.cc:493] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7be02246afd94bd48adc21e99b737e72)
I20260709 12:28:30.624070 16120 raft_consensus.cc:515] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
I20260709 12:28:30.625574 16120 leader_election.cc:290] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:30.626619 15997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf7e15c97d74ecc9767944f3a066ea1" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:30.627352 15997 raft_consensus.cc:2468] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 1.
I20260709 12:28:30.628465 16037 leader_election.cc:304] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 
W20260709 12:28:30.629060 16039 leader_election.cc:336] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111)
I20260709 12:28:30.629077 16120 raft_consensus.cc:2804] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:30.629495 16120 raft_consensus.cc:493] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7be02246afd94bd48adc21e99b737e72)
I20260709 12:28:30.629752 16120 raft_consensus.cc:3060] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:30.634987 16120 raft_consensus.cc:515] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
I20260709 12:28:30.636536 16120 leader_election.cc:290] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:30.637579 15997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "abf7e15c97d74ecc9767944f3a066ea1" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:30.638129 15997 raft_consensus.cc:3060] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:30.639916 16039 leader_election.cc:336] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111)
I20260709 12:28:30.643606 15997 raft_consensus.cc:2468] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 2.
I20260709 12:28:30.644598 16037 leader_election.cc:304] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 7be02246afd94bd48adc21e99b737e72
I20260709 12:28:30.645247 16120 raft_consensus.cc:2804] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:30.645673 16120 raft_consensus.cc:697] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Becoming Leader. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:30.646374 16120 consensus_queue.cc:237] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
I20260709 12:28:30.653192 15822 catalog_manager.cc:5697] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 reported cstate change: term changed from 1 to 2, leader changed from 7be02246afd94bd48adc21e99b737e72 (127.4.181.65) to df5dd0a5504d493aa116f002050b6014 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "df5dd0a5504d493aa116f002050b6014" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:30.681871 16120 raft_consensus.cc:493] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7be02246afd94bd48adc21e99b737e72)
I20260709 12:28:30.682374 16120 raft_consensus.cc:515] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:30.683954 16121 raft_consensus.cc:493] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7be02246afd94bd48adc21e99b737e72)
I20260709 12:28:30.684552 16121 raft_consensus.cc:515] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:30.684084 16120 leader_election.cc:290] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:30.685243 15997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:30.685905 15997 raft_consensus.cc:2468] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 1.
I20260709 12:28:30.687098 16037 leader_election.cc:304] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:30.687261 16121 leader_election.cc:290] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:30.687922 16120 raft_consensus.cc:2804] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:28:30.688082 16039 leader_election.cc:336] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111)
I20260709 12:28:30.688356 16120 raft_consensus.cc:493] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7be02246afd94bd48adc21e99b737e72)
I20260709 12:28:30.688546 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
I20260709 12:28:30.689566 16120 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:30.690428 15965 leader_election.cc:336] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111)
I20260709 12:28:30.695151 16120 raft_consensus.cc:515] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:30.696096 16072 raft_consensus.cc:2393] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 567275700a8f4015b6b87070a382e735 in current term 2: Already voted for candidate df5dd0a5504d493aa116f002050b6014 in this term.
I20260709 12:28:30.697034 16120 leader_election.cc:290] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:30.698266 15997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:30.698892 15997 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:30.699568 15963 leader_election.cc:304] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567275700a8f4015b6b87070a382e735; no voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014
W20260709 12:28:30.700688 16039 leader_election.cc:336] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111)
I20260709 12:28:30.704255 15997 raft_consensus.cc:2468] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 2.
I20260709 12:28:30.704864 16121 raft_consensus.cc:2749] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:30.705405 16037 leader_election.cc:304] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 7be02246afd94bd48adc21e99b737e72
I20260709 12:28:30.706156 16120 raft_consensus.cc:2804] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:30.706907 16120 raft_consensus.cc:697] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Becoming Leader. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:30.707877 16120 consensus_queue.cc:237] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:30.714644 16121 raft_consensus.cc:493] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7be02246afd94bd48adc21e99b737e72)
I20260709 12:28:30.714722 15822 catalog_manager.cc:5697] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 reported cstate change: term changed from 1 to 2, leader changed from 7be02246afd94bd48adc21e99b737e72 (127.4.181.65) to df5dd0a5504d493aa116f002050b6014 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "df5dd0a5504d493aa116f002050b6014" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:30.715191 16121 raft_consensus.cc:515] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:30.716786 16121 leader_election.cc:290] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:30.717934 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4507dea32ba54b6bb03a9b0a565ef8b5" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
W20260709 12:28:30.720538 15965 leader_election.cc:336] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111)
I20260709 12:28:30.720932 15965 leader_election.cc:304] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 567275700a8f4015b6b87070a382e735; no voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014
I20260709 12:28:30.721496 16121 raft_consensus.cc:2749] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:30.726594 16120 raft_consensus.cc:493] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7be02246afd94bd48adc21e99b737e72)
I20260709 12:28:30.727120 16120 raft_consensus.cc:515] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:30.728753 16120 leader_election.cc:290] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:30.729749 15997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4507dea32ba54b6bb03a9b0a565ef8b5" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:30.730300 15997 raft_consensus.cc:2468] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 1.
I20260709 12:28:30.731191 16037 leader_election.cc:304] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 
W20260709 12:28:30.731608 16039 leader_election.cc:336] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111)
I20260709 12:28:30.731798 16120 raft_consensus.cc:2804] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:30.732191 16120 raft_consensus.cc:493] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7be02246afd94bd48adc21e99b737e72)
I20260709 12:28:30.732461 16120 raft_consensus.cc:3060] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:30.737622 16120 raft_consensus.cc:515] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:30.739138 16120 leader_election.cc:290] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:30.740180 15997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4507dea32ba54b6bb03a9b0a565ef8b5" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:30.740724 15997 raft_consensus.cc:3060] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:30.742455 16039 leader_election.cc:336] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111)
I20260709 12:28:30.745901 15997 raft_consensus.cc:2468] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 2.
I20260709 12:28:30.746979 16037 leader_election.cc:304] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 7be02246afd94bd48adc21e99b737e72
I20260709 12:28:30.747605 16120 raft_consensus.cc:2804] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:30.748076 16120 raft_consensus.cc:697] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Becoming Leader. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:30.748850 16120 consensus_queue.cc:237] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:30.755120 15822 catalog_manager.cc:5697] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 reported cstate change: term changed from 1 to 2, leader changed from 7be02246afd94bd48adc21e99b737e72 (127.4.181.65) to df5dd0a5504d493aa116f002050b6014 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "df5dd0a5504d493aa116f002050b6014" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:30.819793 16120 raft_consensus.cc:493] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7be02246afd94bd48adc21e99b737e72)
I20260709 12:28:30.820276 16120 raft_consensus.cc:515] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:30.822238 16120 leader_election.cc:290] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
W20260709 12:28:30.823351 16039 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111) [suppressed 111 similar messages]
I20260709 12:28:30.823818 15997 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ff7ff1388d47c2bedd6918a068f4f5" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "567275700a8f4015b6b87070a382e735" is_pre_election: true
I20260709 12:28:30.824962 16121 raft_consensus.cc:493] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7be02246afd94bd48adc21e99b737e72)
I20260709 12:28:30.825330 16121 raft_consensus.cc:515] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
W20260709 12:28:30.825990 16039 leader_election.cc:336] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111)
I20260709 12:28:30.826402 16039 leader_election.cc:304] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df5dd0a5504d493aa116f002050b6014; no voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72
I20260709 12:28:30.826954 16121 leader_election.cc:290] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:30.827574 16120 raft_consensus.cc:2749] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260709 12:28:30.827977 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ff7ff1388d47c2bedd6918a068f4f5" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
I20260709 12:28:30.828609 16072 raft_consensus.cc:2468] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 1.
I20260709 12:28:30.829530 15963 leader_election.cc:304] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:30.830166 16121 raft_consensus.cc:2804] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260709 12:28:30.830451 16121 raft_consensus.cc:493] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7be02246afd94bd48adc21e99b737e72)
I20260709 12:28:30.830760 16121 raft_consensus.cc:3060] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:30.830847 15965 leader_election.cc:336] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111)
I20260709 12:28:30.836603 16121 raft_consensus.cc:515] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:30.838268 16121 leader_election.cc:290] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:30.839455 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "00ff7ff1388d47c2bedd6918a068f4f5" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014"
I20260709 12:28:30.840083 16072 raft_consensus.cc:3060] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:30.841719 15965 leader_election.cc:336] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111)
I20260709 12:28:30.845515 16072 raft_consensus.cc:2468] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 2.
I20260709 12:28:30.846669 15963 leader_election.cc:304] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 7be02246afd94bd48adc21e99b737e72
I20260709 12:28:30.847427 16121 raft_consensus.cc:2804] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:30.847908 16121 raft_consensus.cc:697] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Becoming Leader. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:30.848727 16121 consensus_queue.cc:237] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:30.851902 16121 raft_consensus.cc:493] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 7be02246afd94bd48adc21e99b737e72)
I20260709 12:28:30.852432 16121 raft_consensus.cc:515] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:30.855667 16121 leader_election.cc:290] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:30.856573 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014" is_pre_election: true
I20260709 12:28:30.857287 16072 raft_consensus.cc:2468] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 1.
I20260709 12:28:30.856827 15822 catalog_manager.cc:5697] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 reported cstate change: term changed from 1 to 2, leader changed from 7be02246afd94bd48adc21e99b737e72 (127.4.181.65) to 567275700a8f4015b6b87070a382e735 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "567275700a8f4015b6b87070a382e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:30.858489 15963 leader_election.cc:304] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:30.859191 16121 raft_consensus.cc:2804] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20260709 12:28:30.859258 15965 leader_election.cc:336] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111)
I20260709 12:28:30.859553 16121 raft_consensus.cc:493] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 7be02246afd94bd48adc21e99b737e72)
I20260709 12:28:30.859963 16121 raft_consensus.cc:3060] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:30.868950 16121 raft_consensus.cc:515] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:30.871526 16121 leader_election.cc:290] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:30.872664 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df5dd0a5504d493aa116f002050b6014"
I20260709 12:28:30.873229 16072 raft_consensus.cc:3060] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:30.874735 15965 leader_election.cc:336] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111)
I20260709 12:28:30.878790 16072 raft_consensus.cc:2468] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 2.
I20260709 12:28:30.879876 15963 leader_election.cc:304] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 7be02246afd94bd48adc21e99b737e72
I20260709 12:28:30.880524 16121 raft_consensus.cc:2804] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:30.880898 16121 raft_consensus.cc:697] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Becoming Leader. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:30.881668 16121 consensus_queue.cc:237] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:30.888124 15822 catalog_manager.cc:5697] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 reported cstate change: term changed from 1 to 2, leader changed from 7be02246afd94bd48adc21e99b737e72 (127.4.181.65) to 567275700a8f4015b6b87070a382e735 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "567275700a8f4015b6b87070a382e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:31.031883 15997 raft_consensus.cc:1275] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:31.033144 16120 consensus_queue.cc:1048] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:31.048796 16039 consensus_peers.cc:597] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:31.130900 15999 raft_consensus.cc:1275] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:31.132252 16120 consensus_queue.cc:1048] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:31.143095 16039 consensus_peers.cc:597] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:31.146551 16039 consensus_peers.cc:597] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:31.274129 15999 raft_consensus.cc:1275] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:31.275379 16169 consensus_queue.cc:1048] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:31.370805 16072 raft_consensus.cc:1275] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:31.372130 16196 consensus_queue.cc:1048] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:31.377187 15965 consensus_peers.cc:597] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:31.420081 16072 raft_consensus.cc:1275] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:31.421383 16121 consensus_queue.cc:1048] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20260709 12:28:31.436832 15965 consensus_peers.cc:597] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:31.496138 15870 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:28:32.115584 16039 consensus_peers.cc:597] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:32.471361 16039 consensus_peers.cc:597] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:32.473912 16039 consensus_peers.cc:597] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:32.476820 16039 consensus_peers.cc:597] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:32.497177 15870 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:28:32.628156 15965 consensus_peers.cc:597] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:33.217401 16039 consensus_peers.cc:597] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:33.284359 16020 debug-util.cc:398] Leaking SignalData structure 0x7b08002f0e00 after lost signal to thread 4824
W20260709 12:28:33.285583 16020 debug-util.cc:398] Leaking SignalData structure 0x7b0800406180 after lost signal to thread 15856
W20260709 12:28:33.286626 16020 debug-util.cc:398] Leaking SignalData structure 0x7b0800218fc0 after lost signal to thread 16023
W20260709 12:28:33.287719 16020 debug-util.cc:398] Leaking SignalData structure 0x7b080010e200 after lost signal to thread 16097
W20260709 12:28:33.288089 16020 debug-util.cc:398] Leaking SignalData structure 0x7b08002ba5e0 after lost signal to thread 16208
W20260709 12:28:33.498152 15870 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:28:33.649019 16039 consensus_peers.cc:597] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:33.934886 16039 consensus_peers.cc:597] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:34.032594 15965 consensus_peers.cc:597] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:34.291607 15965 consensus_peers.cc:597] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20260709 12:28:34.494236 16039 consensus_peers.cc:597] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
W20260709 12:28:34.499215 15870 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
W20260709 12:28:34.583541 16039 consensus_peers.cc:597] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:34.639457  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:34.650207 16229 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:34.651693 16228 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:34.656080  4821 server_base.cc:1061] running on GCE node
W20260709 12:28:34.657629 16231 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:34.659170  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:34.659498  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:34.659735  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600114659707 us; error 0 us; skew 500 ppm
I20260709 12:28:34.660652  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:34.665773  4821 webserver.cc:533] Webserver started at http://127.4.181.65:43733/ using document root <none> and password file <none>
I20260709 12:28:34.666586  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:34.666857  4821 fs_manager.cc:365] Using existing metadata directory in first data directory
I20260709 12:28:34.672497  4821 fs_manager.cc:714] Time spent opening directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:28:34.679534 16236 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:34.680586  4821 fs_manager.cc:730] Time spent opening block manager: real 0.005s	user 0.002s	sys 0.003s
I20260709 12:28:34.680984  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-0-root
uuid: "7be02246afd94bd48adc21e99b737e72"
format_stamp: "Formatted at 2026-07-09 12:28:27 on dist-test-slave-k014"
I20260709 12:28:34.681502  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.TestMaintenanceMode.1783599758264527-4821-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:34.700009  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:34.701421  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:34.703970  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:34.708235 16243 ts_tablet_manager.cc:548] Loading tablet metadata (0/10 complete)
I20260709 12:28:34.766566  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (10 total tablets, 10 live tablets)
I20260709 12:28:34.766899  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.060s	user 0.003s	sys 0.000s
I20260709 12:28:34.767218  4821 ts_tablet_manager.cc:600] Registering tablets (0/10 complete)
I20260709 12:28:34.772677 16243 tablet_bootstrap.cc:492] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:34.795280 16243 tablet_bootstrap.cc:492] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:34.796270 16243 tablet_bootstrap.cc:492] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72: Bootstrap complete.
I20260709 12:28:34.796981 16243 ts_tablet_manager.cc:1403] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.025s	user 0.017s	sys 0.004s
I20260709 12:28:34.799974 16243 raft_consensus.cc:359] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:34.800685 16243 raft_consensus.cc:740] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:34.801441 16243 consensus_queue.cc:260] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:34.804407 16243 ts_tablet_manager.cc:1434] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.007s	user 0.002s	sys 0.007s
I20260709 12:28:34.805369 16243 tablet_bootstrap.cc:492] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:34.816757  4821 ts_tablet_manager.cc:616] Registered 10 tablets
I20260709 12:28:34.817128  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.050s	user 0.047s	sys 0.000s
I20260709 12:28:34.822989 16243 tablet_bootstrap.cc:492] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:34.824102 16243 tablet_bootstrap.cc:492] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72: Bootstrap complete.
I20260709 12:28:34.824851 16243 ts_tablet_manager.cc:1403] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.020s	user 0.009s	sys 0.008s
I20260709 12:28:34.827764 16243 raft_consensus.cc:359] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:34.828642 16243 raft_consensus.cc:740] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:34.829701 16243 consensus_queue.cc:260] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:34.832532 16243 ts_tablet_manager.cc:1434] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:28:34.833606 16243 tablet_bootstrap.cc:492] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:34.852200 16243 tablet_bootstrap.cc:492] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:34.853399 16243 tablet_bootstrap.cc:492] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72: Bootstrap complete.
I20260709 12:28:34.854265 16243 ts_tablet_manager.cc:1403] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.021s	user 0.004s	sys 0.016s
I20260709 12:28:34.857303 16243 raft_consensus.cc:359] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:34.858616 16243 raft_consensus.cc:740] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:34.859529 16243 consensus_queue.cc:260] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:34.861997 16243 ts_tablet_manager.cc:1434] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:28:34.862840 16243 tablet_bootstrap.cc:492] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:34.883338 16243 tablet_bootstrap.cc:492] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:34.884611 16243 tablet_bootstrap.cc:492] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72: Bootstrap complete.
I20260709 12:28:34.885291 16243 ts_tablet_manager.cc:1403] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.023s	user 0.016s	sys 0.004s
I20260709 12:28:34.887933 16243 raft_consensus.cc:359] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:34.888715 16243 raft_consensus.cc:740] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:34.889503 16243 consensus_queue.cc:260] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:34.893194 16243 ts_tablet_manager.cc:1434] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:34.894160 16243 tablet_bootstrap.cc:492] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:34.902388  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.65:44805
I20260709 12:28:34.902566 16304 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.65:44805 every 8 connection(s)
I20260709 12:28:34.910252 16243 tablet_bootstrap.cc:492] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:34.911437 16243 tablet_bootstrap.cc:492] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72: Bootstrap complete.
I20260709 12:28:34.912184 16243 ts_tablet_manager.cc:1403] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.008s
I20260709 12:28:34.915096 16243 raft_consensus.cc:359] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
I20260709 12:28:34.915818 16243 raft_consensus.cc:740] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:34.916543 16243 consensus_queue.cc:260] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } }
I20260709 12:28:34.918605 16243 ts_tablet_manager.cc:1434] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:34.919442 16243 tablet_bootstrap.cc:492] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:34.919800  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:34.955215 16243 tablet_bootstrap.cc:492] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:34.956238 16243 tablet_bootstrap.cc:492] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72: Bootstrap complete.
I20260709 12:28:34.956974 16243 ts_tablet_manager.cc:1403] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.038s	user 0.021s	sys 0.015s
I20260709 12:28:34.958806 16073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "4507dea32ba54b6bb03a9b0a565ef8b5"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
mode: GRACEFUL
new_leader_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:28:34.959561 16073 raft_consensus.cc:606] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Received request to transfer leadership to TS 567275700a8f4015b6b87070a382e735
I20260709 12:28:34.959627 16306 heartbeater.cc:344] Connected to a master server at 127.4.181.126:43179
I20260709 12:28:34.960206 16306 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:34.959757 16243 raft_consensus.cc:359] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:34.960605 16243 raft_consensus.cc:740] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:34.961205 16306 heartbeater.cc:507] Master 127.4.181.126:43179 requested a full tablet report, sending...
I20260709 12:28:34.961501 16243 consensus_queue.cc:260] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:34.963917 16243 ts_tablet_manager.cc:1434] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:34.964960 16243 tablet_bootstrap.cc:492] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:34.967751 16073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ef5b2eb40ec43e28d6375b85d40b58b"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
mode: GRACEFUL
new_leader_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:28:34.968334 16073 raft_consensus.cc:606] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Received request to transfer leadership to TS 567275700a8f4015b6b87070a382e735
I20260709 12:28:34.968329 15822 ts_manager.cc:194] Re-registered known tserver with Master: 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805)
I20260709 12:28:34.971561 16073 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
mode: GRACEFUL
new_leader_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:28:34.972158 16073 raft_consensus.cc:606] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Received request to transfer leadership to TS 567275700a8f4015b6b87070a382e735
I20260709 12:28:34.976099  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:28:34.979141 16313 raft_consensus.cc:993] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014: : Instructing follower 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:34.979578  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:34.983881 16169 raft_consensus.cc:1081] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Signalling peer 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:34.983331  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:34.989068 15999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "4507dea32ba54b6bb03a9b0a565ef8b5"
dest_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:59752
I20260709 12:28:34.989718 15999 raft_consensus.cc:493] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:34.990083 15999 raft_consensus.cc:3060] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:34.996541 15822 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:44322
I20260709 12:28:35.001037 16306 heartbeater.cc:499] Master 127.4.181.126:43179 was elected leader, sending a full tablet report...
I20260709 12:28:35.003399 16243 tablet_bootstrap.cc:492] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72: Bootstrap replayed 1/1 log segments. Stats: ops{read=0 overwritten=0 applied=0 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:35.004348 16243 tablet_bootstrap.cc:492] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72: Bootstrap complete.
I20260709 12:28:35.005091 16243 ts_tablet_manager.cc:1403] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.040s	user 0.019s	sys 0.014s
I20260709 12:28:35.007212 15999 raft_consensus.cc:515] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.009498 15999 leader_election.cc:290] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 3 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:35.007755 16243 raft_consensus.cc:359] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.011662 16243 raft_consensus.cc:740] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:35.013777 16073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4507dea32ba54b6bb03a9b0a565ef8b5" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df5dd0a5504d493aa116f002050b6014"
I20260709 12:28:35.014559 16073 raft_consensus.cc:3055] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:35.015393 16073 raft_consensus.cc:740] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:35.015177 16243 consensus_queue.cc:260] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.016419 16073 consensus_queue.cc:260] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.020877 16073 raft_consensus.cc:3060] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:35.021929 16279 raft_consensus.cc:3060] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.017377 16243 ts_tablet_manager.cc:1434] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.012s	user 0.005s	sys 0.000s
I20260709 12:28:35.026887 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "4507dea32ba54b6bb03a9b0a565ef8b5" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
W20260709 12:28:35.028685 15965 leader_election.cc:343] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 3 election: Tablet error from VoteRequest() call to peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:35.027241 16243 tablet_bootstrap.cc:492] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:35.040654 16073 raft_consensus.cc:2468] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 3.
I20260709 12:28:35.042284 15963 leader_election.cc:304] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 7be02246afd94bd48adc21e99b737e72
I20260709 12:28:35.043769 16222 raft_consensus.cc:2804] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Leader election won for term 3
W20260709 12:28:35.048499 16039 consensus_peers.cc:597] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:35.063344 16222 raft_consensus.cc:697] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 3 LEADER]: Becoming Leader. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:35.064769 16222 consensus_queue.cc:237] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
W20260709 12:28:35.075173 15965 consensus_peers.cc:597] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 11: this message will repeat every 5th retry.
I20260709 12:28:35.085755 15822 catalog_manager.cc:5697] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 reported cstate change: term changed from 2 to 3, leader changed from df5dd0a5504d493aa116f002050b6014 (127.4.181.67) to 567275700a8f4015b6b87070a382e735 (127.4.181.66). New cstate: current_term: 3 leader_uuid: "567275700a8f4015b6b87070a382e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:35.094285 16243 tablet_bootstrap.cc:492] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:35.095592 16243 tablet_bootstrap.cc:492] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72: Bootstrap complete.
I20260709 12:28:35.096421 16243 ts_tablet_manager.cc:1403] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.069s	user 0.020s	sys 0.034s
I20260709 12:28:35.099501 16243 raft_consensus.cc:359] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.100220 16243 raft_consensus.cc:740] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:35.101662 16243 consensus_queue.cc:260] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.103919 16243 ts_tablet_manager.cc:1434] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.007s	user 0.007s	sys 0.000s
I20260709 12:28:35.104803 16243 tablet_bootstrap.cc:492] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:35.115923 16314 raft_consensus.cc:993] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014: : Instructing follower 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:35.116468 16313 raft_consensus.cc:1081] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Signalling peer 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:35.120445 15999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ef5b2eb40ec43e28d6375b85d40b58b"
dest_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:59752
I20260709 12:28:35.121126 15999 raft_consensus.cc:493] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:35.121501 15999 raft_consensus.cc:3060] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.130741 15999 raft_consensus.cc:515] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.141115 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5b2eb40ec43e28d6375b85d40b58b" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:35.141912 16278 raft_consensus.cc:3060] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.152597 16278 raft_consensus.cc:2468] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 2.
I20260709 12:28:35.154686 15965 leader_election.cc:304] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72; no voters: 
I20260709 12:28:35.155992 16322 raft_consensus.cc:2804] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:35.156543 16322 raft_consensus.cc:697] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Becoming Leader. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:35.157497 15999 leader_election.cc:290] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:35.157437 16322 consensus_queue.cc:237] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.157724 16073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5b2eb40ec43e28d6375b85d40b58b" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df5dd0a5504d493aa116f002050b6014"
I20260709 12:28:35.159896 16073 raft_consensus.cc:3055] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:35.160295 16073 raft_consensus.cc:740] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:35.161247 16073 consensus_queue.cc:260] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.163007 16073 raft_consensus.cc:3060] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.165688 16243 tablet_bootstrap.cc:492] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:35.166852 16243 tablet_bootstrap.cc:492] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72: Bootstrap complete.
I20260709 12:28:35.167596 16243 ts_tablet_manager.cc:1403] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.063s	user 0.040s	sys 0.019s
I20260709 12:28:35.170276 16243 raft_consensus.cc:359] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.171234 16243 raft_consensus.cc:740] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:35.172165 16243 consensus_queue.cc:260] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.174788 16073 raft_consensus.cc:2468] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 2.
I20260709 12:28:35.179767 16243 ts_tablet_manager.cc:1434] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.001s
I20260709 12:28:35.180751 16243 tablet_bootstrap.cc:492] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72: Bootstrap starting.
I20260709 12:28:35.180658 16278 raft_consensus.cc:3060] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.189674 15822 catalog_manager.cc:5697] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 reported cstate change: term changed from 1 to 2, leader changed from df5dd0a5504d493aa116f002050b6014 (127.4.181.67) to 567275700a8f4015b6b87070a382e735 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "567275700a8f4015b6b87070a382e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:35.208946 16243 tablet_bootstrap.cc:492] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260709 12:28:35.210131 16243 tablet_bootstrap.cc:492] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72: Bootstrap complete.
I20260709 12:28:35.210986 16243 ts_tablet_manager.cc:1403] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72: Time spent bootstrapping tablet: real 0.030s	user 0.014s	sys 0.013s
I20260709 12:28:35.213945 16243 raft_consensus.cc:359] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.214820 16243 raft_consensus.cc:740] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7be02246afd94bd48adc21e99b737e72, State: Initialized, Role: FOLLOWER
I20260709 12:28:35.216038 16243 consensus_queue.cc:260] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.218215 16243 ts_tablet_manager.cc:1434] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:35.280632 16278 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.434182 16278 raft_consensus.cc:3060] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Advancing to term 2
W20260709 12:28:35.500384 15870 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:35.535245 16314 raft_consensus.cc:993] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014: : Instructing follower 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:35.535840 16169 raft_consensus.cc:1081] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Signalling peer 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:35.537477 15999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960"
dest_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:59752
I20260709 12:28:35.538028 15999 raft_consensus.cc:493] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:35.538349 15999 raft_consensus.cc:3060] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.544874 15999 raft_consensus.cc:515] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.546707 15999 leader_election.cc:290] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:35.547729 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:35.547775 16073 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df5dd0a5504d493aa116f002050b6014"
I20260709 12:28:35.548496 16278 raft_consensus.cc:3060] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.548609 16073 raft_consensus.cc:3055] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:35.549017 16073 raft_consensus.cc:740] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:35.549785 16073 consensus_queue.cc:260] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.551075 16073 raft_consensus.cc:3060] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:35.553504 16278 raft_consensus.cc:2468] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 2.
I20260709 12:28:35.554518 15965 leader_election.cc:304] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72; no voters: 
I20260709 12:28:35.555269 16321 raft_consensus.cc:2804] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:35.555637 16321 raft_consensus.cc:697] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Becoming Leader. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:35.556464 16321 consensus_queue.cc:237] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:35.557945 16073 raft_consensus.cc:2468] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 2.
I20260709 12:28:35.563882 15822 catalog_manager.cc:5697] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 reported cstate change: term changed from 1 to 2, leader changed from df5dd0a5504d493aa116f002050b6014 (127.4.181.67) to 567275700a8f4015b6b87070a382e735 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "567275700a8f4015b6b87070a382e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:35.568698 16073 raft_consensus.cc:1275] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:35.571223 16321 consensus_queue.cc:1048] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:35.571910 16278 raft_consensus.cc:3060] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Advancing to term 3
I20260709 12:28:35.579999 16278 raft_consensus.cc:1275] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:35.581658 16321 consensus_queue.cc:1048] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:35.602254 16279 raft_consensus.cc:1275] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:35.613374 16222 consensus_queue.cc:1048] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:35.624951 16072 raft_consensus.cc:1275] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:35.627208 16321 consensus_queue.cc:1048] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:35.991190 16279 raft_consensus.cc:1275] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:35.992465 16322 consensus_queue.cc:1048] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:36.001431 16072 raft_consensus.cc:1275] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:36.001653  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:36.003118 16342 consensus_queue.cc:1048] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:36.021911 16072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
mode: GRACEFUL
new_leader_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:28:36.022686 16072 raft_consensus.cc:606] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Received request to transfer leadership to TS 567275700a8f4015b6b87070a382e735
I20260709 12:28:36.043226 15999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "738994385014430b9c949af13bc8af2b"
dest_uuid: "567275700a8f4015b6b87070a382e735"
mode: GRACEFUL
new_leader_uuid: "df5dd0a5504d493aa116f002050b6014"
 from {username='slave'} at 127.0.0.1:36654
I20260709 12:28:36.043905 15999 raft_consensus.cc:606] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 1 LEADER]: Received request to transfer leadership to TS df5dd0a5504d493aa116f002050b6014
I20260709 12:28:36.046999 15999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960"
dest_uuid: "567275700a8f4015b6b87070a382e735"
mode: GRACEFUL
new_leader_uuid: "df5dd0a5504d493aa116f002050b6014"
 from {username='slave'} at 127.0.0.1:36654
I20260709 12:28:36.047622 15999 raft_consensus.cc:606] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Received request to transfer leadership to TS df5dd0a5504d493aa116f002050b6014
I20260709 12:28:36.048918  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:28:36.049433  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:36.050007  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:36.294847 16314 raft_consensus.cc:993] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014: : Instructing follower 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:36.295312 16169 raft_consensus.cc:1081] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Signalling peer 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:36.296880 15999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058"
dest_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:59752
I20260709 12:28:36.297322 15999 raft_consensus.cc:493] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:36.297582 15999 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:36.301949 15999 raft_consensus.cc:515] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:36.303496 15999 leader_election.cc:290] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 3 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:36.304302 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:36.304710 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df5dd0a5504d493aa116f002050b6014"
I20260709 12:28:36.304968 16279 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:36.305328 16072 raft_consensus.cc:3055] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:36.305651 16072 raft_consensus.cc:740] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:36.306515 16072 consensus_queue.cc:260] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:36.307778 16072 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:36.312302 16279 raft_consensus.cc:2468] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 3.
I20260709 12:28:36.313650 15965 leader_election.cc:304] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72; no voters: 
I20260709 12:28:36.314531 16342 raft_consensus.cc:2804] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:36.314792 16072 raft_consensus.cc:2468] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 3.
I20260709 12:28:36.314947 16342 raft_consensus.cc:697] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 3 LEADER]: Becoming Leader. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:36.315961 16342 consensus_queue.cc:237] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:36.322726 15821 catalog_manager.cc:5697] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 reported cstate change: term changed from 2 to 3, leader changed from df5dd0a5504d493aa116f002050b6014 (127.4.181.67) to 567275700a8f4015b6b87070a382e735 (127.4.181.66). New cstate: current_term: 3 leader_uuid: "567275700a8f4015b6b87070a382e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:36.501421 15870 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:36.549192 16222 raft_consensus.cc:993] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735: : Instructing follower df5dd0a5504d493aa116f002050b6014 to start an election
I20260709 12:28:36.549731 16342 raft_consensus.cc:1081] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Signalling peer df5dd0a5504d493aa116f002050b6014 to start an election
I20260709 12:28:36.551237 16072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
 from {username='slave'} at 127.0.0.1:51030
I20260709 12:28:36.551744 16072 raft_consensus.cc:493] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:36.552131 16072 raft_consensus.cc:3060] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:36.557796 16072 raft_consensus.cc:515] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:36.559473 16072 leader_election.cc:290] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 3 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:36.560356 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:36.560515 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:36.561110 16279 raft_consensus.cc:3060] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:36.561178 15999 raft_consensus.cc:3055] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:36.561631 15999 raft_consensus.cc:740] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:36.562345 15999 consensus_queue.cc:260] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:36.563715 15999 raft_consensus.cc:3060] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:36.564560 16222 raft_consensus.cc:993] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735: : Instructing follower df5dd0a5504d493aa116f002050b6014 to start an election
I20260709 12:28:36.565099 16342 raft_consensus.cc:1081] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 1 LEADER]: Signalling peer df5dd0a5504d493aa116f002050b6014 to start an election
I20260709 12:28:36.566551 16072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "738994385014430b9c949af13bc8af2b"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
 from {username='slave'} at 127.0.0.1:51030
I20260709 12:28:36.567054 16072 raft_consensus.cc:493] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:36.567414 16072 raft_consensus.cc:3060] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:36.568775 16279 raft_consensus.cc:2468] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 3.
I20260709 12:28:36.569916 16039 leader_election.cc:304] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:36.570303 15999 raft_consensus.cc:2468] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 3.
I20260709 12:28:36.570678 16169 raft_consensus.cc:2804] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:36.571273 16169 raft_consensus.cc:697] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 3 LEADER]: Becoming Leader. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:36.572423 16169 consensus_queue.cc:237] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:36.573498 16072 raft_consensus.cc:515] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:36.576342 16072 leader_election.cc:290] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:36.578380 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738994385014430b9c949af13bc8af2b" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:36.578929 15999 raft_consensus.cc:3055] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:36.578788 16279 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738994385014430b9c949af13bc8af2b" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:36.579299 15999 raft_consensus.cc:740] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:36.579536 16279 raft_consensus.cc:3060] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:36.580003 15999 consensus_queue.cc:260] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:36.580899 15999 raft_consensus.cc:3060] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:36.580395 15821 catalog_manager.cc:5697] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 reported cstate change: term changed from 2 to 3, leader changed from 567275700a8f4015b6b87070a382e735 (127.4.181.66) to df5dd0a5504d493aa116f002050b6014 (127.4.181.67). New cstate: current_term: 3 leader_uuid: "df5dd0a5504d493aa116f002050b6014" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:36.586005 16279 raft_consensus.cc:2468] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 2.
I20260709 12:28:36.586228 15999 raft_consensus.cc:2468] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 2.
I20260709 12:28:36.587232 16039 leader_election.cc:304] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:36.589090 16169 raft_consensus.cc:2804] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:36.589574 16169 raft_consensus.cc:697] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Becoming Leader. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:36.590354 16169 consensus_queue.cc:237] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:36.596778 15821 catalog_manager.cc:5697] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 reported cstate change: term changed from 1 to 2, leader changed from 567275700a8f4015b6b87070a382e735 (127.4.181.66) to df5dd0a5504d493aa116f002050b6014 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "df5dd0a5504d493aa116f002050b6014" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:36.703644 16279 raft_consensus.cc:1275] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:36.704967 16342 consensus_queue.cc:1048] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:36.715451 16072 raft_consensus.cc:1275] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:36.716974 16322 consensus_queue.cc:1048] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:37.033310 16279 raft_consensus.cc:1275] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:37.034636 16169 consensus_queue.cc:1048] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:37.042909 15999 raft_consensus.cc:1275] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:37.044734 16360 consensus_queue.cc:1048] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:37.059510  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:37.064779 16278 raft_consensus.cc:1275] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:37.067200 16360 consensus_queue.cc:1048] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:37.069348 15999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058"
dest_uuid: "567275700a8f4015b6b87070a382e735"
mode: GRACEFUL
new_leader_uuid: "df5dd0a5504d493aa116f002050b6014"
 from {username='slave'} at 127.0.0.1:36654
I20260709 12:28:37.069973 15999 raft_consensus.cc:606] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 3 LEADER]: Received request to transfer leadership to TS df5dd0a5504d493aa116f002050b6014
I20260709 12:28:37.073043 16072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "38283f7f115a433cb2905faa5b88804f"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
mode: GRACEFUL
new_leader_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:28:37.073606 16072 raft_consensus.cc:606] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Received request to transfer leadership to TS 567275700a8f4015b6b87070a382e735
I20260709 12:28:37.077065 16072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "738994385014430b9c949af13bc8af2b"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
mode: GRACEFUL
new_leader_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:28:37.077623 15999 raft_consensus.cc:1275] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:37.077625 16072 raft_consensus.cc:606] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Received request to transfer leadership to TS 567275700a8f4015b6b87070a382e735
I20260709 12:28:37.079579 16169 consensus_queue.cc:1048] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:37.080066  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:28:37.080765  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:37.081609  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:37.090970 16314 raft_consensus.cc:993] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014: : Instructing follower 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:37.091511 16314 raft_consensus.cc:1081] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Signalling peer 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:37.093479 15999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "738994385014430b9c949af13bc8af2b"
dest_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:59752
I20260709 12:28:37.094072 15999 raft_consensus.cc:493] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:37.094632 15999 raft_consensus.cc:3060] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.099351 15999 raft_consensus.cc:515] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:37.101468 15999 leader_election.cc:290] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 3 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:37.102982 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738994385014430b9c949af13bc8af2b" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df5dd0a5504d493aa116f002050b6014"
I20260709 12:28:37.103276 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738994385014430b9c949af13bc8af2b" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:37.103741 16072 raft_consensus.cc:3055] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:37.104192 16072 raft_consensus.cc:740] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:37.103850 16278 raft_consensus.cc:3060] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.105082 16072 consensus_queue.cc:260] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:37.106366 16072 raft_consensus.cc:3060] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:37.113415 16072 raft_consensus.cc:2468] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 3.
I20260709 12:28:37.113415 16278 raft_consensus.cc:2468] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 3.
I20260709 12:28:37.114985 15963 leader_election.cc:304] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:37.115816 16322 raft_consensus.cc:2804] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:37.116259 16322 raft_consensus.cc:697] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 3 LEADER]: Becoming Leader. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:37.116977 16322 consensus_queue.cc:237] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:37.123245 15821 catalog_manager.cc:5697] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 reported cstate change: term changed from 2 to 3, leader changed from df5dd0a5504d493aa116f002050b6014 (127.4.181.67) to 567275700a8f4015b6b87070a382e735 (127.4.181.66). New cstate: current_term: 3 leader_uuid: "567275700a8f4015b6b87070a382e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:37.518021 15870 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:37.549122 16314 raft_consensus.cc:993] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014: : Instructing follower 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:37.549995 16314 raft_consensus.cc:1081] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Signalling peer 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:37.569841 15999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "38283f7f115a433cb2905faa5b88804f"
dest_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:59752
I20260709 12:28:37.570492 15999 raft_consensus.cc:493] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:37.570860 15999 raft_consensus.cc:3060] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.579494 15999 raft_consensus.cc:515] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:37.582103 15999 leader_election.cc:290] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:37.965674 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38283f7f115a433cb2905faa5b88804f" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df5dd0a5504d493aa116f002050b6014"
I20260709 12:28:37.966282 16072 raft_consensus.cc:3055] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:37.966604 16072 raft_consensus.cc:740] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:37.967425 16072 consensus_queue.cc:260] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:37.972420 16072 raft_consensus.cc:3060] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:37.981922 16072 raft_consensus.cc:2468] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 2.
I20260709 12:28:37.987515 15963 leader_election.cc:304] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:37.988164 16368 raft_consensus.cc:2804] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:37.988560 16368 raft_consensus.cc:697] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Becoming Leader. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:37.989245 16072 raft_consensus.cc:1275] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:37.989275 16368 consensus_queue.cc:237] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:37.991067 16369 consensus_queue.cc:1048] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:37.992818 16278 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "38283f7f115a433cb2905faa5b88804f" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:37.993446 16278 raft_consensus.cc:3060] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:38.004124 16273 raft_consensus.cc:1275] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:38.006317 16368 consensus_queue.cc:1048] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:38.007016 16278 raft_consensus.cc:2468] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 2.
I20260709 12:28:38.031047 16279 raft_consensus.cc:1240] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Rejecting Update request from peer df5dd0a5504d493aa116f002050b6014 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:38.039376 16342 raft_consensus.cc:993] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735: : Instructing follower df5dd0a5504d493aa116f002050b6014 to start an election
I20260709 12:28:38.039959 16322 raft_consensus.cc:1081] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 3 LEADER]: Signalling peer df5dd0a5504d493aa116f002050b6014 to start an election
I20260709 12:28:38.041808 16072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
 from {username='slave'} at 127.0.0.1:51030
I20260709 12:28:38.042493 16072 raft_consensus.cc:493] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:38.042861 16072 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.048969 15821 catalog_manager.cc:5697] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 reported cstate change: term changed from 1 to 2, leader changed from df5dd0a5504d493aa116f002050b6014 (127.4.181.67) to 567275700a8f4015b6b87070a382e735 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "567275700a8f4015b6b87070a382e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:38.050815 16072 raft_consensus.cc:515] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:38.054396 16072 leader_election.cc:290] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 4 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:38.055039 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:38.055702 15999 raft_consensus.cc:3055] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:38.055990 15999 raft_consensus.cc:740] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:38.056596 15999 consensus_queue.cc:260] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:38.057425 15999 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.054087 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:38.062321 15999 raft_consensus.cc:2468] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 4.
I20260709 12:28:38.062451 16275 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.063925 16037 leader_election.cc:304] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:38.064808 16367 raft_consensus.cc:2804] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:38.065933 16367 raft_consensus.cc:697] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 4 LEADER]: Becoming Leader. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:38.066869 16367 consensus_queue.cc:237] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:38.070796 16275 raft_consensus.cc:2468] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 4.
I20260709 12:28:38.077958 15821 catalog_manager.cc:5697] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 reported cstate change: term changed from 3 to 4, leader changed from 567275700a8f4015b6b87070a382e735 (127.4.181.66) to df5dd0a5504d493aa116f002050b6014 (127.4.181.67). New cstate: current_term: 4 leader_uuid: "df5dd0a5504d493aa116f002050b6014" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:38.324928  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:38.332598 16072 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
mode: GRACEFUL
new_leader_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:28:38.333099 16072 raft_consensus.cc:606] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 4 LEADER]: Received request to transfer leadership to TS 567275700a8f4015b6b87070a382e735
I20260709 12:28:38.336053 15999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51"
dest_uuid: "567275700a8f4015b6b87070a382e735"
mode: GRACEFUL
new_leader_uuid: "df5dd0a5504d493aa116f002050b6014"
 from {username='slave'} at 127.0.0.1:36654
I20260709 12:28:38.336548 15999 raft_consensus.cc:606] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Received request to transfer leadership to TS df5dd0a5504d493aa116f002050b6014
I20260709 12:28:38.339135 15999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "738994385014430b9c949af13bc8af2b"
dest_uuid: "567275700a8f4015b6b87070a382e735"
mode: GRACEFUL
new_leader_uuid: "df5dd0a5504d493aa116f002050b6014"
 from {username='slave'} at 127.0.0.1:36654
I20260709 12:28:38.339572 15999 raft_consensus.cc:606] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 3 LEADER]: Received request to transfer leadership to TS df5dd0a5504d493aa116f002050b6014
I20260709 12:28:38.340611  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:28:38.341110  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:38.341621  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:38.374321 16342 raft_consensus.cc:993] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735: : Instructing follower df5dd0a5504d493aa116f002050b6014 to start an election
I20260709 12:28:38.374918 16322 raft_consensus.cc:1081] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Signalling peer df5dd0a5504d493aa116f002050b6014 to start an election
I20260709 12:28:38.376652 16072 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
 from {username='slave'} at 127.0.0.1:51030
I20260709 12:28:38.377163 16072 raft_consensus.cc:493] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:38.377439 16072 raft_consensus.cc:3060] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.381913 16072 raft_consensus.cc:515] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:38.383433 16072 leader_election.cc:290] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 3 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:38.384450 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:38.384339 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:38.385041 15999 raft_consensus.cc:3055] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:38.385113 16275 raft_consensus.cc:3060] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.385320 15999 raft_consensus.cc:740] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:38.386010 15999 consensus_queue.cc:260] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:38.386946 15999 raft_consensus.cc:3060] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:38.390939 16275 raft_consensus.cc:2468] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 3.
I20260709 12:28:38.392082 15999 raft_consensus.cc:2468] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 3.
I20260709 12:28:38.392295 16039 leader_election.cc:304] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:38.393388 16367 raft_consensus.cc:2804] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:38.393770 16367 raft_consensus.cc:697] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 3 LEADER]: Becoming Leader. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:38.394575 16367 consensus_queue.cc:237] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:38.400991 15822 catalog_manager.cc:5697] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 reported cstate change: term changed from 2 to 3, leader changed from 567275700a8f4015b6b87070a382e735 (127.4.181.66) to df5dd0a5504d493aa116f002050b6014 (127.4.181.67). New cstate: current_term: 3 leader_uuid: "df5dd0a5504d493aa116f002050b6014" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:38.464995 16275 raft_consensus.cc:1275] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:38.466177 16322 consensus_queue.cc:1048] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:38.476325 16276 raft_consensus.cc:1275] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:38.477888 16367 consensus_queue.cc:1048] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:38.478267 16072 raft_consensus.cc:1275] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:38.482836 16322 consensus_queue.cc:1048] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:38.490945 15999 raft_consensus.cc:1275] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 4 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:38.492890 16367 consensus_queue.cc:1048] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:38.503314 16374 raft_consensus.cc:993] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014: : Instructing follower 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:38.503789 16367 raft_consensus.cc:1081] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 4 LEADER]: Signalling peer 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:38.505352 15999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058"
dest_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:59752
I20260709 12:28:38.505901 15999 raft_consensus.cc:493] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:38.506242 15999 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:38.511819 15999 raft_consensus.cc:515] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:38.513186 15999 leader_election.cc:290] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 5 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:38.514138 16072 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "df5dd0a5504d493aa116f002050b6014"
I20260709 12:28:38.514138 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "091adde7c7344c9fa2b2c93c41383058" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:38.515020 16072 raft_consensus.cc:3055] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 4 LEADER]: Stepping down as leader of term 4
I20260709 12:28:38.515086 16276 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:38.515398 16072 raft_consensus.cc:740] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:38.516155 16072 consensus_queue.cc:260] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:38.517323 16072 raft_consensus.cc:3060] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 4 FOLLOWER]: Advancing to term 5
I20260709 12:28:38.517975 16322 raft_consensus.cc:993] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735: : Instructing follower df5dd0a5504d493aa116f002050b6014 to start an election
I20260709 12:28:38.518499 16380 raft_consensus.cc:1081] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 3 LEADER]: Signalling peer df5dd0a5504d493aa116f002050b6014 to start an election
W20260709 12:28:38.519063 15870 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:38.520308 16071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "738994385014430b9c949af13bc8af2b"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
 from {username='slave'} at 127.0.0.1:51030
I20260709 12:28:38.520781 16071 raft_consensus.cc:493] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:38.521064 16071 raft_consensus.cc:3060] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.522454 16276 raft_consensus.cc:2468] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 5.
I20260709 12:28:38.523766 15965 leader_election.cc:304] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72; no voters: 
I20260709 12:28:38.523896 16072 raft_consensus.cc:2468] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 5.
I20260709 12:28:38.524658 16380 raft_consensus.cc:2804] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 5 FOLLOWER]: Leader election won for term 5
I20260709 12:28:38.525182 16380 raft_consensus.cc:697] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 5 LEADER]: Becoming Leader. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:38.526038 16380 consensus_queue.cc:237] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:38.528475 16071 raft_consensus.cc:515] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:38.530498 16071 leader_election.cc:290] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 4 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:38.531260 16276 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738994385014430b9c949af13bc8af2b" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:38.531870 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "738994385014430b9c949af13bc8af2b" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:38.532001 16276 raft_consensus.cc:3060] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.534323 15999 raft_consensus.cc:3055] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:38.534885 15999 raft_consensus.cc:740] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:38.534260 15822 catalog_manager.cc:5697] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 reported cstate change: term changed from 4 to 5, leader changed from df5dd0a5504d493aa116f002050b6014 (127.4.181.67) to 567275700a8f4015b6b87070a382e735 (127.4.181.66). New cstate: current_term: 5 leader_uuid: "567275700a8f4015b6b87070a382e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:38.535820 15999 consensus_queue.cc:260] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:38.536821 15999 raft_consensus.cc:3060] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:38.540424 16276 raft_consensus.cc:2468] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 4.
I20260709 12:28:38.541541 16275 raft_consensus.cc:1240] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Rejecting Update request from peer 567275700a8f4015b6b87070a382e735 for earlier term 3. Current term is 4. Ops: []
I20260709 12:28:38.541741 16039 leader_election.cc:304] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:38.542656 16367 raft_consensus.cc:2804] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:38.543140 16367 raft_consensus.cc:697] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 4 LEADER]: Becoming Leader. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:38.543941 16367 consensus_queue.cc:237] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:38.544600 15999 raft_consensus.cc:2468] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 4.
I20260709 12:28:38.550559 15822 catalog_manager.cc:5697] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 reported cstate change: term changed from 3 to 4, leader changed from 567275700a8f4015b6b87070a382e735 (127.4.181.66) to df5dd0a5504d493aa116f002050b6014 (127.4.181.67). New cstate: current_term: 4 leader_uuid: "df5dd0a5504d493aa116f002050b6014" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: HEALTHY } } }
W20260709 12:28:38.558303 16094 debug-util.cc:398] Leaking SignalData structure 0x7b08001d3ae0 after lost signal to thread 4824
W20260709 12:28:38.559307 16094 debug-util.cc:398] Leaking SignalData structure 0x7b0800087200 after lost signal to thread 15856
W20260709 12:28:38.560326 16094 debug-util.cc:398] Leaking SignalData structure 0x7b080038a3e0 after lost signal to thread 16023
W20260709 12:28:38.561228 16094 debug-util.cc:398] Leaking SignalData structure 0x7b08000ac280 after lost signal to thread 16097
W20260709 12:28:38.562183 16094 debug-util.cc:398] Leaking SignalData structure 0x7b0800269f40 after lost signal to thread 16304
I20260709 12:28:38.788942 16275 raft_consensus.cc:1275] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:38.790242 16367 consensus_queue.cc:1048] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:38.800230 15999 raft_consensus.cc:1275] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:38.804639 16374 consensus_queue.cc:1048] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:39.016618 15999 raft_consensus.cc:1275] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 4 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:39.027366 16374 consensus_queue.cc:1048] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:39.028301 16276 raft_consensus.cc:1275] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:39.030138 16275 raft_consensus.cc:1275] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 5 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:28:39.032495 16385 consensus_queue.cc:1048] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:39.032585 16380 consensus_queue.cc:1048] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20260709 12:28:39.063736 16071 raft_consensus.cc:1275] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 5 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20260709 12:28:39.066823 16322 consensus_queue.cc:1048] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20260709 12:28:39.348196  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:39.361451 16071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
mode: GRACEFUL
new_leader_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:28:39.362586 16071 raft_consensus.cc:606] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 3 LEADER]: Received request to transfer leadership to TS 567275700a8f4015b6b87070a382e735
I20260709 12:28:39.366763 15999 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "5ef5b2eb40ec43e28d6375b85d40b58b"
dest_uuid: "567275700a8f4015b6b87070a382e735"
mode: GRACEFUL
new_leader_uuid: "df5dd0a5504d493aa116f002050b6014"
 from {username='slave'} at 127.0.0.1:36654
I20260709 12:28:39.367298 15999 raft_consensus.cc:606] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Received request to transfer leadership to TS df5dd0a5504d493aa116f002050b6014
I20260709 12:28:39.370270 16071 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
mode: GRACEFUL
new_leader_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:51040
I20260709 12:28:39.370985 16071 raft_consensus.cc:606] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 3 LEADER]: Received request to transfer leadership to TS 567275700a8f4015b6b87070a382e735
I20260709 12:28:39.372439  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 3
I20260709 12:28:39.373106  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:39.374080  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:39.384212 16367 raft_consensus.cc:993] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014: : Instructing follower 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:39.384979 16374 raft_consensus.cc:1081] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 3 LEADER]: Signalling peer 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:39.387039 15999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51"
dest_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:59752
I20260709 12:28:39.387701 15999 raft_consensus.cc:493] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:39.388132 15999 raft_consensus.cc:3060] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:39.398519 15999 raft_consensus.cc:515] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:39.401278 15999 leader_election.cc:290] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 4 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:39.401639 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:39.401976 16071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "56c3bd8af0e648f99f8e976806f29f51" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "df5dd0a5504d493aa116f002050b6014"
I20260709 12:28:39.402606 16275 raft_consensus.cc:3060] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:39.402642 16071 raft_consensus.cc:3055] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:39.403334 16071 raft_consensus.cc:740] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:39.404448 16071 consensus_queue.cc:260] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:39.406008 16071 raft_consensus.cc:3060] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:39.413249 16275 raft_consensus.cc:2468] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 4.
I20260709 12:28:39.414664 15965 leader_election.cc:304] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72; no voters: 
I20260709 12:28:39.415550 16380 raft_consensus.cc:2804] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:39.415994 16380 raft_consensus.cc:697] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 4 LEADER]: Becoming Leader. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:39.417065 16071 raft_consensus.cc:2468] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 4.
I20260709 12:28:39.417146 16380 consensus_queue.cc:237] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:39.426769 15818 catalog_manager.cc:5697] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 reported cstate change: term changed from 3 to 4, leader changed from df5dd0a5504d493aa116f002050b6014 (127.4.181.67) to 567275700a8f4015b6b87070a382e735 (127.4.181.66). New cstate: current_term: 4 leader_uuid: "567275700a8f4015b6b87070a382e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:39.445834 16367 raft_consensus.cc:993] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014: : Instructing follower 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:39.446300 16374 raft_consensus.cc:1081] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 3 LEADER]: Signalling peer 567275700a8f4015b6b87070a382e735 to start an election
I20260709 12:28:39.447922 15999 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960"
dest_uuid: "567275700a8f4015b6b87070a382e735"
 from {username='slave'} at 127.0.0.1:59752
I20260709 12:28:39.448442 15999 raft_consensus.cc:493] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:39.448777 15999 raft_consensus.cc:3060] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:39.455695 15999 raft_consensus.cc:515] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:39.457587 15999 leader_election.cc:290] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 4 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), df5dd0a5504d493aa116f002050b6014 (127.4.181.67:42111)
I20260709 12:28:39.458530 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:39.458909 16071 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9a2aa06199c94acbacc89b86a43e4960" candidate_uuid: "567275700a8f4015b6b87070a382e735" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "df5dd0a5504d493aa116f002050b6014"
I20260709 12:28:39.459416 16275 raft_consensus.cc:3060] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:39.459519 16071 raft_consensus.cc:3055] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 3 LEADER]: Stepping down as leader of term 3
I20260709 12:28:39.459932 16071 raft_consensus.cc:740] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:39.460983 16071 consensus_queue.cc:260] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:39.462393 16071 raft_consensus.cc:3060] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Advancing to term 4
I20260709 12:28:39.467072 16275 raft_consensus.cc:2468] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 4.
I20260709 12:28:39.468518 15965 leader_election.cc:304] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 567275700a8f4015b6b87070a382e735, 7be02246afd94bd48adc21e99b737e72; no voters: 
I20260709 12:28:39.469395 16380 raft_consensus.cc:2804] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 4 FOLLOWER]: Leader election won for term 4
I20260709 12:28:39.469872 16380 raft_consensus.cc:697] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 4 LEADER]: Becoming Leader. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:39.470008 16071 raft_consensus.cc:2468] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 567275700a8f4015b6b87070a382e735 in term 4.
I20260709 12:28:39.471050 16380 consensus_queue.cc:237] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:39.479118 15818 catalog_manager.cc:5697] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 reported cstate change: term changed from 3 to 4, leader changed from df5dd0a5504d493aa116f002050b6014 (127.4.181.67) to 567275700a8f4015b6b87070a382e735 (127.4.181.66). New cstate: current_term: 4 leader_uuid: "567275700a8f4015b6b87070a382e735" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: UNKNOWN } } }
W20260709 12:28:39.520414 15870 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:39.645401 16368 raft_consensus.cc:993] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735: : Instructing follower df5dd0a5504d493aa116f002050b6014 to start an election
I20260709 12:28:39.645982 16380 raft_consensus.cc:1081] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Signalling peer df5dd0a5504d493aa116f002050b6014 to start an election
I20260709 12:28:39.647634 16071 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "5ef5b2eb40ec43e28d6375b85d40b58b"
dest_uuid: "df5dd0a5504d493aa116f002050b6014"
 from {username='slave'} at 127.0.0.1:51030
I20260709 12:28:39.648212 16071 raft_consensus.cc:493] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:39.648577 16071 raft_consensus.cc:3060] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:39.656949 16071 raft_consensus.cc:515] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:39.659432 16071 leader_election.cc:290] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 3 election: Requested vote from peers 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805), 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283)
I20260709 12:28:39.660251 16275 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5b2eb40ec43e28d6375b85d40b58b" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7be02246afd94bd48adc21e99b737e72"
I20260709 12:28:39.661959 16275 raft_consensus.cc:3060] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:39.662019 15999 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "5ef5b2eb40ec43e28d6375b85d40b58b" candidate_uuid: "df5dd0a5504d493aa116f002050b6014" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "567275700a8f4015b6b87070a382e735"
I20260709 12:28:39.662750 15999 raft_consensus.cc:3055] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:39.663043 15999 raft_consensus.cc:740] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 567275700a8f4015b6b87070a382e735, State: Running, Role: LEADER
I20260709 12:28:39.663919 15999 consensus_queue.cc:260] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:39.665292 15999 raft_consensus.cc:3060] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:39.667529 16275 raft_consensus.cc:2468] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 3.
I20260709 12:28:39.668704 16039 leader_election.cc:304] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7be02246afd94bd48adc21e99b737e72, df5dd0a5504d493aa116f002050b6014; no voters: 
I20260709 12:28:39.669405 16374 raft_consensus.cc:2804] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:39.669790 16374 raft_consensus.cc:697] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 3 LEADER]: Becoming Leader. State: Replica: df5dd0a5504d493aa116f002050b6014, State: Running, Role: LEADER
I20260709 12:28:39.670822 16374 consensus_queue.cc:237] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } }
I20260709 12:28:39.672170 15999 raft_consensus.cc:2468] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df5dd0a5504d493aa116f002050b6014 in term 3.
I20260709 12:28:39.678977 15818 catalog_manager.cc:5697] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 reported cstate change: term changed from 2 to 3, leader changed from 567275700a8f4015b6b87070a382e735 (127.4.181.66) to df5dd0a5504d493aa116f002050b6014 (127.4.181.67). New cstate: current_term: 3 leader_uuid: "df5dd0a5504d493aa116f002050b6014" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:39.828346 16275 raft_consensus.cc:1275] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:39.830075 16380 consensus_queue.cc:1048] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:39.843544 16071 raft_consensus.cc:1275] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 4 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:39.845332 16322 consensus_queue.cc:1048] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:40.004073 16071 raft_consensus.cc:1275] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 4 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:40.005493 16322 consensus_queue.cc:1048] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df5dd0a5504d493aa116f002050b6014" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 42111 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:40.017292 16275 raft_consensus.cc:1275] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Refusing update from remote peer 567275700a8f4015b6b87070a382e735: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20260709 12:28:40.020670 16380 consensus_queue.cc:1048] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:40.062747 16275 raft_consensus.cc:1275] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:40.064363 16374 consensus_queue.cc:1048] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7be02246afd94bd48adc21e99b737e72" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44805 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:40.075374 15999 raft_consensus.cc:1275] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Refusing update from remote peer df5dd0a5504d493aa116f002050b6014: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:40.079429 16367 consensus_queue.cc:1048] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [LEADER]: Connected to new peer: Peer: permanent_uuid: "567275700a8f4015b6b87070a382e735" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 43283 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:40.383599  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:40.420225  4821 tablet_server.cc:179] TabletServer@127.4.181.65:44805 shutting down...
I20260709 12:28:40.451882  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:40.452703  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.453644  4821 raft_consensus.cc:2243] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.454200  4821 raft_consensus.cc:2272] T 738994385014430b9c949af13bc8af2b P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.457391 15965 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 81 similar messages]
I20260709 12:28:40.458415  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.459592  4821 raft_consensus.cc:2243] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.460276  4821 raft_consensus.cc:2272] T af1146be7ff349b38af1961af08430dc P 7be02246afd94bd48adc21e99b737e72 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.463912  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.464769  4821 raft_consensus.cc:2243] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.465373  4821 raft_consensus.cc:2272] T 9a2aa06199c94acbacc89b86a43e4960 P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.466826 15965 consensus_peers.cc:597] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.468713  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.469532  4821 raft_consensus.cc:2243] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.470067  4821 raft_consensus.cc:2272] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.472774  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.473402  4821 raft_consensus.cc:2243] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.473959  4821 raft_consensus.cc:2272] T abf7e15c97d74ecc9767944f3a066ea1 P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.476629  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.477228  4821 raft_consensus.cc:2243] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.477747  4821 raft_consensus.cc:2272] T 00ff7ff1388d47c2bedd6918a068f4f5 P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.480422  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.481035  4821 raft_consensus.cc:2243] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.481462  4821 raft_consensus.cc:2272] T 5ef5b2eb40ec43e28d6375b85d40b58b P 7be02246afd94bd48adc21e99b737e72 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.484589  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.485088  4821 raft_consensus.cc:2243] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.485565  4821 raft_consensus.cc:2272] T 38283f7f115a433cb2905faa5b88804f P 7be02246afd94bd48adc21e99b737e72 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.488096  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.488739  4821 raft_consensus.cc:2243] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.489785  4821 raft_consensus.cc:2272] T 091adde7c7344c9fa2b2c93c41383058 P 7be02246afd94bd48adc21e99b737e72 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.493577  4821 tablet_replica.cc:333] stopping tablet replica
I20260709 12:28:40.494362  4821 raft_consensus.cc:2243] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.494994  4821 raft_consensus.cc:2272] T 56c3bd8af0e648f99f8e976806f29f51 P 7be02246afd94bd48adc21e99b737e72 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.496292 16039 consensus_peers.cc:597] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.521493 15870 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:40.532483  4821 tablet_server.cc:196] TabletServer@127.4.181.65:44805 shutdown complete.
W20260709 12:28:40.566475 16039 consensus_peers.cc:597] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.569211  4821 tablet_server.cc:179] TabletServer@127.4.181.66:0 shutting down...
W20260709 12:28:40.590648 16037 consensus_peers.cc:597] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 -> Peer 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283): Couldn't send request to peer 567275700a8f4015b6b87070a382e735. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.590976 15965 consensus_peers.cc:597] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:28:40.608457 16039 consensus_peers.cc:597] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.612352  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:40.613361  4821 tablet_replica.cc:333] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735: stopping tablet replica
I20260709 12:28:40.614305  4821 raft_consensus.cc:2243] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.614908  4821 raft_consensus.cc:2272] T 5ef5b2eb40ec43e28d6375b85d40b58b P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.617689 15965 consensus_peers.cc:597] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.618690  4821 tablet_replica.cc:333] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735: stopping tablet replica
I20260709 12:28:40.619576  4821 raft_consensus.cc:2243] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.620182  4821 raft_consensus.cc:2272] T 738994385014430b9c949af13bc8af2b P 567275700a8f4015b6b87070a382e735 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.623364  4821 tablet_replica.cc:333] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735: stopping tablet replica
I20260709 12:28:40.624259  4821 raft_consensus.cc:2243] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.625377  4821 raft_consensus.cc:2272] T 00ff7ff1388d47c2bedd6918a068f4f5 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.628573  4821 tablet_replica.cc:333] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735: stopping tablet replica
I20260709 12:28:40.629447  4821 raft_consensus.cc:2243] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.630677  4821 raft_consensus.cc:2272] T 4507dea32ba54b6bb03a9b0a565ef8b5 P 567275700a8f4015b6b87070a382e735 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.634028  4821 tablet_replica.cc:333] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735: stopping tablet replica
I20260709 12:28:40.634915  4821 raft_consensus.cc:2243] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.635593  4821 raft_consensus.cc:2272] T abf7e15c97d74ecc9767944f3a066ea1 P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.638736  4821 tablet_replica.cc:333] T af1146be7ff349b38af1961af08430dc P 567275700a8f4015b6b87070a382e735: stopping tablet replica
I20260709 12:28:40.639460  4821 raft_consensus.cc:2243] T af1146be7ff349b38af1961af08430dc P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.640079  4821 raft_consensus.cc:2272] T af1146be7ff349b38af1961af08430dc P 567275700a8f4015b6b87070a382e735 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.643054  4821 tablet_replica.cc:333] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735: stopping tablet replica
I20260709 12:28:40.643694  4821 raft_consensus.cc:2243] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 4 LEADER]: Raft consensus shutting down.
W20260709 12:28:40.643864 16039 consensus_peers.cc:597] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 -> Peer 7be02246afd94bd48adc21e99b737e72 (127.4.181.65:44805): Couldn't send request to peer 7be02246afd94bd48adc21e99b737e72. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:44805: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.644591  4821 raft_consensus.cc:2272] T 9a2aa06199c94acbacc89b86a43e4960 P 567275700a8f4015b6b87070a382e735 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.647743  4821 tablet_replica.cc:333] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735: stopping tablet replica
I20260709 12:28:40.648460  4821 raft_consensus.cc:2243] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.649628  4821 raft_consensus.cc:2272] T 38283f7f115a433cb2905faa5b88804f P 567275700a8f4015b6b87070a382e735 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.652629  4821 tablet_replica.cc:333] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735: stopping tablet replica
I20260709 12:28:40.653379  4821 raft_consensus.cc:2243] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 5 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.654393  4821 raft_consensus.cc:2272] T 091adde7c7344c9fa2b2c93c41383058 P 567275700a8f4015b6b87070a382e735 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.657426  4821 tablet_replica.cc:333] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735: stopping tablet replica
I20260709 12:28:40.658089  4821 raft_consensus.cc:2243] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.659118  4821 raft_consensus.cc:2272] T 56c3bd8af0e648f99f8e976806f29f51 P 567275700a8f4015b6b87070a382e735 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:40.681809 16037 consensus_peers.cc:597] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 -> Peer 567275700a8f4015b6b87070a382e735 (127.4.181.66:43283): Couldn't send request to peer 567275700a8f4015b6b87070a382e735. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:28:40.722569  4821 tablet_server.cc:196] TabletServer@127.4.181.66:0 shutdown complete.
I20260709 12:28:40.752970  4821 tablet_server.cc:179] TabletServer@127.4.181.67:0 shutting down...
I20260709 12:28:40.788339  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:40.789268  4821 tablet_replica.cc:333] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014: stopping tablet replica
I20260709 12:28:40.790349  4821 raft_consensus.cc:2243] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.790934  4821 raft_consensus.cc:2272] T 56c3bd8af0e648f99f8e976806f29f51 P df5dd0a5504d493aa116f002050b6014 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.794632  4821 tablet_replica.cc:333] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014: stopping tablet replica
I20260709 12:28:40.795414  4821 raft_consensus.cc:2243] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 4 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.796615  4821 raft_consensus.cc:2272] T 738994385014430b9c949af13bc8af2b P df5dd0a5504d493aa116f002050b6014 [term 4 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.799360  4821 tablet_replica.cc:333] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014: stopping tablet replica
I20260709 12:28:40.800302  4821 raft_consensus.cc:2243] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.800963  4821 raft_consensus.cc:2272] T 38283f7f115a433cb2905faa5b88804f P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.804136  4821 tablet_replica.cc:333] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014: stopping tablet replica
I20260709 12:28:40.804874  4821 raft_consensus.cc:2243] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 5 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.805545  4821 raft_consensus.cc:2272] T 091adde7c7344c9fa2b2c93c41383058 P df5dd0a5504d493aa116f002050b6014 [term 5 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.808655  4821 tablet_replica.cc:333] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014: stopping tablet replica
I20260709 12:28:40.809435  4821 raft_consensus.cc:2243] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.810675  4821 raft_consensus.cc:2272] T abf7e15c97d74ecc9767944f3a066ea1 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.814445  4821 tablet_replica.cc:333] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014: stopping tablet replica
I20260709 12:28:40.815348  4821 raft_consensus.cc:2243] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.816148  4821 raft_consensus.cc:2272] T 4507dea32ba54b6bb03a9b0a565ef8b5 P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.819082  4821 tablet_replica.cc:333] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014: stopping tablet replica
I20260709 12:28:40.819754  4821 raft_consensus.cc:2243] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.820379  4821 raft_consensus.cc:2272] T 00ff7ff1388d47c2bedd6918a068f4f5 P df5dd0a5504d493aa116f002050b6014 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.823698  4821 tablet_replica.cc:333] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014: stopping tablet replica
I20260709 12:28:40.824424  4821 raft_consensus.cc:2243] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.825529  4821 raft_consensus.cc:2272] T 5ef5b2eb40ec43e28d6375b85d40b58b P df5dd0a5504d493aa116f002050b6014 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.829263  4821 tablet_replica.cc:333] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014: stopping tablet replica
I20260709 12:28:40.829995  4821 raft_consensus.cc:2243] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:40.831250  4821 raft_consensus.cc:2272] T af1146be7ff349b38af1961af08430dc P df5dd0a5504d493aa116f002050b6014 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:40.834342  4821 tablet_replica.cc:333] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014: stopping tablet replica
I20260709 12:28:40.834990  4821 raft_consensus.cc:2243] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 4 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:40.835520  4821 raft_consensus.cc:2272] T 9a2aa06199c94acbacc89b86a43e4960 P df5dd0a5504d493aa116f002050b6014 [term 4 FOLLOWER]: Raft consensus is shut down!
W20260709 12:28:41.522696 15870 auto_rebalancer.cc:288] Could not retrieve cluster info: Illegal state: not all tservers available for tablet placement
I20260709 12:28:41.652529  4821 tablet_server.cc:196] TabletServer@127.4.181.67:0 shutdown complete.
I20260709 12:28:41.677429  4821 master.cc:562] Master@127.4.181.126:43179 shutting down...
I20260709 12:28:41.699224  4821 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:41.699795  4821 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:41.700136  4821 tablet_replica.cc:333] T 00000000000000000000000000000000 P 6d47f5a064544f44bf1d0e1c2e86e8a5: stopping tablet replica
I20260709 12:28:41.719594  4821 master.cc:584] Master@127.4.181.126:43179 shutdown complete.
[       OK ] LeaderRebalancerTest.TestMaintenanceMode (14406 ms)
[ RUN      ] LeaderRebalancerTest.MultiTableLeaderBalance
I20260709 12:28:41.766149  4821 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.181.126:34993
I20260709 12:28:41.767735  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:41.774160 16414 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:41.774801 16415 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:41.775424 16417 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:41.775677  4821 server_base.cc:1061] running on GCE node
I20260709 12:28:41.776758  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:41.776950  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:41.777113  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600121777096 us; error 0 us; skew 500 ppm
I20260709 12:28:41.777697  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:41.780519  4821 webserver.cc:533] Webserver started at http://127.4.181.126:35425/ using document root <none> and password file <none>
I20260709 12:28:41.780993  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:41.781145  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:41.781369  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:41.782507  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/master-0-root/instance:
uuid: "8bedcaf6fe274f4fb202d0e84361dffc"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-k014"
I20260709 12:28:41.786984  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:28:41.790277 16422 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:41.791018  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:28:41.791319  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/master-0-root
uuid: "8bedcaf6fe274f4fb202d0e84361dffc"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-k014"
I20260709 12:28:41.791579  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:41.817080  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:41.818310  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:41.854578  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.126:34993
I20260709 12:28:41.854704 16473 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.126:34993 every 8 connection(s)
I20260709 12:28:41.858345 16474 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:41.869827 16474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc: Bootstrap starting.
I20260709 12:28:41.874763 16474 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:41.879245 16474 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc: No bootstrap required, opened a new log
I20260709 12:28:41.881606 16474 raft_consensus.cc:359] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bedcaf6fe274f4fb202d0e84361dffc" member_type: VOTER }
I20260709 12:28:41.882026 16474 raft_consensus.cc:385] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:41.882256 16474 raft_consensus.cc:740] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bedcaf6fe274f4fb202d0e84361dffc, State: Initialized, Role: FOLLOWER
I20260709 12:28:41.882834 16474 consensus_queue.cc:260] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bedcaf6fe274f4fb202d0e84361dffc" member_type: VOTER }
I20260709 12:28:41.883260 16474 raft_consensus.cc:399] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:41.883476 16474 raft_consensus.cc:493] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:41.883716 16474 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:41.888640 16474 raft_consensus.cc:515] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bedcaf6fe274f4fb202d0e84361dffc" member_type: VOTER }
I20260709 12:28:41.889178 16474 leader_election.cc:304] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 8bedcaf6fe274f4fb202d0e84361dffc; no voters: 
I20260709 12:28:41.890311 16474 leader_election.cc:290] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:41.890750 16477 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:41.892063 16477 raft_consensus.cc:697] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [term 1 LEADER]: Becoming Leader. State: Replica: 8bedcaf6fe274f4fb202d0e84361dffc, State: Running, Role: LEADER
I20260709 12:28:41.892745 16477 consensus_queue.cc:237] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bedcaf6fe274f4fb202d0e84361dffc" member_type: VOTER }
I20260709 12:28:41.893337 16474 sys_catalog.cc:565] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:41.897253 16478 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "8bedcaf6fe274f4fb202d0e84361dffc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bedcaf6fe274f4fb202d0e84361dffc" member_type: VOTER } }
I20260709 12:28:41.897938 16478 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:41.899411 16479 sys_catalog.cc:455] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 8bedcaf6fe274f4fb202d0e84361dffc. Latest consensus state: current_term: 1 leader_uuid: "8bedcaf6fe274f4fb202d0e84361dffc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "8bedcaf6fe274f4fb202d0e84361dffc" member_type: VOTER } }
I20260709 12:28:41.899727 16483 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:41.900014 16479 sys_catalog.cc:458] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:41.905045 16483 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:41.911163  4821 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:41.914335 16483 catalog_manager.cc:1383] Generated new cluster ID: 978ddf0d40cb4e919be698857af82993
I20260709 12:28:41.914659 16483 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:41.935014 16483 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:41.936285 16483 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:41.956487 16483 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc: Generated new TSK 0
I20260709 12:28:41.957069 16483 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:41.982297  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:41.988396 16495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:41.989091 16496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:41.991173 16498 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:41.991914  4821 server_base.cc:1061] running on GCE node
I20260709 12:28:41.992903  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:41.993096  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:41.993290  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600121993271 us; error 0 us; skew 500 ppm
I20260709 12:28:41.993820  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:41.996064  4821 webserver.cc:533] Webserver started at http://127.4.181.65:40999/ using document root <none> and password file <none>
I20260709 12:28:41.996493  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:41.996649  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:41.996992  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:41.998389  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-0-root/instance:
uuid: "8e5a7f8907034a1eb43bd7761c003277"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-k014"
I20260709 12:28:42.002795  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:28:42.006217 16503 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.007119  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.001s
I20260709 12:28:42.007441  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-0-root
uuid: "8e5a7f8907034a1eb43bd7761c003277"
format_stamp: "Formatted at 2026-07-09 12:28:41 on dist-test-slave-k014"
I20260709 12:28:42.007730  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:42.076975  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:42.078236  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:42.079842  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:42.082355  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:42.082588  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.001s	sys 0.000s
I20260709 12:28:42.082834  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:42.083011  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.133100  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.65:44383
I20260709 12:28:42.133158 16565 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.65:44383 every 8 connection(s)
I20260709 12:28:42.139056  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:42.148068 16570 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:42.149580 16571 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:42.150128 16573 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:42.151015  4821 server_base.cc:1061] running on GCE node
I20260709 12:28:42.152493  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:42.152936  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:42.153168  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600122153146 us; error 0 us; skew 500 ppm
I20260709 12:28:42.153743  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:42.154124 16566 heartbeater.cc:344] Connected to a master server at 127.4.181.126:34993
I20260709 12:28:42.154829 16566 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:42.155936 16566 heartbeater.cc:507] Master 127.4.181.126:34993 requested a full tablet report, sending...
I20260709 12:28:42.157198  4821 webserver.cc:533] Webserver started at http://127.4.181.66:37389/ using document root <none> and password file <none>
I20260709 12:28:42.157917  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:42.158171  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:42.158536  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:42.158902 16439 ts_manager.cc:194] Registered new tserver with Master: 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65:44383)
I20260709 12:28:42.160663  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-1-root/instance:
uuid: "09f6aced80b34b0eacfb18ddc05b62a7"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-k014"
I20260709 12:28:42.162050 16439 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38432
I20260709 12:28:42.167505  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.006s	user 0.004s	sys 0.004s
I20260709 12:28:42.171494 16578 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.172398  4821 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.004s	sys 0.000s
I20260709 12:28:42.172720  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-1-root
uuid: "09f6aced80b34b0eacfb18ddc05b62a7"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-k014"
I20260709 12:28:42.173033  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:42.187021  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:42.188306  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:42.189862  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:42.192247  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:42.192557  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.192837  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:42.193001  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.236191  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.66:38989
I20260709 12:28:42.236313 16640 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.66:38989 every 8 connection(s)
I20260709 12:28:42.241093  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:42.249095 16644 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:42.250847 16645 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:42.252770  4821 server_base.cc:1061] running on GCE node
W20260709 12:28:42.253932 16647 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:42.254913 16641 heartbeater.cc:344] Connected to a master server at 127.4.181.126:34993
I20260709 12:28:42.255190  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20260709 12:28:42.255394 16641 heartbeater.cc:461] Registering TS with master...
W20260709 12:28:42.255502  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:42.255779  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600122255761 us; error 0 us; skew 500 ppm
I20260709 12:28:42.256464 16641 heartbeater.cc:507] Master 127.4.181.126:34993 requested a full tablet report, sending...
I20260709 12:28:42.256625  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:42.258971 16439 ts_manager.cc:194] Registered new tserver with Master: 09f6aced80b34b0eacfb18ddc05b62a7 (127.4.181.66:38989)
I20260709 12:28:42.260113  4821 webserver.cc:533] Webserver started at http://127.4.181.67:36557/ using document root <none> and password file <none>
I20260709 12:28:42.260689  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:42.260756 16439 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38440
I20260709 12:28:42.260906  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:42.261332  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:42.262622  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-2-root/instance:
uuid: "94961ebabff5434597afdc7ff7e4e669"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-k014"
I20260709 12:28:42.267313  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.003s
I20260709 12:28:42.270960 16652 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.271803  4821 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.002s	sys 0.001s
I20260709 12:28:42.272095  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-2-root
uuid: "94961ebabff5434597afdc7ff7e4e669"
format_stamp: "Formatted at 2026-07-09 12:28:42 on dist-test-slave-k014"
I20260709 12:28:42.272353  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.MultiTableLeaderBalance.1783599758264527-4821-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:42.284276  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:42.285519  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:42.286993  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:42.289569  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:42.289883  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.290130  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:42.290279  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:42.332934  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.67:37605
I20260709 12:28:42.333025 16714 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.67:37605 every 8 connection(s)
I20260709 12:28:42.347090 16715 heartbeater.cc:344] Connected to a master server at 127.4.181.126:34993
I20260709 12:28:42.347568 16715 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:42.348297 16715 heartbeater.cc:507] Master 127.4.181.126:34993 requested a full tablet report, sending...
I20260709 12:28:42.350425 16439 ts_manager.cc:194] Registered new tserver with Master: 94961ebabff5434597afdc7ff7e4e669 (127.4.181.67:37605)
I20260709 12:28:42.350757  4821 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014704013s
I20260709 12:28:42.352301 16439 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38444
I20260709 12:28:42.377776 16439 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38448:
name: "multi_table_leader_balance_table1"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:42.380080 16439 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table1 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:42.426616 16680 tablet_service.cc:1511] Processing CreateTablet for tablet fc384bccfd8641668532782714825b5c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=79bbe0db08924cfe800654dea13a9a4b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:42.428141 16680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc384bccfd8641668532782714825b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.439666 16531 tablet_service.cc:1511] Processing CreateTablet for tablet fc384bccfd8641668532782714825b5c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=79bbe0db08924cfe800654dea13a9a4b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:42.439980 16530 tablet_service.cc:1511] Processing CreateTablet for tablet e8ad3ee92c6740ffa8f0fc023ce7ef67 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=79bbe0db08924cfe800654dea13a9a4b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:42.441388 16531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc384bccfd8641668532782714825b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.442962 16530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ad3ee92c6740ffa8f0fc023ce7ef67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.443008 16679 tablet_service.cc:1511] Processing CreateTablet for tablet e8ad3ee92c6740ffa8f0fc023ce7ef67 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=79bbe0db08924cfe800654dea13a9a4b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:42.444540 16679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ad3ee92c6740ffa8f0fc023ce7ef67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.454710 16606 tablet_service.cc:1511] Processing CreateTablet for tablet fc384bccfd8641668532782714825b5c (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=79bbe0db08924cfe800654dea13a9a4b]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:42.456139 16606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc384bccfd8641668532782714825b5c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.462013 16605 tablet_service.cc:1511] Processing CreateTablet for tablet e8ad3ee92c6740ffa8f0fc023ce7ef67 (DEFAULT_TABLE table=multi_table_leader_balance_table1 [id=79bbe0db08924cfe800654dea13a9a4b]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:42.463413 16605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e8ad3ee92c6740ffa8f0fc023ce7ef67. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.478103 16731 tablet_bootstrap.cc:492] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669: Bootstrap starting.
I20260709 12:28:42.484141 16730 tablet_bootstrap.cc:492] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277: Bootstrap starting.
I20260709 12:28:42.485594 16732 tablet_bootstrap.cc:492] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7: Bootstrap starting.
I20260709 12:28:42.490653 16731 tablet_bootstrap.cc:654] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.491513 16730 tablet_bootstrap.cc:654] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.492136 16732 tablet_bootstrap.cc:654] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.496464 16731 tablet_bootstrap.cc:492] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669: No bootstrap required, opened a new log
I20260709 12:28:42.496784 16730 tablet_bootstrap.cc:492] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277: No bootstrap required, opened a new log
I20260709 12:28:42.496874 16731 ts_tablet_manager.cc:1403] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669: Time spent bootstrapping tablet: real 0.019s	user 0.006s	sys 0.005s
I20260709 12:28:42.497433 16730 ts_tablet_manager.cc:1403] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277: Time spent bootstrapping tablet: real 0.014s	user 0.013s	sys 0.000s
I20260709 12:28:42.497851 16732 tablet_bootstrap.cc:492] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7: No bootstrap required, opened a new log
I20260709 12:28:42.498356 16732 ts_tablet_manager.cc:1403] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7: Time spent bootstrapping tablet: real 0.013s	user 0.007s	sys 0.004s
I20260709 12:28:42.499349 16731 raft_consensus.cc:359] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } } peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } }
I20260709 12:28:42.499917 16731 raft_consensus.cc:385] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.500138 16731 raft_consensus.cc:740] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94961ebabff5434597afdc7ff7e4e669, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.500382 16730 raft_consensus.cc:359] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } } peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } }
I20260709 12:28:42.500761 16731 consensus_queue.cc:260] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } } peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } }
I20260709 12:28:42.501118 16730 raft_consensus.cc:385] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.501510 16730 raft_consensus.cc:740] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e5a7f8907034a1eb43bd7761c003277, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.501170 16732 raft_consensus.cc:359] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:42.501972 16732 raft_consensus.cc:385] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.502540 16732 raft_consensus.cc:740] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09f6aced80b34b0eacfb18ddc05b62a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.503142 16715 heartbeater.cc:499] Master 127.4.181.126:34993 was elected leader, sending a full tablet report...
I20260709 12:28:42.503526 16731 ts_tablet_manager.cc:1434] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669: Time spent starting tablet: real 0.006s	user 0.003s	sys 0.002s
I20260709 12:28:42.503332 16732 consensus_queue.cc:260] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:42.504392 16731 tablet_bootstrap.cc:492] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669: Bootstrap starting.
I20260709 12:28:42.502296 16730 consensus_queue.cc:260] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } } peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } }
I20260709 12:28:42.511629 16731 tablet_bootstrap.cc:654] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.513166 16732 ts_tablet_manager.cc:1434] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7: Time spent starting tablet: real 0.014s	user 0.012s	sys 0.000s
I20260709 12:28:42.514041 16641 heartbeater.cc:499] Master 127.4.181.126:34993 was elected leader, sending a full tablet report...
I20260709 12:28:42.515129 16730 ts_tablet_manager.cc:1434] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277: Time spent starting tablet: real 0.017s	user 0.010s	sys 0.004s
I20260709 12:28:42.515872 16566 heartbeater.cc:499] Master 127.4.181.126:34993 was elected leader, sending a full tablet report...
I20260709 12:28:42.517427 16732 tablet_bootstrap.cc:492] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7: Bootstrap starting.
I20260709 12:28:42.524591 16732 tablet_bootstrap.cc:654] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.529268 16730 tablet_bootstrap.cc:492] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277: Bootstrap starting.
I20260709 12:28:42.541301 16730 tablet_bootstrap.cc:654] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.545477 16731 tablet_bootstrap.cc:492] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669: No bootstrap required, opened a new log
I20260709 12:28:42.546043 16731 ts_tablet_manager.cc:1403] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669: Time spent bootstrapping tablet: real 0.042s	user 0.021s	sys 0.019s
I20260709 12:28:42.548049 16732 tablet_bootstrap.cc:492] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7: No bootstrap required, opened a new log
I20260709 12:28:42.548646 16732 ts_tablet_manager.cc:1403] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7: Time spent bootstrapping tablet: real 0.031s	user 0.017s	sys 0.012s
I20260709 12:28:42.548950 16731 raft_consensus.cc:359] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:42.549759 16731 raft_consensus.cc:385] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.550115 16731 raft_consensus.cc:740] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94961ebabff5434597afdc7ff7e4e669, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.550881 16730 tablet_bootstrap.cc:492] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277: No bootstrap required, opened a new log
I20260709 12:28:42.550993 16731 consensus_queue.cc:260] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:42.551479 16730 ts_tablet_manager.cc:1403] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277: Time spent bootstrapping tablet: real 0.022s	user 0.016s	sys 0.000s
I20260709 12:28:42.553161 16731 ts_tablet_manager.cc:1434] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:28:42.552603 16732 raft_consensus.cc:359] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } } peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } }
I20260709 12:28:42.553655 16732 raft_consensus.cc:385] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.553959 16732 raft_consensus.cc:740] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09f6aced80b34b0eacfb18ddc05b62a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.554843 16730 raft_consensus.cc:359] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:42.554857 16732 consensus_queue.cc:260] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } } peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } }
I20260709 12:28:42.555840 16730 raft_consensus.cc:385] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.556154 16730 raft_consensus.cc:740] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e5a7f8907034a1eb43bd7761c003277, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.557379 16732 ts_tablet_manager.cc:1434] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:28:42.556908 16730 consensus_queue.cc:260] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:42.559999 16730 ts_tablet_manager.cc:1434] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:42.783830 16736 raft_consensus.cc:493] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.784360 16736 raft_consensus.cc:515] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:42.786262 16736 leader_election.cc:290] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65:44383), 09f6aced80b34b0eacfb18ddc05b62a7 (127.4.181.66:38989)
I20260709 12:28:42.792891 16737 raft_consensus.cc:493] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:42.793493 16737 raft_consensus.cc:515] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } } peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } }
I20260709 12:28:42.796495 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ad3ee92c6740ffa8f0fc023ce7ef67" candidate_uuid: "94961ebabff5434597afdc7ff7e4e669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5a7f8907034a1eb43bd7761c003277" is_pre_election: true
I20260709 12:28:42.797269 16541 raft_consensus.cc:2468] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94961ebabff5434597afdc7ff7e4e669 in term 0.
I20260709 12:28:42.797678 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ad3ee92c6740ffa8f0fc023ce7ef67" candidate_uuid: "94961ebabff5434597afdc7ff7e4e669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" is_pre_election: true
I20260709 12:28:42.798072 16737 leader_election.cc:290] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 94961ebabff5434597afdc7ff7e4e669 (127.4.181.67:37605), 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65:44383)
I20260709 12:28:42.798475 16616 raft_consensus.cc:2468] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 94961ebabff5434597afdc7ff7e4e669 in term 0.
I20260709 12:28:42.799918 16656 leader_election.cc:304] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e5a7f8907034a1eb43bd7761c003277, 94961ebabff5434597afdc7ff7e4e669; no voters: 
I20260709 12:28:42.800853 16736 raft_consensus.cc:2804] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:42.801201 16736 raft_consensus.cc:493] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.801519 16736 raft_consensus.cc:3060] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:42.809377 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc384bccfd8641668532782714825b5c" candidate_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94961ebabff5434597afdc7ff7e4e669" is_pre_election: true
I20260709 12:28:42.809230 16736 raft_consensus.cc:515] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:42.810223 16690 raft_consensus.cc:2468] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09f6aced80b34b0eacfb18ddc05b62a7 in term 0.
I20260709 12:28:42.810709 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc384bccfd8641668532782714825b5c" candidate_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5a7f8907034a1eb43bd7761c003277" is_pre_election: true
I20260709 12:28:42.811358 16541 raft_consensus.cc:2468] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09f6aced80b34b0eacfb18ddc05b62a7 in term 0.
I20260709 12:28:42.811599 16580 leader_election.cc:304] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09f6aced80b34b0eacfb18ddc05b62a7, 94961ebabff5434597afdc7ff7e4e669; no voters: 
I20260709 12:28:42.812490 16737 raft_consensus.cc:2804] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:42.812417 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ad3ee92c6740ffa8f0fc023ce7ef67" candidate_uuid: "94961ebabff5434597afdc7ff7e4e669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5a7f8907034a1eb43bd7761c003277"
I20260709 12:28:42.812964 16737 raft_consensus.cc:493] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:42.813076 16736 leader_election.cc:290] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [CANDIDATE]: Term 1 election: Requested vote from peers 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65:44383), 09f6aced80b34b0eacfb18ddc05b62a7 (127.4.181.66:38989)
I20260709 12:28:42.813148 16540 raft_consensus.cc:3060] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:42.813436 16737 raft_consensus.cc:3060] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:42.814131 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ad3ee92c6740ffa8f0fc023ce7ef67" candidate_uuid: "94961ebabff5434597afdc7ff7e4e669" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "09f6aced80b34b0eacfb18ddc05b62a7"
I20260709 12:28:42.814719 16616 raft_consensus.cc:3060] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:42.819314 16737 raft_consensus.cc:515] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } } peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } }
I20260709 12:28:42.821291 16540 raft_consensus.cc:2468] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94961ebabff5434597afdc7ff7e4e669 in term 1.
I20260709 12:28:42.821344 16737 leader_election.cc:290] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [CANDIDATE]: Term 1 election: Requested vote from peers 94961ebabff5434597afdc7ff7e4e669 (127.4.181.67:37605), 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65:44383)
I20260709 12:28:42.822222 16616 raft_consensus.cc:2468] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94961ebabff5434597afdc7ff7e4e669 in term 1.
I20260709 12:28:42.822181 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc384bccfd8641668532782714825b5c" candidate_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94961ebabff5434597afdc7ff7e4e669"
I20260709 12:28:42.822764 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc384bccfd8641668532782714825b5c" candidate_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5a7f8907034a1eb43bd7761c003277"
I20260709 12:28:42.823081 16690 raft_consensus.cc:3060] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:42.823380 16541 raft_consensus.cc:3060] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:42.823698 16656 leader_election.cc:304] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e5a7f8907034a1eb43bd7761c003277, 94961ebabff5434597afdc7ff7e4e669; no voters: 
I20260709 12:28:42.824652 16736 raft_consensus.cc:2804] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:42.825779 16736 raft_consensus.cc:697] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 1 LEADER]: Becoming Leader. State: Replica: 94961ebabff5434597afdc7ff7e4e669, State: Running, Role: LEADER
I20260709 12:28:42.826710 16736 consensus_queue.cc:237] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:42.829651 16541 raft_consensus.cc:2468] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09f6aced80b34b0eacfb18ddc05b62a7 in term 1.
I20260709 12:28:42.830899 16582 leader_election.cc:304] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09f6aced80b34b0eacfb18ddc05b62a7, 8e5a7f8907034a1eb43bd7761c003277; no voters: 
I20260709 12:28:42.831571 16737 raft_consensus.cc:2804] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:42.831784 16690 raft_consensus.cc:2468] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09f6aced80b34b0eacfb18ddc05b62a7 in term 1.
I20260709 12:28:42.834111 16737 raft_consensus.cc:697] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Becoming Leader. State: Replica: 09f6aced80b34b0eacfb18ddc05b62a7, State: Running, Role: LEADER
I20260709 12:28:42.835003 16737 consensus_queue.cc:237] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } } peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } }
I20260709 12:28:42.837286 16436 catalog_manager.cc:5697] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 reported cstate change: term changed from 0 to 1, leader changed from <none> to 94961ebabff5434597afdc7ff7e4e669 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "94961ebabff5434597afdc7ff7e4e669" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:42.841820 16438 catalog_manager.cc:5697] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09f6aced80b34b0eacfb18ddc05b62a7 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:42.922895 16438 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38452:
name: "multi_table_leader_balance_table2"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\377\377\377?""\004\001\000\377\377\377?"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:42.924760 16438 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table multi_table_leader_balance_table2 in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:42.947544 16531 tablet_service.cc:1511] Processing CreateTablet for tablet 71fe9ac77aca42bdb69b93f7f69b64fd (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7c9911f0710e46e3978c4fb675ee3a70]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:42.948884 16531 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fe9ac77aca42bdb69b93f7f69b64fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.949457 16606 tablet_service.cc:1511] Processing CreateTablet for tablet 71fe9ac77aca42bdb69b93f7f69b64fd (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7c9911f0710e46e3978c4fb675ee3a70]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:42.949923 16680 tablet_service.cc:1511] Processing CreateTablet for tablet 71fe9ac77aca42bdb69b93f7f69b64fd (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7c9911f0710e46e3978c4fb675ee3a70]), partition=RANGE (key) PARTITION VALUES < 1073741823
I20260709 12:28:42.950850 16606 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fe9ac77aca42bdb69b93f7f69b64fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.951102 16680 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 71fe9ac77aca42bdb69b93f7f69b64fd. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.961222 16530 tablet_service.cc:1511] Processing CreateTablet for tablet 9187a01afa454732985a2946ff27ce2f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7c9911f0710e46e3978c4fb675ee3a70]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:42.962633 16530 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9187a01afa454732985a2946ff27ce2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.964237 16679 tablet_service.cc:1511] Processing CreateTablet for tablet 9187a01afa454732985a2946ff27ce2f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7c9911f0710e46e3978c4fb675ee3a70]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:42.965003 16731 tablet_bootstrap.cc:492] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669: Bootstrap starting.
I20260709 12:28:42.965389 16730 tablet_bootstrap.cc:492] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277: Bootstrap starting.
I20260709 12:28:42.965548 16679 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9187a01afa454732985a2946ff27ce2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.968375 16605 tablet_service.cc:1511] Processing CreateTablet for tablet 9187a01afa454732985a2946ff27ce2f (DEFAULT_TABLE table=multi_table_leader_balance_table2 [id=7c9911f0710e46e3978c4fb675ee3a70]), partition=RANGE (key) PARTITION 1073741823 <= VALUES
I20260709 12:28:42.969712 16605 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9187a01afa454732985a2946ff27ce2f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:42.971613 16731 tablet_bootstrap.cc:654] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.972093 16730 tablet_bootstrap.cc:654] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.988917 16731 tablet_bootstrap.cc:492] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669: No bootstrap required, opened a new log
I20260709 12:28:42.989449 16731 ts_tablet_manager.cc:1403] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669: Time spent bootstrapping tablet: real 0.025s	user 0.007s	sys 0.007s
I20260709 12:28:42.991783 16732 tablet_bootstrap.cc:492] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7: Bootstrap starting.
I20260709 12:28:42.993026 16730 tablet_bootstrap.cc:492] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277: No bootstrap required, opened a new log
I20260709 12:28:42.993737 16730 ts_tablet_manager.cc:1403] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277: Time spent bootstrapping tablet: real 0.029s	user 0.011s	sys 0.004s
I20260709 12:28:42.993916 16731 raft_consensus.cc:359] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:42.994736 16731 raft_consensus.cc:385] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.995021 16731 raft_consensus.cc:740] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94961ebabff5434597afdc7ff7e4e669, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.995991 16731 consensus_queue.cc:260] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:42.997251 16730 raft_consensus.cc:359] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:42.998045 16730 raft_consensus.cc:385] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:42.998356 16730 raft_consensus.cc:740] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e5a7f8907034a1eb43bd7761c003277, State: Initialized, Role: FOLLOWER
I20260709 12:28:42.998585 16732 tablet_bootstrap.cc:654] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:42.999184 16730 consensus_queue.cc:260] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.001467 16730 ts_tablet_manager.cc:1434] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:43.003333 16731 ts_tablet_manager.cc:1434] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669: Time spent starting tablet: real 0.014s	user 0.009s	sys 0.000s
I20260709 12:28:43.004508 16731 tablet_bootstrap.cc:492] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669: Bootstrap starting.
I20260709 12:28:43.009143 16730 tablet_bootstrap.cc:492] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277: Bootstrap starting.
I20260709 12:28:43.010928 16731 tablet_bootstrap.cc:654] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.016067 16730 tablet_bootstrap.cc:654] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.017745 16731 tablet_bootstrap.cc:492] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669: No bootstrap required, opened a new log
I20260709 12:28:43.018368 16731 ts_tablet_manager.cc:1403] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669: Time spent bootstrapping tablet: real 0.014s	user 0.011s	sys 0.000s
I20260709 12:28:43.019234 16732 tablet_bootstrap.cc:492] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7: No bootstrap required, opened a new log
I20260709 12:28:43.019845 16732 ts_tablet_manager.cc:1403] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7: Time spent bootstrapping tablet: real 0.028s	user 0.007s	sys 0.005s
I20260709 12:28:43.021644 16731 raft_consensus.cc:359] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.022585 16731 raft_consensus.cc:385] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.022900 16731 raft_consensus.cc:740] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 94961ebabff5434597afdc7ff7e4e669, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.022974 16732 raft_consensus.cc:359] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.023675 16732 raft_consensus.cc:385] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.023928 16732 raft_consensus.cc:740] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09f6aced80b34b0eacfb18ddc05b62a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.023757 16731 consensus_queue.cc:260] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.024925 16730 tablet_bootstrap.cc:492] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277: No bootstrap required, opened a new log
I20260709 12:28:43.024628 16732 consensus_queue.cc:260] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.025533 16730 ts_tablet_manager.cc:1403] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277: Time spent bootstrapping tablet: real 0.018s	user 0.016s	sys 0.000s
I20260709 12:28:43.027297 16732 ts_tablet_manager.cc:1434] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:28:43.028405 16732 tablet_bootstrap.cc:492] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7: Bootstrap starting.
I20260709 12:28:43.029426 16730 raft_consensus.cc:359] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.030225 16730 raft_consensus.cc:385] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.030526 16730 raft_consensus.cc:740] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8e5a7f8907034a1eb43bd7761c003277, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.026211 16731 ts_tablet_manager.cc:1434] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:43.031900 16730 consensus_queue.cc:260] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.035594 16732 tablet_bootstrap.cc:654] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:43.036715 16730 ts_tablet_manager.cc:1434] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:28:43.043278 16732 tablet_bootstrap.cc:492] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7: No bootstrap required, opened a new log
I20260709 12:28:43.043942 16732 ts_tablet_manager.cc:1403] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7: Time spent bootstrapping tablet: real 0.016s	user 0.014s	sys 0.000s
I20260709 12:28:43.046628 16732 raft_consensus.cc:359] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.047255 16732 raft_consensus.cc:385] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:43.047468 16732 raft_consensus.cc:740] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09f6aced80b34b0eacfb18ddc05b62a7, State: Initialized, Role: FOLLOWER
I20260709 12:28:43.048008 16732 consensus_queue.cc:260] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.049539 16732 ts_tablet_manager.cc:1434] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:28:43.059840 16737 raft_consensus.cc:493] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.060333 16737 raft_consensus.cc:515] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.061882 16737 leader_election.cc:290] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65:44383), 94961ebabff5434597afdc7ff7e4e669 (127.4.181.67:37605)
I20260709 12:28:43.062762 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fe9ac77aca42bdb69b93f7f69b64fd" candidate_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5a7f8907034a1eb43bd7761c003277" is_pre_election: true
I20260709 12:28:43.062952 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fe9ac77aca42bdb69b93f7f69b64fd" candidate_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94961ebabff5434597afdc7ff7e4e669" is_pre_election: true
I20260709 12:28:43.063367 16541 raft_consensus.cc:2468] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09f6aced80b34b0eacfb18ddc05b62a7 in term 0.
I20260709 12:28:43.063534 16690 raft_consensus.cc:2468] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09f6aced80b34b0eacfb18ddc05b62a7 in term 0.
I20260709 12:28:43.064353 16582 leader_election.cc:304] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09f6aced80b34b0eacfb18ddc05b62a7, 8e5a7f8907034a1eb43bd7761c003277; no voters: 
I20260709 12:28:43.065025 16737 raft_consensus.cc:2804] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.065307 16737 raft_consensus.cc:493] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.065557 16737 raft_consensus.cc:3060] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.070945 16737 raft_consensus.cc:515] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.072832 16737 leader_election.cc:290] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [CANDIDATE]: Term 1 election: Requested vote from peers 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65:44383), 94961ebabff5434597afdc7ff7e4e669 (127.4.181.67:37605)
I20260709 12:28:43.073552 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fe9ac77aca42bdb69b93f7f69b64fd" candidate_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5a7f8907034a1eb43bd7761c003277"
I20260709 12:28:43.073771 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fe9ac77aca42bdb69b93f7f69b64fd" candidate_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94961ebabff5434597afdc7ff7e4e669"
I20260709 12:28:43.074290 16541 raft_consensus.cc:3060] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.074301 16690 raft_consensus.cc:3060] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.081789 16541 raft_consensus.cc:2468] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09f6aced80b34b0eacfb18ddc05b62a7 in term 1.
I20260709 12:28:43.081789 16690 raft_consensus.cc:2468] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09f6aced80b34b0eacfb18ddc05b62a7 in term 1.
I20260709 12:28:43.083323 16580 leader_election.cc:304] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09f6aced80b34b0eacfb18ddc05b62a7, 94961ebabff5434597afdc7ff7e4e669; no voters: 
I20260709 12:28:43.084064 16737 raft_consensus.cc:2804] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.084499 16737 raft_consensus.cc:697] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Becoming Leader. State: Replica: 09f6aced80b34b0eacfb18ddc05b62a7, State: Running, Role: LEADER
I20260709 12:28:43.085278 16737 consensus_queue.cc:237] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.093580 16439 catalog_manager.cc:5697] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09f6aced80b34b0eacfb18ddc05b62a7 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.182402 16737 raft_consensus.cc:493] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:43.182926 16737 raft_consensus.cc:515] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.184669 16737 leader_election.cc:290] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65:44383), 94961ebabff5434597afdc7ff7e4e669 (127.4.181.67:37605)
I20260709 12:28:43.185702 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187a01afa454732985a2946ff27ce2f" candidate_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94961ebabff5434597afdc7ff7e4e669" is_pre_election: true
I20260709 12:28:43.185702 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187a01afa454732985a2946ff27ce2f" candidate_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5a7f8907034a1eb43bd7761c003277" is_pre_election: true
I20260709 12:28:43.186623 16690 raft_consensus.cc:2468] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09f6aced80b34b0eacfb18ddc05b62a7 in term 0.
I20260709 12:28:43.186652 16541 raft_consensus.cc:2468] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 09f6aced80b34b0eacfb18ddc05b62a7 in term 0.
I20260709 12:28:43.187989 16582 leader_election.cc:304] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09f6aced80b34b0eacfb18ddc05b62a7, 8e5a7f8907034a1eb43bd7761c003277; no voters: 
I20260709 12:28:43.188869 16737 raft_consensus.cc:2804] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:43.189172 16737 raft_consensus.cc:493] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:43.189428 16737 raft_consensus.cc:3060] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.195258 16737 raft_consensus.cc:515] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.196841 16737 leader_election.cc:290] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [CANDIDATE]: Term 1 election: Requested vote from peers 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65:44383), 94961ebabff5434597afdc7ff7e4e669 (127.4.181.67:37605)
I20260709 12:28:43.197819 16541 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187a01afa454732985a2946ff27ce2f" candidate_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8e5a7f8907034a1eb43bd7761c003277"
I20260709 12:28:43.197916 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187a01afa454732985a2946ff27ce2f" candidate_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "94961ebabff5434597afdc7ff7e4e669"
I20260709 12:28:43.198406 16541 raft_consensus.cc:3060] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.198529 16690 raft_consensus.cc:3060] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:43.203670 16541 raft_consensus.cc:2468] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09f6aced80b34b0eacfb18ddc05b62a7 in term 1.
I20260709 12:28:43.204020 16690 raft_consensus.cc:2468] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09f6aced80b34b0eacfb18ddc05b62a7 in term 1.
I20260709 12:28:43.204783 16582 leader_election.cc:304] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09f6aced80b34b0eacfb18ddc05b62a7, 8e5a7f8907034a1eb43bd7761c003277; no voters: 
I20260709 12:28:43.205740 16737 raft_consensus.cc:2804] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:43.206192 16737 raft_consensus.cc:697] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Becoming Leader. State: Replica: 09f6aced80b34b0eacfb18ddc05b62a7, State: Running, Role: LEADER
I20260709 12:28:43.206943 16737 consensus_queue.cc:237] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.214066 16439 catalog_manager.cc:5697] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 09f6aced80b34b0eacfb18ddc05b62a7 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.251317 16737 consensus_queue.cc:1048] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.251461 16736 consensus_queue.cc:1048] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.253576 16616 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "fc384bccfd8641668532782714825b5c"
dest_uuid: "09f6aced80b34b0eacfb18ddc05b62a7"
mode: GRACEFUL
new_leader_uuid: "8e5a7f8907034a1eb43bd7761c003277"
 from {username='slave'} at 127.0.0.1:46936
I20260709 12:28:43.254271 16616 raft_consensus.cc:606] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Received request to transfer leadership to TS 8e5a7f8907034a1eb43bd7761c003277
I20260709 12:28:43.274365 16690 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e8ad3ee92c6740ffa8f0fc023ce7ef67"
dest_uuid: "94961ebabff5434597afdc7ff7e4e669"
mode: GRACEFUL
new_leader_uuid: "09f6aced80b34b0eacfb18ddc05b62a7"
 from {username='slave'} at 127.0.0.1:55754
I20260709 12:28:43.275336 16690 raft_consensus.cc:606] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 1 LEADER]: Received request to transfer leadership to TS 09f6aced80b34b0eacfb18ddc05b62a7
I20260709 12:28:43.283051 16615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fe9ac77aca42bdb69b93f7f69b64fd"
dest_uuid: "09f6aced80b34b0eacfb18ddc05b62a7"
mode: GRACEFUL
new_leader_uuid: "8e5a7f8907034a1eb43bd7761c003277"
 from {username='slave'} at 127.0.0.1:46936
I20260709 12:28:43.283855 16615 raft_consensus.cc:606] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Received request to transfer leadership to TS 8e5a7f8907034a1eb43bd7761c003277
I20260709 12:28:43.287200 16745 consensus_queue.cc:1048] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:43.288930 16747 consensus_queue.cc:1048] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:43.291281 16615 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "9187a01afa454732985a2946ff27ce2f"
dest_uuid: "09f6aced80b34b0eacfb18ddc05b62a7"
mode: GRACEFUL
new_leader_uuid: "8e5a7f8907034a1eb43bd7761c003277"
 from {username='slave'} at 127.0.0.1:46936
I20260709 12:28:43.292066 16615 raft_consensus.cc:606] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Received request to transfer leadership to TS 8e5a7f8907034a1eb43bd7761c003277
I20260709 12:28:43.300853 16745 raft_consensus.cc:993] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669: : Instructing follower 09f6aced80b34b0eacfb18ddc05b62a7 to start an election
I20260709 12:28:43.301338 16745 raft_consensus.cc:1081] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 1 LEADER]: Signalling peer 09f6aced80b34b0eacfb18ddc05b62a7 to start an election
I20260709 12:28:43.307739 16616 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e8ad3ee92c6740ffa8f0fc023ce7ef67"
dest_uuid: "09f6aced80b34b0eacfb18ddc05b62a7"
 from {username='slave'} at 127.0.0.1:46924
I20260709 12:28:43.308305 16616 raft_consensus.cc:493] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:43.308821 16616 raft_consensus.cc:3060] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:43.316390 16616 raft_consensus.cc:515] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.317334 16737 raft_consensus.cc:993] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7: : Instructing follower 8e5a7f8907034a1eb43bd7761c003277 to start an election
I20260709 12:28:43.317884 16737 raft_consensus.cc:1081] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Signalling peer 8e5a7f8907034a1eb43bd7761c003277 to start an election
I20260709 12:28:43.318450 16616 leader_election.cc:290] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [CANDIDATE]: Term 2 election: Requested vote from peers 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65:44383), 94961ebabff5434597afdc7ff7e4e669 (127.4.181.67:37605)
I20260709 12:28:43.319749 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ad3ee92c6740ffa8f0fc023ce7ef67" candidate_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94961ebabff5434597afdc7ff7e4e669"
I20260709 12:28:43.320420 16690 raft_consensus.cc:3055] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:43.320752 16690 raft_consensus.cc:740] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 94961ebabff5434597afdc7ff7e4e669, State: Running, Role: LEADER
I20260709 12:28:43.321599 16690 consensus_queue.cc:260] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.322916 16690 raft_consensus.cc:3060] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:43.326067 16541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "fc384bccfd8641668532782714825b5c"
dest_uuid: "8e5a7f8907034a1eb43bd7761c003277"
 from {username='slave'} at 127.0.0.1:51486
I20260709 12:28:43.326915 16541 raft_consensus.cc:493] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:43.327050 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e8ad3ee92c6740ffa8f0fc023ce7ef67" candidate_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "8e5a7f8907034a1eb43bd7761c003277"
I20260709 12:28:43.327368 16541 raft_consensus.cc:3060] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:43.327728 16540 raft_consensus.cc:3060] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:43.330556 16690 raft_consensus.cc:2468] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09f6aced80b34b0eacfb18ddc05b62a7 in term 2.
I20260709 12:28:43.331739 16580 leader_election.cc:304] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09f6aced80b34b0eacfb18ddc05b62a7, 94961ebabff5434597afdc7ff7e4e669; no voters: 
I20260709 12:28:43.332660 16769 raft_consensus.cc:2804] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:43.333138 16769 raft_consensus.cc:697] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 LEADER]: Becoming Leader. State: Replica: 09f6aced80b34b0eacfb18ddc05b62a7, State: Running, Role: LEADER
I20260709 12:28:43.333990 16769 consensus_queue.cc:237] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.336197 16541 raft_consensus.cc:515] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } } peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } }
I20260709 12:28:43.336951 16540 raft_consensus.cc:2468] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 09f6aced80b34b0eacfb18ddc05b62a7 in term 2.
I20260709 12:28:43.342594 16541 leader_election.cc:290] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [CANDIDATE]: Term 2 election: Requested vote from peers 94961ebabff5434597afdc7ff7e4e669 (127.4.181.67:37605), 09f6aced80b34b0eacfb18ddc05b62a7 (127.4.181.66:38989)
I20260709 12:28:43.344991 16439 catalog_manager.cc:5697] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 reported cstate change: term changed from 1 to 2, leader changed from 94961ebabff5434597afdc7ff7e4e669 (127.4.181.67) to 09f6aced80b34b0eacfb18ddc05b62a7 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.356787 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc384bccfd8641668532782714825b5c" candidate_uuid: "8e5a7f8907034a1eb43bd7761c003277" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09f6aced80b34b0eacfb18ddc05b62a7"
I20260709 12:28:43.356787 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "fc384bccfd8641668532782714825b5c" candidate_uuid: "8e5a7f8907034a1eb43bd7761c003277" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94961ebabff5434597afdc7ff7e4e669"
I20260709 12:28:43.357530 16616 raft_consensus.cc:3055] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:43.357738 16690 raft_consensus.cc:3060] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:43.358059 16616 raft_consensus.cc:740] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09f6aced80b34b0eacfb18ddc05b62a7, State: Running, Role: LEADER
I20260709 12:28:43.359148 16616 consensus_queue.cc:260] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } } peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } }
I20260709 12:28:43.360311 16616 raft_consensus.cc:3060] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:43.366317 16616 raft_consensus.cc:2468] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e5a7f8907034a1eb43bd7761c003277 in term 2.
I20260709 12:28:43.366626 16690 raft_consensus.cc:2468] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e5a7f8907034a1eb43bd7761c003277 in term 2.
I20260709 12:28:43.367587 16506 leader_election.cc:304] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09f6aced80b34b0eacfb18ddc05b62a7, 8e5a7f8907034a1eb43bd7761c003277; no voters: 
I20260709 12:28:43.368513 16738 raft_consensus.cc:2804] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:43.369530 16738 raft_consensus.cc:697] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [term 2 LEADER]: Becoming Leader. State: Replica: 8e5a7f8907034a1eb43bd7761c003277, State: Running, Role: LEADER
I20260709 12:28:43.370604 16738 consensus_queue.cc:237] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } } peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } }
I20260709 12:28:43.377676 16436 catalog_manager.cc:5697] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 reported cstate change: term changed from 1 to 2, leader changed from 09f6aced80b34b0eacfb18ddc05b62a7 (127.4.181.66) to 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "8e5a7f8907034a1eb43bd7761c003277" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.474520 16769 consensus_queue.cc:1048] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.481106 16737 raft_consensus.cc:993] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7: : Instructing follower 8e5a7f8907034a1eb43bd7761c003277 to start an election
I20260709 12:28:43.481765 16737 raft_consensus.cc:1081] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Signalling peer 8e5a7f8907034a1eb43bd7761c003277 to start an election
I20260709 12:28:43.486667 16541 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71fe9ac77aca42bdb69b93f7f69b64fd"
dest_uuid: "8e5a7f8907034a1eb43bd7761c003277"
 from {username='slave'} at 127.0.0.1:51486
I20260709 12:28:43.487237 16541 raft_consensus.cc:493] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:43.487658 16541 raft_consensus.cc:3060] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:43.487947 16747 consensus_queue.cc:1048] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.495561 16541 raft_consensus.cc:515] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.498507 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fe9ac77aca42bdb69b93f7f69b64fd" candidate_uuid: "8e5a7f8907034a1eb43bd7761c003277" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09f6aced80b34b0eacfb18ddc05b62a7"
I20260709 12:28:43.499015 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fe9ac77aca42bdb69b93f7f69b64fd" candidate_uuid: "8e5a7f8907034a1eb43bd7761c003277" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94961ebabff5434597afdc7ff7e4e669"
I20260709 12:28:43.499248 16616 raft_consensus.cc:3055] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:43.499570 16690 raft_consensus.cc:3060] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:43.499707 16616 raft_consensus.cc:740] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09f6aced80b34b0eacfb18ddc05b62a7, State: Running, Role: LEADER
I20260709 12:28:43.500655 16616 consensus_queue.cc:260] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.501893 16616 raft_consensus.cc:3060] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:43.498503 16541 leader_election.cc:290] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [CANDIDATE]: Term 2 election: Requested vote from peers 09f6aced80b34b0eacfb18ddc05b62a7 (127.4.181.66:38989), 94961ebabff5434597afdc7ff7e4e669 (127.4.181.67:37605)
I20260709 12:28:43.506109 16690 raft_consensus.cc:2468] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e5a7f8907034a1eb43bd7761c003277 in term 2.
I20260709 12:28:43.507546 16616 raft_consensus.cc:2468] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e5a7f8907034a1eb43bd7761c003277 in term 2.
I20260709 12:28:43.508839 16506 leader_election.cc:304] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09f6aced80b34b0eacfb18ddc05b62a7, 8e5a7f8907034a1eb43bd7761c003277; no voters: 
I20260709 12:28:43.509604 16738 raft_consensus.cc:2804] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:43.510118 16738 raft_consensus.cc:697] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 2 LEADER]: Becoming Leader. State: Replica: 8e5a7f8907034a1eb43bd7761c003277, State: Running, Role: LEADER
I20260709 12:28:43.510972 16738 consensus_queue.cc:237] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.517995 16439 catalog_manager.cc:5697] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 reported cstate change: term changed from 1 to 2, leader changed from 09f6aced80b34b0eacfb18ddc05b62a7 (127.4.181.66) to 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "8e5a7f8907034a1eb43bd7761c003277" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.613124 16747 consensus_queue.cc:1048] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.620177 16737 raft_consensus.cc:993] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7: : Instructing follower 8e5a7f8907034a1eb43bd7761c003277 to start an election
I20260709 12:28:43.620683 16737 raft_consensus.cc:1081] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Signalling peer 8e5a7f8907034a1eb43bd7761c003277 to start an election
I20260709 12:28:43.622274 16540 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "9187a01afa454732985a2946ff27ce2f"
dest_uuid: "8e5a7f8907034a1eb43bd7761c003277"
 from {username='slave'} at 127.0.0.1:51486
I20260709 12:28:43.622785 16540 raft_consensus.cc:493] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:43.623148 16540 raft_consensus.cc:3060] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:43.625144 16737 consensus_queue.cc:1048] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.629952 16540 raft_consensus.cc:515] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.631145 16541 raft_consensus.cc:1240] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 2 FOLLOWER]: Rejecting Update request from peer 09f6aced80b34b0eacfb18ddc05b62a7 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:43.634299 16769 consensus_queue.cc:1059] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:43.634770 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187a01afa454732985a2946ff27ce2f" candidate_uuid: "8e5a7f8907034a1eb43bd7761c003277" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "09f6aced80b34b0eacfb18ddc05b62a7"
I20260709 12:28:43.634981 16540 leader_election.cc:290] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [CANDIDATE]: Term 2 election: Requested vote from peers 09f6aced80b34b0eacfb18ddc05b62a7 (127.4.181.66:38989), 94961ebabff5434597afdc7ff7e4e669 (127.4.181.67:37605)
I20260709 12:28:43.635095 16769 raft_consensus.cc:3055] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:43.635954 16769 raft_consensus.cc:740] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 09f6aced80b34b0eacfb18ddc05b62a7, State: Running, Role: LEADER
I20260709 12:28:43.635967 16690 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "9187a01afa454732985a2946ff27ce2f" candidate_uuid: "8e5a7f8907034a1eb43bd7761c003277" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "94961ebabff5434597afdc7ff7e4e669"
I20260709 12:28:43.636932 16690 raft_consensus.cc:3060] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:43.636749 16769 consensus_queue.cc:260] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.638046 16769 raft_consensus.cc:3060] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:43.644035 16690 raft_consensus.cc:2468] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e5a7f8907034a1eb43bd7761c003277 in term 2.
I20260709 12:28:43.645329 16505 leader_election.cc:304] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 8e5a7f8907034a1eb43bd7761c003277, 94961ebabff5434597afdc7ff7e4e669; no voters: 
I20260709 12:28:43.646250 16738 raft_consensus.cc:2804] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:43.646744 16738 raft_consensus.cc:697] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 2 LEADER]: Becoming Leader. State: Replica: 8e5a7f8907034a1eb43bd7761c003277, State: Running, Role: LEADER
I20260709 12:28:43.647562 16738 consensus_queue.cc:237] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.651405 16616 raft_consensus.cc:2468] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8e5a7f8907034a1eb43bd7761c003277 in term 2.
I20260709 12:28:43.654574 16439 catalog_manager.cc:5697] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 reported cstate change: term changed from 1 to 2, leader changed from 09f6aced80b34b0eacfb18ddc05b62a7 (127.4.181.66) to 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65). New cstate: current_term: 2 leader_uuid: "8e5a7f8907034a1eb43bd7761c003277" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:43.750955 16616 raft_consensus.cc:1275] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 FOLLOWER]: Refusing update from remote peer 8e5a7f8907034a1eb43bd7761c003277: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:43.752538 16738 consensus_queue.cc:1048] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:43.764659 16690 raft_consensus.cc:1275] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Refusing update from remote peer 8e5a7f8907034a1eb43bd7761c003277: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:43.766161 16738 consensus_queue.cc:1048] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:43.781849  4821 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table1
I20260709 12:28:43.783934  4821 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table1, leader rebalance finish, leader transfer count: 0
I20260709 12:28:43.784412  4821 auto_leader_rebalancer.cc:141] leader rebalance for table multi_table_leader_balance_table2
I20260709 12:28:43.795593 16540 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "71fe9ac77aca42bdb69b93f7f69b64fd"
dest_uuid: "8e5a7f8907034a1eb43bd7761c003277"
mode: GRACEFUL
new_leader_uuid: "94961ebabff5434597afdc7ff7e4e669"
 from {username='slave'} at 127.0.0.1:51488
I20260709 12:28:43.796111 16540 raft_consensus.cc:606] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 2 LEADER]: Received request to transfer leadership to TS 94961ebabff5434597afdc7ff7e4e669
I20260709 12:28:43.797214  4821 auto_leader_rebalancer.cc:440] table: multi_table_leader_balance_table2, leader rebalance finish, leader transfer count: 1
I20260709 12:28:43.811517 16690 raft_consensus.cc:1275] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Refusing update from remote peer 09f6aced80b34b0eacfb18ddc05b62a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:43.812824 16769 consensus_queue.cc:1048] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:43.821069 16540 raft_consensus.cc:1275] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277 [term 2 FOLLOWER]: Refusing update from remote peer 09f6aced80b34b0eacfb18ddc05b62a7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:43.822880 16747 consensus_queue.cc:1048] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:43.925307 16690 raft_consensus.cc:1275] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Refusing update from remote peer 8e5a7f8907034a1eb43bd7761c003277: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:43.926664 16738 consensus_queue.cc:1048] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:43.932628 16774 raft_consensus.cc:993] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277: : Instructing follower 94961ebabff5434597afdc7ff7e4e669 to start an election
I20260709 12:28:43.933202 16774 raft_consensus.cc:1081] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 2 LEADER]: Signalling peer 94961ebabff5434597afdc7ff7e4e669 to start an election
I20260709 12:28:43.936095 16689 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "71fe9ac77aca42bdb69b93f7f69b64fd"
dest_uuid: "94961ebabff5434597afdc7ff7e4e669"
 from {username='slave'} at 127.0.0.1:55756
I20260709 12:28:43.936722 16689 raft_consensus.cc:493] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:43.937131 16689 raft_consensus.cc:3060] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:43.937371 16616 raft_consensus.cc:1275] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 FOLLOWER]: Refusing update from remote peer 8e5a7f8907034a1eb43bd7761c003277: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:43.940034 16738 consensus_queue.cc:1048] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [LEADER]: Connected to new peer: Peer: permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:43.944773 16689 raft_consensus.cc:515] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.947810 16689 leader_election.cc:290] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [CANDIDATE]: Term 3 election: Requested vote from peers 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65:44383), 09f6aced80b34b0eacfb18ddc05b62a7 (127.4.181.66:38989)
I20260709 12:28:43.948516 16540 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fe9ac77aca42bdb69b93f7f69b64fd" candidate_uuid: "94961ebabff5434597afdc7ff7e4e669" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "8e5a7f8907034a1eb43bd7761c003277"
I20260709 12:28:43.949186 16540 raft_consensus.cc:3055] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:43.949509 16540 raft_consensus.cc:740] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 8e5a7f8907034a1eb43bd7761c003277, State: Running, Role: LEADER
I20260709 12:28:43.949748 16616 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "71fe9ac77aca42bdb69b93f7f69b64fd" candidate_uuid: "94961ebabff5434597afdc7ff7e4e669" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "09f6aced80b34b0eacfb18ddc05b62a7"
I20260709 12:28:43.950371 16616 raft_consensus.cc:3060] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:43.950296 16540 consensus_queue.cc:260] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.954113 16540 raft_consensus.cc:3060] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:43.957517 16616 raft_consensus.cc:2468] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94961ebabff5434597afdc7ff7e4e669 in term 3.
I20260709 12:28:43.958856 16655 leader_election.cc:304] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 09f6aced80b34b0eacfb18ddc05b62a7, 94961ebabff5434597afdc7ff7e4e669; no voters: 
I20260709 12:28:43.959683 16736 raft_consensus.cc:2804] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:43.960105 16540 raft_consensus.cc:2468] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 94961ebabff5434597afdc7ff7e4e669 in term 3.
I20260709 12:28:43.960601 16736 raft_consensus.cc:697] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 3 LEADER]: Becoming Leader. State: Replica: 94961ebabff5434597afdc7ff7e4e669, State: Running, Role: LEADER
I20260709 12:28:43.961541 16736 consensus_queue.cc:237] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } }
I20260709 12:28:43.968191 16438 catalog_manager.cc:5697] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 reported cstate change: term changed from 2 to 3, leader changed from 8e5a7f8907034a1eb43bd7761c003277 (127.4.181.65) to 94961ebabff5434597afdc7ff7e4e669 (127.4.181.67). New cstate: current_term: 3 leader_uuid: "94961ebabff5434597afdc7ff7e4e669" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "8e5a7f8907034a1eb43bd7761c003277" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 44383 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "09f6aced80b34b0eacfb18ddc05b62a7" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 38989 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "94961ebabff5434597afdc7ff7e4e669" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 37605 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:44.021056  4821 tablet_server.cc:179] TabletServer@127.4.181.65:0 shutting down...
I20260709 12:28:44.038713  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:44.039379  4821 tablet_replica.cc:333] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277: stopping tablet replica
I20260709 12:28:44.039930  4821 raft_consensus.cc:2243] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:44.040377  4821 raft_consensus.cc:2272] T 71fe9ac77aca42bdb69b93f7f69b64fd P 8e5a7f8907034a1eb43bd7761c003277 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:44.042802  4821 tablet_replica.cc:333] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277: stopping tablet replica
I20260709 12:28:44.043354  4821 raft_consensus.cc:2243] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:44.043848  4821 raft_consensus.cc:2272] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 8e5a7f8907034a1eb43bd7761c003277 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:44.046783  4821 tablet_replica.cc:333] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277: stopping tablet replica
I20260709 12:28:44.047531  4821 raft_consensus.cc:2243] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:44.048367  4821 pending_rounds.cc:70] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277: Trying to abort 2 pending ops.
I20260709 12:28:44.048641  4821 pending_rounds.cc:77] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277: Aborting op as it isn't in flight: id { term: 2 index: 2 } timestamp: 7305626106469494784 op_type: NO_OP noop_request { }
I20260709 12:28:44.049309  4821 raft_consensus.cc:2889] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:28:44.049614  4821 pending_rounds.cc:77] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277: Aborting op as it isn't in flight: id { term: 1 index: 1 } timestamp: 7305626104662781952 op_type: NO_OP noop_request { }
I20260709 12:28:44.049947  4821 raft_consensus.cc:2889] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 2 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:28:44.050292  4821 raft_consensus.cc:2272] T 9187a01afa454732985a2946ff27ce2f P 8e5a7f8907034a1eb43bd7761c003277 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:44.052907  4821 tablet_replica.cc:333] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277: stopping tablet replica
I20260709 12:28:44.053442  4821 raft_consensus.cc:2243] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:44.054232  4821 raft_consensus.cc:2272] T fc384bccfd8641668532782714825b5c P 8e5a7f8907034a1eb43bd7761c003277 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:44.077497  4821 tablet_server.cc:196] TabletServer@127.4.181.65:0 shutdown complete.
I20260709 12:28:44.090732  4821 tablet_server.cc:179] TabletServer@127.4.181.66:0 shutting down...
I20260709 12:28:44.112804  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:44.113641  4821 tablet_replica.cc:333] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7: stopping tablet replica
I20260709 12:28:44.114379  4821 raft_consensus.cc:2243] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:44.115057  4821 raft_consensus.cc:2272] T 9187a01afa454732985a2946ff27ce2f P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:44.117288  4821 tablet_replica.cc:333] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7: stopping tablet replica
I20260709 12:28:44.117887  4821 raft_consensus.cc:2243] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:44.118340  4821 raft_consensus.cc:2272] T fc384bccfd8641668532782714825b5c P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:44.120564  4821 tablet_replica.cc:333] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7: stopping tablet replica
I20260709 12:28:44.121109  4821 raft_consensus.cc:2243] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:44.121554  4821 raft_consensus.cc:2272] T 71fe9ac77aca42bdb69b93f7f69b64fd P 09f6aced80b34b0eacfb18ddc05b62a7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:44.123929  4821 tablet_replica.cc:333] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7: stopping tablet replica
I20260709 12:28:44.124445  4821 raft_consensus.cc:2243] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:28:44.125275  4821 raft_consensus.cc:2272] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 09f6aced80b34b0eacfb18ddc05b62a7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:44.149639  4821 tablet_server.cc:196] TabletServer@127.4.181.66:0 shutdown complete.
I20260709 12:28:44.164268  4821 tablet_server.cc:179] TabletServer@127.4.181.67:0 shutting down...
I20260709 12:28:44.183069  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:28:44.183751  4821 tablet_replica.cc:333] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669: stopping tablet replica
I20260709 12:28:44.184322  4821 raft_consensus.cc:2243] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:28:44.185127  4821 pending_rounds.cc:70] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669: Trying to abort 1 pending ops.
I20260709 12:28:44.185356  4821 pending_rounds.cc:77] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669: Aborting op as it isn't in flight: id { term: 3 index: 3 } timestamp: 7305626107754725376 op_type: NO_OP noop_request { }
I20260709 12:28:44.185621  4821 raft_consensus.cc:2889] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 3 LEADER]: NO_OP replication failed: Aborted: Op aborted
I20260709 12:28:44.185906  4821 raft_consensus.cc:2272] T 71fe9ac77aca42bdb69b93f7f69b64fd P 94961ebabff5434597afdc7ff7e4e669 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:44.188380  4821 tablet_replica.cc:333] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669: stopping tablet replica
I20260709 12:28:44.188973  4821 raft_consensus.cc:2243] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:44.189429  4821 raft_consensus.cc:2272] T e8ad3ee92c6740ffa8f0fc023ce7ef67 P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:44.191834  4821 tablet_replica.cc:333] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669: stopping tablet replica
I20260709 12:28:44.192477  4821 raft_consensus.cc:2243] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:44.193159  4821 raft_consensus.cc:2272] T 9187a01afa454732985a2946ff27ce2f P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:44.195807  4821 tablet_replica.cc:333] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669: stopping tablet replica
I20260709 12:28:44.196323  4821 raft_consensus.cc:2243] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:28:44.196753  4821 raft_consensus.cc:2272] T fc384bccfd8641668532782714825b5c P 94961ebabff5434597afdc7ff7e4e669 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:44.220903  4821 tablet_server.cc:196] TabletServer@127.4.181.67:0 shutdown complete.
I20260709 12:28:44.234908  4821 master.cc:562] Master@127.4.181.126:34993 shutting down...
I20260709 12:28:44.253708  4821 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:28:44.254390  4821 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:28:44.254906  4821 tablet_replica.cc:333] T 00000000000000000000000000000000 P 8bedcaf6fe274f4fb202d0e84361dffc: stopping tablet replica
I20260709 12:28:44.274413  4821 master.cc:584] Master@127.4.181.126:34993 shutdown complete.
[       OK ] LeaderRebalancerTest.MultiTableLeaderBalance (2541 ms)
[----------] 6 tests from LeaderRebalancerTest (365865 ms total)

[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20260709 12:28:44.306520  4821 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.181.126:40685
I20260709 12:28:44.307667  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:44.313447 16783 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:44.313732 16784 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:44.314347 16786 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:44.315505  4821 server_base.cc:1061] running on GCE node
I20260709 12:28:44.316334  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:44.316519  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:44.316685  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600124316666 us; error 0 us; skew 500 ppm
I20260709 12:28:44.317190  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:44.319739  4821 webserver.cc:533] Webserver started at http://127.4.181.126:41231/ using document root <none> and password file <none>
I20260709 12:28:44.320186  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:44.320348  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:44.320611  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:44.321655  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/master-0-root/instance:
uuid: "68c20caf3a384edd987625527b5c9e08"
format_stamp: "Formatted at 2026-07-09 12:28:44 on dist-test-slave-k014"
I20260709 12:28:44.326153  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:28:44.329598 16791 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:44.330313  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:28:44.330628  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/master-0-root
uuid: "68c20caf3a384edd987625527b5c9e08"
format_stamp: "Formatted at 2026-07-09 12:28:44 on dist-test-slave-k014"
I20260709 12:28:44.330929  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:44.360096  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:44.361171  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:44.398814  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.126:40685
I20260709 12:28:44.398962 16842 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.126:40685 every 8 connection(s)
I20260709 12:28:44.402577 16843 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.414613 16843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08: Bootstrap starting.
I20260709 12:28:44.419134 16843 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:44.423169 16843 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08: No bootstrap required, opened a new log
I20260709 12:28:44.425235 16843 raft_consensus.cc:359] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68c20caf3a384edd987625527b5c9e08" member_type: VOTER }
I20260709 12:28:44.425618 16843 raft_consensus.cc:385] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:44.425794 16843 raft_consensus.cc:740] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 68c20caf3a384edd987625527b5c9e08, State: Initialized, Role: FOLLOWER
I20260709 12:28:44.426333 16843 consensus_queue.cc:260] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68c20caf3a384edd987625527b5c9e08" member_type: VOTER }
I20260709 12:28:44.426815 16843 raft_consensus.cc:399] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:28:44.427017 16843 raft_consensus.cc:493] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:28:44.427225 16843 raft_consensus.cc:3060] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:44.432034 16843 raft_consensus.cc:515] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68c20caf3a384edd987625527b5c9e08" member_type: VOTER }
I20260709 12:28:44.432627 16843 leader_election.cc:304] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 68c20caf3a384edd987625527b5c9e08; no voters: 
I20260709 12:28:44.433772 16843 leader_election.cc:290] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:28:44.434118 16846 raft_consensus.cc:2804] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:44.435648 16846 raft_consensus.cc:697] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [term 1 LEADER]: Becoming Leader. State: Replica: 68c20caf3a384edd987625527b5c9e08, State: Running, Role: LEADER
I20260709 12:28:44.436389 16846 consensus_queue.cc:237] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68c20caf3a384edd987625527b5c9e08" member_type: VOTER }
I20260709 12:28:44.436969 16843 sys_catalog.cc:565] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:28:44.439100 16847 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "68c20caf3a384edd987625527b5c9e08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68c20caf3a384edd987625527b5c9e08" member_type: VOTER } }
I20260709 12:28:44.439198 16848 sys_catalog.cc:455] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 68c20caf3a384edd987625527b5c9e08. Latest consensus state: current_term: 1 leader_uuid: "68c20caf3a384edd987625527b5c9e08" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "68c20caf3a384edd987625527b5c9e08" member_type: VOTER } }
I20260709 12:28:44.439818 16847 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:44.439885 16848 sys_catalog.cc:458] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [sys.catalog]: This master's current role is: LEADER
I20260709 12:28:44.445384 16851 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:28:44.449946 16851 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:28:44.451797  4821 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:28:44.458148 16851 catalog_manager.cc:1383] Generated new cluster ID: cdb0c12674ba4de6a43f425d95c7819c
I20260709 12:28:44.458485 16851 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:28:44.481251 16851 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:28:44.482671 16851 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:28:44.505198 16851 catalog_manager.cc:6070] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08: Generated new TSK 0
I20260709 12:28:44.505898 16851 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:28:44.518698  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:44.526680 16864 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:44.528647 16865 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:44.529155 16867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:44.535811  4821 server_base.cc:1061] running on GCE node
I20260709 12:28:44.536972  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:44.537238  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:44.537428  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600124537410 us; error 0 us; skew 500 ppm
I20260709 12:28:44.538137  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:44.540923  4821 webserver.cc:533] Webserver started at http://127.4.181.65:39055/ using document root <none> and password file <none>
I20260709 12:28:44.541380  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:44.541550  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:44.541810  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:44.543146  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-0-root/instance:
uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
format_stamp: "Formatted at 2026-07-09 12:28:44 on dist-test-slave-k014"
I20260709 12:28:44.547763  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.005s	sys 0.000s
I20260709 12:28:44.550881 16872 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:44.551534  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.001s
I20260709 12:28:44.551820  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-0-root
uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
format_stamp: "Formatted at 2026-07-09 12:28:44 on dist-test-slave-k014"
I20260709 12:28:44.552073  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:44.569801  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:44.571121  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:44.572656  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:44.575556  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:44.575788  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:44.576023  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:44.576170  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:44.614218  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.65:45885
I20260709 12:28:44.614362 16934 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.65:45885 every 8 connection(s)
I20260709 12:28:44.618856  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:44.625944 16939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:44.627562 16940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:44.628566  4821 server_base.cc:1061] running on GCE node
W20260709 12:28:44.630167 16942 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:44.631318  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:44.631587  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:44.631785  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600124631766 us; error 0 us; skew 500 ppm
I20260709 12:28:44.632396  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:44.632488 16935 heartbeater.cc:344] Connected to a master server at 127.4.181.126:40685
I20260709 12:28:44.632948 16935 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:44.633839 16935 heartbeater.cc:507] Master 127.4.181.126:40685 requested a full tablet report, sending...
I20260709 12:28:44.634917  4821 webserver.cc:533] Webserver started at http://127.4.181.66:41955/ using document root <none> and password file <none>
I20260709 12:28:44.635504  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:44.635689  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:44.635962  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:44.636042 16808 ts_manager.cc:194] Registered new tserver with Master: 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885)
I20260709 12:28:44.637006  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-1-root/instance:
uuid: "51de95355c524c4cb143cf88d4c0a1e9"
format_stamp: "Formatted at 2026-07-09 12:28:44 on dist-test-slave-k014"
I20260709 12:28:44.637890 16808 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56366
I20260709 12:28:44.641585  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.003s
I20260709 12:28:44.645154 16947 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:44.646034  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.002s	sys 0.000s
I20260709 12:28:44.646347  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-1-root
uuid: "51de95355c524c4cb143cf88d4c0a1e9"
format_stamp: "Formatted at 2026-07-09 12:28:44 on dist-test-slave-k014"
I20260709 12:28:44.646663  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:44.664815  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:44.665936  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:44.667451  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:44.669778  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:44.670003  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:44.670226  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:44.670385  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:44.707876  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.66:42693
I20260709 12:28:44.707973 17009 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.66:42693 every 8 connection(s)
I20260709 12:28:44.712644  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:28:44.719364 17013 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:44.720649 17014 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:28:44.722084 17016 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:28:44.722513  4821 server_base.cc:1061] running on GCE node
I20260709 12:28:44.723681  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:28:44.723888  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:28:44.724092  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600124724071 us; error 0 us; skew 500 ppm
I20260709 12:28:44.724279 17010 heartbeater.cc:344] Connected to a master server at 127.4.181.126:40685
I20260709 12:28:44.724684 17010 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:44.724680  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:28:44.725541 17010 heartbeater.cc:507] Master 127.4.181.126:40685 requested a full tablet report, sending...
I20260709 12:28:44.727283  4821 webserver.cc:533] Webserver started at http://127.4.181.67:36425/ using document root <none> and password file <none>
I20260709 12:28:44.727829  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:28:44.728027  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:28:44.727846 16808 ts_manager.cc:194] Registered new tserver with Master: 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:44.728349  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:28:44.729385 16808 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56374
I20260709 12:28:44.729416  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-2-root/instance:
uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
format_stamp: "Formatted at 2026-07-09 12:28:44 on dist-test-slave-k014"
I20260709 12:28:44.734040  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.004s	sys 0.000s
I20260709 12:28:44.737418 17021 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:44.738279  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:28:44.738588  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-2-root
uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
format_stamp: "Formatted at 2026-07-09 12:28:44 on dist-test-slave-k014"
I20260709 12:28:44.738911  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1783599758264527-4821-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:28:44.755213  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:28:44.756327  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:28:44.757769  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:28:44.760154  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:28:44.760346  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:44.760587  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:28:44.760735  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:28:44.802739  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.67:40303
I20260709 12:28:44.802875 17083 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.67:40303 every 8 connection(s)
I20260709 12:28:44.816273 17084 heartbeater.cc:344] Connected to a master server at 127.4.181.126:40685
I20260709 12:28:44.816718 17084 heartbeater.cc:461] Registering TS with master...
I20260709 12:28:44.817452 17084 heartbeater.cc:507] Master 127.4.181.126:40685 requested a full tablet report, sending...
I20260709 12:28:44.819380 16808 ts_manager.cc:194] Registered new tserver with Master: 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:44.819576  4821 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013695623s
I20260709 12:28:44.821205 16808 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56388
I20260709 12:28:44.844835 16808 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56404:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:44.847478 16808 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:44.934338 16975 tablet_service.cc:1511] Processing CreateTablet for tablet bba2a79583a5466d80d19d9e8e441f52 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:44.934868 16974 tablet_service.cc:1511] Processing CreateTablet for tablet f1a8dbf7787b45f18f0264ee1c131caf (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:44.935786 16975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba2a79583a5466d80d19d9e8e441f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.935436 16973 tablet_service.cc:1511] Processing CreateTablet for tablet b68c285dc783415d93ea00e7b29bff20 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:44.936480 16974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a8dbf7787b45f18f0264ee1c131caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.937109 16973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b68c285dc783415d93ea00e7b29bff20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.938256 16972 tablet_service.cc:1511] Processing CreateTablet for tablet 945852bfb9e94583920a5357b105f7c0 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:44.939680 16972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945852bfb9e94583920a5357b105f7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.949796 17048 tablet_service.cc:1511] Processing CreateTablet for tablet f1a8dbf7787b45f18f0264ee1c131caf (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:44.951344 17048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a8dbf7787b45f18f0264ee1c131caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.952761 17049 tablet_service.cc:1511] Processing CreateTablet for tablet bba2a79583a5466d80d19d9e8e441f52 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:44.954107 17049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba2a79583a5466d80d19d9e8e441f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.955236 16971 tablet_service.cc:1511] Processing CreateTablet for tablet 92485db6a3c743b2a35e05e166bbd561 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:44.956588 16971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92485db6a3c743b2a35e05e166bbd561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.960286 16970 tablet_service.cc:1511] Processing CreateTablet for tablet 03efb0a48115462f8a67785131ecec20 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:44.960471 17046 tablet_service.cc:1511] Processing CreateTablet for tablet 945852bfb9e94583920a5357b105f7c0 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:44.961725 16970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03efb0a48115462f8a67785131ecec20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.961823 17046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945852bfb9e94583920a5357b105f7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.963532 17045 tablet_service.cc:1511] Processing CreateTablet for tablet 92485db6a3c743b2a35e05e166bbd561 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:44.964927 17045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92485db6a3c743b2a35e05e166bbd561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.967553 16900 tablet_service.cc:1511] Processing CreateTablet for tablet bba2a79583a5466d80d19d9e8e441f52 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:44.968909 16900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba2a79583a5466d80d19d9e8e441f52. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.970831 16899 tablet_service.cc:1511] Processing CreateTablet for tablet f1a8dbf7787b45f18f0264ee1c131caf (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:44.972332 16899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1a8dbf7787b45f18f0264ee1c131caf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.975613 16898 tablet_service.cc:1511] Processing CreateTablet for tablet b68c285dc783415d93ea00e7b29bff20 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:44.977058 16898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b68c285dc783415d93ea00e7b29bff20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.979596 16897 tablet_service.cc:1511] Processing CreateTablet for tablet 945852bfb9e94583920a5357b105f7c0 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:44.980960 16897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 945852bfb9e94583920a5357b105f7c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.984159 16895 tablet_service.cc:1511] Processing CreateTablet for tablet 03efb0a48115462f8a67785131ecec20 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:44.985698 16895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03efb0a48115462f8a67785131ecec20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.987296 16896 tablet_service.cc:1511] Processing CreateTablet for tablet 92485db6a3c743b2a35e05e166bbd561 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:44.988823 16896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92485db6a3c743b2a35e05e166bbd561. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.989068 17044 tablet_service.cc:1511] Processing CreateTablet for tablet 03efb0a48115462f8a67785131ecec20 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:44.950942 17047 tablet_service.cc:1511] Processing CreateTablet for tablet b68c285dc783415d93ea00e7b29bff20 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:44.990774 17044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 03efb0a48115462f8a67785131ecec20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:44.994899 17047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b68c285dc783415d93ea00e7b29bff20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:45.024482 16894 tablet_service.cc:1511] Processing CreateTablet for tablet 3d7cec59cb20410dbd32311463982c38 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:45.026021 16894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d7cec59cb20410dbd32311463982c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:45.025784 17043 tablet_service.cc:1511] Processing CreateTablet for tablet 3d7cec59cb20410dbd32311463982c38 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:45.033245 16892 tablet_service.cc:1511] Processing CreateTablet for tablet b06bd37a9a6142e2a320bb82b7340abe (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:45.027751 16969 tablet_service.cc:1511] Processing CreateTablet for tablet b06bd37a9a6142e2a320bb82b7340abe (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:45.034060 17043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d7cec59cb20410dbd32311463982c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:45.034782 16892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b06bd37a9a6142e2a320bb82b7340abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:45.027530 16975 tablet_service.cc:1511] Processing CreateTablet for tablet e272da12bca745c8b3a6d6d60533f926 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:45.035672 16969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b06bd37a9a6142e2a320bb82b7340abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:45.028676 17042 tablet_service.cc:1511] Processing CreateTablet for tablet e272da12bca745c8b3a6d6d60533f926 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:45.031996 16893 tablet_service.cc:1511] Processing CreateTablet for tablet e272da12bca745c8b3a6d6d60533f926 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:45.029871 17041 tablet_service.cc:1511] Processing CreateTablet for tablet b06bd37a9a6142e2a320bb82b7340abe (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:45.037950 16893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e272da12bca745c8b3a6d6d60533f926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:45.038271 16975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e272da12bca745c8b3a6d6d60533f926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:45.024595 16973 tablet_service.cc:1511] Processing CreateTablet for tablet 3d7cec59cb20410dbd32311463982c38 (DEFAULT_TABLE table=test-workload [id=09b58d85975b4e32a9bc77437ad61f82]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:45.040963 16973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3d7cec59cb20410dbd32311463982c38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:45.046886 17041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b06bd37a9a6142e2a320bb82b7340abe. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:45.054751 17042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e272da12bca745c8b3a6d6d60533f926. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:45.114037 17100 tablet_bootstrap.cc:492] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:45.120056 17099 tablet_bootstrap.cc:492] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:45.122291 17100 tablet_bootstrap.cc:654] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.145977 17098 tablet_bootstrap.cc:492] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:45.162868 17099 tablet_bootstrap.cc:654] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.154265 17098 tablet_bootstrap.cc:654] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.172812 17100 tablet_bootstrap.cc:492] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:45.173346 17100 ts_tablet_manager.cc:1403] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.060s	user 0.021s	sys 0.026s
I20260709 12:28:45.176316 17100 raft_consensus.cc:359] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.177112 17100 raft_consensus.cc:385] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.177481 17100 raft_consensus.cc:740] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.180835 17098 tablet_bootstrap.cc:492] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:45.181406 17098 ts_tablet_manager.cc:1403] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.036s	user 0.009s	sys 0.003s
I20260709 12:28:45.178807 17100 consensus_queue.cc:260] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.181407 17099 tablet_bootstrap.cc:492] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:45.182977 17099 ts_tablet_manager.cc:1403] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.063s	user 0.004s	sys 0.014s
I20260709 12:28:45.183614 16935 heartbeater.cc:499] Master 127.4.181.126:40685 was elected leader, sending a full tablet report...
I20260709 12:28:45.184497 17098 raft_consensus.cc:359] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.185289 17098 raft_consensus.cc:385] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.185596 17098 raft_consensus.cc:740] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.185798 17099 raft_consensus.cc:359] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:45.186632 17099 raft_consensus.cc:385] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.186414 17098 consensus_queue.cc:260] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.186944 17099 raft_consensus.cc:740] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.188278 17100 ts_tablet_manager.cc:1434] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:28:45.187753 17099 consensus_queue.cc:260] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:45.189510 17100 tablet_bootstrap.cc:492] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:45.197780 17100 tablet_bootstrap.cc:654] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.215507 17084 heartbeater.cc:499] Master 127.4.181.126:40685 was elected leader, sending a full tablet report...
I20260709 12:28:45.216210 17099 ts_tablet_manager.cc:1434] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.033s	user 0.020s	sys 0.012s
I20260709 12:28:45.216876 17098 ts_tablet_manager.cc:1434] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.035s	user 0.018s	sys 0.015s
I20260709 12:28:45.217446 17099 tablet_bootstrap.cc:492] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:45.217500 17010 heartbeater.cc:499] Master 127.4.181.126:40685 was elected leader, sending a full tablet report...
I20260709 12:28:45.217953 17098 tablet_bootstrap.cc:492] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:45.219128 17104 raft_consensus.cc:493] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.219637 17104 raft_consensus.cc:515] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.224014 17100 tablet_bootstrap.cc:492] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:45.224906 17100 ts_tablet_manager.cc:1403] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.036s	user 0.017s	sys 0.009s
I20260709 12:28:45.224953 17098 tablet_bootstrap.cc:654] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.225586 17104 leader_election.cc:290] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:45.226415 17099 tablet_bootstrap.cc:654] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.228350 17100 raft_consensus.cc:359] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.229174 17100 raft_consensus.cc:385] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.229526 17100 raft_consensus.cc:740] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.230298 17100 consensus_queue.cc:260] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.232439 17100 ts_tablet_manager.cc:1434] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:45.233675 17100 tablet_bootstrap.cc:492] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:45.235282 17099 tablet_bootstrap.cc:492] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:45.235967 17099 ts_tablet_manager.cc:1403] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.019s	user 0.011s	sys 0.003s
I20260709 12:28:45.239701 17099 raft_consensus.cc:359] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.240304 17099 raft_consensus.cc:385] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.240429 17100 tablet_bootstrap.cc:654] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.240541 17099 raft_consensus.cc:740] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.242218 17099 consensus_queue.cc:260] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.243086 17098 tablet_bootstrap.cc:492] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:45.243697 17098 ts_tablet_manager.cc:1403] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 12:28:45.244692 17099 ts_tablet_manager.cc:1434] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:45.245703 17099 tablet_bootstrap.cc:492] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:45.246742 17098 raft_consensus.cc:359] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:45.247551 17098 raft_consensus.cc:385] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.247900 17098 raft_consensus.cc:740] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.248859 17098 consensus_queue.cc:260] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:45.251317 17098 ts_tablet_manager.cc:1434] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:45.252296 17099 tablet_bootstrap.cc:654] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.252337 17098 tablet_bootstrap.cc:492] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:45.259516 17098 tablet_bootstrap.cc:654] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.262825 17100 tablet_bootstrap.cc:492] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:45.263480 17100 ts_tablet_manager.cc:1403] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.030s	user 0.017s	sys 0.011s
I20260709 12:28:45.265169 17105 raft_consensus.cc:493] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.265836 17105 raft_consensus.cc:515] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:45.266314 17100 raft_consensus.cc:359] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.267251 17100 raft_consensus.cc:385] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.267560 17100 raft_consensus.cc:740] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.268602 17105 leader_election.cc:290] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303), 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885)
I20260709 12:28:45.268783 17099 tablet_bootstrap.cc:492] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:45.268450 17100 consensus_queue.cc:260] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.269418 17099 ts_tablet_manager.cc:1403] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.024s	user 0.013s	sys 0.005s
I20260709 12:28:45.270773 17100 ts_tablet_manager.cc:1434] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:28:45.272024 17100 tablet_bootstrap.cc:492] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:45.272428 17099 raft_consensus.cc:359] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.273272 17099 raft_consensus.cc:385] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.273577 17099 raft_consensus.cc:740] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.274590 17099 consensus_queue.cc:260] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.277171 17099 ts_tablet_manager.cc:1434] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:45.278311 17099 tablet_bootstrap.cc:492] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:45.278770 17100 tablet_bootstrap.cc:654] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.285395 17099 tablet_bootstrap.cc:654] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.288460 17098 tablet_bootstrap.cc:492] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:45.289070 17098 ts_tablet_manager.cc:1403] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.005s
I20260709 12:28:45.294910 17098 raft_consensus.cc:359] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.295644 17098 raft_consensus.cc:385] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.295951 17098 raft_consensus.cc:740] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.300732 17099 tablet_bootstrap.cc:492] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:45.301380 17099 ts_tablet_manager.cc:1403] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.023s	user 0.008s	sys 0.008s
I20260709 12:28:45.304622 17099 raft_consensus.cc:359] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.305629 17099 raft_consensus.cc:385] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.305961 17099 raft_consensus.cc:740] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.307771 17099 consensus_queue.cc:260] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.309877 17100 tablet_bootstrap.cc:492] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:45.310400 17099 ts_tablet_manager.cc:1434] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:28:45.310519 17100 ts_tablet_manager.cc:1403] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.039s	user 0.012s	sys 0.010s
I20260709 12:28:45.313944 17100 raft_consensus.cc:359] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.314839 17100 raft_consensus.cc:385] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.315541 17100 raft_consensus.cc:740] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.317047 17100 consensus_queue.cc:260] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.318900 17099 tablet_bootstrap.cc:492] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:45.319708 17100 ts_tablet_manager.cc:1434] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.002s
I20260709 12:28:45.320942 17100 tablet_bootstrap.cc:492] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:45.297988 17098 consensus_queue.cc:260] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.326098 17098 ts_tablet_manager.cc:1434] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.035s	user 0.005s	sys 0.000s
I20260709 12:28:45.327170 17098 tablet_bootstrap.cc:492] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:45.331195 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e272da12bca745c8b3a6d6d60533f926" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:45.333197 17100 tablet_bootstrap.cc:654] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.333726 17099 tablet_bootstrap.cc:654] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.336738 17098 tablet_bootstrap.cc:654] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.339938 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2a79583a5466d80d19d9e8e441f52" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:45.340790 17059 raft_consensus.cc:2468] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 0.
I20260709 12:28:45.341153 17100 tablet_bootstrap.cc:492] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:45.341712 17100 ts_tablet_manager.cc:1403] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.021s	user 0.012s	sys 0.002s
I20260709 12:28:45.342303 17098 tablet_bootstrap.cc:492] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:45.342890 17098 ts_tablet_manager.cc:1403] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.016s	user 0.011s	sys 0.000s
I20260709 12:28:45.344118 17100 raft_consensus.cc:359] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.344907 17100 raft_consensus.cc:385] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.345207 17100 raft_consensus.cc:740] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.345435 16951 leader_election.cc:304] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
W20260709 12:28:45.333313 16876 leader_election.cc:343] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.346020 17100 consensus_queue.cc:260] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.346359 17098 raft_consensus.cc:359] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.348552 17098 raft_consensus.cc:385] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.348796 17105 raft_consensus.cc:2804] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.349222 17105 raft_consensus.cc:493] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.349433 17100 ts_tablet_manager.cc:1434] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.001s
I20260709 12:28:45.350451 17100 tablet_bootstrap.cc:492] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:45.349546 17105 raft_consensus.cc:3060] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.356745 17100 tablet_bootstrap.cc:654] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.358875 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2a79583a5466d80d19d9e8e441f52" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:45.359258 17105 raft_consensus.cc:515] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:45.361893 17105 leader_election.cc:290] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Requested vote from peers 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303), 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885)
I20260709 12:28:45.348857 17098 raft_consensus.cc:740] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.364529 17099 tablet_bootstrap.cc:492] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:45.364296 17098 consensus_queue.cc:260] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.365103 17099 ts_tablet_manager.cc:1403] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.046s	user 0.008s	sys 0.003s
I20260709 12:28:45.366779 17098 ts_tablet_manager.cc:1434] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.024s	user 0.007s	sys 0.001s
I20260709 12:28:45.368045 17098 tablet_bootstrap.cc:492] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:45.372381 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2a79583a5466d80d19d9e8e441f52" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:45.373004 17059 raft_consensus.cc:3060] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.373167 17099 raft_consensus.cc:359] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.374058 17099 raft_consensus.cc:385] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.374429 17099 raft_consensus.cc:740] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.374945 17105 raft_consensus.cc:493] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.375566 17105 raft_consensus.cc:515] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
W20260709 12:28:45.379832 16951 leader_election.cc:343] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.380311 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2a79583a5466d80d19d9e8e441f52" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:45.381031 17105 leader_election.cc:290] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
W20260709 12:28:45.381806 16951 leader_election.cc:343] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.382086 17104 raft_consensus.cc:493] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.375329 17099 consensus_queue.cc:260] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.382613 17104 raft_consensus.cc:515] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.384619 17099 ts_tablet_manager.cc:1434] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:28:45.384764 17058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68c285dc783415d93ea00e7b29bff20" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:45.376020 17098 tablet_bootstrap.cc:654] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.392946 17056 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8dbf7787b45f18f0264ee1c131caf" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:45.389031 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8dbf7787b45f18f0264ee1c131caf" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:45.395402 17099 tablet_bootstrap.cc:492] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:45.396371 16985 raft_consensus.cc:2468] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 0.
I20260709 12:28:45.395761 17056 raft_consensus.cc:2468] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 0.
I20260709 12:28:45.398818 16876 leader_election.cc:304] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:45.392350 17057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e272da12bca745c8b3a6d6d60533f926" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:45.400955 17058 raft_consensus.cc:2468] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 0.
I20260709 12:28:45.402344 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68c285dc783415d93ea00e7b29bff20" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:45.403082 16910 raft_consensus.cc:2468] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 0.
I20260709 12:28:45.405128 17099 tablet_bootstrap.cc:654] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.387029 17104 leader_election.cc:290] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:45.406498 16951 leader_election.cc:304] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 
I20260709 12:28:45.406769 17104 raft_consensus.cc:2804] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.407852 17104 raft_consensus.cc:493] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.407465 17124 raft_consensus.cc:2804] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.408305 17124 raft_consensus.cc:493] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.408672 17124 raft_consensus.cc:3060] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.412156 17059 raft_consensus.cc:2468] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 1.
I20260709 12:28:45.413398 16951 leader_election.cc:304] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 0d1d35a1ebcf415c9e3e8af85b90a24c
I20260709 12:28:45.414206 17105 raft_consensus.cc:2804] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.414438 17100 tablet_bootstrap.cc:492] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:45.414706 17104 raft_consensus.cc:3060] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.415270 17100 ts_tablet_manager.cc:1403] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.065s	user 0.042s	sys 0.012s
I20260709 12:28:45.418843 17100 raft_consensus.cc:359] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:45.419706 17100 raft_consensus.cc:385] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.420017 17100 raft_consensus.cc:740] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.420866 17100 consensus_queue.cc:260] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:45.423398 17100 ts_tablet_manager.cc:1434] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.008s	user 0.004s	sys 0.003s
I20260709 12:28:45.424695 17100 tablet_bootstrap.cc:492] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:45.425825 17124 raft_consensus.cc:515] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.436465 17124 leader_election.cc:290] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:45.431687 17100 tablet_bootstrap.cc:654] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.438289 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68c285dc783415d93ea00e7b29bff20" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:45.439087 16910 raft_consensus.cc:3060] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.433581 17104 raft_consensus.cc:515] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.441701 17104 leader_election.cc:290] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 election: Requested vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
W20260709 12:28:45.442251 16876 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.67:40303, user_credentials={real_user=slave}} blocked reactor thread for 43526.7us
W20260709 12:28:45.449456 16856 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:45.452073 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8dbf7787b45f18f0264ee1c131caf" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:45.452780 16985 raft_consensus.cc:3060] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.453909 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68c285dc783415d93ea00e7b29bff20" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:45.454757 17059 raft_consensus.cc:3060] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.461124 16985 raft_consensus.cc:2468] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 1.
I20260709 12:28:45.461323 17098 tablet_bootstrap.cc:492] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:45.465111 17098 ts_tablet_manager.cc:1403] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.097s	user 0.020s	sys 0.057s
I20260709 12:28:45.466060 17058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f1a8dbf7787b45f18f0264ee1c131caf" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:45.466746 17058 raft_consensus.cc:3060] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:45.466903 16876 leader_election.cc:343] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.468183 16876 leader_election.cc:304] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c; no voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8
I20260709 12:28:45.465459 16910 raft_consensus.cc:2468] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 1.
I20260709 12:28:45.468520 17105 raft_consensus.cc:697] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Becoming Leader. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:45.468555 17098 raft_consensus.cc:359] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.469647 16876 leader_election.cc:304] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 
I20260709 12:28:45.469717 17098 raft_consensus.cc:385] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.462026 17059 raft_consensus.cc:2468] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 1.
I20260709 12:28:45.464243 17099 tablet_bootstrap.cc:492] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:45.470582 17098 raft_consensus.cc:740] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.470923 17126 raft_consensus.cc:2749] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:45.469981 17105 consensus_queue.cc:237] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:45.471681 17126 raft_consensus.cc:2804] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.472375 17126 raft_consensus.cc:697] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Becoming Leader. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:45.471792 17098 consensus_queue.cc:260] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.471247 16951 leader_election.cc:304] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 
I20260709 12:28:45.473258 17126 consensus_queue.cc:237] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.474201 17127 raft_consensus.cc:2804] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.474761 17127 raft_consensus.cc:697] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Becoming Leader. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:45.475152 17098 ts_tablet_manager.cc:1434] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.010s	user 0.004s	sys 0.004s
I20260709 12:28:45.475627 17127 consensus_queue.cc:237] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.471096 17099 ts_tablet_manager.cc:1403] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.076s	user 0.012s	sys 0.008s
I20260709 12:28:45.476284 17098 tablet_bootstrap.cc:492] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:45.479463 17099 raft_consensus.cc:359] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.480213 17099 raft_consensus.cc:385] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.480507 17099 raft_consensus.cc:740] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.482802 17100 tablet_bootstrap.cc:492] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:45.483364 17100 ts_tablet_manager.cc:1403] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.059s	user 0.017s	sys 0.008s
I20260709 12:28:45.485548 17058 raft_consensus.cc:2468] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 1.
I20260709 12:28:45.486423 17100 raft_consensus.cc:359] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.488976 17100 raft_consensus.cc:385] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.489281 17100 raft_consensus.cc:740] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.489934 17098 tablet_bootstrap.cc:654] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.488142 17099 consensus_queue.cc:260] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.492761 17099 ts_tablet_manager.cc:1434] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.016s	user 0.006s	sys 0.000s
I20260709 12:28:45.492451 16806 catalog_manager.cc:5697] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65). New cstate: current_term: 1 leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:45.494040 17099 tablet_bootstrap.cc:492] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:45.501129 17099 tablet_bootstrap.cc:654] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.502806 17100 consensus_queue.cc:260] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.505602 17100 ts_tablet_manager.cc:1434] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.022s	user 0.007s	sys 0.000s
I20260709 12:28:45.506685 17100 tablet_bootstrap.cc:492] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:45.506810 17098 tablet_bootstrap.cc:492] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:45.507459 17098 ts_tablet_manager.cc:1403] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.031s	user 0.012s	sys 0.006s
I20260709 12:28:45.510622 17098 raft_consensus.cc:359] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.511593 17098 raft_consensus.cc:385] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.512005 17098 raft_consensus.cc:740] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.513108 17100 tablet_bootstrap.cc:654] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.512818 17098 consensus_queue.cc:260] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.515372 17098 ts_tablet_manager.cc:1434] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:45.516525 17098 tablet_bootstrap.cc:492] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:45.523244 17098 tablet_bootstrap.cc:654] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.526599 17100 tablet_bootstrap.cc:492] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:45.527180 17100 ts_tablet_manager.cc:1403] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.021s	user 0.008s	sys 0.007s
I20260709 12:28:45.530560 17099 tablet_bootstrap.cc:492] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:45.533604 17099 ts_tablet_manager.cc:1403] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.040s	user 0.014s	sys 0.003s
I20260709 12:28:45.534606 17098 tablet_bootstrap.cc:492] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:45.535212 17098 ts_tablet_manager.cc:1403] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.019s	user 0.012s	sys 0.002s
I20260709 12:28:45.536795 17099 raft_consensus.cc:359] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.537598 17099 raft_consensus.cc:385] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.536324 16807 catalog_manager.cc:5697] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:45.537926 17099 raft_consensus.cc:740] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.538518 17098 raft_consensus.cc:359] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.538936 17099 consensus_queue.cc:260] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.539418 17098 raft_consensus.cc:385] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.539868 17098 raft_consensus.cc:740] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.543172 17098 consensus_queue.cc:260] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.541759 17099 ts_tablet_manager.cc:1434] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.008s	user 0.007s	sys 0.000s
I20260709 12:28:45.545419 17098 ts_tablet_manager.cc:1434] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.010s	user 0.006s	sys 0.000s
I20260709 12:28:45.533030 17100 raft_consensus.cc:359] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.545542 17099 tablet_bootstrap.cc:492] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:45.545837 17100 raft_consensus.cc:385] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.546185 17100 raft_consensus.cc:740] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.547086 17100 consensus_queue.cc:260] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.549348 17100 ts_tablet_manager.cc:1434] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.022s	user 0.006s	sys 0.000s
I20260709 12:28:45.550274 17100 tablet_bootstrap.cc:492] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:45.552882 17099 tablet_bootstrap.cc:654] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.554936 17098 tablet_bootstrap.cc:492] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:45.559679 17100 tablet_bootstrap.cc:654] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.559993 17099 tablet_bootstrap.cc:492] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:45.560516 17099 ts_tablet_manager.cc:1403] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.015s	user 0.009s	sys 0.004s
I20260709 12:28:45.561159 17098 tablet_bootstrap.cc:654] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.563326 17099 raft_consensus.cc:359] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.564287 17099 raft_consensus.cc:385] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.564579 17099 raft_consensus.cc:740] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.565634 17099 consensus_queue.cc:260] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.570570 17099 ts_tablet_manager.cc:1434] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.010s	user 0.009s	sys 0.000s
I20260709 12:28:45.571785 17099 tablet_bootstrap.cc:492] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:45.578711 17099 tablet_bootstrap.cc:654] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.586069 16806 catalog_manager.cc:5697] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:45.606710 17100 tablet_bootstrap.cc:492] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:45.606842 17099 tablet_bootstrap.cc:492] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:45.607223 17100 ts_tablet_manager.cc:1403] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.057s	user 0.013s	sys 0.038s
I20260709 12:28:45.607369 17099 ts_tablet_manager.cc:1403] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.036s	user 0.018s	sys 0.015s
I20260709 12:28:45.607875 17098 tablet_bootstrap.cc:492] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:45.608345 17098 ts_tablet_manager.cc:1403] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.054s	user 0.047s	sys 0.004s
I20260709 12:28:45.609316 17100 raft_consensus.cc:359] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.609833 17100 raft_consensus.cc:385] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.610034 17100 raft_consensus.cc:740] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.609957 17099 raft_consensus.cc:359] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.610738 17099 raft_consensus.cc:385] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.610752 17100 consensus_queue.cc:260] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.611236 17099 raft_consensus.cc:740] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.610939 17098 raft_consensus.cc:359] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.612005 17099 consensus_queue.cc:260] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.613607 17098 raft_consensus.cc:385] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.613901 17098 raft_consensus.cc:740] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.615046 17099 ts_tablet_manager.cc:1434] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.007s	user 0.006s	sys 0.000s
I20260709 12:28:45.615010 17126 raft_consensus.cc:493] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.612591 17100 ts_tablet_manager.cc:1434] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.005s	user 0.005s	sys 0.000s
I20260709 12:28:45.622221 17126 raft_consensus.cc:515] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.625293 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06bd37a9a6142e2a320bb82b7340abe" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:45.626668 17104 raft_consensus.cc:493] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.627233 17104 raft_consensus.cc:515] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.629238 17104 leader_election.cc:290] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
W20260709 12:28:45.630326 16876 leader_election.cc:343] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.630594 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92485db6a3c743b2a35e05e166bbd561" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:45.631235 17058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92485db6a3c743b2a35e05e166bbd561" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:45.631345 17126 leader_election.cc:290] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:45.631781 17058 raft_consensus.cc:2468] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 0.
I20260709 12:28:45.614687 17098 consensus_queue.cc:260] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.632393 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06bd37a9a6142e2a320bb82b7340abe" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:45.632504 16985 raft_consensus.cc:2468] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 0.
I20260709 12:28:45.633122 17059 raft_consensus.cc:2468] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 0.
I20260709 12:28:45.634143 16876 leader_election.cc:304] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:45.634867 17126 raft_consensus.cc:2804] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.635229 17126 raft_consensus.cc:493] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.635572 17126 raft_consensus.cc:3060] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.635560 16876 leader_election.cc:304] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 51de95355c524c4cb143cf88d4c0a1e9
I20260709 12:28:45.636401 17104 raft_consensus.cc:2804] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.636750 17104 raft_consensus.cc:493] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.637056 17104 raft_consensus.cc:3060] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.642230 17104 raft_consensus.cc:515] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.642410 17126 raft_consensus.cc:515] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.643812 17104 leader_election.cc:290] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 election: Requested vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:45.644271 17126 leader_election.cc:290] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 election: Requested vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:45.644886 17098 ts_tablet_manager.cc:1434] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.036s	user 0.009s	sys 0.000s
I20260709 12:28:45.644693 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06bd37a9a6142e2a320bb82b7340abe" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:45.645515 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06bd37a9a6142e2a320bb82b7340abe" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:45.645902 17058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92485db6a3c743b2a35e05e166bbd561" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:45.646118 17059 raft_consensus.cc:3060] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.646402 17058 raft_consensus.cc:3060] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.646070 16984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92485db6a3c743b2a35e05e166bbd561" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
W20260709 12:28:45.646715 16876 leader_election.cc:343] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:45.647154 16984 raft_consensus.cc:3060] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.651746 17058 raft_consensus.cc:2468] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 1.
I20260709 12:28:45.653184 17059 raft_consensus.cc:2468] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 1.
I20260709 12:28:45.652987 16876 leader_election.cc:304] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:45.653421 17098 tablet_bootstrap.cc:492] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:45.654068 17126 raft_consensus.cc:2804] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.654145 16984 raft_consensus.cc:2468] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 1.
I20260709 12:28:45.654721 17126 raft_consensus.cc:697] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Becoming Leader. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:45.654803 16876 leader_election.cc:304] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 51de95355c524c4cb143cf88d4c0a1e9
I20260709 12:28:45.655745 17126 consensus_queue.cc:237] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.658002 17104 raft_consensus.cc:2804] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.658543 17104 raft_consensus.cc:697] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Becoming Leader. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:45.659768 17098 tablet_bootstrap.cc:654] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:45.659370 17104 consensus_queue.cc:237] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.671178 17098 tablet_bootstrap.cc:492] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:45.671574 17098 ts_tablet_manager.cc:1403] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.018s	user 0.009s	sys 0.008s
I20260709 12:28:45.672216 16806 catalog_manager.cc:5697] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65). New cstate: current_term: 1 leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:45.673482 17098 raft_consensus.cc:359] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.673996 17098 raft_consensus.cc:385] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:45.674183 17098 raft_consensus.cc:740] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:45.674752 17098 consensus_queue.cc:260] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.676388 17098 ts_tablet_manager.cc:1434] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.005s	user 0.002s	sys 0.002s
I20260709 12:28:45.684743 16807 catalog_manager.cc:5697] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65). New cstate: current_term: 1 leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:45.689993 17106 raft_consensus.cc:493] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.690501 17106 raft_consensus.cc:515] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.693100 17106 leader_election.cc:290] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:45.703696 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e272da12bca745c8b3a6d6d60533f926" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:45.704445 16910 raft_consensus.cc:2468] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 0.
I20260709 12:28:45.704500 16984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e272da12bca745c8b3a6d6d60533f926" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:45.705137 16984 raft_consensus.cc:2468] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 0.
I20260709 12:28:45.705415 17025 leader_election.cc:304] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:45.706199 17106 raft_consensus.cc:2804] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.706501 17106 raft_consensus.cc:493] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.706745 17106 raft_consensus.cc:3060] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.711773 17106 raft_consensus.cc:515] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.713310 17106 leader_election.cc:290] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:45.714162 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e272da12bca745c8b3a6d6d60533f926" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:45.714371 16984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e272da12bca745c8b3a6d6d60533f926" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:45.714824 16910 raft_consensus.cc:3060] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.715052 16984 raft_consensus.cc:3060] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.719959 16984 raft_consensus.cc:2468] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 1.
I20260709 12:28:45.720561 16910 raft_consensus.cc:2468] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 1.
I20260709 12:28:45.720984 17025 leader_election.cc:304] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:45.721864 17106 raft_consensus.cc:2804] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.722802 17106 raft_consensus.cc:697] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Becoming Leader. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:45.723644 17106 consensus_queue.cc:237] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.730700 16806 catalog_manager.cc:5697] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:45.731982 17126 raft_consensus.cc:493] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.732571 17126 raft_consensus.cc:515] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:45.734328 17126 leader_election.cc:290] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:45.735188 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2a79583a5466d80d19d9e8e441f52" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:45.735524 16984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2a79583a5466d80d19d9e8e441f52" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:45.736011 17059 raft_consensus.cc:2393] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in current term 1: Already voted for candidate 51de95355c524c4cb143cf88d4c0a1e9 in this term.
I20260709 12:28:45.737226 16876 leader_election.cc:304] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c; no voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8
I20260709 12:28:45.738224 17126 raft_consensus.cc:3060] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.743458 17126 raft_consensus.cc:2749] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:45.750422 17105 raft_consensus.cc:493] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.750995 17105 raft_consensus.cc:515] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.752642 17105 leader_election.cc:290] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:45.753437 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06bd37a9a6142e2a320bb82b7340abe" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:45.753684 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06bd37a9a6142e2a320bb82b7340abe" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:45.754387 17059 raft_consensus.cc:2393] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51de95355c524c4cb143cf88d4c0a1e9 in current term 1: Already voted for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in this term.
I20260709 12:28:45.755275 16951 leader_election.cc:304] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9; no voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8
I20260709 12:28:45.755853 17105 raft_consensus.cc:3060] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.761271 17105 raft_consensus.cc:2749] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:45.772384 17106 raft_consensus.cc:493] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.772908 17106 raft_consensus.cc:515] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.774631 17106 leader_election.cc:290] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:45.775492 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945852bfb9e94583920a5357b105f7c0" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:45.775678 16984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945852bfb9e94583920a5357b105f7c0" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:45.776132 16910 raft_consensus.cc:2468] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 0.
I20260709 12:28:45.776340 16984 raft_consensus.cc:2468] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 0.
I20260709 12:28:45.777060 17025 leader_election.cc:304] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:45.777705 17106 raft_consensus.cc:2804] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.777993 17106 raft_consensus.cc:493] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.778244 17106 raft_consensus.cc:3060] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.782692 17105 raft_consensus.cc:493] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.782987 17106 raft_consensus.cc:515] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.783226 17105 raft_consensus.cc:515] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.785084 17106 leader_election.cc:290] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:45.785151 17105 leader_election.cc:290] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:45.786288 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efb0a48115462f8a67785131ecec20" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:45.786509 16909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945852bfb9e94583920a5357b105f7c0" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:45.786890 16984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945852bfb9e94583920a5357b105f7c0" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:45.786375 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efb0a48115462f8a67785131ecec20" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:45.787077 16910 raft_consensus.cc:2468] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 0.
I20260709 12:28:45.787259 16909 raft_consensus.cc:3060] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.787596 16984 raft_consensus.cc:3060] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.787753 17059 raft_consensus.cc:2468] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 0.
I20260709 12:28:45.789091 16951 leader_election.cc:304] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:45.789896 17105 raft_consensus.cc:2804] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.790320 17105 raft_consensus.cc:493] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.790714 17105 raft_consensus.cc:3060] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.793741 16909 raft_consensus.cc:2468] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 1.
I20260709 12:28:45.794346 16984 raft_consensus.cc:2468] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 1.
I20260709 12:28:45.794771 17025 leader_election.cc:304] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:45.795539 17106 raft_consensus.cc:2804] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.796020 17106 raft_consensus.cc:697] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Becoming Leader. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:45.796805 17106 consensus_queue.cc:237] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.797463 17105 raft_consensus.cc:515] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.799587 17105 leader_election.cc:290] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:45.800669 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efb0a48115462f8a67785131ecec20" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:45.801155 16909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "03efb0a48115462f8a67785131ecec20" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:45.801394 17059 raft_consensus.cc:3060] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.801831 16909 raft_consensus.cc:3060] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.804117 17106 raft_consensus.cc:493] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:45.804697 17106 raft_consensus.cc:515] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.806082 16806 catalog_manager.cc:5697] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:45.807647 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7cec59cb20410dbd32311463982c38" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:45.808349 16910 raft_consensus.cc:2468] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 0.
I20260709 12:28:45.809011 16984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7cec59cb20410dbd32311463982c38" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:45.809360 16909 raft_consensus.cc:2468] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 1.
I20260709 12:28:45.810164 17025 leader_election.cc:304] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:45.810570 16951 leader_election.cc:304] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 
I20260709 12:28:45.811007 17059 raft_consensus.cc:2468] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 1.
I20260709 12:28:45.811189 16984 raft_consensus.cc:2468] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 0.
I20260709 12:28:45.811484 17105 raft_consensus.cc:2804] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.812032 17105 raft_consensus.cc:697] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Becoming Leader. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:45.812062 17106 leader_election.cc:290] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:45.812907 17105 consensus_queue.cc:237] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.812148 17150 raft_consensus.cc:2804] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:45.814769 17150 raft_consensus.cc:493] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:45.815035 17150 raft_consensus.cc:3060] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.821846 16807 catalog_manager.cc:5697] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:45.822394 17150 raft_consensus.cc:515] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.824550 17150 leader_election.cc:290] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:45.825243 16909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7cec59cb20410dbd32311463982c38" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:45.825531 16984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7cec59cb20410dbd32311463982c38" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:45.825749 16909 raft_consensus.cc:3060] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.826156 16984 raft_consensus.cc:3060] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:45.832442 16984 raft_consensus.cc:2468] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 1.
I20260709 12:28:45.833073 16909 raft_consensus.cc:2468] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 1.
I20260709 12:28:45.833498 17025 leader_election.cc:304] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:45.834276 17150 raft_consensus.cc:2804] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:45.834672 17150 raft_consensus.cc:697] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Becoming Leader. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:45.835408 17150 consensus_queue.cc:237] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:45.842792 16807 catalog_manager.cc:5697] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:45.855700 17105 consensus_queue.cc:1048] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:45.867691 17127 consensus_queue.cc:1048] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:45.889482 17126 consensus_queue.cc:1048] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:45.900287 17104 consensus_queue.cc:1048] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:45.904863 17127 consensus_queue.cc:1048] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:45.917595 17127 consensus_queue.cc:1048] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:46.034384 16984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bba2a79583a5466d80d19d9e8e441f52"
dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
mode: GRACEFUL
new_leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
 from {username='slave'} at 127.0.0.1:53674
I20260709 12:28:46.034978 16984 raft_consensus.cc:606] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Received request to transfer leadership to TS 0d1d35a1ebcf415c9e3e8af85b90a24c
I20260709 12:28:46.043642 16984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b68c285dc783415d93ea00e7b29bff20"
dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
mode: GRACEFUL
new_leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
 from {username='slave'} at 127.0.0.1:53674
I20260709 12:28:46.044219 16984 raft_consensus.cc:606] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Received request to transfer leadership to TS 0d1d35a1ebcf415c9e3e8af85b90a24c
I20260709 12:28:46.058076 17059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "945852bfb9e94583920a5357b105f7c0"
dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
mode: GRACEFUL
new_leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
 from {username='slave'} at 127.0.0.1:49936
I20260709 12:28:46.058662 17059 raft_consensus.cc:606] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Received request to transfer leadership to TS 0d1d35a1ebcf415c9e3e8af85b90a24c
I20260709 12:28:46.072974 16909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92485db6a3c743b2a35e05e166bbd561"
dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
mode: GRACEFUL
new_leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
 from {username='slave'} at 127.0.0.1:34928
I20260709 12:28:46.073479 16909 raft_consensus.cc:606] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Received request to transfer leadership to TS 51de95355c524c4cb143cf88d4c0a1e9
I20260709 12:28:46.082612 17059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "3d7cec59cb20410dbd32311463982c38"
dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
mode: GRACEFUL
new_leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
 from {username='slave'} at 127.0.0.1:49936
I20260709 12:28:46.083130 17059 raft_consensus.cc:606] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Received request to transfer leadership to TS 51de95355c524c4cb143cf88d4c0a1e9
I20260709 12:28:46.089169 17059 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e272da12bca745c8b3a6d6d60533f926"
dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
mode: GRACEFUL
new_leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
 from {username='slave'} at 127.0.0.1:49936
I20260709 12:28:46.089682 17059 raft_consensus.cc:606] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Received request to transfer leadership to TS 51de95355c524c4cb143cf88d4c0a1e9
I20260709 12:28:46.095202 16909 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b06bd37a9a6142e2a320bb82b7340abe"
dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
mode: GRACEFUL
new_leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
 from {username='slave'} at 127.0.0.1:34928
I20260709 12:28:46.095711 16909 raft_consensus.cc:606] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Received request to transfer leadership to TS 6f55d37b709d49a2b523a88c4fc5acf8
I20260709 12:28:46.107235 17106 consensus_queue.cc:1048] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:46.107903 17150 consensus_queue.cc:1048] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:46.123769 17104 consensus_queue.cc:1048] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:46.125454 17150 raft_consensus.cc:993] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8: : Instructing follower 51de95355c524c4cb143cf88d4c0a1e9 to start an election
I20260709 12:28:46.126070 17106 raft_consensus.cc:1081] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Signalling peer 51de95355c524c4cb143cf88d4c0a1e9 to start an election
I20260709 12:28:46.128542 16984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e272da12bca745c8b3a6d6d60533f926"
dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
 from {username='slave'} at 127.0.0.1:38440
I20260709 12:28:46.129242 16984 raft_consensus.cc:493] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:46.129701 16984 raft_consensus.cc:3060] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.139026 16984 raft_consensus.cc:515] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.143733 17058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e272da12bca745c8b3a6d6d60533f926" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:46.144515 17058 raft_consensus.cc:3055] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:46.145181 17058 raft_consensus.cc:740] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:46.146011 16909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e272da12bca745c8b3a6d6d60533f926" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:46.146323 17058 consensus_queue.cc:260] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.146934 16909 raft_consensus.cc:3060] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.144534 17104 consensus_queue.cc:1048] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20260709 12:28:46.147915 17058 raft_consensus.cc:3060] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.148273 16984 leader_election.cc:290] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 2 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:46.157166 17058 raft_consensus.cc:2468] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 2.
I20260709 12:28:46.158403 16951 leader_election.cc:304] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:46.159328 17127 raft_consensus.cc:2804] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:46.159829 17127 raft_consensus.cc:697] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Becoming Leader. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:46.160619 17127 consensus_queue.cc:237] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.166294 16909 raft_consensus.cc:2468] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 2.
I20260709 12:28:46.169868 16806 catalog_manager.cc:5697] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 reported cstate change: term changed from 1 to 2, leader changed from 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67) to 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:46.173580 17144 raft_consensus.cc:993] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c: : Instructing follower 6f55d37b709d49a2b523a88c4fc5acf8 to start an election
I20260709 12:28:46.174103 17171 raft_consensus.cc:1081] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Signalling peer 6f55d37b709d49a2b523a88c4fc5acf8 to start an election
I20260709 12:28:46.175678 17059 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b06bd37a9a6142e2a320bb82b7340abe"
dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
 from {username='slave'} at 127.0.0.1:48040
I20260709 12:28:46.176326 17059 raft_consensus.cc:493] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:46.176689 17059 raft_consensus.cc:3060] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.183233 17059 raft_consensus.cc:515] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.185271 17059 leader_election.cc:290] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 2 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:46.186335 16909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06bd37a9a6142e2a320bb82b7340abe" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:46.186694 16984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b06bd37a9a6142e2a320bb82b7340abe" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:46.187103 16909 raft_consensus.cc:3055] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:46.187275 16984 raft_consensus.cc:3060] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.187605 16909 raft_consensus.cc:740] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:46.188743 16909 consensus_queue.cc:260] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.190537 16909 raft_consensus.cc:3060] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.192958 17171 consensus_queue.cc:1048] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:46.196060 16984 raft_consensus.cc:2468] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 2.
I20260709 12:28:46.197305 17025 leader_election.cc:304] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:46.197962 16909 raft_consensus.cc:2468] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 2.
I20260709 12:28:46.198117 17169 raft_consensus.cc:2804] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:46.198820 17169 raft_consensus.cc:697] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 LEADER]: Becoming Leader. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:46.199608 17169 consensus_queue.cc:237] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.206207 17127 consensus_queue.cc:1048] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:46.209630 17104 consensus_queue.cc:1048] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:46.212155 16806 catalog_manager.cc:5697] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 reported cstate change: term changed from 1 to 2, leader changed from 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65) to 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:46.219883 17104 raft_consensus.cc:993] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c: : Instructing follower 51de95355c524c4cb143cf88d4c0a1e9 to start an election
I20260709 12:28:46.220520 17104 raft_consensus.cc:1081] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Signalling peer 51de95355c524c4cb143cf88d4c0a1e9 to start an election
I20260709 12:28:46.222666 16984 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92485db6a3c743b2a35e05e166bbd561"
dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
 from {username='slave'} at 127.0.0.1:38432
I20260709 12:28:46.223255 16984 raft_consensus.cc:493] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:46.223696 16984 raft_consensus.cc:3060] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.231462 16984 raft_consensus.cc:515] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.231846 17124 consensus_queue.cc:1048] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:46.233632 16984 leader_election.cc:290] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 2 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:46.235934 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92485db6a3c743b2a35e05e166bbd561" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:46.236528 16910 raft_consensus.cc:3055] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:46.236850 16910 raft_consensus.cc:740] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:46.237223 17058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92485db6a3c743b2a35e05e166bbd561" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:46.237920 17058 raft_consensus.cc:3060] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.237668 16910 consensus_queue.cc:260] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.239411 16910 raft_consensus.cc:3060] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.240680 17169 consensus_queue.cc:1048] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:46.246085 17058 raft_consensus.cc:2468] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 2.
I20260709 12:28:46.247740 16951 leader_election.cc:304] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:46.248867 17105 raft_consensus.cc:2804] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:46.249351 17105 raft_consensus.cc:697] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Becoming Leader. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:46.246778 16910 raft_consensus.cc:2468] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 2.
I20260709 12:28:46.250211 17105 consensus_queue.cc:237] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.252389 17169 raft_consensus.cc:993] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8: : Instructing follower 0d1d35a1ebcf415c9e3e8af85b90a24c to start an election
I20260709 12:28:46.252890 17169 raft_consensus.cc:1081] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Signalling peer 0d1d35a1ebcf415c9e3e8af85b90a24c to start an election
I20260709 12:28:46.257174 16908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "945852bfb9e94583920a5357b105f7c0"
dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
 from {username='slave'} at 127.0.0.1:48528
I20260709 12:28:46.257818 16908 raft_consensus.cc:493] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:46.258191 16908 raft_consensus.cc:3060] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.261986 16808 catalog_manager.cc:5697] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 reported cstate change: term changed from 1 to 2, leader changed from 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65) to 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:46.264642 16908 raft_consensus.cc:515] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.265784 16910 raft_consensus.cc:1240] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Rejecting Update request from peer 6f55d37b709d49a2b523a88c4fc5acf8 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:46.267066 16908 leader_election.cc:290] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 2 election: Requested vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:46.267931 17169 consensus_queue.cc:1048] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:46.268453 17058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945852bfb9e94583920a5357b105f7c0" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:46.270836 17058 raft_consensus.cc:3055] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:46.271214 17058 raft_consensus.cc:740] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:46.272074 17058 consensus_queue.cc:260] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.272960 17169 consensus_queue.cc:1059] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:46.268132 16984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "945852bfb9e94583920a5357b105f7c0" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:46.278450 17058 raft_consensus.cc:3060] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.285458 17058 raft_consensus.cc:2468] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 2.
I20260709 12:28:46.286597 16876 leader_election.cc:304] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 51de95355c524c4cb143cf88d4c0a1e9
I20260709 12:28:46.287317 17126 raft_consensus.cc:2804] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:46.287819 17126 raft_consensus.cc:697] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Becoming Leader. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:46.288764 17126 consensus_queue.cc:237] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.295907 16808 catalog_manager.cc:5697] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c reported cstate change: term changed from 1 to 2, leader changed from 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67) to 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65). New cstate: current_term: 2 leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:46.310174 17124 raft_consensus.cc:993] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9: : Instructing follower 0d1d35a1ebcf415c9e3e8af85b90a24c to start an election
I20260709 12:28:46.310597 17124 raft_consensus.cc:1081] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Signalling peer 0d1d35a1ebcf415c9e3e8af85b90a24c to start an election
I20260709 12:28:46.311949 16910 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b68c285dc783415d93ea00e7b29bff20"
dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
 from {username='slave'} at 127.0.0.1:48518
I20260709 12:28:46.312422 16910 raft_consensus.cc:493] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:46.312693 16910 raft_consensus.cc:3060] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.317821 16910 raft_consensus.cc:515] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.319406 16910 leader_election.cc:290] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 2 election: Requested vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:46.320349 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68c285dc783415d93ea00e7b29bff20" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:46.320551 17058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b68c285dc783415d93ea00e7b29bff20" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:46.321029 16985 raft_consensus.cc:3055] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:46.321125 17058 raft_consensus.cc:3060] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.321376 16985 raft_consensus.cc:740] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:46.322078 16985 consensus_queue.cc:260] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.323117 16985 raft_consensus.cc:3060] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.327971 17058 raft_consensus.cc:2468] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 2.
I20260709 12:28:46.328646 16985 raft_consensus.cc:2468] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 2.
I20260709 12:28:46.329177 16876 leader_election.cc:304] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:46.330025 17104 raft_consensus.cc:2804] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:46.330567 17104 raft_consensus.cc:697] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Becoming Leader. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:46.331410 17104 consensus_queue.cc:237] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.337781 16806 catalog_manager.cc:5697] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c reported cstate change: term changed from 1 to 2, leader changed from 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66) to 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65). New cstate: current_term: 2 leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:46.354238 17169 consensus_queue.cc:1048] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:46.365187 17169 consensus_queue.cc:1048] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:46.372900 17106 raft_consensus.cc:993] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8: : Instructing follower 51de95355c524c4cb143cf88d4c0a1e9 to start an election
I20260709 12:28:46.373446 17169 raft_consensus.cc:1081] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Signalling peer 51de95355c524c4cb143cf88d4c0a1e9 to start an election
I20260709 12:28:46.375092 16985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "3d7cec59cb20410dbd32311463982c38"
dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
 from {username='slave'} at 127.0.0.1:38440
I20260709 12:28:46.375573 16985 raft_consensus.cc:493] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:46.375934 16985 raft_consensus.cc:3060] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.381085 16985 raft_consensus.cc:515] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.384272 16985 leader_election.cc:290] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 2 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:46.386570 17105 raft_consensus.cc:993] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9: : Instructing follower 0d1d35a1ebcf415c9e3e8af85b90a24c to start an election
I20260709 12:28:46.387200 17124 raft_consensus.cc:1081] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Signalling peer 0d1d35a1ebcf415c9e3e8af85b90a24c to start an election
I20260709 12:28:46.387353 17058 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7cec59cb20410dbd32311463982c38" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:46.388123 17058 raft_consensus.cc:3055] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:46.388499 17058 raft_consensus.cc:740] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:46.389168 16908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bba2a79583a5466d80d19d9e8e441f52"
dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
 from {username='slave'} at 127.0.0.1:48518
I20260709 12:28:46.389747 16908 raft_consensus.cc:493] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:46.389312 17058 consensus_queue.cc:260] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.390064 16908 raft_consensus.cc:3060] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.390743 17058 raft_consensus.cc:3060] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.386765 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "3d7cec59cb20410dbd32311463982c38" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:46.392373 16910 raft_consensus.cc:3060] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.396469 16908 raft_consensus.cc:515] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:46.399374 16910 raft_consensus.cc:2468] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 2.
I20260709 12:28:46.400192 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2a79583a5466d80d19d9e8e441f52" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:46.400478 17058 raft_consensus.cc:2468] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 2.
I20260709 12:28:46.400579 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2a79583a5466d80d19d9e8e441f52" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:46.400821 16908 leader_election.cc:290] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 2 election: Requested vote from peers 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:46.401795 16985 raft_consensus.cc:3055] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:46.401023 17059 raft_consensus.cc:3060] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.402355 16985 raft_consensus.cc:740] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:46.401659 16951 leader_election.cc:304] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 
I20260709 12:28:46.403194 17124 raft_consensus.cc:2804] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:46.403656 17124 raft_consensus.cc:697] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Becoming Leader. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:46.403193 16985 consensus_queue.cc:260] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:46.404537 17124 consensus_queue.cc:237] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:46.405223 16985 raft_consensus.cc:3060] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.409104 17059 raft_consensus.cc:2468] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 2.
I20260709 12:28:46.409749 17057 raft_consensus.cc:1240] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Rejecting Update request from peer 51de95355c524c4cb143cf88d4c0a1e9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:46.412246 16876 leader_election.cc:304] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:46.412946 17104 raft_consensus.cc:2804] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:46.413170 16985 raft_consensus.cc:2468] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 2.
I20260709 12:28:46.413378 17104 raft_consensus.cc:697] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Becoming Leader. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:46.413303 16808 catalog_manager.cc:5697] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 reported cstate change: term changed from 1 to 2, leader changed from 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67) to 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:46.414448 17104 consensus_queue.cc:237] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:46.421429 16806 catalog_manager.cc:5697] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c reported cstate change: term changed from 1 to 2, leader changed from 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66) to 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65). New cstate: current_term: 2 leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:46.575255 17059 raft_consensus.cc:1275] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Refusing update from remote peer 51de95355c524c4cb143cf88d4c0a1e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.576792 17124 consensus_queue.cc:1048] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:46.584627 16908 raft_consensus.cc:1275] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Refusing update from remote peer 51de95355c524c4cb143cf88d4c0a1e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.587268 17181 consensus_queue.cc:1048] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:46.631317 16908 raft_consensus.cc:1275] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Refusing update from remote peer 51de95355c524c4cb143cf88d4c0a1e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.632571 17181 consensus_queue.cc:1048] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:46.641216 17059 raft_consensus.cc:1275] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Refusing update from remote peer 51de95355c524c4cb143cf88d4c0a1e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.642637 17105 consensus_queue.cc:1048] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:46.726565 16985 raft_consensus.cc:1275] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Refusing update from remote peer 0d1d35a1ebcf415c9e3e8af85b90a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.727797 17104 consensus_queue.cc:1048] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:46.735558 17059 raft_consensus.cc:1275] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Refusing update from remote peer 0d1d35a1ebcf415c9e3e8af85b90a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.737007 17126 consensus_queue.cc:1048] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:46.785908 16908 raft_consensus.cc:1275] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Refusing update from remote peer 6f55d37b709d49a2b523a88c4fc5acf8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.787314 17106 consensus_queue.cc:1048] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:46.795655 16985 raft_consensus.cc:1275] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Refusing update from remote peer 6f55d37b709d49a2b523a88c4fc5acf8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.797075 17150 consensus_queue.cc:1048] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:46.833180 16908 raft_consensus.cc:1275] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Refusing update from remote peer 51de95355c524c4cb143cf88d4c0a1e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.834347 17181 consensus_queue.cc:1048] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:46.841562 17059 raft_consensus.cc:1275] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Refusing update from remote peer 51de95355c524c4cb143cf88d4c0a1e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.843544 17105 consensus_queue.cc:1048] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:28:46.850498 16985 raft_consensus.cc:3060] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:46.857208 16985 raft_consensus.cc:1275] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Refusing update from remote peer 0d1d35a1ebcf415c9e3e8af85b90a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.858695 17104 consensus_queue.cc:1048] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:46.868131 17059 raft_consensus.cc:1275] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Refusing update from remote peer 0d1d35a1ebcf415c9e3e8af85b90a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.870129 17144 consensus_queue.cc:1048] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:46.906719 17059 raft_consensus.cc:1275] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Refusing update from remote peer 0d1d35a1ebcf415c9e3e8af85b90a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.908012 17144 consensus_queue.cc:1048] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:46.911381 16985 raft_consensus.cc:1275] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Refusing update from remote peer 0d1d35a1ebcf415c9e3e8af85b90a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:46.912772 17144 consensus_queue.cc:1048] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:49.124861 16806 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:34520:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:28:49.127203 16806 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:28:49.235098 16892 tablet_service.cc:1511] Processing CreateTablet for tablet c3c037275b364555b53fa733e4d8f1e7 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:49.236241 16969 tablet_service.cc:1511] Processing CreateTablet for tablet c3c037275b364555b53fa733e4d8f1e7 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:49.237608 16892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c037275b364555b53fa733e4d8f1e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.237807 16969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c037275b364555b53fa733e4d8f1e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.239490 17043 tablet_service.cc:1511] Processing CreateTablet for tablet c3c037275b364555b53fa733e4d8f1e7 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:28:49.240072 16896 tablet_service.cc:1511] Processing CreateTablet for tablet bf6c876e465a43fcb34c937877cd7afb (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:49.267969 16896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf6c876e465a43fcb34c937877cd7afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.270617 17043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c3c037275b364555b53fa733e4d8f1e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.271943 16974 tablet_service.cc:1511] Processing CreateTablet for tablet 35bc8bd564e64d69ad3a2f103c4cd5e2 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:49.273541 16974 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35bc8bd564e64d69ad3a2f103c4cd5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.242198 16975 tablet_service.cc:1511] Processing CreateTablet for tablet bf6c876e465a43fcb34c937877cd7afb (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:49.244882 17041 tablet_service.cc:1511] Processing CreateTablet for tablet bf6c876e465a43fcb34c937877cd7afb (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:28:49.247269 16894 tablet_service.cc:1511] Processing CreateTablet for tablet 8edce4cea96b4bb7bde070ecc69f01d4 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:49.250108 17042 tablet_service.cc:1511] Processing CreateTablet for tablet 8edce4cea96b4bb7bde070ecc69f01d4 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:49.250234 16971 tablet_service.cc:1511] Processing CreateTablet for tablet 8edce4cea96b4bb7bde070ecc69f01d4 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:28:49.254576 16900 tablet_service.cc:1511] Processing CreateTablet for tablet c674e30bf2564b9c86216ec9b8cc8de9 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:49.279588 17041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf6c876e465a43fcb34c937877cd7afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.279968 16900 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c674e30bf2564b9c86216ec9b8cc8de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.280560 16972 tablet_service.cc:1511] Processing CreateTablet for tablet f85e5a8ee06c4347b7d0206d20056e77 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:49.256304 16973 tablet_service.cc:1511] Processing CreateTablet for tablet c674e30bf2564b9c86216ec9b8cc8de9 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:49.282603 17042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edce4cea96b4bb7bde070ecc69f01d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.257150 17044 tablet_service.cc:1511] Processing CreateTablet for tablet c674e30bf2564b9c86216ec9b8cc8de9 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:28:49.283057 16897 tablet_service.cc:1511] Processing CreateTablet for tablet f85e5a8ee06c4347b7d0206d20056e77 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:49.284026 16894 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edce4cea96b4bb7bde070ecc69f01d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.285647 16893 tablet_service.cc:1511] Processing CreateTablet for tablet d4593f72a2a24c8ab967901c66587a21 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:49.257637 16895 tablet_service.cc:1511] Processing CreateTablet for tablet 35bc8bd564e64d69ad3a2f103c4cd5e2 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:49.287216 16893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4593f72a2a24c8ab967901c66587a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.288173 17044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c674e30bf2564b9c86216ec9b8cc8de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.260661 17047 tablet_service.cc:1511] Processing CreateTablet for tablet 35bc8bd564e64d69ad3a2f103c4cd5e2 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:28:49.290189 17049 tablet_service.cc:1511] Processing CreateTablet for tablet f85e5a8ee06c4347b7d0206d20056e77 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:28:49.290808 17047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35bc8bd564e64d69ad3a2f103c4cd5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.291857 16897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85e5a8ee06c4347b7d0206d20056e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.294163 16895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35bc8bd564e64d69ad3a2f103c4cd5e2. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.294164 17049 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85e5a8ee06c4347b7d0206d20056e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.278576 16975 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bf6c876e465a43fcb34c937877cd7afb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.298971 16973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c674e30bf2564b9c86216ec9b8cc8de9. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.300964 16971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8edce4cea96b4bb7bde070ecc69f01d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.302855 16972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f85e5a8ee06c4347b7d0206d20056e77. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.311549 16970 tablet_service.cc:1511] Processing CreateTablet for tablet d4593f72a2a24c8ab967901c66587a21 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:49.313306 16970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4593f72a2a24c8ab967901c66587a21. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.341392 17045 tablet_service.cc:1511] Processing CreateTablet for tablet d4593f72a2a24c8ab967901c66587a21 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:28:49.350953 17045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d4593f72a2a24c8ab967901c66587a21. 1 dirs total, 0 dirs full, 0 dirs failed
W20260709 12:28:49.418586 16951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:45885, user_credentials={real_user=slave}} blocked reactor thread for 96463.4us
I20260709 12:28:49.421612 16899 tablet_service.cc:1511] Processing CreateTablet for tablet 92f2d4ba10a04aff94f41e73b0d49184 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:49.429962 16899 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f2d4ba10a04aff94f41e73b0d49184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.430047 17046 tablet_service.cc:1511] Processing CreateTablet for tablet 92f2d4ba10a04aff94f41e73b0d49184 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:49.431617 17046 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f2d4ba10a04aff94f41e73b0d49184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.430119 16968 tablet_service.cc:1511] Processing CreateTablet for tablet 92f2d4ba10a04aff94f41e73b0d49184 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:28:49.441025 16968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 92f2d4ba10a04aff94f41e73b0d49184. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.441599 16967 tablet_service.cc:1511] Processing CreateTablet for tablet 70bc3b0d10fc4e43b94892335f006545 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:49.443197 16967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bc3b0d10fc4e43b94892335f006545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.452299 16893 tablet_service.cc:1511] Processing CreateTablet for tablet 70bc3b0d10fc4e43b94892335f006545 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:49.459321 16893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bc3b0d10fc4e43b94892335f006545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.482121 17197 tablet_bootstrap.cc:492] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
W20260709 12:28:49.487236 16856 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:28:49.491595 17041 tablet_service.cc:1511] Processing CreateTablet for tablet 70bc3b0d10fc4e43b94892335f006545 (DEFAULT_TABLE table=soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:28:49.495805 17041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 70bc3b0d10fc4e43b94892335f006545. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:28:49.502040 17200 tablet_bootstrap.cc:492] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:49.522644 17201 tablet_bootstrap.cc:492] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:49.525943 17197 tablet_bootstrap.cc:654] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.522773 17200 tablet_bootstrap.cc:654] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.532965 17201 tablet_bootstrap.cc:654] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.539883 17197 tablet_bootstrap.cc:492] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:49.539909 17201 tablet_bootstrap.cc:492] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:49.540385 17197 ts_tablet_manager.cc:1403] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.059s	user 0.011s	sys 0.001s
I20260709 12:28:49.540577 17201 ts_tablet_manager.cc:1403] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.018s	user 0.008s	sys 0.005s
I20260709 12:28:49.540993 17200 tablet_bootstrap.cc:492] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:49.541498 17200 ts_tablet_manager.cc:1403] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.040s	user 0.007s	sys 0.013s
I20260709 12:28:49.543323 17197 raft_consensus.cc:359] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.544186 17197 raft_consensus.cc:385] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.544144 17201 raft_consensus.cc:359] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.544683 17197 raft_consensus.cc:740] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.545061 17201 raft_consensus.cc:385] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.544620 17200 raft_consensus.cc:359] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.545431 17201 raft_consensus.cc:740] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.545595 17200 raft_consensus.cc:385] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.546160 17200 raft_consensus.cc:740] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.545634 17197 consensus_queue.cc:260] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.546249 17201 consensus_queue.cc:260] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.547367 17200 consensus_queue.cc:260] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.549358 17197 ts_tablet_manager.cc:1434] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.009s	user 0.005s	sys 0.003s
I20260709 12:28:49.550657 17197 tablet_bootstrap.cc:492] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:49.550576 17200 ts_tablet_manager.cc:1434] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.004s
I20260709 12:28:49.554538 17201 ts_tablet_manager.cc:1434] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.013s	user 0.008s	sys 0.000s
I20260709 12:28:49.555757 17201 tablet_bootstrap.cc:492] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:49.554580 17200 tablet_bootstrap.cc:492] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:49.559389 17197 tablet_bootstrap.cc:654] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.568861 17200 tablet_bootstrap.cc:654] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.573196 17197 tablet_bootstrap.cc:492] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:49.573894 17197 ts_tablet_manager.cc:1403] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.023s	user 0.006s	sys 0.013s
I20260709 12:28:49.575208 17201 tablet_bootstrap.cc:654] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.576767 17200 tablet_bootstrap.cc:492] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:49.577440 17200 ts_tablet_manager.cc:1403] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.023s	user 0.014s	sys 0.000s
I20260709 12:28:49.577087 17197 raft_consensus.cc:359] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.578208 17197 raft_consensus.cc:385] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.578790 17197 raft_consensus.cc:740] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.579691 17197 consensus_queue.cc:260] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.581363 17200 raft_consensus.cc:359] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.582367 17200 raft_consensus.cc:385] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.582592 17197 ts_tablet_manager.cc:1434] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:28:49.582803 17200 raft_consensus.cc:740] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.583961 17197 tablet_bootstrap.cc:492] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:49.583920 17200 consensus_queue.cc:260] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.587142 17200 ts_tablet_manager.cc:1434] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:28:49.588424 17200 tablet_bootstrap.cc:492] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:49.591543 17201 tablet_bootstrap.cc:492] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:49.592257 17201 ts_tablet_manager.cc:1403] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.037s	user 0.012s	sys 0.011s
I20260709 12:28:49.592895 17197 tablet_bootstrap.cc:654] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.595122 17200 tablet_bootstrap.cc:654] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.595585 17201 raft_consensus.cc:359] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.596413 17201 raft_consensus.cc:385] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.596776 17201 raft_consensus.cc:740] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.597802 17201 consensus_queue.cc:260] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.600358 17201 ts_tablet_manager.cc:1434] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:49.601513 17201 tablet_bootstrap.cc:492] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:49.608672 17201 tablet_bootstrap.cc:654] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.612057 17197 tablet_bootstrap.cc:492] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:49.612761 17197 ts_tablet_manager.cc:1403] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.029s	user 0.016s	sys 0.009s
I20260709 12:28:49.612808 17200 tablet_bootstrap.cc:492] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:49.613469 17200 ts_tablet_manager.cc:1403] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.025s	user 0.018s	sys 0.004s
I20260709 12:28:49.616108 17197 raft_consensus.cc:359] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.617007 17197 raft_consensus.cc:385] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.617379 17197 raft_consensus.cc:740] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.635192 17197 consensus_queue.cc:260] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.638363 17197 ts_tablet_manager.cc:1434] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.025s	user 0.013s	sys 0.010s
I20260709 12:28:49.638623 17200 raft_consensus.cc:359] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.639529 17200 raft_consensus.cc:385] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.639587 17197 tablet_bootstrap.cc:492] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:49.639854 17201 tablet_bootstrap.cc:492] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:49.640565 17201 ts_tablet_manager.cc:1403] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.039s	user 0.011s	sys 0.013s
I20260709 12:28:49.639976 17200 raft_consensus.cc:740] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.641724 17200 consensus_queue.cc:260] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.644446 17200 ts_tablet_manager.cc:1434] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.031s	user 0.005s	sys 0.001s
I20260709 12:28:49.643996 17201 raft_consensus.cc:359] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.645036 17201 raft_consensus.cc:385] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.645413 17201 raft_consensus.cc:740] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.646315 17201 consensus_queue.cc:260] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.647553 17197 tablet_bootstrap.cc:654] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.648762 17200 tablet_bootstrap.cc:492] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:49.649006 17201 ts_tablet_manager.cc:1434] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:49.654706 17199 raft_consensus.cc:493] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.656170 17201 tablet_bootstrap.cc:492] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:49.660610 17200 tablet_bootstrap.cc:654] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.660537 17199 raft_consensus.cc:515] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.664031 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4593f72a2a24c8ab967901c66587a21" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
W20260709 12:28:49.666046 16876 leader_election.cc:343] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.668555 17057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4593f72a2a24c8ab967901c66587a21" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:49.668835 17201 tablet_bootstrap.cc:654] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.669402 17198 raft_consensus.cc:493] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.670009 17198 raft_consensus.cc:515] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
W20260709 12:28:49.670363 16876 leader_election.cc:343] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.670887 16876 leader_election.cc:304] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c; no voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8
I20260709 12:28:49.671878 17126 raft_consensus.cc:2749] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:49.672472 17198 leader_election.cc:290] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:49.672998 17199 leader_election.cc:290] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:49.675176 17200 tablet_bootstrap.cc:492] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:49.675393 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c037275b364555b53fa733e4d8f1e7" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:49.675649 17057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c037275b364555b53fa733e4d8f1e7" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:49.675953 17200 ts_tablet_manager.cc:1403] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.031s	user 0.014s	sys 0.005s
I20260709 12:28:49.676131 16910 raft_consensus.cc:2468] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 0.
I20260709 12:28:49.678009 16951 leader_election.cc:304] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 
I20260709 12:28:49.678921 17198 raft_consensus.cc:2804] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.679283 17198 raft_consensus.cc:493] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.679620 17198 raft_consensus.cc:3060] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.680078 17200 raft_consensus.cc:359] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.680925 17200 raft_consensus.cc:385] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.681236 17200 raft_consensus.cc:740] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.681516 17201 tablet_bootstrap.cc:492] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:49.682067 17201 ts_tablet_manager.cc:1403] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.026s	user 0.011s	sys 0.008s
I20260709 12:28:49.682053 17200 consensus_queue.cc:260] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.684923 17200 ts_tablet_manager.cc:1434] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:49.685966 17200 tablet_bootstrap.cc:492] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:49.676259 17057 raft_consensus.cc:2468] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 0.
I20260709 12:28:49.688364 17198 raft_consensus.cc:515] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.690824 17197 tablet_bootstrap.cc:492] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:49.691473 17197 ts_tablet_manager.cc:1403] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.052s	user 0.007s	sys 0.006s
I20260709 12:28:49.692101 17198 leader_election.cc:290] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:49.688948 17201 raft_consensus.cc:359] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.692909 17201 raft_consensus.cc:385] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.693377 17201 raft_consensus.cc:740] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.693640 17200 tablet_bootstrap.cc:654] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.694687 17197 raft_consensus.cc:359] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.694487 17201 consensus_queue.cc:260] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.695513 17197 raft_consensus.cc:385] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.695928 17197 raft_consensus.cc:740] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.696820 17197 consensus_queue.cc:260] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.697515 17201 ts_tablet_manager.cc:1434] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:28:49.697770 17150 raft_consensus.cc:493] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.698257 17150 raft_consensus.cc:515] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.698777 17201 tablet_bootstrap.cc:492] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:49.699580 17197 ts_tablet_manager.cc:1434] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:49.700744 17197 tablet_bootstrap.cc:492] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:49.700804 17150 leader_election.cc:290] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:49.703104 16908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85e5a8ee06c4347b7d0206d20056e77" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:49.703526 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c037275b364555b53fa733e4d8f1e7" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:49.704295 17059 raft_consensus.cc:3060] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.704387 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85e5a8ee06c4347b7d0206d20056e77" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:49.705092 16985 raft_consensus.cc:2468] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 0.
I20260709 12:28:49.707521 17025 leader_election.cc:304] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
W20260709 12:28:49.708602 17025 leader_election.cc:343] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.702492 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c037275b364555b53fa733e4d8f1e7" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:49.709450 16910 raft_consensus.cc:3060] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.709148 17150 raft_consensus.cc:2804] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.710286 17150 raft_consensus.cc:493] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.710745 17150 raft_consensus.cc:3060] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.717160 16910 raft_consensus.cc:2468] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 1.
I20260709 12:28:49.718693 16951 leader_election.cc:304] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 
I20260709 12:28:49.719141 17059 raft_consensus.cc:2468] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 1.
I20260709 12:28:49.719576 17198 raft_consensus.cc:2804] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:49.723397 17201 tablet_bootstrap.cc:654] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.724416 17198 raft_consensus.cc:697] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Becoming Leader. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:49.726244 17197 tablet_bootstrap.cc:654] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.726437 17198 consensus_queue.cc:237] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.723618 17200 tablet_bootstrap.cc:492] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:49.719223 17150 raft_consensus.cc:515] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.731338 17200 ts_tablet_manager.cc:1403] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.046s	user 0.015s	sys 0.004s
I20260709 12:28:49.731768 17197 tablet_bootstrap.cc:492] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:49.732398 17197 ts_tablet_manager.cc:1403] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.032s	user 0.006s	sys 0.006s
I20260709 12:28:49.733193 17150 leader_election.cc:290] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:49.734759 17200 raft_consensus.cc:359] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.735056 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85e5a8ee06c4347b7d0206d20056e77" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:49.735517 17200 raft_consensus.cc:385] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.735534 17197 raft_consensus.cc:359] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.736037 17200 raft_consensus.cc:740] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.736050 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85e5a8ee06c4347b7d0206d20056e77" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:49.736845 16985 raft_consensus.cc:3060] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.737232 17197 raft_consensus.cc:385] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.736997 17200 consensus_queue.cc:260] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.737512 17197 raft_consensus.cc:740] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
W20260709 12:28:49.738138 17025 leader_election.cc:343] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.738886 17201 tablet_bootstrap.cc:492] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:49.739473 17201 ts_tablet_manager.cc:1403] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.041s	user 0.017s	sys 0.000s
I20260709 12:28:49.740502 17200 ts_tablet_manager.cc:1434] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.009s	user 0.003s	sys 0.004s
I20260709 12:28:49.741358 17200 tablet_bootstrap.cc:492] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:49.738991 17197 consensus_queue.cc:260] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.742745 17201 raft_consensus.cc:359] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.743570 17201 raft_consensus.cc:385] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.743976 17201 raft_consensus.cc:740] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.744999 17201 consensus_queue.cc:260] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.748239 17197 ts_tablet_manager.cc:1434] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.001s
I20260709 12:28:49.749053 17200 tablet_bootstrap.cc:654] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.749519 17197 tablet_bootstrap.cc:492] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:49.757604 17197 tablet_bootstrap.cc:654] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.759771 17201 ts_tablet_manager.cc:1434] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.000s
I20260709 12:28:49.758169 16985 raft_consensus.cc:2468] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 1.
I20260709 12:28:49.761786 17025 leader_election.cc:304] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 0d1d35a1ebcf415c9e3e8af85b90a24c
I20260709 12:28:49.764642 17150 raft_consensus.cc:2804] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:49.773969 17200 tablet_bootstrap.cc:492] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:49.774940 17200 ts_tablet_manager.cc:1403] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.034s	user 0.011s	sys 0.008s
I20260709 12:28:49.775353 17201 tablet_bootstrap.cc:492] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:49.778436 17200 raft_consensus.cc:359] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.779487 17200 raft_consensus.cc:385] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.779937 17200 raft_consensus.cc:740] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.780819 17200 consensus_queue.cc:260] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.782603 17150 raft_consensus.cc:697] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Becoming Leader. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:49.783686 17200 ts_tablet_manager.cc:1434] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:28:49.783888 17150 consensus_queue.cc:237] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.784977 17200 tablet_bootstrap.cc:492] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:49.786377 17201 tablet_bootstrap.cc:654] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.789783 17198 raft_consensus.cc:493] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.790303 17198 raft_consensus.cc:515] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.792326 17198 leader_election.cc:290] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:49.794667 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6c876e465a43fcb34c937877cd7afb" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:49.794714 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6c876e465a43fcb34c937877cd7afb" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:49.795895 16804 catalog_manager.cc:5697] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:49.802512 17200 tablet_bootstrap.cc:654] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.795907 17059 raft_consensus.cc:2468] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 0.
W20260709 12:28:49.796353 16951 leader_election.cc:343] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.809497 17197 tablet_bootstrap.cc:492] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:49.810207 17197 ts_tablet_manager.cc:1403] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.061s	user 0.019s	sys 0.008s
I20260709 12:28:49.813671 17197 raft_consensus.cc:359] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.816407 17197 raft_consensus.cc:385] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.805456 16807 catalog_manager.cc:5697] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:49.816303 16951 leader_election.cc:304] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 0d1d35a1ebcf415c9e3e8af85b90a24c
I20260709 12:28:49.817754 17198 raft_consensus.cc:2804] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.818100 17198 raft_consensus.cc:493] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.818500 17198 raft_consensus.cc:3060] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.819404 17197 raft_consensus.cc:740] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.820510 17197 consensus_queue.cc:260] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.828626 17201 tablet_bootstrap.cc:492] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:49.829120 17201 ts_tablet_manager.cc:1403] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.054s	user 0.017s	sys 0.028s
I20260709 12:28:49.830134 17198 raft_consensus.cc:515] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.831059 17200 tablet_bootstrap.cc:492] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:49.831624 17200 ts_tablet_manager.cc:1403] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.047s	user 0.018s	sys 0.004s
I20260709 12:28:49.831518 17201 raft_consensus.cc:359] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.832242 17201 raft_consensus.cc:385] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.832568 17201 raft_consensus.cc:740] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.833165 16908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6c876e465a43fcb34c937877cd7afb" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:49.833447 17198 leader_election.cc:290] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:49.825804 17197 ts_tablet_manager.cc:1434] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.015s	user 0.004s	sys 0.004s
I20260709 12:28:49.834240 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6c876e465a43fcb34c937877cd7afb" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:49.834935 17059 raft_consensus.cc:3060] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.835129 17197 tablet_bootstrap.cc:492] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
W20260709 12:28:49.837594 16951 leader_election.cc:343] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.839439 17201 consensus_queue.cc:260] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.840562 17150 raft_consensus.cc:493] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.841058 17150 raft_consensus.cc:515] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.840740 17200 raft_consensus.cc:359] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.841905 17200 raft_consensus.cc:385] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.842211 17200 raft_consensus.cc:740] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.842344 17201 ts_tablet_manager.cc:1434] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.013s	user 0.006s	sys 0.001s
I20260709 12:28:49.843360 17197 tablet_bootstrap.cc:654] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.843556 17201 tablet_bootstrap.cc:492] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:49.844401 17200 consensus_queue.cc:260] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.846364 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c674e30bf2564b9c86216ec9b8cc8de9" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:49.848142 17199 raft_consensus.cc:493] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.848655 17199 raft_consensus.cc:515] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.851614 17201 tablet_bootstrap.cc:654] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.852847 17200 ts_tablet_manager.cc:1434] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.021s	user 0.005s	sys 0.003s
W20260709 12:28:49.853682 17025 leader_election.cc:343] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.845523 16908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c674e30bf2564b9c86216ec9b8cc8de9" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:49.854696 16908 raft_consensus.cc:2468] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 0.
I20260709 12:28:49.854173 17200 tablet_bootstrap.cc:492] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:49.857931 17197 tablet_bootstrap.cc:492] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:49.858593 17197 ts_tablet_manager.cc:1403] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.024s	user 0.017s	sys 0.002s
I20260709 12:28:49.859602 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bc8bd564e64d69ad3a2f103c4cd5e2" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:49.860323 16985 raft_consensus.cc:2468] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 0.
I20260709 12:28:49.861444 16876 leader_election.cc:304] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 
I20260709 12:28:49.862402 17126 raft_consensus.cc:2804] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.862804 17126 raft_consensus.cc:493] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.862942 17025 leader_election.cc:304] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 51de95355c524c4cb143cf88d4c0a1e9
I20260709 12:28:49.865339 17220 raft_consensus.cc:2804] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.865757 17220 raft_consensus.cc:493] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.866096 17220 raft_consensus.cc:3060] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.866429 17200 tablet_bootstrap.cc:654] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.863255 17126 raft_consensus.cc:3060] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.866143 17197 raft_consensus.cc:359] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.875319 17197 raft_consensus.cc:385] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.875669 17197 raft_consensus.cc:740] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.879136 17199 leader_election.cc:290] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:49.889288 17199 raft_consensus.cc:493] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.890033 17199 raft_consensus.cc:515] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.843443 17150 leader_election.cc:290] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:49.881088 17057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bc8bd564e64d69ad3a2f103c4cd5e2" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:49.891716 17057 raft_consensus.cc:2468] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 0.
I20260709 12:28:49.893823 17197 consensus_queue.cc:260] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.896457 17197 ts_tablet_manager.cc:1434] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.037s	user 0.019s	sys 0.003s
I20260709 12:28:49.897567 17197 tablet_bootstrap.cc:492] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:49.898113 17199 leader_election.cc:290] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:49.904183 17198 raft_consensus.cc:493] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.904747 17197 tablet_bootstrap.cc:654] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.906186 17198 raft_consensus.cc:515] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.908784 17198 leader_election.cc:290] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:49.910818 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4593f72a2a24c8ab967901c66587a21" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:49.911628 16910 raft_consensus.cc:2468] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 0.
I20260709 12:28:49.913125 16951 leader_election.cc:304] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 
I20260709 12:28:49.912968 17126 raft_consensus.cc:515] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.916783 17126 leader_election.cc:290] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 election: Requested vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:49.916940 17057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4593f72a2a24c8ab967901c66587a21" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:49.914728 17198 raft_consensus.cc:2804] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.919123 17198 raft_consensus.cc:493] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.919504 17198 raft_consensus.cc:3060] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:28:49.920215 16951 leader_election.cc:343] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.924808 17220 raft_consensus.cc:515] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.931531 17059 raft_consensus.cc:2468] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 1.
I20260709 12:28:49.932825 17198 raft_consensus.cc:515] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.938452 16984 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85e5a8ee06c4347b7d0206d20056e77" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:49.938956 16951 leader_election.cc:304] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 0d1d35a1ebcf415c9e3e8af85b90a24c
I20260709 12:28:49.939328 16984 raft_consensus.cc:2393] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in current term 1: Already voted for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in this term.
I20260709 12:28:49.934046 17105 raft_consensus.cc:493] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:49.934930 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c674e30bf2564b9c86216ec9b8cc8de9" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:49.935621 17220 leader_election.cc:290] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:49.942061 17105 raft_consensus.cc:515] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
W20260709 12:28:49.946906 17025 leader_election.cc:343] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:49.947762 17105 leader_election.cc:290] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:49.948411 17105 raft_consensus.cc:2804] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:49.950753 16908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edce4cea96b4bb7bde070ecc69f01d4" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:49.951489 16908 raft_consensus.cc:2468] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 0.
I20260709 12:28:49.953744 17057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edce4cea96b4bb7bde070ecc69f01d4" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:49.954437 17057 raft_consensus.cc:2468] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 0.
I20260709 12:28:49.955318 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85e5a8ee06c4347b7d0206d20056e77" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:49.948880 17105 raft_consensus.cc:697] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Becoming Leader. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:49.964433 16908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4593f72a2a24c8ab967901c66587a21" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:49.964344 17105 consensus_queue.cc:237] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.964802 17057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bc8bd564e64d69ad3a2f103c4cd5e2" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:49.965173 16908 raft_consensus.cc:3060] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.965445 17057 raft_consensus.cc:3060] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.958266 17198 leader_election.cc:290] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:49.960801 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bc8bd564e64d69ad3a2f103c4cd5e2" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:49.961999 17197 tablet_bootstrap.cc:492] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:49.969058 17197 ts_tablet_manager.cc:1403] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.072s	user 0.007s	sys 0.015s
I20260709 12:28:49.969416 16909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c674e30bf2564b9c86216ec9b8cc8de9" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:49.970088 16909 raft_consensus.cc:3060] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.971954 17197 raft_consensus.cc:359] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.972723 17197 raft_consensus.cc:385] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:49.973023 17197 raft_consensus.cc:740] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:49.973853 17197 consensus_queue.cc:260] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:49.975732 17197 ts_tablet_manager.cc:1434] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:28:49.976989 17197 tablet_bootstrap.cc:492] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Bootstrap starting.
I20260709 12:28:49.971858 16985 raft_consensus.cc:3060] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.978742 16909 raft_consensus.cc:2468] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 1.
I20260709 12:28:49.979530 16876 leader_election.cc:304] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c; no voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8
I20260709 12:28:49.981088 17126 raft_consensus.cc:3060] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:49.983106 17197 tablet_bootstrap.cc:654] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:49.988776 16908 raft_consensus.cc:2468] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 1.
I20260709 12:28:49.990727 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4593f72a2a24c8ab967901c66587a21" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:49.991885 17126 raft_consensus.cc:2749] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:49.992288 16951 leader_election.cc:304] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:49.993074 17201 tablet_bootstrap.cc:492] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:49.993602 17201 ts_tablet_manager.cc:1403] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.150s	user 0.047s	sys 0.030s
I20260709 12:28:49.993975 17025 leader_election.cc:304] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 51de95355c524c4cb143cf88d4c0a1e9
I20260709 12:28:49.995244 17220 raft_consensus.cc:2804] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:49.996292 17220 raft_consensus.cc:697] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Becoming Leader. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:49.996488 17198 raft_consensus.cc:2804] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:49.996919 17198 raft_consensus.cc:493] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:49.997149 17200 tablet_bootstrap.cc:492] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:49.997762 17200 ts_tablet_manager.cc:1403] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.144s	user 0.007s	sys 0.006s
I20260709 12:28:49.997107 17220 consensus_queue.cc:237] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.000594 16806 catalog_manager.cc:5697] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.003511 17200 raft_consensus.cc:359] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.005916 17200 raft_consensus.cc:385] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.006158 17200 raft_consensus.cc:740] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
W20260709 12:28:49.995224 16951 leader_election.cc:343] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:28:50.002628 17198 raft_consensus.cc:3060] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.012046 16985 raft_consensus.cc:2468] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 1.
I20260709 12:28:50.014307 16951 leader_election.cc:304] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 6f55d37b709d49a2b523a88c4fc5acf8
I20260709 12:28:50.018415 17105 raft_consensus.cc:2804] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:50.018952 17105 raft_consensus.cc:697] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Becoming Leader. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:50.019050 17200 consensus_queue.cc:260] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.020051 17105 consensus_queue.cc:237] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.017364 17057 raft_consensus.cc:2468] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 1.
I20260709 12:28:50.024766 16806 catalog_manager.cc:5697] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67). New cstate: current_term: 1 leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:50.031126 17198 raft_consensus.cc:515] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.032030 16876 leader_election.cc:304] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 
I20260709 12:28:50.033149 17201 raft_consensus.cc:359] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.035655 17197 tablet_bootstrap.cc:492] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c: No bootstrap required, opened a new log
I20260709 12:28:50.037484 17201 raft_consensus.cc:385] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.037786 17197 ts_tablet_manager.cc:1403] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent bootstrapping tablet: real 0.061s	user 0.012s	sys 0.022s
I20260709 12:28:50.038391 17200 ts_tablet_manager.cc:1434] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.040s	user 0.003s	sys 0.009s
I20260709 12:28:50.037892 17201 raft_consensus.cc:740] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.039533 17200 tablet_bootstrap.cc:492] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9: Bootstrap starting.
I20260709 12:28:50.040380 17201 consensus_queue.cc:260] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.042989 17126 raft_consensus.cc:2804] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:50.043689 17126 raft_consensus.cc:697] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Becoming Leader. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:50.044638 17126 consensus_queue.cc:237] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.046301 17200 tablet_bootstrap.cc:654] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:50.051155 17198 leader_election.cc:290] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:50.049830 17197 raft_consensus.cc:359] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.052500 17197 raft_consensus.cc:385] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.053112 17197 raft_consensus.cc:740] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.054611 16908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edce4cea96b4bb7bde070ecc69f01d4" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:50.055450 16908 raft_consensus.cc:3060] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.055145 17197 consensus_queue.cc:260] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.057047 16804 catalog_manager.cc:5697] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65). New cstate: current_term: 1 leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.064141 17057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edce4cea96b4bb7bde070ecc69f01d4" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:50.065073 17057 raft_consensus.cc:3060] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.067269 17200 tablet_bootstrap.cc:492] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9: No bootstrap required, opened a new log
I20260709 12:28:50.067788 17200 ts_tablet_manager.cc:1403] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent bootstrapping tablet: real 0.028s	user 0.010s	sys 0.006s
I20260709 12:28:50.069936 17200 raft_consensus.cc:359] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.070500 17200 raft_consensus.cc:385] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.070765 17200 raft_consensus.cc:740] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.071413 17200 consensus_queue.cc:260] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.073297 17197 ts_tablet_manager.cc:1434] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Time spent starting tablet: real 0.035s	user 0.006s	sys 0.000s
I20260709 12:28:50.073616 17200 ts_tablet_manager.cc:1434] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.000s
I20260709 12:28:50.074707 17232 raft_consensus.cc:493] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.075389 17232 raft_consensus.cc:515] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.077811 17232 leader_election.cc:290] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:50.079828 17057 raft_consensus.cc:2468] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 1.
I20260709 12:28:50.080631 17198 raft_consensus.cc:493] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.081341 16951 leader_election.cc:304] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:50.081245 17198 raft_consensus.cc:515] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.082383 17239 raft_consensus.cc:2804] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:50.083030 17239 raft_consensus.cc:697] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Becoming Leader. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:50.083473 17198 leader_election.cc:290] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:50.084072 17239 consensus_queue.cc:237] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.083760 17201 ts_tablet_manager.cc:1434] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.090s	user 0.007s	sys 0.003s
I20260709 12:28:50.086615 16908 raft_consensus.cc:2468] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 1.
I20260709 12:28:50.087945 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6c876e465a43fcb34c937877cd7afb" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:50.088725 17201 tablet_bootstrap.cc:492] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:50.091523 17057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6c876e465a43fcb34c937877cd7afb" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:50.091733 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f2d4ba10a04aff94f41e73b0d49184" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:50.092391 17059 raft_consensus.cc:2468] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 0.
I20260709 12:28:50.094807 16951 leader_election.cc:304] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:50.092371 17057 raft_consensus.cc:2393] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in current term 1: Already voted for candidate 51de95355c524c4cb143cf88d4c0a1e9 in this term.
I20260709 12:28:50.093866 16908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f2d4ba10a04aff94f41e73b0d49184" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:50.097210 16908 raft_consensus.cc:2468] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 0.
I20260709 12:28:50.096858 17198 raft_consensus.cc:2804] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:50.097384 17201 tablet_bootstrap.cc:654] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:50.097779 17198 raft_consensus.cc:493] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:50.098237 17198 raft_consensus.cc:3060] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.103227 16804 catalog_manager.cc:5697] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.107132 17198 raft_consensus.cc:515] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.109422 17198 leader_election.cc:290] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:50.110641 16876 leader_election.cc:304] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c; no voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8
I20260709 12:28:50.112646 16908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f2d4ba10a04aff94f41e73b0d49184" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:50.113530 16908 raft_consensus.cc:3060] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.114319 17057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92f2d4ba10a04aff94f41e73b0d49184" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:50.115026 17057 raft_consensus.cc:3060] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.115932 17201 tablet_bootstrap.cc:492] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:50.116851 17201 ts_tablet_manager.cc:1403] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.006s
I20260709 12:28:50.119814 17201 raft_consensus.cc:359] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.120532 17201 raft_consensus.cc:385] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.120796 17201 raft_consensus.cc:740] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.121102 17057 raft_consensus.cc:2468] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 1.
I20260709 12:28:50.121511 16908 raft_consensus.cc:2468] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 1.
I20260709 12:28:50.121480 17201 consensus_queue.cc:260] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.121929 17126 raft_consensus.cc:3060] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.122875 16951 leader_election.cc:304] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:50.124143 17201 ts_tablet_manager.cc:1434] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:28:50.125399 17201 tablet_bootstrap.cc:492] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8: Bootstrap starting.
I20260709 12:28:50.130411 17126 raft_consensus.cc:2749] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:50.133103 17201 tablet_bootstrap.cc:654] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8: Neither blocks nor log segments found. Creating new log.
I20260709 12:28:50.132269 17198 raft_consensus.cc:2804] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:50.134271 17198 raft_consensus.cc:697] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Becoming Leader. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:50.135221 17198 consensus_queue.cc:237] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.135227 16806 catalog_manager.cc:5697] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.142052 17201 tablet_bootstrap.cc:492] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8: No bootstrap required, opened a new log
I20260709 12:28:50.142576 17201 ts_tablet_manager.cc:1403] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent bootstrapping tablet: real 0.017s	user 0.009s	sys 0.007s
I20260709 12:28:50.145670 17201 raft_consensus.cc:359] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.146276 17201 raft_consensus.cc:385] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:28:50.146584 17201 raft_consensus.cc:740] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Initialized, Role: FOLLOWER
I20260709 12:28:50.147258 17201 consensus_queue.cc:260] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.149359 17201 ts_tablet_manager.cc:1434] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8: Time spent starting tablet: real 0.006s	user 0.004s	sys 0.000s
I20260709 12:28:50.152931 16806 catalog_manager.cc:5697] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.252091 17126 raft_consensus.cc:493] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.252583 17126 raft_consensus.cc:515] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.254419 17126 leader_election.cc:290] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:50.255241 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc3b0d10fc4e43b94892335f006545" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:50.255519 17057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc3b0d10fc4e43b94892335f006545" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" is_pre_election: true
I20260709 12:28:50.255844 16985 raft_consensus.cc:2468] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 0.
I20260709 12:28:50.256143 17057 raft_consensus.cc:2468] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 0.
I20260709 12:28:50.256775 16876 leader_election.cc:304] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 
I20260709 12:28:50.257426 17126 raft_consensus.cc:2804] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:28:50.257802 17126 raft_consensus.cc:493] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:28:50.258064 17126 raft_consensus.cc:3060] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.262820 17126 raft_consensus.cc:515] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.264369 17126 leader_election.cc:290] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 election: Requested vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:50.265278 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc3b0d10fc4e43b94892335f006545" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:50.265410 17057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc3b0d10fc4e43b94892335f006545" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:50.265888 16985 raft_consensus.cc:3060] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.265940 17057 raft_consensus.cc:3060] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.271330 17057 raft_consensus.cc:2468] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 1.
I20260709 12:28:50.273329 16876 leader_election.cc:304] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:50.273291 16985 raft_consensus.cc:2468] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 1.
I20260709 12:28:50.274513 17126 raft_consensus.cc:2804] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:28:50.275255 17126 raft_consensus.cc:697] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Becoming Leader. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:50.276072 17126 consensus_queue.cc:237] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.277704 17198 consensus_queue.cc:1048] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.285236 16804 catalog_manager.cc:5697] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c reported cstate change: term changed from 0 to 1, leader changed from <none> to 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65). New cstate: current_term: 1 leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.294924 17198 consensus_queue.cc:1048] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.362902 17220 consensus_queue.cc:1048] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.363590 17198 consensus_queue.cc:1048] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.376358 17150 consensus_queue.cc:1048] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.382179 17239 consensus_queue.cc:1048] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.410712 17220 consensus_queue.cc:1048] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.423899 16985 raft_consensus.cc:3060] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.433223 17150 consensus_queue.cc:1048] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.451944 17150 raft_consensus.cc:493] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:28:50.452374 17150 raft_consensus.cc:515] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.454384 17150 leader_election.cc:290] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:50.454881 16908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4593f72a2a24c8ab967901c66587a21" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" is_pre_election: true
I20260709 12:28:50.455289 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "d4593f72a2a24c8ab967901c66587a21" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9" is_pre_election: true
I20260709 12:28:50.455704 16908 raft_consensus.cc:2393] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 6f55d37b709d49a2b523a88c4fc5acf8 in current term 1: Already voted for candidate 51de95355c524c4cb143cf88d4c0a1e9 in this term.
I20260709 12:28:50.456876 17025 leader_election.cc:304] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9
I20260709 12:28:50.457522 17150 raft_consensus.cc:3060] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:28:50.462947 17150 raft_consensus.cc:2749] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:28:50.474020 17126 consensus_queue.cc:1048] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.484375 17126 consensus_queue.cc:1048] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.496016 16985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c3c037275b364555b53fa733e4d8f1e7"
dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
mode: GRACEFUL
new_leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
 from {username='slave'} at 127.0.0.1:53674
I20260709 12:28:50.496788 16985 raft_consensus.cc:606] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Received request to transfer leadership to TS 0d1d35a1ebcf415c9e3e8af85b90a24c
I20260709 12:28:50.502933 16985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf6c876e465a43fcb34c937877cd7afb"
dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
mode: GRACEFUL
new_leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
 from {username='slave'} at 127.0.0.1:53674
I20260709 12:28:50.503450 16985 raft_consensus.cc:606] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Received request to transfer leadership to TS 0d1d35a1ebcf415c9e3e8af85b90a24c
I20260709 12:28:50.508337 16985 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8edce4cea96b4bb7bde070ecc69f01d4"
dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
mode: GRACEFUL
new_leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
 from {username='slave'} at 127.0.0.1:53674
I20260709 12:28:50.508806 16985 raft_consensus.cc:606] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Received request to transfer leadership to TS 0d1d35a1ebcf415c9e3e8af85b90a24c
I20260709 12:28:50.513645 17057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c674e30bf2564b9c86216ec9b8cc8de9"
dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
mode: GRACEFUL
new_leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
 from {username='slave'} at 127.0.0.1:49936
I20260709 12:28:50.514276 17057 raft_consensus.cc:606] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Received request to transfer leadership to TS 0d1d35a1ebcf415c9e3e8af85b90a24c
I20260709 12:28:50.519904 16908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35bc8bd564e64d69ad3a2f103c4cd5e2"
dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
mode: GRACEFUL
new_leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
 from {username='slave'} at 127.0.0.1:34928
I20260709 12:28:50.520443 16908 raft_consensus.cc:606] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Received request to transfer leadership to TS 51de95355c524c4cb143cf88d4c0a1e9
I20260709 12:28:50.525847 17057 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "f85e5a8ee06c4347b7d0206d20056e77"
dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
mode: GRACEFUL
new_leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
 from {username='slave'} at 127.0.0.1:49936
I20260709 12:28:50.526571 17057 raft_consensus.cc:606] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Received request to transfer leadership to TS 51de95355c524c4cb143cf88d4c0a1e9
I20260709 12:28:50.537904 16908 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "70bc3b0d10fc4e43b94892335f006545"
dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
mode: GRACEFUL
new_leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
 from {username='slave'} at 127.0.0.1:34928
I20260709 12:28:50.538546 16908 raft_consensus.cc:606] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Received request to transfer leadership to TS 6f55d37b709d49a2b523a88c4fc5acf8
I20260709 12:28:50.546765 17239 consensus_queue.cc:1048] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.553188 17198 raft_consensus.cc:993] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9: : Instructing follower 0d1d35a1ebcf415c9e3e8af85b90a24c to start an election
I20260709 12:28:50.553862 17234 raft_consensus.cc:1081] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Signalling peer 0d1d35a1ebcf415c9e3e8af85b90a24c to start an election
I20260709 12:28:50.556340 16909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8edce4cea96b4bb7bde070ecc69f01d4"
dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
 from {username='slave'} at 127.0.0.1:48518
I20260709 12:28:50.556978 16909 raft_consensus.cc:493] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:50.557345 16909 raft_consensus.cc:3060] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.563060 17234 consensus_queue.cc:1048] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:28:50.564679 16909 raft_consensus.cc:515] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.565749 16908 raft_consensus.cc:1240] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Rejecting Update request from peer 51de95355c524c4cb143cf88d4c0a1e9 for earlier term 1. Current term is 2. Ops: []
I20260709 12:28:50.568562 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edce4cea96b4bb7bde070ecc69f01d4" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:50.568857 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8edce4cea96b4bb7bde070ecc69f01d4" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:50.569280 16985 raft_consensus.cc:3055] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:50.569416 17234 consensus_queue.cc:1059] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.569795 16985 raft_consensus.cc:740] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:50.568599 16909 leader_election.cc:290] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 2 election: Requested vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:50.570653 16985 consensus_queue.cc:260] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.571525 16985 raft_consensus.cc:3060] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.577493 16985 raft_consensus.cc:2468] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 2.
W20260709 12:28:50.577998 17198 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:28:50.578648 16876 leader_election.cc:304] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 6f55d37b709d49a2b523a88c4fc5acf8
I20260709 12:28:50.579774 17126 raft_consensus.cc:2804] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:50.580143 17126 raft_consensus.cc:697] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Becoming Leader. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:50.580751 17126 consensus_queue.cc:237] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.586856 16807 catalog_manager.cc:5697] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c reported cstate change: term changed from 1 to 2, leader changed from 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66) to 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65). New cstate: current_term: 2 leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.604945 17198 consensus_queue.cc:1048] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.615365 17198 consensus_queue.cc:1048] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.656112 17126 consensus_queue.cc:1048] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.669525 17232 consensus_queue.cc:1048] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.677955 17199 raft_consensus.cc:993] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c: : Instructing follower 6f55d37b709d49a2b523a88c4fc5acf8 to start an election
I20260709 12:28:50.678447 17232 raft_consensus.cc:1081] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Signalling peer 6f55d37b709d49a2b523a88c4fc5acf8 to start an election
I20260709 12:28:50.680231 17057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "70bc3b0d10fc4e43b94892335f006545"
dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
 from {username='slave'} at 127.0.0.1:48040
I20260709 12:28:50.680821 17057 raft_consensus.cc:493] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:50.681118 17057 raft_consensus.cc:3060] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.686589 17057 raft_consensus.cc:515] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.688292 17057 leader_election.cc:290] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 2 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:50.689213 16909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc3b0d10fc4e43b94892335f006545" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:50.689565 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "70bc3b0d10fc4e43b94892335f006545" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:50.689970 16909 raft_consensus.cc:3055] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:50.690114 16985 raft_consensus.cc:3060] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.690359 16909 raft_consensus.cc:740] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:50.691244 16909 consensus_queue.cc:260] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.692507 16909 raft_consensus.cc:3060] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.697448 16985 raft_consensus.cc:2468] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 2.
I20260709 12:28:50.698758 17025 leader_election.cc:304] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:50.699537 17150 raft_consensus.cc:2804] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:50.699483 16909 raft_consensus.cc:2468] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 2.
I20260709 12:28:50.700305 17150 raft_consensus.cc:697] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 LEADER]: Becoming Leader. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:50.701179 17150 consensus_queue.cc:237] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.707860 16806 catalog_manager.cc:5697] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 reported cstate change: term changed from 1 to 2, leader changed from 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65) to 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67). New cstate: current_term: 2 leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:50.727226 17198 consensus_queue.cc:1048] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.737726 17105 consensus_queue.cc:1048] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:28:50.802030 17234 raft_consensus.cc:993] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9: : Instructing follower 0d1d35a1ebcf415c9e3e8af85b90a24c to start an election
I20260709 12:28:50.802502 17234 raft_consensus.cc:1081] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Signalling peer 0d1d35a1ebcf415c9e3e8af85b90a24c to start an election
I20260709 12:28:50.803859 16909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c3c037275b364555b53fa733e4d8f1e7"
dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
 from {username='slave'} at 127.0.0.1:48518
I20260709 12:28:50.804279 16909 raft_consensus.cc:493] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:50.804613 16909 raft_consensus.cc:3060] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.810267 16909 raft_consensus.cc:515] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.812198 16909 leader_election.cc:290] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 2 election: Requested vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:50.812704 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c037275b364555b53fa733e4d8f1e7" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:50.813225 17057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c3c037275b364555b53fa733e4d8f1e7" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:50.813249 16985 raft_consensus.cc:3055] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:50.813854 16985 raft_consensus.cc:740] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:50.813865 17057 raft_consensus.cc:3060] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.814777 16985 consensus_queue.cc:260] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.816052 16985 raft_consensus.cc:3060] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.820384 16985 raft_consensus.cc:2468] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 2.
I20260709 12:28:50.821071 17057 raft_consensus.cc:2468] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 2.
I20260709 12:28:50.821293 16876 leader_election.cc:304] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 
I20260709 12:28:50.822033 17232 raft_consensus.cc:2804] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:50.822557 17232 raft_consensus.cc:697] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Becoming Leader. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:50.823346 17232 consensus_queue.cc:237] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.829394 16806 catalog_manager.cc:5697] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c reported cstate change: term changed from 1 to 2, leader changed from 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66) to 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65). New cstate: current_term: 2 leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.868724 17199 raft_consensus.cc:993] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c: : Instructing follower 51de95355c524c4cb143cf88d4c0a1e9 to start an election
I20260709 12:28:50.869153 17232 raft_consensus.cc:1081] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Signalling peer 51de95355c524c4cb143cf88d4c0a1e9 to start an election
I20260709 12:28:50.870819 16985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35bc8bd564e64d69ad3a2f103c4cd5e2"
dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
 from {username='slave'} at 127.0.0.1:38432
I20260709 12:28:50.871301 16985 raft_consensus.cc:493] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:50.871549 16985 raft_consensus.cc:3060] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.876047 16985 raft_consensus.cc:515] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.877534 16985 leader_election.cc:290] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 2 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:50.878551 16909 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bc8bd564e64d69ad3a2f103c4cd5e2" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:50.878760 17057 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bc8bd564e64d69ad3a2f103c4cd5e2" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:50.879117 16909 raft_consensus.cc:3055] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:50.879299 17057 raft_consensus.cc:3060] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.879437 16909 raft_consensus.cc:740] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:50.880167 16909 consensus_queue.cc:260] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.881244 16909 raft_consensus.cc:3060] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.885319 17057 raft_consensus.cc:2468] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 2.
I20260709 12:28:50.887697 16951 leader_election.cc:304] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:50.888530 17105 raft_consensus.cc:2804] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:50.889012 17105 raft_consensus.cc:697] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Becoming Leader. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:50.889858 17105 consensus_queue.cc:237] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.890576 16909 raft_consensus.cc:2468] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 2.
I20260709 12:28:50.896782 16806 catalog_manager.cc:5697] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 reported cstate change: term changed from 1 to 2, leader changed from 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65) to 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.921555 17239 raft_consensus.cc:993] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9: : Instructing follower 0d1d35a1ebcf415c9e3e8af85b90a24c to start an election
I20260709 12:28:50.922009 17105 raft_consensus.cc:1081] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Signalling peer 0d1d35a1ebcf415c9e3e8af85b90a24c to start an election
I20260709 12:28:50.923561 16909 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf6c876e465a43fcb34c937877cd7afb"
dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
 from {username='slave'} at 127.0.0.1:48518
I20260709 12:28:50.924044 16909 raft_consensus.cc:493] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:50.924300 16909 raft_consensus.cc:3060] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.928160 17259 raft_consensus.cc:993] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8: : Instructing follower 0d1d35a1ebcf415c9e3e8af85b90a24c to start an election
I20260709 12:28:50.928691 17150 raft_consensus.cc:1081] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Signalling peer 0d1d35a1ebcf415c9e3e8af85b90a24c to start an election
I20260709 12:28:50.930431 16908 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c674e30bf2564b9c86216ec9b8cc8de9"
dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
 from {username='slave'} at 127.0.0.1:48528
I20260709 12:28:50.931027 16908 raft_consensus.cc:493] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:50.931416 16908 raft_consensus.cc:3060] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.931149 16909 raft_consensus.cc:515] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.933341 16909 leader_election.cc:290] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 2 election: Requested vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:50.937377 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6c876e465a43fcb34c937877cd7afb" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:50.937601 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6c876e465a43fcb34c937877cd7afb" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:50.938004 16985 raft_consensus.cc:3055] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:50.938267 17059 raft_consensus.cc:3060] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.938421 16985 raft_consensus.cc:740] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:50.939195 16985 consensus_queue.cc:260] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.940351 16985 raft_consensus.cc:3060] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.944703 17059 raft_consensus.cc:2468] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 2.
I20260709 12:28:50.945453 16908 raft_consensus.cc:515] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.945798 16876 leader_election.cc:304] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:50.946590 16985 raft_consensus.cc:2468] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 2.
I20260709 12:28:50.946705 17232 raft_consensus.cc:2804] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:50.947297 17232 raft_consensus.cc:697] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Becoming Leader. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:50.947607 16908 leader_election.cc:290] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 2 election: Requested vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:50.948266 16983 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c674e30bf2564b9c86216ec9b8cc8de9" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:50.948143 17232 consensus_queue.cc:237] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.949007 16983 raft_consensus.cc:3060] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.949242 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c674e30bf2564b9c86216ec9b8cc8de9" candidate_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:50.949888 17059 raft_consensus.cc:3055] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:50.950188 17059 raft_consensus.cc:740] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:50.951025 17059 consensus_queue.cc:260] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.952215 17059 raft_consensus.cc:3060] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.955399 16806 catalog_manager.cc:5697] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c reported cstate change: term changed from 1 to 2, leader changed from 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66) to 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65). New cstate: current_term: 2 leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.956192 16983 raft_consensus.cc:2468] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 2.
I20260709 12:28:50.958956 17059 raft_consensus.cc:2468] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0d1d35a1ebcf415c9e3e8af85b90a24c in term 2.
I20260709 12:28:50.963523 16876 leader_election.cc:304] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 
I20260709 12:28:50.965421 17259 raft_consensus.cc:993] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8: : Instructing follower 51de95355c524c4cb143cf88d4c0a1e9 to start an election
I20260709 12:28:50.965891 17271 raft_consensus.cc:1081] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Signalling peer 51de95355c524c4cb143cf88d4c0a1e9 to start an election
I20260709 12:28:50.967578 16985 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "f85e5a8ee06c4347b7d0206d20056e77"
dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
 from {username='slave'} at 127.0.0.1:38440
I20260709 12:28:50.968086 16985 raft_consensus.cc:493] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:50.968434 16985 raft_consensus.cc:3060] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.968869 17232 raft_consensus.cc:2804] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:50.969558 17232 raft_consensus.cc:697] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Becoming Leader. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:50.970345 17232 consensus_queue.cc:237] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.974855 16985 raft_consensus.cc:515] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.976425 16985 leader_election.cc:290] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 2 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67:40303)
I20260709 12:28:50.977195 16908 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85e5a8ee06c4347b7d0206d20056e77" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:50.977571 17059 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f85e5a8ee06c4347b7d0206d20056e77" candidate_uuid: "51de95355c524c4cb143cf88d4c0a1e9" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
I20260709 12:28:50.977849 16908 raft_consensus.cc:3060] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.978152 17059 raft_consensus.cc:3055] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:28:50.978440 17059 raft_consensus.cc:740] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:50.979032 16806 catalog_manager.cc:5697] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c reported cstate change: term changed from 1 to 2, leader changed from 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67) to 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65). New cstate: current_term: 2 leader_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:50.979290 17059 consensus_queue.cc:260] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.980537 17059 raft_consensus.cc:3060] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:50.985001 16908 raft_consensus.cc:2468] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 2.
I20260709 12:28:50.986377 16951 leader_election.cc:304] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 51de95355c524c4cb143cf88d4c0a1e9; no voters: 
I20260709 12:28:50.987191 17105 raft_consensus.cc:2804] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:28:50.987195 17059 raft_consensus.cc:2468] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51de95355c524c4cb143cf88d4c0a1e9 in term 2.
I20260709 12:28:50.987733 17105 raft_consensus.cc:697] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Becoming Leader. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:50.988485 17105 consensus_queue.cc:237] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:50.994990 16806 catalog_manager.cc:5697] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 reported cstate change: term changed from 1 to 2, leader changed from 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67) to 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "51de95355c524c4cb143cf88d4c0a1e9" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:51.035497 16985 raft_consensus.cc:1275] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Refusing update from remote peer 0d1d35a1ebcf415c9e3e8af85b90a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.036770 17232 consensus_queue.cc:1048] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.045748 17059 raft_consensus.cc:3060] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:28:51.053205 17059 raft_consensus.cc:1275] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Refusing update from remote peer 0d1d35a1ebcf415c9e3e8af85b90a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.054497 17126 consensus_queue.cc:1048] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.243959 16908 raft_consensus.cc:1275] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Refusing update from remote peer 6f55d37b709d49a2b523a88c4fc5acf8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.245281 17271 consensus_queue.cc:1048] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.253183 16985 raft_consensus.cc:1275] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Refusing update from remote peer 6f55d37b709d49a2b523a88c4fc5acf8: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.255589 17150 consensus_queue.cc:1048] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.313751 17059 raft_consensus.cc:1275] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Refusing update from remote peer 51de95355c524c4cb143cf88d4c0a1e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.315234 17239 consensus_queue.cc:1048] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.323220 16908 raft_consensus.cc:1275] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Refusing update from remote peer 51de95355c524c4cb143cf88d4c0a1e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.325188 17234 consensus_queue.cc:1048] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.372680 16983 raft_consensus.cc:1275] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Refusing update from remote peer 0d1d35a1ebcf415c9e3e8af85b90a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.374013 17126 consensus_queue.cc:1048] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.381829 17059 raft_consensus.cc:1275] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Refusing update from remote peer 0d1d35a1ebcf415c9e3e8af85b90a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.383185 17199 consensus_queue.cc:1048] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.389870 17059 raft_consensus.cc:1275] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Refusing update from remote peer 0d1d35a1ebcf415c9e3e8af85b90a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.392197 17126 consensus_queue.cc:1048] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.399304 16985 raft_consensus.cc:1275] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Refusing update from remote peer 0d1d35a1ebcf415c9e3e8af85b90a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.402081 17126 consensus_queue.cc:1048] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.406708 16908 raft_consensus.cc:1275] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Refusing update from remote peer 51de95355c524c4cb143cf88d4c0a1e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.409245 17239 consensus_queue.cc:1048] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.419258 17059 raft_consensus.cc:1275] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Refusing update from remote peer 51de95355c524c4cb143cf88d4c0a1e9: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.420706 17234 consensus_queue.cc:1048] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.427892 17057 raft_consensus.cc:1275] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Refusing update from remote peer 0d1d35a1ebcf415c9e3e8af85b90a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.437155 17232 consensus_queue.cc:1048] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:51.438181 16985 raft_consensus.cc:1275] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Refusing update from remote peer 0d1d35a1ebcf415c9e3e8af85b90a24c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:28:51.439707 17232 consensus_queue.cc:1048] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:28:53.541970 16807 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:34520:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:28:53.562865 16807 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:34520:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:28:53.587661  4821 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
W20260709 12:28:53.792624 17302 log.cc:927] Time spent T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8: Append to log took a long time: real 0.072s	user 0.000s	sys 0.002s
W20260709 12:28:53.814874 17318 log.cc:927] Time spent T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9: Append to log took a long time: real 0.059s	user 0.001s	sys 0.000s
W20260709 12:28:53.954654 16951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:45885, user_credentials={real_user=slave}} blocked reactor thread for 137595us
I20260709 12:28:53.955894 17338 tablet.cc:1724] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.973104 17341 tablet.cc:1724] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.954619 17337 tablet.cc:1724] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.982589 17340 tablet.cc:1724] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.984233 17335 tablet.cc:1724] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:28:53.998147 17085 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:70bc3b0d10fc4e43b94892335f006545)
I20260709 12:28:54.002702 17344 tablet.cc:1724] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:28:54.021262 17325 log.cc:927] Time spent T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Append to log took a long time: real 0.094s	user 0.001s	sys 0.000s
I20260709 12:28:54.023888 17337 tablet.cc:1724] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.029358 16983 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "35bc8bd564e64d69ad3a2f103c4cd5e2"
dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
mode: GRACEFUL
new_leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
 from {username='slave'} at 127.0.0.1:53678
I20260709 12:28:54.030193 16983 raft_consensus.cc:606] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Received request to transfer leadership to TS 6f55d37b709d49a2b523a88c4fc5acf8
I20260709 12:28:53.942746 17332 tablet.cc:1724] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:53.958725 17331 tablet.cc:1724] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.058300 17281 raft_consensus.cc:993] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9: : Instructing follower 6f55d37b709d49a2b523a88c4fc5acf8 to start an election
I20260709 12:28:54.058821 17281 raft_consensus.cc:1081] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Signalling peer 6f55d37b709d49a2b523a88c4fc5acf8 to start an election
I20260709 12:28:54.063040 17349 tablet.cc:1724] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.063406 17346 tablet.cc:1724] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.065033 17344 tablet.cc:1724] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:28:54.077188 17085 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:70bc3b0d10fc4e43b94892335f006545)
W20260709 12:28:54.080300 17085 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:70bc3b0d10fc4e43b94892335f006545)
I20260709 12:28:54.092577 17350 tablet.cc:1724] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.094579 17057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "35bc8bd564e64d69ad3a2f103c4cd5e2"
dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
 from {username='slave'} at 127.0.0.1:48026
I20260709 12:28:54.095415 17057 raft_consensus.cc:493] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:54.096084 17057 raft_consensus.cc:3060] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:54.105360 17326 log.cc:927] Time spent T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Append to log took a long time: real 0.117s	user 0.001s	sys 0.000s
I20260709 12:28:54.104023 17347 tablet.cc:1724] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.125808 17340 tablet.cc:1724] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.126605 17350 tablet.cc:1724] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.131788 17057 raft_consensus.cc:515] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:54.111092 17338 tablet.cc:1724] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.142037 17331 tablet.cc:1724] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.146250 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bc8bd564e64d69ad3a2f103c4cd5e2" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:54.154105 16910 raft_consensus.cc:3060] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:54.153398 17057 leader_election.cc:290] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 3 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:54.174837 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "35bc8bd564e64d69ad3a2f103c4cd5e2" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:54.175493 16985 raft_consensus.cc:3055] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:54.175774 16985 raft_consensus.cc:740] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:54.176509 16985 consensus_queue.cc:260] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:54.176995 17350 tablet.cc:1724] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.177958 16985 raft_consensus.cc:3060] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Advancing to term 3
W20260709 12:28:54.186544 16951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:40303, user_credentials={real_user=slave}} blocked reactor thread for 62919.1us
I20260709 12:28:54.157678 17341 tablet.cc:1724] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.192274 16906 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bf6c876e465a43fcb34c937877cd7afb"
dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
mode: GRACEFUL
new_leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
 from {username='slave'} at 127.0.0.1:34940
I20260709 12:28:54.193115 16906 raft_consensus.cc:606] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Received request to transfer leadership to TS 6f55d37b709d49a2b523a88c4fc5acf8
I20260709 12:28:54.182888 17335 tablet.cc:1724] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.196328  4821 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20260709 12:28:54.197013  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:54.200323 17346 tablet.cc:1724] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.202587 16910 raft_consensus.cc:2468] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 3.
I20260709 12:28:54.204007 17025 leader_election.cc:304] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:54.205582 17313 raft_consensus.cc:2804] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:54.206065 17313 raft_consensus.cc:697] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 LEADER]: Becoming Leader. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:54.206910 17313 consensus_queue.cc:237] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:54.208688 16984 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "92485db6a3c743b2a35e05e166bbd561"
dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
mode: GRACEFUL
new_leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
 from {username='slave'} at 127.0.0.1:53678
I20260709 12:28:54.209331 16984 raft_consensus.cc:606] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Received request to transfer leadership to TS 6f55d37b709d49a2b523a88c4fc5acf8
I20260709 12:28:54.192919 17349 tablet.cc:1724] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.201933 17347 tablet.cc:1724] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.192572 16985 raft_consensus.cc:2468] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 3.
I20260709 12:28:54.220440 16805 catalog_manager.cc:5697] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 reported cstate change: term changed from 2 to 3, leader changed from 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66) to 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67). New cstate: current_term: 3 leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.231029 16910 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "bba2a79583a5466d80d19d9e8e441f52"
dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
mode: GRACEFUL
new_leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
 from {username='slave'} at 127.0.0.1:34940
I20260709 12:28:54.231644 16910 raft_consensus.cc:606] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Received request to transfer leadership to TS 6f55d37b709d49a2b523a88c4fc5acf8
I20260709 12:28:54.234408 17340 tablet.cc:1724] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.234208 17337 tablet.cc:1724] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.236733  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:28:54.237398  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:54.252516 17331 tablet.cc:1724] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:28:54.264312 16807 catalog_manager.cc:6242] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08: soft_deleted_table [id=cb0dc68af1c248b1b2f1beae73418634] alter complete (version 1)
I20260709 12:28:54.267102 17324 raft_consensus.cc:993] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9: : Instructing follower 6f55d37b709d49a2b523a88c4fc5acf8 to start an election
I20260709 12:28:54.267683 17324 raft_consensus.cc:1081] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Signalling peer 6f55d37b709d49a2b523a88c4fc5acf8 to start an election
I20260709 12:28:54.273458 17056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "92485db6a3c743b2a35e05e166bbd561"
dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
 from {username='slave'} at 127.0.0.1:48026
I20260709 12:28:54.274125 17056 raft_consensus.cc:493] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:54.274554 17056 raft_consensus.cc:3060] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:54.282110 17056 raft_consensus.cc:515] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:54.284216 17056 leader_election.cc:290] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 3 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:54.285277 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92485db6a3c743b2a35e05e166bbd561" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:54.285485 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "92485db6a3c743b2a35e05e166bbd561" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:54.286128 16985 raft_consensus.cc:3055] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:54.286140 16910 raft_consensus.cc:3060] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:54.286492 16985 raft_consensus.cc:740] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 51de95355c524c4cb143cf88d4c0a1e9, State: Running, Role: LEADER
I20260709 12:28:54.287485 16985 consensus_queue.cc:260] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:54.288635 16985 raft_consensus.cc:3060] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:54.291917 16910 raft_consensus.cc:2468] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 3.
I20260709 12:28:54.292861 16985 raft_consensus.cc:2468] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 3.
I20260709 12:28:54.293045 17025 leader_election.cc:304] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0d1d35a1ebcf415c9e3e8af85b90a24c, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:54.293861 17313 raft_consensus.cc:2804] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:54.294332 17313 raft_consensus.cc:697] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 LEADER]: Becoming Leader. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:54.295028 17313 consensus_queue.cc:237] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:54.302023 16806 catalog_manager.cc:5697] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 reported cstate change: term changed from 2 to 3, leader changed from 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66) to 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67). New cstate: current_term: 3 leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.409636 17308 raft_consensus.cc:993] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c: : Instructing follower 6f55d37b709d49a2b523a88c4fc5acf8 to start an election
I20260709 12:28:54.410180 17309 raft_consensus.cc:1081] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Signalling peer 6f55d37b709d49a2b523a88c4fc5acf8 to start an election
I20260709 12:28:54.411755 17056 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bf6c876e465a43fcb34c937877cd7afb"
dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
 from {username='slave'} at 127.0.0.1:48040
I20260709 12:28:54.412248 17056 raft_consensus.cc:493] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:54.412549 17056 raft_consensus.cc:3060] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:54.418252 17056 raft_consensus.cc:515] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:54.419940 17056 leader_election.cc:290] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 3 election: Requested vote from peers 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885), 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693)
I20260709 12:28:54.420908 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6c876e465a43fcb34c937877cd7afb" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:54.421298 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bf6c876e465a43fcb34c937877cd7afb" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:54.421594 16910 raft_consensus.cc:3055] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:54.421886 16985 raft_consensus.cc:3060] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:54.421914 16910 raft_consensus.cc:740] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:54.422891 16910 consensus_queue.cc:260] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:54.423815 16910 raft_consensus.cc:3060] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:54.426569 16985 raft_consensus.cc:2468] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 3.
I20260709 12:28:54.427840 17025 leader_election.cc:304] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:54.428676 17313 raft_consensus.cc:2804] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:54.429083 17313 raft_consensus.cc:697] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 LEADER]: Becoming Leader. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:54.429082 16910 raft_consensus.cc:2468] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 3.
I20260709 12:28:54.430171 17313 consensus_queue.cc:237] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } }
I20260709 12:28:54.437688 16806 catalog_manager.cc:5697] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 reported cstate change: term changed from 2 to 3, leader changed from 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65) to 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67). New cstate: current_term: 3 leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: HEALTHY } } }
I20260709 12:28:54.522883 17309 raft_consensus.cc:993] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c: : Instructing follower 6f55d37b709d49a2b523a88c4fc5acf8 to start an election
I20260709 12:28:54.523308 17308 raft_consensus.cc:1081] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Signalling peer 6f55d37b709d49a2b523a88c4fc5acf8 to start an election
I20260709 12:28:54.524626 17057 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "bba2a79583a5466d80d19d9e8e441f52"
dest_uuid: "6f55d37b709d49a2b523a88c4fc5acf8"
 from {username='slave'} at 127.0.0.1:48040
I20260709 12:28:54.525076 17057 raft_consensus.cc:493] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:28:54.525310 17057 raft_consensus.cc:3060] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:54.530344 17057 raft_consensus.cc:515] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:54.531864 17057 leader_election.cc:290] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 3 election: Requested vote from peers 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693), 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885)
I20260709 12:28:54.532773 16985 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2a79583a5466d80d19d9e8e441f52" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "51de95355c524c4cb143cf88d4c0a1e9"
I20260709 12:28:54.533056 16910 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "bba2a79583a5466d80d19d9e8e441f52" candidate_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c"
I20260709 12:28:54.533428 16985 raft_consensus.cc:3060] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:54.533638 16910 raft_consensus.cc:3055] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:28:54.533972 16910 raft_consensus.cc:740] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0d1d35a1ebcf415c9e3e8af85b90a24c, State: Running, Role: LEADER
I20260709 12:28:54.534816 16910 consensus_queue.cc:260] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:54.536051 16910 raft_consensus.cc:3060] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:28:54.540896 16985 raft_consensus.cc:2468] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 3.
I20260709 12:28:54.542210 17025 leader_election.cc:304] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51de95355c524c4cb143cf88d4c0a1e9, 6f55d37b709d49a2b523a88c4fc5acf8; no voters: 
I20260709 12:28:54.543009 17313 raft_consensus.cc:2804] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:28:54.543298 16910 raft_consensus.cc:2468] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f55d37b709d49a2b523a88c4fc5acf8 in term 3.
I20260709 12:28:54.543530 17313 raft_consensus.cc:697] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 LEADER]: Becoming Leader. State: Replica: 6f55d37b709d49a2b523a88c4fc5acf8, State: Running, Role: LEADER
I20260709 12:28:54.544593 17313 consensus_queue.cc:237] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } }
I20260709 12:28:54.553737 16806 catalog_manager.cc:5697] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 reported cstate change: term changed from 2 to 3, leader changed from 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65) to 6f55d37b709d49a2b523a88c4fc5acf8 (127.4.181.67). New cstate: current_term: 3 leader_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "6f55d37b709d49a2b523a88c4fc5acf8" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 40303 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 } health_report { overall_health: UNKNOWN } } }
I20260709 12:28:54.675422 16910 raft_consensus.cc:1275] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Refusing update from remote peer 6f55d37b709d49a2b523a88c4fc5acf8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:28:54.676810 17313 consensus_queue.cc:1048] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:54.685155 16985 raft_consensus.cc:1275] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Refusing update from remote peer 6f55d37b709d49a2b523a88c4fc5acf8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:28:54.686580 17313 consensus_queue.cc:1048] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:54.809922 16910 raft_consensus.cc:1275] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Refusing update from remote peer 6f55d37b709d49a2b523a88c4fc5acf8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:54.811447 17312 consensus_queue.cc:1048] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:54.815148 16906 raft_consensus.cc:1275] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Refusing update from remote peer 6f55d37b709d49a2b523a88c4fc5acf8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:28:54.816345 17312 consensus_queue.cc:1048] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20260709 12:28:54.830948 16985 raft_consensus.cc:1275] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Refusing update from remote peer 6f55d37b709d49a2b523a88c4fc5acf8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:54.834046 16984 raft_consensus.cc:1275] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Refusing update from remote peer 6f55d37b709d49a2b523a88c4fc5acf8: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20260709 12:28:54.837878 17312 consensus_queue.cc:1048] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20260709 12:28:54.838414 17313 consensus_queue.cc:1048] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:28:55.003830 16984 raft_consensus.cc:1275] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Refusing update from remote peer 6f55d37b709d49a2b523a88c4fc5acf8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:55.005281 17313 consensus_queue.cc:1048] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51de95355c524c4cb143cf88d4c0a1e9" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 42693 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:55.015348 16910 raft_consensus.cc:1275] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Refusing update from remote peer 6f55d37b709d49a2b523a88c4fc5acf8: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:28:55.018146 17313 consensus_queue.cc:1048] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0d1d35a1ebcf415c9e3e8af85b90a24c" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 45885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20260709 12:28:55.238760  4821 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:55.244692  4821 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:55.245070  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:55.250254  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:55.250973  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:56.251969  4821 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:56.257427  4821 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:56.257884  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:56.263546  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:56.263971  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:57.264905  4821 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:57.270583  4821 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:57.271150  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:57.276225  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:57.276741  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:58.277801  4821 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:58.283375  4821 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:58.284042  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:58.290535  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:58.290979  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:28:59.292450  4821 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:28:59.299721  4821 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:28:59.300282  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:28:59.306221  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:28:59.306667  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:00.307922  4821 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:00.313441  4821 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:00.313879  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:00.318750  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:00.319173  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:01.320116  4821 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:01.325474  4821 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:01.326033  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:01.330919  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:01.331347  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:02.332362  4821 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:02.337978  4821 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:02.338513  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:02.343881  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:02.344282  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:03.345220  4821 auto_leader_rebalancer.cc:141] leader rebalance for table soft_deleted_table
I20260709 12:29:03.352224  4821 auto_leader_rebalancer.cc:440] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20260709 12:29:03.352794  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:03.358384  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:03.358781  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
W20260709 12:29:04.815963 16951 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.65:45885, user_credentials={real_user=slave}} blocked reactor thread for 118913us
I20260709 12:29:04.877969  4821 tablet_server.cc:179] TabletServer@127.4.181.65:0 shutting down...
W20260709 12:29:04.894385 17025 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 8 similar messages]
W20260709 12:29:04.898872 17025 consensus_peers.cc:597] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 -> Peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Couldn't send request to peer 0d1d35a1ebcf415c9e3e8af85b90a24c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:04.916862  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:04.917703  4821 tablet_replica.cc:333] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.918785  4821 raft_consensus.cc:2243] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.919492  4821 raft_consensus.cc:2272] T 70bc3b0d10fc4e43b94892335f006545 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.922089  4821 tablet_replica.cc:333] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.922847  4821 raft_consensus.cc:2243] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.923328  4821 raft_consensus.cc:2272] T bf6c876e465a43fcb34c937877cd7afb P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.925717  4821 tablet_replica.cc:333] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.926290  4821 raft_consensus.cc:2243] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.927023  4821 raft_consensus.cc:2272] T f85e5a8ee06c4347b7d0206d20056e77 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.929303  4821 tablet_replica.cc:333] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.929906  4821 raft_consensus.cc:2243] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:04.930821  4821 raft_consensus.cc:2272] T c674e30bf2564b9c86216ec9b8cc8de9 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.933939  4821 tablet_replica.cc:333] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.934823  4821 raft_consensus.cc:2243] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.935663  4821 raft_consensus.cc:2272] T d4593f72a2a24c8ab967901c66587a21 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.939172  4821 tablet_replica.cc:333] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.939702  4821 raft_consensus.cc:2243] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:04.940603  4821 raft_consensus.cc:2272] T c3c037275b364555b53fa733e4d8f1e7 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.943019  4821 tablet_replica.cc:333] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.943622  4821 raft_consensus.cc:2243] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.944134  4821 raft_consensus.cc:2272] T b06bd37a9a6142e2a320bb82b7340abe P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.946439  4821 tablet_replica.cc:333] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.947070  4821 raft_consensus.cc:2243] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.947551  4821 raft_consensus.cc:2272] T 3d7cec59cb20410dbd32311463982c38 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.949877  4821 tablet_replica.cc:333] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.950387  4821 raft_consensus.cc:2243] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.950858  4821 raft_consensus.cc:2272] T bba2a79583a5466d80d19d9e8e441f52 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.953142  4821 tablet_replica.cc:333] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.953660  4821 raft_consensus.cc:2243] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.954232  4821 raft_consensus.cc:2272] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.956650  4821 tablet_replica.cc:333] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.957182  4821 raft_consensus.cc:2243] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.957644  4821 raft_consensus.cc:2272] T 92485db6a3c743b2a35e05e166bbd561 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.959813  4821 tablet_replica.cc:333] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.960353  4821 raft_consensus.cc:2243] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.960806  4821 raft_consensus.cc:2272] T 03efb0a48115462f8a67785131ecec20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.963110  4821 tablet_replica.cc:333] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.963636  4821 raft_consensus.cc:2243] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.964323  4821 raft_consensus.cc:2272] T 92f2d4ba10a04aff94f41e73b0d49184 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.966748  4821 tablet_replica.cc:333] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.967288  4821 raft_consensus.cc:2243] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:04.968184  4821 raft_consensus.cc:2272] T 8edce4cea96b4bb7bde070ecc69f01d4 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.970314  4821 tablet_replica.cc:333] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.970901  4821 raft_consensus.cc:2243] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:04.971746  4821 raft_consensus.cc:2272] T b68c285dc783415d93ea00e7b29bff20 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.974155  4821 tablet_replica.cc:333] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.974699  4821 raft_consensus.cc:2243] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:04.975499  4821 raft_consensus.cc:2272] T 945852bfb9e94583920a5357b105f7c0 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:04.977859  4821 tablet_replica.cc:333] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.978441  4821 raft_consensus.cc:2243] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:04.979552  4821 raft_consensus.cc:2272] T f1a8dbf7787b45f18f0264ee1c131caf P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:04.981747 17025 consensus_peers.cc:597] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 -> Peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Couldn't send request to peer 0d1d35a1ebcf415c9e3e8af85b90a24c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:04.982864  4821 tablet_replica.cc:333] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c: stopping tablet replica
I20260709 12:29:04.983464  4821 raft_consensus.cc:2243] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:04.983973  4821 raft_consensus.cc:2272] T e272da12bca745c8b3a6d6d60533f926 P 0d1d35a1ebcf415c9e3e8af85b90a24c [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.033044  4821 tablet_server.cc:196] TabletServer@127.4.181.65:0 shutdown complete.
I20260709 12:29:05.082089  4821 tablet_server.cc:179] TabletServer@127.4.181.66:0 shutting down...
W20260709 12:29:05.108299 17025 consensus_peers.cc:597] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 -> Peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Couldn't send request to peer 0d1d35a1ebcf415c9e3e8af85b90a24c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:45885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.116111  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:05.117233  4821 tablet_replica.cc:333] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
W20260709 12:29:05.117547 16951 consensus_peers.cc:597] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 -> Peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Couldn't send request to peer 0d1d35a1ebcf415c9e3e8af85b90a24c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:45885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.118064 16951 consensus_peers.cc:597] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 -> Peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Couldn't send request to peer 0d1d35a1ebcf415c9e3e8af85b90a24c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:45885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.118208  4821 raft_consensus.cc:2243] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.118978  4821 raft_consensus.cc:2272] T 70bc3b0d10fc4e43b94892335f006545 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.121376  4821 tablet_replica.cc:333] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.122061  4821 raft_consensus.cc:2243] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.122623  4821 raft_consensus.cc:2272] T c674e30bf2564b9c86216ec9b8cc8de9 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.125213  4821 tablet_replica.cc:333] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.125927  4821 raft_consensus.cc:2243] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.127111  4821 raft_consensus.cc:2272] T d4593f72a2a24c8ab967901c66587a21 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:05.128741 17025 consensus_peers.cc:597] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 -> Peer 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693): Couldn't send request to peer 51de95355c524c4cb143cf88d4c0a1e9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.130537  4821 tablet_replica.cc:333] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.131621  4821 raft_consensus.cc:2243] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.132772  4821 raft_consensus.cc:2272] T f85e5a8ee06c4347b7d0206d20056e77 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:05.134246 16951 consensus_peers.cc:597] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 -> Peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Couldn't send request to peer 0d1d35a1ebcf415c9e3e8af85b90a24c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:45885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.135776  4821 tablet_replica.cc:333] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.136505  4821 raft_consensus.cc:2243] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.137106  4821 raft_consensus.cc:2272] T c3c037275b364555b53fa733e4d8f1e7 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.139588  4821 tablet_replica.cc:333] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.140285  4821 raft_consensus.cc:2243] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.140858  4821 raft_consensus.cc:2272] T b06bd37a9a6142e2a320bb82b7340abe P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.143253  4821 tablet_replica.cc:333] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.143788  4821 raft_consensus.cc:2243] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.144897  4821 raft_consensus.cc:2272] T e272da12bca745c8b3a6d6d60533f926 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.147410  4821 tablet_replica.cc:333] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.148062  4821 raft_consensus.cc:2243] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.149292  4821 raft_consensus.cc:2272] T 3d7cec59cb20410dbd32311463982c38 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.152313  4821 tablet_replica.cc:333] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.153173  4821 raft_consensus.cc:2243] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Raft consensus shutting down.
W20260709 12:29:05.154166 17025 consensus_peers.cc:597] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 -> Peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Couldn't send request to peer 0d1d35a1ebcf415c9e3e8af85b90a24c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:45885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.154193  4821 raft_consensus.cc:2272] T 92f2d4ba10a04aff94f41e73b0d49184 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.157088  4821 tablet_replica.cc:333] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.157866  4821 raft_consensus.cc:2243] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.158546  4821 raft_consensus.cc:2272] T 8edce4cea96b4bb7bde070ecc69f01d4 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.161000  4821 tablet_replica.cc:333] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.161845  4821 raft_consensus.cc:2243] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.162370  4821 raft_consensus.cc:2272] T 945852bfb9e94583920a5357b105f7c0 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.165081  4821 tablet_replica.cc:333] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.165839  4821 raft_consensus.cc:2243] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.166379  4821 raft_consensus.cc:2272] T b68c285dc783415d93ea00e7b29bff20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.168889  4821 tablet_replica.cc:333] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.169471  4821 raft_consensus.cc:2243] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.170024  4821 raft_consensus.cc:2272] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.172825  4821 tablet_replica.cc:333] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.173547  4821 raft_consensus.cc:2243] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.174181  4821 raft_consensus.cc:2272] T 92485db6a3c743b2a35e05e166bbd561 P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.176739  4821 tablet_replica.cc:333] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.177311  4821 raft_consensus.cc:2243] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.178447  4821 raft_consensus.cc:2272] T 03efb0a48115462f8a67785131ecec20 P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.180795  4821 tablet_replica.cc:333] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.181354  4821 raft_consensus.cc:2243] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.181851  4821 raft_consensus.cc:2272] T bba2a79583a5466d80d19d9e8e441f52 P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.184463  4821 tablet_replica.cc:333] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.185042  4821 raft_consensus.cc:2243] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.185511  4821 raft_consensus.cc:2272] T bf6c876e465a43fcb34c937877cd7afb P 51de95355c524c4cb143cf88d4c0a1e9 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.187747  4821 tablet_replica.cc:333] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9: stopping tablet replica
I20260709 12:29:05.188252  4821 raft_consensus.cc:2243] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.188670  4821 raft_consensus.cc:2272] T f1a8dbf7787b45f18f0264ee1c131caf P 51de95355c524c4cb143cf88d4c0a1e9 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:05.201944 17025 consensus_peers.cc:597] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 -> Peer 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693): Couldn't send request to peer 51de95355c524c4cb143cf88d4c0a1e9. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.232654 17025 consensus_peers.cc:597] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 -> Peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Couldn't send request to peer 0d1d35a1ebcf415c9e3e8af85b90a24c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:45885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.236476  4821 tablet_server.cc:196] TabletServer@127.4.181.66:0 shutdown complete.
W20260709 12:29:05.237113 17025 consensus_peers.cc:597] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 -> Peer 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693): Couldn't send request to peer 51de95355c524c4cb143cf88d4c0a1e9. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:42693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.249024 17025 consensus_peers.cc:597] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 -> Peer 0d1d35a1ebcf415c9e3e8af85b90a24c (127.4.181.65:45885): Couldn't send request to peer 0d1d35a1ebcf415c9e3e8af85b90a24c. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:45885: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:05.264777 17025 consensus_peers.cc:597] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 -> Peer 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693): Couldn't send request to peer 51de95355c524c4cb143cf88d4c0a1e9. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:42693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.278900  4821 tablet_server.cc:179] TabletServer@127.4.181.67:0 shutting down...
I20260709 12:29:05.307416  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:05.308254  4821 tablet_replica.cc:333] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.308975  4821 raft_consensus.cc:2243] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.309932  4821 raft_consensus.cc:2272] T 70bc3b0d10fc4e43b94892335f006545 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.312448  4821 tablet_replica.cc:333] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.313421  4821 raft_consensus.cc:2243] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.314051  4821 raft_consensus.cc:2272] T d4593f72a2a24c8ab967901c66587a21 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.316581  4821 tablet_replica.cc:333] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.317183  4821 raft_consensus.cc:2243] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.317683  4821 raft_consensus.cc:2272] T c674e30bf2564b9c86216ec9b8cc8de9 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.320492  4821 tablet_replica.cc:333] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.321106  4821 raft_consensus.cc:2243] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.321748  4821 raft_consensus.cc:2272] T c3c037275b364555b53fa733e4d8f1e7 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:05.323110 17025 consensus_peers.cc:597] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 -> Peer 51de95355c524c4cb143cf88d4c0a1e9 (127.4.181.66:42693): Couldn't send request to peer 51de95355c524c4cb143cf88d4c0a1e9. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:42693: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:05.324463  4821 tablet_replica.cc:333] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.325109  4821 raft_consensus.cc:2243] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.325600  4821 raft_consensus.cc:2272] T 3d7cec59cb20410dbd32311463982c38 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.327888  4821 tablet_replica.cc:333] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.328470  4821 raft_consensus.cc:2243] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.329321  4821 raft_consensus.cc:2272] T b06bd37a9a6142e2a320bb82b7340abe P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.331779  4821 tablet_replica.cc:333] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.332340  4821 raft_consensus.cc:2243] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.332860  4821 raft_consensus.cc:2272] T e272da12bca745c8b3a6d6d60533f926 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.335592  4821 tablet_replica.cc:333] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.336270  4821 raft_consensus.cc:2243] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.336817  4821 raft_consensus.cc:2272] T f85e5a8ee06c4347b7d0206d20056e77 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.339498  4821 tablet_replica.cc:333] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.340102  4821 raft_consensus.cc:2243] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.340590  4821 raft_consensus.cc:2272] T 92f2d4ba10a04aff94f41e73b0d49184 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.342756  4821 tablet_replica.cc:333] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.343322  4821 raft_consensus.cc:2243] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.343851  4821 raft_consensus.cc:2272] T 8edce4cea96b4bb7bde070ecc69f01d4 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.346177  4821 tablet_replica.cc:333] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.346796  4821 raft_consensus.cc:2243] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.347286  4821 raft_consensus.cc:2272] T b68c285dc783415d93ea00e7b29bff20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.349380  4821 tablet_replica.cc:333] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.349916  4821 raft_consensus.cc:2243] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.350427  4821 raft_consensus.cc:2272] T 945852bfb9e94583920a5357b105f7c0 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.352873  4821 tablet_replica.cc:333] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.353415  4821 raft_consensus.cc:2243] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.354318  4821 raft_consensus.cc:2272] T bf6c876e465a43fcb34c937877cd7afb P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.356861  4821 tablet_replica.cc:333] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.357475  4821 raft_consensus.cc:2243] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.357936  4821 raft_consensus.cc:2272] T f1a8dbf7787b45f18f0264ee1c131caf P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.360092  4821 tablet_replica.cc:333] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.360736  4821 raft_consensus.cc:2243] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:05.361245  4821 raft_consensus.cc:2272] T 03efb0a48115462f8a67785131ecec20 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.363459  4821 tablet_replica.cc:333] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.363973  4821 raft_consensus.cc:2243] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.365119  4821 raft_consensus.cc:2272] T 35bc8bd564e64d69ad3a2f103c4cd5e2 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.367411  4821 tablet_replica.cc:333] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.367966  4821 raft_consensus.cc:2243] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.368825  4821 raft_consensus.cc:2272] T 92485db6a3c743b2a35e05e166bbd561 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:05.370908  4821 tablet_replica.cc:333] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8: stopping tablet replica
I20260709 12:29:05.371337  4821 raft_consensus.cc:2243] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:05.372077  4821 raft_consensus.cc:2272] T bba2a79583a5466d80d19d9e8e441f52 P 6f55d37b709d49a2b523a88c4fc5acf8 [term 3 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:05.787160 17080 debug-util.cc:398] Leaking SignalData structure 0x7b08001099e0 after lost signal to thread 4824
W20260709 12:29:05.788206 17080 debug-util.cc:398] Leaking SignalData structure 0x7b08000b5ba0 after lost signal to thread 16842
W20260709 12:29:06.413123  4821 thread.cc:527] Waited for 1000ms trying to join with diag-logger (tid 17080)
W20260709 12:29:07.413663  4821 thread.cc:527] Waited for 2000ms trying to join with diag-logger (tid 17080)
W20260709 12:29:08.414098  4821 thread.cc:527] Waited for 3000ms trying to join with diag-logger (tid 17080)
I20260709 12:29:08.673668  4821 tablet_server.cc:196] TabletServer@127.4.181.67:0 shutdown complete.
I20260709 12:29:08.708987  4821 master.cc:562] Master@127.4.181.126:40685 shutting down...
I20260709 12:29:08.732039  4821 raft_consensus.cc:2243] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:08.732666  4821 raft_consensus.cc:2272] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:08.733002  4821 tablet_replica.cc:333] T 00000000000000000000000000000000 P 68c20caf3a384edd987625527b5c9e08: stopping tablet replica
I20260709 12:29:08.753077  4821 master.cc:584] Master@127.4.181.126:40685 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0 (24496 ms)
[ RUN      ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20260709 12:29:08.803221  4821 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.4.181.126:45421
I20260709 12:29:08.804319  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:08.810956 17404 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:08.811264 17403 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:08.811295 17406 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:08.812043  4821 server_base.cc:1061] running on GCE node
I20260709 12:29:08.812914  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:08.813089  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:08.813199  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600148813188 us; error 0 us; skew 500 ppm
I20260709 12:29:08.813624  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:08.815862  4821 webserver.cc:533] Webserver started at http://127.4.181.126:41947/ using document root <none> and password file <none>
I20260709 12:29:08.816298  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:08.816449  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:08.816654  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:08.817718  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/master-0-root/instance:
uuid: "ec937a54e65544069ba5518ec239d382"
format_stamp: "Formatted at 2026-07-09 12:29:08 on dist-test-slave-k014"
I20260709 12:29:08.822103  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.006s	sys 0.000s
I20260709 12:29:08.825361 17411 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:08.826078  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.003s	sys 0.000s
I20260709 12:29:08.826341  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/master-0-root
uuid: "ec937a54e65544069ba5518ec239d382"
format_stamp: "Formatted at 2026-07-09 12:29:08 on dist-test-slave-k014"
I20260709 12:29:08.826632  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:08.849799  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:08.851070  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:08.889014  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.126:45421
I20260709 12:29:08.889161 17462 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.126:45421 every 8 connection(s)
I20260709 12:29:08.893023 17463 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:08.905012 17463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382: Bootstrap starting.
I20260709 12:29:08.909925 17463 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:08.914201 17463 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382: No bootstrap required, opened a new log
I20260709 12:29:08.916496 17463 raft_consensus.cc:359] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec937a54e65544069ba5518ec239d382" member_type: VOTER }
I20260709 12:29:08.916910 17463 raft_consensus.cc:385] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:08.917124 17463 raft_consensus.cc:740] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec937a54e65544069ba5518ec239d382, State: Initialized, Role: FOLLOWER
I20260709 12:29:08.917671 17463 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec937a54e65544069ba5518ec239d382" member_type: VOTER }
I20260709 12:29:08.918128 17463 raft_consensus.cc:399] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260709 12:29:08.918335 17463 raft_consensus.cc:493] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260709 12:29:08.918632 17463 raft_consensus.cc:3060] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:08.923733 17463 raft_consensus.cc:515] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec937a54e65544069ba5518ec239d382" member_type: VOTER }
I20260709 12:29:08.924232 17463 leader_election.cc:304] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec937a54e65544069ba5518ec239d382; no voters: 
I20260709 12:29:08.925364 17463 leader_election.cc:290] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [CANDIDATE]: Term 1 election: Requested vote from peers 
I20260709 12:29:08.925709 17466 raft_consensus.cc:2804] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:08.927079 17466 raft_consensus.cc:697] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [term 1 LEADER]: Becoming Leader. State: Replica: ec937a54e65544069ba5518ec239d382, State: Running, Role: LEADER
I20260709 12:29:08.927888 17466 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec937a54e65544069ba5518ec239d382" member_type: VOTER }
I20260709 12:29:08.928272 17463 sys_catalog.cc:565] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [sys.catalog]: configured and running, proceeding with master startup.
I20260709 12:29:08.933365 17467 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec937a54e65544069ba5518ec239d382" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec937a54e65544069ba5518ec239d382" member_type: VOTER } }
I20260709 12:29:08.934185 17467 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:08.933969 17468 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec937a54e65544069ba5518ec239d382. Latest consensus state: current_term: 1 leader_uuid: "ec937a54e65544069ba5518ec239d382" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec937a54e65544069ba5518ec239d382" member_type: VOTER } }
I20260709 12:29:08.934924 17468 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [sys.catalog]: This master's current role is: LEADER
I20260709 12:29:08.938337 17475 catalog_manager.cc:1511] Loading table and tablet metadata into memory...
I20260709 12:29:08.945408 17475 catalog_manager.cc:1520] Initializing Kudu cluster ID...
I20260709 12:29:08.946499  4821 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20260709 12:29:08.954134 17475 catalog_manager.cc:1383] Generated new cluster ID: 11d4dc546f8048d28b92690525974c61
I20260709 12:29:08.954439 17475 catalog_manager.cc:1531] Initializing Kudu internal certificate authority...
I20260709 12:29:08.976656 17475 catalog_manager.cc:1406] Generated new certificate authority record
I20260709 12:29:08.977958 17475 catalog_manager.cc:1540] Loading token signing keys...
I20260709 12:29:08.996013 17475 catalog_manager.cc:6070] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382: Generated new TSK 0
I20260709 12:29:08.996634 17475 catalog_manager.cc:1550] Initializing in-progress tserver states...
I20260709 12:29:09.013404  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:09.019585 17484 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:09.020936 17485 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:09.025238 17487 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:09.026003  4821 server_base.cc:1061] running on GCE node
I20260709 12:29:09.027014  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:09.027217  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:09.027395  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600149027376 us; error 0 us; skew 500 ppm
I20260709 12:29:09.027889  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:09.030284  4821 webserver.cc:533] Webserver started at http://127.4.181.65:42333/ using document root <none> and password file <none>
I20260709 12:29:09.030754  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:09.030920  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:09.031138  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:09.032176  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-0-root/instance:
uuid: "e8f68305d8674b5c825afab76ae8090b"
format_stamp: "Formatted at 2026-07-09 12:29:09 on dist-test-slave-k014"
I20260709 12:29:09.036574  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.004s	user 0.001s	sys 0.004s
I20260709 12:29:09.040095 17492 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:09.040953  4821 fs_manager.cc:730] Time spent opening block manager: real 0.002s	user 0.001s	sys 0.000s
I20260709 12:29:09.041244  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-0-root
uuid: "e8f68305d8674b5c825afab76ae8090b"
format_stamp: "Formatted at 2026-07-09 12:29:09 on dist-test-slave-k014"
I20260709 12:29:09.041518  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:09.060202  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:09.061456  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:09.063042  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:09.065366  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:09.065572  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:09.065807  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:09.065970  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:09.114850  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.65:42015
I20260709 12:29:09.115020 17554 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.65:42015 every 8 connection(s)
I20260709 12:29:09.120362  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:09.127944 17559 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:09.130721 17560 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:09.135084  4821 server_base.cc:1061] running on GCE node
W20260709 12:29:09.135654 17562 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:09.135938 17555 heartbeater.cc:344] Connected to a master server at 127.4.181.126:45421
I20260709 12:29:09.136426 17555 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:09.136802  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:09.137090  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:09.137159 17555 heartbeater.cc:507] Master 127.4.181.126:45421 requested a full tablet report, sending...
I20260709 12:29:09.137337  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600149137317 us; error 0 us; skew 500 ppm
I20260709 12:29:09.138037  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:09.139629 17428 ts_manager.cc:194] Registered new tserver with Master: e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015)
I20260709 12:29:09.141285  4821 webserver.cc:533] Webserver started at http://127.4.181.66:42705/ using document root <none> and password file <none>
I20260709 12:29:09.141873  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:09.142052  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:09.142115 17428 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56548
I20260709 12:29:09.142313  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:09.144289  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-1-root/instance:
uuid: "1bdf878b9c63415bb5225d18d95f32f3"
format_stamp: "Formatted at 2026-07-09 12:29:09 on dist-test-slave-k014"
I20260709 12:29:09.149840  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.006s	sys 0.000s
I20260709 12:29:09.153934 17567 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:09.154964  4821 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.000s
I20260709 12:29:09.155314  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-1-root
uuid: "1bdf878b9c63415bb5225d18d95f32f3"
format_stamp: "Formatted at 2026-07-09 12:29:09 on dist-test-slave-k014"
I20260709 12:29:09.155730  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:09.208973  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:09.210219  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:09.211812  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:09.214068  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:09.214280  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:09.214519  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:09.214672  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:09.282181  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.66:44585
I20260709 12:29:09.282297 17630 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.66:44585 every 8 connection(s)
I20260709 12:29:09.289063  4821 file_cache.cc:504] Constructed file cache file cache with capacity 419430
W20260709 12:29:09.298952 17635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:09.298974 17634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260709 12:29:09.302311 17637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260709 12:29:09.302371  4821 server_base.cc:1061] running on GCE node
I20260709 12:29:09.303822  4821 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20260709 12:29:09.304114  4821 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20260709 12:29:09.304354  4821 hybrid_clock.cc:648] HybridClock initialized: now 1783600149304338 us; error 0 us; skew 500 ppm
I20260709 12:29:09.304811 17631 heartbeater.cc:344] Connected to a master server at 127.4.181.126:45421
I20260709 12:29:09.305145  4821 server_base.cc:861] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260709 12:29:09.305354 17631 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:09.306740 17631 heartbeater.cc:507] Master 127.4.181.126:45421 requested a full tablet report, sending...
I20260709 12:29:09.308884  4821 webserver.cc:533] Webserver started at http://127.4.181.67:34689/ using document root <none> and password file <none>
I20260709 12:29:09.309670  4821 fs_manager.cc:362] Metadata directory not provided
I20260709 12:29:09.309875  4821 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260709 12:29:09.309878 17428 ts_manager.cc:194] Registered new tserver with Master: 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:09.310684  4821 server_base.cc:909] This appears to be a new deployment of Kudu; creating new FS layout
I20260709 12:29:09.312114 17428 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56560
I20260709 12:29:09.312584  4821 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-2-root/instance:
uuid: "81441d21f9f442cdbb8b7db3765484fd"
format_stamp: "Formatted at 2026-07-09 12:29:09 on dist-test-slave-k014"
I20260709 12:29:09.318799  4821 fs_manager.cc:696] Time spent creating directory manager: real 0.005s	user 0.007s	sys 0.001s
I20260709 12:29:09.322676 17642 log_block_manager.cc:4127] Time spent loading block containers with low live blocks: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:09.323554  4821 fs_manager.cc:730] Time spent opening block manager: real 0.003s	user 0.003s	sys 0.001s
I20260709 12:29:09.323849  4821 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-2-root
uuid: "81441d21f9f442cdbb8b7db3765484fd"
format_stamp: "Formatted at 2026-07-09 12:29:09 on dist-test-slave-k014"
I20260709 12:29:09.324128  4821 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskYeqs8C/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1783599758264527-4821-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260709 12:29:09.334580  4821 rpc_server.cc:225] running with OpenSSL 1.1.1  11 Sep 2018
I20260709 12:29:09.335805  4821 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260709 12:29:09.337306  4821 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20260709 12:29:09.339802  4821 ts_tablet_manager.cc:585] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260709 12:29:09.340011  4821 ts_tablet_manager.cc:531] Time spent load tablet metadata: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:09.340255  4821 ts_tablet_manager.cc:616] Registered 0 tablets
I20260709 12:29:09.340430  4821 ts_tablet_manager.cc:595] Time spent register tablets: real 0.000s	user 0.000s	sys 0.000s
I20260709 12:29:09.384366  4821 rpc_server.cc:307] RPC server started. Bound to: 127.4.181.67:41275
I20260709 12:29:09.384491 17704 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.4.181.67:41275 every 8 connection(s)
I20260709 12:29:09.400025 17705 heartbeater.cc:344] Connected to a master server at 127.4.181.126:45421
I20260709 12:29:09.400535 17705 heartbeater.cc:461] Registering TS with master...
I20260709 12:29:09.401533 17705 heartbeater.cc:507] Master 127.4.181.126:45421 requested a full tablet report, sending...
I20260709 12:29:09.403976 17428 ts_manager.cc:194] Registered new tserver with Master: 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:09.404210  4821 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.016372957s
I20260709 12:29:09.405967 17428 master_service.cc:502] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:56566
I20260709 12:29:09.432852 17428 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56568:
name: "test-workload"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:09.435986 17428 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:09.529623 17592 tablet_service.cc:1511] Processing CreateTablet for tablet ff6c5abfd4014f9385d4d326823caa63 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:09.530167 17520 tablet_service.cc:1511] Processing CreateTablet for tablet 936d28e6956b49a3afaea2f695aec47a (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:09.531682 17592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6c5abfd4014f9385d4d326823caa63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.532011 17520 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936d28e6956b49a3afaea2f695aec47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.531884 17595 tablet_service.cc:1511] Processing CreateTablet for tablet 936d28e6956b49a3afaea2f695aec47a (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:09.532567 17516 tablet_service.cc:1511] Processing CreateTablet for tablet e4ffbcfb8f514f94b30298d803ff4479 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:09.533339 17595 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936d28e6956b49a3afaea2f695aec47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.534000 17516 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ffbcfb8f514f94b30298d803ff4479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.535595 17594 tablet_service.cc:1511] Processing CreateTablet for tablet b442e5d870aa4a52a5b258bb8c78a626 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:09.535790 17517 tablet_service.cc:1511] Processing CreateTablet for tablet ff6c5abfd4014f9385d4d326823caa63 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:09.537025 17594 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b442e5d870aa4a52a5b258bb8c78a626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.535637 17591 tablet_service.cc:1511] Processing CreateTablet for tablet e4ffbcfb8f514f94b30298d803ff4479 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:09.538163 17591 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ffbcfb8f514f94b30298d803ff4479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.538789 17518 tablet_service.cc:1511] Processing CreateTablet for tablet f67d18d64f1f4e62adaaf5463889c313 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:09.541263 17519 tablet_service.cc:1511] Processing CreateTablet for tablet b442e5d870aa4a52a5b258bb8c78a626 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:09.541857 17668 tablet_service.cc:1511] Processing CreateTablet for tablet f67d18d64f1f4e62adaaf5463889c313 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:09.537263 17517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6c5abfd4014f9385d4d326823caa63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.544905 17669 tablet_service.cc:1511] Processing CreateTablet for tablet b442e5d870aa4a52a5b258bb8c78a626 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:09.546446 17670 tablet_service.cc:1511] Processing CreateTablet for tablet 936d28e6956b49a3afaea2f695aec47a (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:09.546847 17519 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b442e5d870aa4a52a5b258bb8c78a626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.539326 17593 tablet_service.cc:1511] Processing CreateTablet for tablet f67d18d64f1f4e62adaaf5463889c313 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:09.548966 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67d18d64f1f4e62adaaf5463889c313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.550781 17518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67d18d64f1f4e62adaaf5463889c313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.551993 17667 tablet_service.cc:1511] Processing CreateTablet for tablet ff6c5abfd4014f9385d4d326823caa63 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:09.552407 17666 tablet_service.cc:1511] Processing CreateTablet for tablet e4ffbcfb8f514f94b30298d803ff4479 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:09.543388 17668 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f67d18d64f1f4e62adaaf5463889c313. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.556073 17666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4ffbcfb8f514f94b30298d803ff4479. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.556694 17667 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ff6c5abfd4014f9385d4d326823caa63. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.559136 17670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 936d28e6956b49a3afaea2f695aec47a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.560299 17669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b442e5d870aa4a52a5b258bb8c78a626. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.572053 17515 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3dc8230bed4a4a9ee2087323af1274 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:09.574132 17515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3dc8230bed4a4a9ee2087323af1274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.574959 17665 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3dc8230bed4a4a9ee2087323af1274 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:09.576547 17665 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3dc8230bed4a4a9ee2087323af1274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.576783 17590 tablet_service.cc:1511] Processing CreateTablet for tablet 8c3dc8230bed4a4a9ee2087323af1274 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:09.578187 17590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8c3dc8230bed4a4a9ee2087323af1274. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.582367 17514 tablet_service.cc:1511] Processing CreateTablet for tablet 6d428813b51b45acac6923de43089a2d (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:09.586822 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d428813b51b45acac6923de43089a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.596524 17589 tablet_service.cc:1511] Processing CreateTablet for tablet 6d428813b51b45acac6923de43089a2d (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:09.598081 17589 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d428813b51b45acac6923de43089a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.599649 17664 tablet_service.cc:1511] Processing CreateTablet for tablet 6d428813b51b45acac6923de43089a2d (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:09.601058 17664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6d428813b51b45acac6923de43089a2d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.603114 17663 tablet_service.cc:1511] Processing CreateTablet for tablet e73a457ec8c74b5481defe532b6ba268 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:09.604571 17663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e73a457ec8c74b5481defe532b6ba268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.613049 17720 tablet_bootstrap.cc:492] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:09.609344 17588 tablet_service.cc:1511] Processing CreateTablet for tablet e73a457ec8c74b5481defe532b6ba268 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:09.616508 17518 tablet_service.cc:1511] Processing CreateTablet for tablet e73a457ec8c74b5481defe532b6ba268 (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:09.617172 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e73a457ec8c74b5481defe532b6ba268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.617910 17518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e73a457ec8c74b5481defe532b6ba268. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.646044 17587 tablet_service.cc:1511] Processing CreateTablet for tablet 19bcdba75ad0445ca47283e77797e7fa (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:09.647606 17587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19bcdba75ad0445ca47283e77797e7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.651515 17517 tablet_service.cc:1511] Processing CreateTablet for tablet 19bcdba75ad0445ca47283e77797e7fa (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:09.651671 17662 tablet_service.cc:1511] Processing CreateTablet for tablet 19bcdba75ad0445ca47283e77797e7fa (DEFAULT_TABLE table=test-workload [id=c90743cb4534487dad79a921773414a9]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:09.652928 17517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19bcdba75ad0445ca47283e77797e7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.653098 17662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19bcdba75ad0445ca47283e77797e7fa. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:09.660039 17720 tablet_bootstrap.cc:654] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.706337 17721 tablet_bootstrap.cc:492] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:09.722134 17720 tablet_bootstrap.cc:492] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:09.722800 17720 ts_tablet_manager.cc:1403] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.110s	user 0.017s	sys 0.010s
I20260709 12:29:09.722899 17722 tablet_bootstrap.cc:492] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:09.726349 17720 raft_consensus.cc:359] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.727406 17720 raft_consensus.cc:385] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:09.727746 17720 raft_consensus.cc:740] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:09.728587 17720 consensus_queue.cc:260] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.729708 17722 tablet_bootstrap.cc:654] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.730084 17721 tablet_bootstrap.cc:654] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.731523 17555 heartbeater.cc:499] Master 127.4.181.126:45421 was elected leader, sending a full tablet report...
I20260709 12:29:09.731953 17720 ts_tablet_manager.cc:1434] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.009s	user 0.008s	sys 0.000s
I20260709 12:29:09.733052 17720 tablet_bootstrap.cc:492] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:09.739424 17721 tablet_bootstrap.cc:492] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:09.739964 17721 ts_tablet_manager.cc:1403] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.034s	user 0.008s	sys 0.008s
I20260709 12:29:09.740023 17720 tablet_bootstrap.cc:654] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.743291 17721 raft_consensus.cc:359] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.744050 17721 raft_consensus.cc:385] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:09.744345 17721 raft_consensus.cc:740] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:09.746193 17721 consensus_queue.cc:260] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.747718 17722 tablet_bootstrap.cc:492] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:09.748350 17722 ts_tablet_manager.cc:1403] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.026s	user 0.007s	sys 0.015s
I20260709 12:29:09.751586 17722 raft_consensus.cc:359] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.752364 17722 raft_consensus.cc:385] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:09.752681 17722 raft_consensus.cc:740] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:09.753742 17722 consensus_queue.cc:260] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.758240 17720 tablet_bootstrap.cc:492] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:09.758993 17720 ts_tablet_manager.cc:1403] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.026s	user 0.014s	sys 0.008s
I20260709 12:29:09.761178 17722 ts_tablet_manager.cc:1434] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.013s	user 0.009s	sys 0.002s
I20260709 12:29:09.761911 17631 heartbeater.cc:499] Master 127.4.181.126:45421 was elected leader, sending a full tablet report...
I20260709 12:29:09.762079 17720 raft_consensus.cc:359] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } } peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } }
I20260709 12:29:09.762961 17720 raft_consensus.cc:385] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:09.763299 17720 raft_consensus.cc:740] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:09.764199 17720 consensus_queue.cc:260] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } } peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } }
I20260709 12:29:09.765197 17721 ts_tablet_manager.cc:1434] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.025s	user 0.016s	sys 0.003s
I20260709 12:29:09.766299 17705 heartbeater.cc:499] Master 127.4.181.126:45421 was elected leader, sending a full tablet report...
I20260709 12:29:09.766686 17720 ts_tablet_manager.cc:1434] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.007s	user 0.001s	sys 0.005s
I20260709 12:29:09.767791 17720 tablet_bootstrap.cc:492] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:09.770401 17724 raft_consensus.cc:493] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:09.770697 17722 tablet_bootstrap.cc:492] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:09.771368 17721 tablet_bootstrap.cc:492] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:09.771157 17724 raft_consensus.cc:515] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.774178 17724 leader_election.cc:290] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:09.778868 17721 tablet_bootstrap.cc:654] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.779369 17720 tablet_bootstrap.cc:654] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:09.787581 17632 tablet.cc:2406] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260709 12:29:09.790560 17721 tablet_bootstrap.cc:492] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:09.791170 17721 ts_tablet_manager.cc:1403] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.020s	user 0.014s	sys 0.004s
I20260709 12:29:09.801169 17722 tablet_bootstrap.cc:654] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.801365 17721 raft_consensus.cc:359] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.802198 17721 raft_consensus.cc:385] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:09.802517 17721 raft_consensus.cc:740] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:09.803386 17721 consensus_queue.cc:260] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.805536 17721 ts_tablet_manager.cc:1434] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.014s	user 0.005s	sys 0.000s
I20260709 12:29:09.806502 17721 tablet_bootstrap.cc:492] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:09.808360 17720 tablet_bootstrap.cc:492] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:09.808945 17720 ts_tablet_manager.cc:1403] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.041s	user 0.020s	sys 0.013s
I20260709 12:29:09.811466 17722 tablet_bootstrap.cc:492] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:09.812095 17722 ts_tablet_manager.cc:1403] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.042s	user 0.011s	sys 0.005s
I20260709 12:29:09.812193 17720 raft_consensus.cc:359] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.812903 17721 tablet_bootstrap.cc:654] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.812965 17720 raft_consensus.cc:385] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:09.813484 17720 raft_consensus.cc:740] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:09.814419 17720 consensus_queue.cc:260] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.817766 17720 ts_tablet_manager.cc:1434] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.009s	user 0.009s	sys 0.000s
I20260709 12:29:09.818823 17720 tablet_bootstrap.cc:492] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:09.819739 17722 raft_consensus.cc:359] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.820593 17722 raft_consensus.cc:385] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:09.820924 17722 raft_consensus.cc:740] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:09.822036 17722 consensus_queue.cc:260] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.824509 17722 ts_tablet_manager.cc:1434] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.012s	user 0.006s	sys 0.000s
I20260709 12:29:09.824766 17721 tablet_bootstrap.cc:492] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:09.825363 17721 ts_tablet_manager.cc:1403] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.019s	user 0.008s	sys 0.008s
I20260709 12:29:09.825652 17722 tablet_bootstrap.cc:492] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:09.826498 17720 tablet_bootstrap.cc:654] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.828601 17721 raft_consensus.cc:359] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.829370 17721 raft_consensus.cc:385] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:09.829763 17721 raft_consensus.cc:740] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:09.830689 17721 consensus_queue.cc:260] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.833108 17721 ts_tablet_manager.cc:1434] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:09.834066 17721 tablet_bootstrap.cc:492] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:09.834165 17722 tablet_bootstrap.cc:654] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.840418 17721 tablet_bootstrap.cc:654] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.851822 17605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6c5abfd4014f9385d4d326823caa63" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
I20260709 12:29:09.852794 17605 raft_consensus.cc:2468] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 0.
I20260709 12:29:09.854265 17495 leader_election.cc:304] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:09.855131 17724 raft_consensus.cc:2804] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:09.855535 17724 raft_consensus.cc:493] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:09.855822 17721 tablet_bootstrap.cc:492] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:09.855876 17724 raft_consensus.cc:3060] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:09.856472 17721 ts_tablet_manager.cc:1403] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.023s	user 0.015s	sys 0.003s
I20260709 12:29:09.859134 17729 raft_consensus.cc:493] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:09.859483 17721 raft_consensus.cc:359] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } } peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } }
I20260709 12:29:09.859807 17729 raft_consensus.cc:515] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.860366 17721 raft_consensus.cc:385] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:09.860693 17721 raft_consensus.cc:740] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:09.861577 17721 consensus_queue.cc:260] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } } peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } }
I20260709 12:29:09.864126 17721 ts_tablet_manager.cc:1434] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.003s
I20260709 12:29:09.865151 17721 tablet_bootstrap.cc:492] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:09.871698 17721 tablet_bootstrap.cc:654] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.879522 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6c5abfd4014f9385d4d326823caa63" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
W20260709 12:29:09.881358 17496 leader_election.cc:343] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:09.882360 17729 leader_election.cc:290] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:09.884990 17721 tablet_bootstrap.cc:492] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:09.885535 17721 ts_tablet_manager.cc:1403] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.021s	user 0.009s	sys 0.007s
I20260709 12:29:09.888545 17721 raft_consensus.cc:359] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.891434 17721 raft_consensus.cc:385] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:09.891743 17721 raft_consensus.cc:740] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:09.892516 17721 consensus_queue.cc:260] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.895140 17721 ts_tablet_manager.cc:1434] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.009s	user 0.007s	sys 0.002s
I20260709 12:29:09.896195 17721 tablet_bootstrap.cc:492] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:09.898259 17724 raft_consensus.cc:515] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.909884 17721 tablet_bootstrap.cc:654] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.917065 17743 raft_consensus.cc:493] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:09.919201 17728 raft_consensus.cc:493] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:09.917845 17743 raft_consensus.cc:515] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.919731 17728 raft_consensus.cc:515] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.922329 17728 leader_election.cc:290] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:09.922369 17720 tablet_bootstrap.cc:492] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:09.922400 17721 tablet_bootstrap.cc:492] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:09.923197 17720 ts_tablet_manager.cc:1403] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.105s	user 0.052s	sys 0.048s
I20260709 12:29:09.923204 17721 ts_tablet_manager.cc:1403] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.027s	user 0.006s	sys 0.013s
I20260709 12:29:09.927392 17720 raft_consensus.cc:359] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.929567 17720 raft_consensus.cc:385] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:09.927748 17721 raft_consensus.cc:359] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.930707 17721 raft_consensus.cc:385] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:09.931106 17721 raft_consensus.cc:740] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:09.931545 17722 tablet_bootstrap.cc:492] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:09.930224 17720 raft_consensus.cc:740] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:09.931537 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d18d64f1f4e62adaaf5463889c313" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
I20260709 12:29:09.932301 17722 ts_tablet_manager.cc:1403] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.107s	user 0.014s	sys 0.018s
I20260709 12:29:09.932459 17680 raft_consensus.cc:2468] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 0.
I20260709 12:29:09.933132 17720 consensus_queue.cc:260] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.933640 17496 leader_election.cc:304] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:09.935653 17722 raft_consensus.cc:359] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.936527 17722 raft_consensus.cc:385] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:09.936843 17722 raft_consensus.cc:740] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:09.937819 17722 consensus_queue.cc:260] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
W20260709 12:29:09.939379 17476 auto_rebalancer.cc:288] Could not retrieve cluster info: Service unavailable: Tablet not running
I20260709 12:29:09.932672 17721 consensus_queue.cc:260] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.943097 17605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d18d64f1f4e62adaaf5463889c313" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
I20260709 12:29:09.934433 17743 leader_election.cc:290] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:09.946998 17743 raft_consensus.cc:2804] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:09.947427 17743 raft_consensus.cc:493] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:09.947678 17722 ts_tablet_manager.cc:1434] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.015s	user 0.006s	sys 0.000s
I20260709 12:29:09.947844 17743 raft_consensus.cc:3060] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:09.949319 17721 ts_tablet_manager.cc:1434] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.025s	user 0.003s	sys 0.005s
W20260709 12:29:09.951077 17495 leader_election.cc:343] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:09.963483 17721 tablet_bootstrap.cc:492] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:09.964632 17605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6c5abfd4014f9385d4d326823caa63" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:09.965417 17605 raft_consensus.cc:3060] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:09.971001 17722 tablet_bootstrap.cc:492] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:09.971762 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6c5abfd4014f9385d4d326823caa63" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:09.972477 17680 raft_consensus.cc:3060] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:09.975952 17720 ts_tablet_manager.cc:1434] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.052s	user 0.020s	sys 0.020s
I20260709 12:29:09.976106 17604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d18d64f1f4e62adaaf5463889c313" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
W20260709 12:29:09.977808 17645 leader_election.cc:343] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:09.978811 17722 tablet_bootstrap.cc:654] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.979763 17720 tablet_bootstrap.cc:492] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:09.981456 17605 raft_consensus.cc:2468] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 1.
I20260709 12:29:09.982681 17495 leader_election.cc:304] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:09.983781 17749 raft_consensus.cc:2804] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:09.984759 17680 raft_consensus.cc:2468] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 1.
I20260709 12:29:09.985813 17749 raft_consensus.cc:697] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Becoming Leader. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:09.987111 17749 consensus_queue.cc:237] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.988181 17720 tablet_bootstrap.cc:654] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.988911 17743 raft_consensus.cc:515] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.989498 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ffbcfb8f514f94b30298d803ff4479" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
I20260709 12:29:09.990041 17721 tablet_bootstrap.cc:654] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:09.990271 17679 raft_consensus.cc:2468] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 0.
I20260709 12:29:09.991209 17728 raft_consensus.cc:493] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:09.991736 17728 raft_consensus.cc:515] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.995076 17722 tablet_bootstrap.cc:492] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:09.995661 17722 ts_tablet_manager.cc:1403] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.025s	user 0.013s	sys 0.005s
I20260709 12:29:09.995942 17743 leader_election.cc:290] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Requested vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:09.997443 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d18d64f1f4e62adaaf5463889c313" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:09.998142 17679 raft_consensus.cc:3060] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:09.998922 17722 raft_consensus.cc:359] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:09.999886 17722 raft_consensus.cc:385] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:10.000197 17722 raft_consensus.cc:740] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.001013 17722 consensus_queue.cc:260] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.002799 17743 raft_consensus.cc:493] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:09.996644 17728 leader_election.cc:290] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:10.003324 17743 raft_consensus.cc:515] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } } peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } }
I20260709 12:29:10.004654 17604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d18d64f1f4e62adaaf5463889c313" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:10.006112 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936d28e6956b49a3afaea2f695aec47a" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
W20260709 12:29:10.006287 17495 leader_election.cc:343] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:10.006804 17680 raft_consensus.cc:2468] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 0.
I20260709 12:29:10.008071 17496 leader_election.cc:304] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:10.009128 17748 raft_consensus.cc:2804] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:10.009399 17743 leader_election.cc:290] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:10.009526 17748 raft_consensus.cc:493] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.010130 17748 raft_consensus.cc:3060] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.010149 17722 ts_tablet_manager.cc:1434] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.014s	user 0.007s	sys 0.001s
I20260709 12:29:10.013450 17721 tablet_bootstrap.cc:492] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:10.014036 17721 ts_tablet_manager.cc:1403] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.051s	user 0.004s	sys 0.014s
I20260709 12:29:10.017161 17721 raft_consensus.cc:359] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.017891 17721 raft_consensus.cc:385] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:10.018178 17721 raft_consensus.cc:740] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.019219 17722 tablet_bootstrap.cc:492] T 936d28e6956b49a3afaea2f695aec47a P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:10.018896 17721 consensus_queue.cc:260] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.021412 17679 raft_consensus.cc:2468] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 1.
I20260709 12:29:10.021626 17721 ts_tablet_manager.cc:1434] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.007s	user 0.003s	sys 0.005s
I20260709 12:29:10.022975 17721 tablet_bootstrap.cc:492] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:10.022998 17496 leader_election.cc:304] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 1bdf878b9c63415bb5225d18d95f32f3
I20260709 12:29:10.024149 17743 raft_consensus.cc:2804] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:10.025728 17604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ffbcfb8f514f94b30298d803ff4479" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
I20260709 12:29:10.026505 17604 raft_consensus.cc:2468] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 0.
I20260709 12:29:10.027752 17645 leader_election.cc:304] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd; no voters: 
I20260709 12:29:10.028733 17728 raft_consensus.cc:2804] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:10.029127 17728 raft_consensus.cc:493] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.029480 17728 raft_consensus.cc:3060] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:09.952675 17724 leader_election.cc:290] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Requested vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:10.034952 17604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936d28e6956b49a3afaea2f695aec47a" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
W20260709 12:29:10.040071 17495 leader_election.cc:343] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:10.042246 17571 leader_election.cc:304] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd; no voters: 
I20260709 12:29:10.041234 17722 tablet_bootstrap.cc:654] T 936d28e6956b49a3afaea2f695aec47a P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:10.043474 17729 raft_consensus.cc:2804] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:10.043916 17729 raft_consensus.cc:493] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.044279 17729 raft_consensus.cc:3060] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.045889 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ffbcfb8f514f94b30298d803ff4479" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:10.046748 17530 raft_consensus.cc:2468] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 0.
I20260709 12:29:10.035606 17721 tablet_bootstrap.cc:654] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:10.051460 17743 raft_consensus.cc:697] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Becoming Leader. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:10.052572 17743 consensus_queue.cc:237] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.052867 17729 raft_consensus.cc:515] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.056025 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "f67d18d64f1f4e62adaaf5463889c313" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:10.058081 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ffbcfb8f514f94b30298d803ff4479" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:10.058719 17530 raft_consensus.cc:2468] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 0.
I20260709 12:29:10.060410 17643 leader_election.cc:304] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd; no voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b
I20260709 12:29:10.063676 17748 raft_consensus.cc:515] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } } peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } }
I20260709 12:29:10.067651 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936d28e6956b49a3afaea2f695aec47a" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:10.068404 17680 raft_consensus.cc:3060] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.069832 17722 tablet_bootstrap.cc:492] T 936d28e6956b49a3afaea2f695aec47a P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:10.069854 17721 tablet_bootstrap.cc:492] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:10.070497 17722 ts_tablet_manager.cc:1403] T 936d28e6956b49a3afaea2f695aec47a P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.051s	user 0.018s	sys 0.013s
I20260709 12:29:10.070696 17721 ts_tablet_manager.cc:1403] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.048s	user 0.015s	sys 0.000s
I20260709 12:29:10.073550 17721 raft_consensus.cc:359] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.073761 17722 raft_consensus.cc:359] T 936d28e6956b49a3afaea2f695aec47a P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } } peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } }
I20260709 12:29:10.074306 17721 raft_consensus.cc:385] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:10.074569 17722 raft_consensus.cc:385] T 936d28e6956b49a3afaea2f695aec47a P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:10.074620 17721 raft_consensus.cc:740] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.074947 17722 raft_consensus.cc:740] T 936d28e6956b49a3afaea2f695aec47a P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.075657 17721 consensus_queue.cc:260] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.075733 17722 consensus_queue.cc:260] T 936d28e6956b49a3afaea2f695aec47a P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } } peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } }
I20260709 12:29:10.077270 17680 raft_consensus.cc:2468] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 1.
I20260709 12:29:10.079097 17496 leader_election.cc:304] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:10.080143 17743 raft_consensus.cc:2804] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:10.080674 17743 raft_consensus.cc:697] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Becoming Leader. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:10.080714 17728 raft_consensus.cc:515] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.081666 17743 consensus_queue.cc:237] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } } peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } }
I20260709 12:29:10.085532 17722 ts_tablet_manager.cc:1434] T 936d28e6956b49a3afaea2f695aec47a P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.015s	user 0.012s	sys 0.000s
I20260709 12:29:10.087312 17729 leader_election.cc:290] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:10.088315 17729 raft_consensus.cc:493] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.088840 17729 raft_consensus.cc:515] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.092000 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ffbcfb8f514f94b30298d803ff4479" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:10.092917 17530 raft_consensus.cc:3060] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.106290 17722 tablet_bootstrap.cc:492] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:10.108748 17721 ts_tablet_manager.cc:1434] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.038s	user 0.009s	sys 0.007s
I20260709 12:29:10.110121 17721 tablet_bootstrap.cc:492] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:10.106333 17758 raft_consensus.cc:2749] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:10.117025 17605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "936d28e6956b49a3afaea2f695aec47a" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:10.117920 17605 raft_consensus.cc:3060] T 936d28e6956b49a3afaea2f695aec47a P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.118147 17722 tablet_bootstrap.cc:654] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:10.126041 17721 tablet_bootstrap.cc:654] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:10.125916 17728 leader_election.cc:290] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:10.122217 17758 raft_consensus.cc:493] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.129776 17604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ffbcfb8f514f94b30298d803ff4479" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:10.129567 17758 raft_consensus.cc:515] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.130661 17604 raft_consensus.cc:2393] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 81441d21f9f442cdbb8b7db3765484fd in current term 1: Already voted for candidate 1bdf878b9c63415bb5225d18d95f32f3 in this term.
I20260709 12:29:10.132473 17758 leader_election.cc:290] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:10.133812 17604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d428813b51b45acac6923de43089a2d" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
W20260709 12:29:10.135286 17645 leader_election.cc:343] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:10.135365 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3dc8230bed4a4a9ee2087323af1274" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:10.137285 17729 leader_election.cc:290] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:10.118356 17748 leader_election.cc:290] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Requested vote from peers 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
W20260709 12:29:10.138705 17568 leader_election.cc:343] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015): Illegal state: must be running to vote when last-logged opid is not known
W20260709 12:29:10.106053 17643 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.4.181.65:42015, user_credentials={real_user=slave}} blocked reactor thread for 45869.4us
I20260709 12:29:10.140259 17428 catalog_manager.cc:5697] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b reported cstate change: term changed from 0 to 1, leader changed from <none> to e8f68305d8674b5c825afab76ae8090b (127.4.181.65). New cstate: current_term: 1 leader_uuid: "e8f68305d8674b5c825afab76ae8090b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:10.138022 17530 raft_consensus.cc:2468] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 1.
I20260709 12:29:10.147341 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ffbcfb8f514f94b30298d803ff4479" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:10.147974 17568 leader_election.cc:304] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:10.148312 17529 raft_consensus.cc:2393] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 81441d21f9f442cdbb8b7db3765484fd in current term 1: Already voted for candidate 1bdf878b9c63415bb5225d18d95f32f3 in this term.
I20260709 12:29:10.148751 17729 raft_consensus.cc:2804] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:10.149219 17729 raft_consensus.cc:697] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Becoming Leader. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Running, Role: LEADER
I20260709 12:29:10.150343 17759 raft_consensus.cc:493] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.150473 17729 consensus_queue.cc:237] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.151010 17759 raft_consensus.cc:515] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.151862 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e4ffbcfb8f514f94b30298d803ff4479" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:10.152216 17643 leader_election.cc:304] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd; no voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b
I20260709 12:29:10.152709 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3dc8230bed4a4a9ee2087323af1274" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
I20260709 12:29:10.153450 17759 leader_election.cc:290] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:10.150717 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d428813b51b45acac6923de43089a2d" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:10.155272 17679 raft_consensus.cc:2393] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1bdf878b9c63415bb5225d18d95f32f3 in current term 1: Already voted for candidate 81441d21f9f442cdbb8b7db3765484fd in this term.
I20260709 12:29:10.156176 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b442e5d870aa4a52a5b258bb8c78a626" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:10.157641 17678 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b442e5d870aa4a52a5b258bb8c78a626" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
W20260709 12:29:10.157932 17568 leader_election.cc:343] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:10.158438 17678 raft_consensus.cc:2468] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 0.
I20260709 12:29:10.155539 17680 raft_consensus.cc:2468] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 0.
W20260709 12:29:10.159689 17643 leader_election.cc:343] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:10.160629 17728 raft_consensus.cc:2749] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260709 12:29:10.162184 17605 raft_consensus.cc:2468] T 936d28e6956b49a3afaea2f695aec47a P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 1.
I20260709 12:29:10.164327 17720 tablet_bootstrap.cc:492] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:10.168018 17720 ts_tablet_manager.cc:1403] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.188s	user 0.060s	sys 0.083s
I20260709 12:29:10.168165 17643 leader_election.cc:304] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd; no voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b
I20260709 12:29:10.170042 17758 raft_consensus.cc:2749] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:10.170950 17722 tablet_bootstrap.cc:492] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:10.171705 17722 ts_tablet_manager.cc:1403] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.066s	user 0.013s	sys 0.013s
I20260709 12:29:10.171491 17571 leader_election.cc:304] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd; no voters: e8f68305d8674b5c825afab76ae8090b
I20260709 12:29:10.172485 17759 raft_consensus.cc:2804] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:10.172844 17759 raft_consensus.cc:493] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.173173 17759 raft_consensus.cc:3060] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.174558 17720 raft_consensus.cc:359] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.175796 17722 raft_consensus.cc:359] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.177290 17722 raft_consensus.cc:385] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:10.177603 17722 raft_consensus.cc:740] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.178386 17722 consensus_queue.cc:260] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.178964 17721 tablet_bootstrap.cc:492] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:10.179512 17721 ts_tablet_manager.cc:1403] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.070s	user 0.008s	sys 0.011s
I20260709 12:29:10.180785 17722 ts_tablet_manager.cc:1434] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.009s	user 0.006s	sys 0.000s
I20260709 12:29:10.181902 17722 tablet_bootstrap.cc:492] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:10.182349 17721 raft_consensus.cc:359] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.183127 17721 raft_consensus.cc:385] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:10.183389 17721 raft_consensus.cc:740] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.176229 17571 leader_election.cc:304] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd; no voters: e8f68305d8674b5c825afab76ae8090b
I20260709 12:29:10.184047 17759 raft_consensus.cc:515] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.185062 17721 consensus_queue.cc:260] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.185446 17760 raft_consensus.cc:2804] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:10.175890 17720 raft_consensus.cc:385] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:10.186017 17760 raft_consensus.cc:493] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.186305 17720 raft_consensus.cc:740] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.186393 17760 raft_consensus.cc:3060] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.187220 17720 consensus_queue.cc:260] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.187561 17759 leader_election.cc:290] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:10.189679 17720 ts_tablet_manager.cc:1434] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:29:10.190831 17720 tablet_bootstrap.cc:492] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:10.191854 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b442e5d870aa4a52a5b258bb8c78a626" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:10.192540 17530 raft_consensus.cc:3060] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.196084 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b442e5d870aa4a52a5b258bb8c78a626" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:10.196943 17679 raft_consensus.cc:3060] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.198402 17720 tablet_bootstrap.cc:654] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:10.203392 17760 raft_consensus.cc:515] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.204509 17722 tablet_bootstrap.cc:654] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:10.205003 17728 raft_consensus.cc:493] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.205623 17728 raft_consensus.cc:515] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.206748 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3dc8230bed4a4a9ee2087323af1274" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
W20260709 12:29:10.208470 17568 leader_election.cc:343] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:10.209242 17728 leader_election.cc:290] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:10.209517 17605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bcdba75ad0445ca47283e77797e7fa" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
W20260709 12:29:10.210937 17645 leader_election.cc:343] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:10.211030 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bcdba75ad0445ca47283e77797e7fa" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:10.212493 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3dc8230bed4a4a9ee2087323af1274" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:10.213146 17679 raft_consensus.cc:2468] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 1.
W20260709 12:29:10.213467 17643 leader_election.cc:343] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:10.213976 17643 leader_election.cc:304] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd; no voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b
I20260709 12:29:10.210495 17760 leader_election.cc:290] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:10.215509 17571 leader_election.cc:304] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd; no voters: 
I20260709 12:29:10.215932 17758 raft_consensus.cc:2749] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:10.213178 17680 raft_consensus.cc:3060] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.219506 17720 tablet_bootstrap.cc:492] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:10.220096 17720 ts_tablet_manager.cc:1403] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.029s	user 0.015s	sys 0.000s
I20260709 12:29:10.221822 17530 raft_consensus.cc:2468] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 1.
I20260709 12:29:10.222352 17729 raft_consensus.cc:2804] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:10.222992 17729 raft_consensus.cc:697] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Becoming Leader. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Running, Role: LEADER
I20260709 12:29:10.223397 17720 raft_consensus.cc:359] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.224012 17721 ts_tablet_manager.cc:1434] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.044s	user 0.007s	sys 0.000s
I20260709 12:29:10.224248 17720 raft_consensus.cc:385] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:10.223894 17729 consensus_queue.cc:237] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.224577 17720 raft_consensus.cc:740] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.225029 17425 catalog_manager.cc:5697] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:10.225842 17720 consensus_queue.cc:260] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.228461 17720 ts_tablet_manager.cc:1434] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.008s	user 0.008s	sys 0.000s
I20260709 12:29:10.229844 17720 tablet_bootstrap.cc:492] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:10.232141 17722 tablet_bootstrap.cc:492] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:10.232758 17722 ts_tablet_manager.cc:1403] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.051s	user 0.014s	sys 0.001s
I20260709 12:29:10.236212 17722 raft_consensus.cc:359] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.237073 17722 raft_consensus.cc:385] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:10.237380 17722 raft_consensus.cc:740] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.238214 17722 consensus_queue.cc:260] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.244983 17722 ts_tablet_manager.cc:1434] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.012s	user 0.007s	sys 0.001s
I20260709 12:29:10.246065 17722 tablet_bootstrap.cc:492] T f67d18d64f1f4e62adaaf5463889c313 P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:10.248688 17428 catalog_manager.cc:5697] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b reported cstate change: term changed from 0 to 1, leader changed from <none> to e8f68305d8674b5c825afab76ae8090b (127.4.181.65). New cstate: current_term: 1 leader_uuid: "e8f68305d8674b5c825afab76ae8090b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:10.251003 17428 catalog_manager.cc:5697] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b reported cstate change: term changed from 0 to 1, leader changed from <none> to e8f68305d8674b5c825afab76ae8090b (127.4.181.65). New cstate: current_term: 1 leader_uuid: "e8f68305d8674b5c825afab76ae8090b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:10.254418 17722 tablet_bootstrap.cc:654] T f67d18d64f1f4e62adaaf5463889c313 P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:10.261415 17680 raft_consensus.cc:2468] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 1.
I20260709 12:29:10.262739 17571 leader_election.cc:304] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd; no voters: e8f68305d8674b5c825afab76ae8090b
I20260709 12:29:10.263005 17720 tablet_bootstrap.cc:654] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:10.264420 17759 raft_consensus.cc:2804] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:10.265164 17759 raft_consensus.cc:697] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Becoming Leader. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Running, Role: LEADER
I20260709 12:29:10.266124 17759 consensus_queue.cc:237] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.269125 17722 tablet_bootstrap.cc:492] T f67d18d64f1f4e62adaaf5463889c313 P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:10.269701 17722 ts_tablet_manager.cc:1403] T f67d18d64f1f4e62adaaf5463889c313 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.024s	user 0.008s	sys 0.004s
I20260709 12:29:10.272933 17722 raft_consensus.cc:359] T f67d18d64f1f4e62adaaf5463889c313 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.273867 17722 raft_consensus.cc:385] T f67d18d64f1f4e62adaaf5463889c313 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:10.274223 17722 raft_consensus.cc:740] T f67d18d64f1f4e62adaaf5463889c313 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.279260 17722 consensus_queue.cc:260] T f67d18d64f1f4e62adaaf5463889c313 P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.280005 17748 raft_consensus.cc:493] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.280592 17748 raft_consensus.cc:515] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.281514 17722 ts_tablet_manager.cc:1434] T f67d18d64f1f4e62adaaf5463889c313 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.012s	user 0.008s	sys 0.000s
I20260709 12:29:10.281255 17428 catalog_manager.cc:5697] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:10.282346 17722 tablet_bootstrap.cc:492] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:10.282917 17748 leader_election.cc:290] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:10.283740 17605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d428813b51b45acac6923de43089a2d" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
I20260709 12:29:10.284165 17720 tablet_bootstrap.cc:492] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:10.284440 17605 raft_consensus.cc:2468] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 0.
I20260709 12:29:10.284641 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d428813b51b45acac6923de43089a2d" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
I20260709 12:29:10.284865 17720 ts_tablet_manager.cc:1403] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.055s	user 0.013s	sys 0.007s
I20260709 12:29:10.285431 17680 raft_consensus.cc:2468] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 0.
I20260709 12:29:10.286194 17495 leader_election.cc:304] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:10.287074 17748 raft_consensus.cc:2804] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:10.287468 17748 raft_consensus.cc:493] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.287810 17748 raft_consensus.cc:3060] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.289055 17722 tablet_bootstrap.cc:654] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:10.288933 17720 raft_consensus.cc:359] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.289989 17720 raft_consensus.cc:385] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:10.290373 17720 raft_consensus.cc:740] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.291257 17720 consensus_queue.cc:260] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.295804 17748 raft_consensus.cc:515] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.297025 17720 ts_tablet_manager.cc:1434] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.011s	user 0.004s	sys 0.004s
I20260709 12:29:10.298419 17720 tablet_bootstrap.cc:492] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:10.298890 17605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d428813b51b45acac6923de43089a2d" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:10.299571 17605 raft_consensus.cc:3060] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.306438 17720 tablet_bootstrap.cc:654] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:10.307279 17605 raft_consensus.cc:2468] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 1.
I20260709 12:29:10.308614 17495 leader_election.cc:304] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:10.309542 17743 raft_consensus.cc:2804] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:10.310009 17743 raft_consensus.cc:697] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Becoming Leader. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:10.310868 17743 consensus_queue.cc:237] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.313622 17749 raft_consensus.cc:493] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.314188 17749 raft_consensus.cc:515] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.317494 17749 leader_election.cc:290] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:10.320040 17604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3dc8230bed4a4a9ee2087323af1274" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
I20260709 12:29:10.321810 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8c3dc8230bed4a4a9ee2087323af1274" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
I20260709 12:29:10.322692 17680 raft_consensus.cc:2393] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e8f68305d8674b5c825afab76ae8090b in current term 1: Already voted for candidate 1bdf878b9c63415bb5225d18d95f32f3 in this term.
I20260709 12:29:10.323945 17496 leader_election.cc:304] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e8f68305d8674b5c825afab76ae8090b; no voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd
I20260709 12:29:10.325105 17749 raft_consensus.cc:3060] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.331568 17749 raft_consensus.cc:2749] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:10.321810 17425 catalog_manager.cc:5697] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:10.335999 17748 leader_election.cc:290] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Requested vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:10.342772 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d428813b51b45acac6923de43089a2d" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:10.343608 17680 raft_consensus.cc:3060] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.347405 17722 tablet_bootstrap.cc:492] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:10.347980 17722 ts_tablet_manager.cc:1403] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.066s	user 0.019s	sys 0.044s
I20260709 12:29:10.348270 17720 tablet_bootstrap.cc:492] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:10.348801 17720 ts_tablet_manager.cc:1403] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.051s	user 0.027s	sys 0.019s
I20260709 12:29:10.350977 17722 raft_consensus.cc:359] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.351403 17680 raft_consensus.cc:2468] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 1.
I20260709 12:29:10.351781 17722 raft_consensus.cc:385] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:10.351526 17720 raft_consensus.cc:359] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.352183 17722 raft_consensus.cc:740] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.352330 17720 raft_consensus.cc:385] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:10.352674 17720 raft_consensus.cc:740] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.353078 17722 consensus_queue.cc:260] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.353420 17720 consensus_queue.cc:260] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.353078 17428 catalog_manager.cc:5697] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b reported cstate change: term changed from 0 to 1, leader changed from <none> to e8f68305d8674b5c825afab76ae8090b (127.4.181.65). New cstate: current_term: 1 leader_uuid: "e8f68305d8674b5c825afab76ae8090b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:10.355257 17722 ts_tablet_manager.cc:1434] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.007s	user 0.008s	sys 0.000s
I20260709 12:29:10.355391 17720 ts_tablet_manager.cc:1434] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.006s	user 0.007s	sys 0.001s
I20260709 12:29:10.356472 17720 tablet_bootstrap.cc:492] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:10.361912 17720 tablet_bootstrap.cc:654] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:10.367107 17720 tablet_bootstrap.cc:492] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:10.367602 17720 ts_tablet_manager.cc:1403] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.011s	user 0.009s	sys 0.000s
I20260709 12:29:10.370324 17720 raft_consensus.cc:359] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.370942 17720 raft_consensus.cc:385] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:10.371160 17720 raft_consensus.cc:740] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:10.371750 17720 consensus_queue.cc:260] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.373206 17720 ts_tablet_manager.cc:1434] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:10.477079 17743 consensus_queue.cc:1048] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:10.488981 17748 consensus_queue.cc:1048] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:10.550522 17748 consensus_queue.cc:1048] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:10.560968 17749 consensus_queue.cc:1048] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:10.601171 17605 raft_consensus.cc:3060] T f67d18d64f1f4e62adaaf5463889c313 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.606925 17759 raft_consensus.cc:493] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.607535 17749 consensus_queue.cc:1048] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:10.607540 17759 raft_consensus.cc:515] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.609619 17759 leader_election.cc:290] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:10.610610 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bcdba75ad0445ca47283e77797e7fa" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:10.610769 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bcdba75ad0445ca47283e77797e7fa" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
I20260709 12:29:10.611346 17680 raft_consensus.cc:2468] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 0.
I20260709 12:29:10.611344 17530 raft_consensus.cc:2468] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 0.
I20260709 12:29:10.612506 17571 leader_election.cc:304] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd; no voters: 
I20260709 12:29:10.613335 17759 raft_consensus.cc:2804] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:10.613757 17759 raft_consensus.cc:493] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.614135 17759 raft_consensus.cc:3060] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.621098 17753 consensus_queue.cc:1048] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:10.627498 17759 raft_consensus.cc:515] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.631178 17759 leader_election.cc:290] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:10.631258 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bcdba75ad0445ca47283e77797e7fa" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:10.631950 17530 raft_consensus.cc:3060] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.632633 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bcdba75ad0445ca47283e77797e7fa" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:10.633270 17679 raft_consensus.cc:3060] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.633178 17759 consensus_queue.cc:1048] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:10.639688 17530 raft_consensus.cc:2468] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 1.
I20260709 12:29:10.641045 17568 leader_election.cc:304] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:10.641405 17679 raft_consensus.cc:2468] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 1.
I20260709 12:29:10.641983 17759 raft_consensus.cc:2804] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:10.642633 17759 raft_consensus.cc:697] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Becoming Leader. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Running, Role: LEADER
I20260709 12:29:10.643585 17759 consensus_queue.cc:237] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.656152 17759 consensus_queue.cc:1048] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:10.660194 17428 catalog_manager.cc:5697] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:10.661485 17728 raft_consensus.cc:493] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:10.662099 17728 raft_consensus.cc:515] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.664408 17728 leader_election.cc:290] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:10.666452 17605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e73a457ec8c74b5481defe532b6ba268" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
I20260709 12:29:10.666698 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e73a457ec8c74b5481defe532b6ba268" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:10.667506 17530 raft_consensus.cc:2468] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 0.
I20260709 12:29:10.667212 17605 raft_consensus.cc:2468] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 0.
I20260709 12:29:10.668892 17643 leader_election.cc:304] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:10.669633 17728 raft_consensus.cc:2804] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:10.669986 17728 raft_consensus.cc:493] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:10.670270 17728 raft_consensus.cc:3060] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.676038 17728 raft_consensus.cc:515] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.678078 17728 leader_election.cc:290] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:10.678591 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e73a457ec8c74b5481defe532b6ba268" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:10.679136 17605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e73a457ec8c74b5481defe532b6ba268" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:10.679203 17530 raft_consensus.cc:3060] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.679603 17605 raft_consensus.cc:3060] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:10.684074 17530 raft_consensus.cc:2468] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 1.
I20260709 12:29:10.684332 17605 raft_consensus.cc:2468] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 1.
I20260709 12:29:10.685163 17643 leader_election.cc:304] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:10.685802 17728 raft_consensus.cc:2804] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:10.686132 17728 raft_consensus.cc:697] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Becoming Leader. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Running, Role: LEADER
I20260709 12:29:10.686895 17728 consensus_queue.cc:237] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:10.693598 17428 catalog_manager.cc:5697] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67). New cstate: current_term: 1 leader_uuid: "81441d21f9f442cdbb8b7db3765484fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:10.722450 17753 consensus_queue.cc:1048] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:10.723050 17759 consensus_queue.cc:1048] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:10.736981 17743 consensus_queue.cc:1048] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:10.742864 17760 consensus_queue.cc:1048] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:10.813851 17759 consensus_queue.cc:1048] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:10.819655 17759 consensus_queue.cc:1048] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:10.935636 17605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "b442e5d870aa4a52a5b258bb8c78a626"
dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
mode: GRACEFUL
new_leader_uuid: "e8f68305d8674b5c825afab76ae8090b"
 from {username='slave'} at 127.0.0.1:47838
I20260709 12:29:10.936216 17605 raft_consensus.cc:606] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Received request to transfer leadership to TS e8f68305d8674b5c825afab76ae8090b
I20260709 12:29:10.961800 17530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "6d428813b51b45acac6923de43089a2d"
dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
mode: GRACEFUL
new_leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
 from {username='slave'} at 127.0.0.1:33540
I20260709 12:29:10.962332 17530 raft_consensus.cc:606] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Received request to transfer leadership to TS 1bdf878b9c63415bb5225d18d95f32f3
I20260709 12:29:10.975718 17679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e73a457ec8c74b5481defe532b6ba268"
dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
mode: GRACEFUL
new_leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:29:10.976280 17679 raft_consensus.cc:606] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Received request to transfer leadership to TS 1bdf878b9c63415bb5225d18d95f32f3
I20260709 12:29:10.982057 17605 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "19bcdba75ad0445ca47283e77797e7fa"
dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
mode: GRACEFUL
new_leader_uuid: "81441d21f9f442cdbb8b7db3765484fd"
 from {username='slave'} at 127.0.0.1:47838
I20260709 12:29:10.982651 17605 raft_consensus.cc:606] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Received request to transfer leadership to TS 81441d21f9f442cdbb8b7db3765484fd
I20260709 12:29:11.110612 17759 consensus_queue.cc:1048] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:11.118929 17790 raft_consensus.cc:993] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3: : Instructing follower 81441d21f9f442cdbb8b7db3765484fd to start an election
I20260709 12:29:11.119414 17729 raft_consensus.cc:1081] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Signalling peer 81441d21f9f442cdbb8b7db3765484fd to start an election
I20260709 12:29:11.121466 17680 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "19bcdba75ad0445ca47283e77797e7fa"
dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
 from {username='slave'} at 127.0.0.1:42434
I20260709 12:29:11.122172 17680 raft_consensus.cc:493] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:11.122620 17680 raft_consensus.cc:3060] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.124328 17790 consensus_queue.cc:1048] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:11.129554 17680 raft_consensus.cc:515] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:11.135387 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bcdba75ad0445ca47283e77797e7fa" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:11.139453 17605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "19bcdba75ad0445ca47283e77797e7fa" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:11.140254 17605 raft_consensus.cc:3055] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:11.140623 17605 raft_consensus.cc:740] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Running, Role: LEADER
I20260709 12:29:11.141382 17605 consensus_queue.cc:260] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:11.142068 17680 leader_election.cc:290] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 2 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:11.142390 17605 raft_consensus.cc:3060] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.151329 17605 raft_consensus.cc:2468] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 2.
I20260709 12:29:11.152591 17645 leader_election.cc:304] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd; no voters: e8f68305d8674b5c825afab76ae8090b
I20260709 12:29:11.153401 17728 raft_consensus.cc:2804] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:11.153995 17728 raft_consensus.cc:697] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 2 LEADER]: Becoming Leader. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Running, Role: LEADER
I20260709 12:29:11.155014 17728 consensus_queue.cc:237] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:11.162654 17425 catalog_manager.cc:5697] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd reported cstate change: term changed from 1 to 2, leader changed from 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66) to 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67). New cstate: current_term: 2 leader_uuid: "81441d21f9f442cdbb8b7db3765484fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:11.230372 17728 consensus_queue.cc:1048] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:11.239959 17758 raft_consensus.cc:993] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd: : Instructing follower 1bdf878b9c63415bb5225d18d95f32f3 to start an election
I20260709 12:29:11.240697 17728 raft_consensus.cc:1081] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Signalling peer 1bdf878b9c63415bb5225d18d95f32f3 to start an election
I20260709 12:29:11.242527 17604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e73a457ec8c74b5481defe532b6ba268"
dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
 from {username='slave'} at 127.0.0.1:47830
I20260709 12:29:11.245173 17604 raft_consensus.cc:493] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:11.245625 17604 raft_consensus.cc:3060] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.248381 17758 consensus_queue.cc:1048] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:11.257107 17604 raft_consensus.cc:515] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:11.262938 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e73a457ec8c74b5481defe532b6ba268" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:11.263583 17530 raft_consensus.cc:3060] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.263760 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e73a457ec8c74b5481defe532b6ba268" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:11.264467 17679 raft_consensus.cc:3055] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:11.264798 17679 raft_consensus.cc:740] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Running, Role: LEADER
I20260709 12:29:11.266021 17679 consensus_queue.cc:260] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:11.267174 17679 raft_consensus.cc:3060] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.264684 17604 leader_election.cc:290] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 2 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:11.272248 17530 raft_consensus.cc:2468] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 2.
I20260709 12:29:11.273908 17568 leader_election.cc:304] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:11.274953 17729 raft_consensus.cc:2804] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:11.275360 17679 raft_consensus.cc:2468] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 2.
I20260709 12:29:11.275425 17729 raft_consensus.cc:697] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 LEADER]: Becoming Leader. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Running, Role: LEADER
I20260709 12:29:11.276921 17729 consensus_queue.cc:237] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:11.283710 17427 catalog_manager.cc:5697] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 reported cstate change: term changed from 1 to 2, leader changed from 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67) to 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:11.344630 17748 raft_consensus.cc:993] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b: : Instructing follower 1bdf878b9c63415bb5225d18d95f32f3 to start an election
I20260709 12:29:11.345086 17743 raft_consensus.cc:1081] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Signalling peer 1bdf878b9c63415bb5225d18d95f32f3 to start an election
I20260709 12:29:11.346563 17604 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "6d428813b51b45acac6923de43089a2d"
dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
 from {username='slave'} at 127.0.0.1:47826
I20260709 12:29:11.347208 17604 raft_consensus.cc:493] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:11.347595 17604 raft_consensus.cc:3060] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.354496 17604 raft_consensus.cc:515] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:11.356148 17604 leader_election.cc:290] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 2 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:11.357108 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d428813b51b45acac6923de43089a2d" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:11.357260 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "6d428813b51b45acac6923de43089a2d" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:11.357708 17530 raft_consensus.cc:3055] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:11.357944 17679 raft_consensus.cc:3060] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.358038 17530 raft_consensus.cc:740] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:11.359105 17530 consensus_queue.cc:260] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:11.360070 17530 raft_consensus.cc:3060] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.363641 17679 raft_consensus.cc:2468] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 2.
I20260709 12:29:11.364817 17571 leader_election.cc:304] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd; no voters: 
I20260709 12:29:11.365247 17530 raft_consensus.cc:2468] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 2.
I20260709 12:29:11.365468 17729 raft_consensus.cc:2804] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:11.365974 17729 raft_consensus.cc:697] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 LEADER]: Becoming Leader. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Running, Role: LEADER
I20260709 12:29:11.366797 17729 consensus_queue.cc:237] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:11.373021 17427 catalog_manager.cc:5697] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 reported cstate change: term changed from 1 to 2, leader changed from e8f68305d8674b5c825afab76ae8090b (127.4.181.65) to 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:11.391332 17759 raft_consensus.cc:993] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3: : Instructing follower e8f68305d8674b5c825afab76ae8090b to start an election
I20260709 12:29:11.391904 17729 raft_consensus.cc:1081] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Signalling peer e8f68305d8674b5c825afab76ae8090b to start an election
I20260709 12:29:11.393464 17530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "b442e5d870aa4a52a5b258bb8c78a626"
dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
 from {username='slave'} at 127.0.0.1:33514
I20260709 12:29:11.393965 17530 raft_consensus.cc:493] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:11.394268 17530 raft_consensus.cc:3060] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.399501 17530 raft_consensus.cc:515] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:11.401263 17530 leader_election.cc:290] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 2 election: Requested vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:11.402172 17604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b442e5d870aa4a52a5b258bb8c78a626" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:11.402340 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "b442e5d870aa4a52a5b258bb8c78a626" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:11.402961 17679 raft_consensus.cc:3060] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.403038 17604 raft_consensus.cc:3055] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:11.403466 17604 raft_consensus.cc:740] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Running, Role: LEADER
I20260709 12:29:11.404134 17604 consensus_queue.cc:260] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:11.405081 17604 raft_consensus.cc:3060] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.408386 17679 raft_consensus.cc:2468] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 2.
I20260709 12:29:11.409648 17496 leader_election.cc:304] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:11.410552 17743 raft_consensus.cc:2804] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:11.411082 17743 raft_consensus.cc:697] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [term 2 LEADER]: Becoming Leader. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:11.411873 17743 consensus_queue.cc:237] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:11.412621 17604 raft_consensus.cc:2468] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 2.
I20260709 12:29:11.418807 17427 catalog_manager.cc:5697] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b reported cstate change: term changed from 1 to 2, leader changed from 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66) to e8f68305d8674b5c825afab76ae8090b (127.4.181.65). New cstate: current_term: 2 leader_uuid: "e8f68305d8674b5c825afab76ae8090b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:11.679839 17604 raft_consensus.cc:1275] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Refusing update from remote peer 81441d21f9f442cdbb8b7db3765484fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.681041 17728 consensus_queue.cc:1048] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.688537 17530 raft_consensus.cc:3060] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:11.695837 17530 raft_consensus.cc:1275] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Refusing update from remote peer 81441d21f9f442cdbb8b7db3765484fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.697110 17728 consensus_queue.cc:1048] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.765901 17530 raft_consensus.cc:1275] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Refusing update from remote peer 1bdf878b9c63415bb5225d18d95f32f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.767210 17729 consensus_queue.cc:1048] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.776069 17679 raft_consensus.cc:1275] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Refusing update from remote peer 1bdf878b9c63415bb5225d18d95f32f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.777572 17759 consensus_queue.cc:1048] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.798285 17679 raft_consensus.cc:1275] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Refusing update from remote peer 1bdf878b9c63415bb5225d18d95f32f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.799546 17759 consensus_queue.cc:1048] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.807317 17530 raft_consensus.cc:1275] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Refusing update from remote peer 1bdf878b9c63415bb5225d18d95f32f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.810051 17812 consensus_queue.cc:1048] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:11.904827 17604 raft_consensus.cc:1275] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Refusing update from remote peer e8f68305d8674b5c825afab76ae8090b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.906270 17743 consensus_queue.cc:1048] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:11.915575 17679 raft_consensus.cc:1275] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Refusing update from remote peer e8f68305d8674b5c825afab76ae8090b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:11.917536 17814 consensus_queue.cc:1048] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:14.013233 17427 catalog_manager.cc:2283] Servicing CreateTable request from {username='slave'} at 127.0.0.1:56574:
name: "soft_deleted_table"
schema {
  columns {
    name: "key"
    type: INT32
    is_key: true
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "int_val"
    type: INT32
    is_key: false
    is_nullable: false
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
  columns {
    name: "string_val"
    type: STRING
    is_key: false
    is_nullable: true
    encoding: AUTO_ENCODING
    compression: DEFAULT_COMPRESSION
    cfile_block_size: 0
    immutable: false
  }
}
num_replicas: 3
split_rows_range_bounds {
  rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
  indirect_data: """"
}
partition_schema {
  range_schema {
    columns {
      name: "key"
    }
  }
}
W20260709 12:29:14.015878 17427 catalog_manager.cc:7077] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260709 12:29:14.067093 17517 tablet_service.cc:1511] Processing CreateTablet for tablet c0fe7fbeab8346e6851bdf62eee362cf (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:14.067886 17588 tablet_service.cc:1511] Processing CreateTablet for tablet c0fe7fbeab8346e6851bdf62eee362cf (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:14.068480 17517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0fe7fbeab8346e6851bdf62eee362cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.069769 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0fe7fbeab8346e6851bdf62eee362cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.071676 17663 tablet_service.cc:1511] Processing CreateTablet for tablet c0fe7fbeab8346e6851bdf62eee362cf (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION VALUES < 238609294
I20260709 12:29:14.072496 17518 tablet_service.cc:1511] Processing CreateTablet for tablet e0230111cda042999f62a185104bf907 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:14.073807 17518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0230111cda042999f62a185104bf907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.073047 17663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0fe7fbeab8346e6851bdf62eee362cf. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.078713 17587 tablet_service.cc:1511] Processing CreateTablet for tablet e0230111cda042999f62a185104bf907 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:14.080385 17587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0230111cda042999f62a185104bf907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.097891 17827 tablet_bootstrap.cc:492] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:14.101711 17828 tablet_bootstrap.cc:492] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:14.104817 17517 tablet_service.cc:1511] Processing CreateTablet for tablet 384a1b6765dd4606b086be68b7a0e8b0 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:14.105770 17588 tablet_service.cc:1511] Processing CreateTablet for tablet 384a1b6765dd4606b086be68b7a0e8b0 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:14.106613 17517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 384a1b6765dd4606b086be68b7a0e8b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.107295 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 384a1b6765dd4606b086be68b7a0e8b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.109316 17664 tablet_service.cc:1511] Processing CreateTablet for tablet e0230111cda042999f62a185104bf907 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20260709 12:29:14.110810 17664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e0230111cda042999f62a185104bf907. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.118098 17828 tablet_bootstrap.cc:654] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.120858 17666 tablet_service.cc:1511] Processing CreateTablet for tablet 384a1b6765dd4606b086be68b7a0e8b0 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20260709 12:29:14.129247 17666 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 384a1b6765dd4606b086be68b7a0e8b0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.130515 17515 tablet_service.cc:1511] Processing CreateTablet for tablet dbbfc9d2b1d24a4790f57b14ba39c1c4 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:14.131927 17515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbfc9d2b1d24a4790f57b14ba39c1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.121098 17518 tablet_service.cc:1511] Processing CreateTablet for tablet a1e9753b18a14698a48b2634cbb6735d (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:14.122655 17593 tablet_service.cc:1511] Processing CreateTablet for tablet a1e9753b18a14698a48b2634cbb6735d (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:14.124219 17662 tablet_service.cc:1511] Processing CreateTablet for tablet a1e9753b18a14698a48b2634cbb6735d (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20260709 12:29:14.136909 17593 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e9753b18a14698a48b2634cbb6735d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.137486 17827 tablet_bootstrap.cc:654] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.136900 17518 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e9753b18a14698a48b2634cbb6735d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.144378 17662 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a1e9753b18a14698a48b2634cbb6735d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.144855 17587 tablet_service.cc:1511] Processing CreateTablet for tablet dbbfc9d2b1d24a4790f57b14ba39c1c4 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:14.151820 17669 tablet_service.cc:1511] Processing CreateTablet for tablet dbbfc9d2b1d24a4790f57b14ba39c1c4 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20260709 12:29:14.153355 17669 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbfc9d2b1d24a4790f57b14ba39c1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.146327 17587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dbbfc9d2b1d24a4790f57b14ba39c1c4. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.168956 17517 tablet_service.cc:1511] Processing CreateTablet for tablet 8458b7f6b80643488fd4bb86f4b52f20 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:14.175624 17670 tablet_service.cc:1511] Processing CreateTablet for tablet 8458b7f6b80643488fd4bb86f4b52f20 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:14.176644 17588 tablet_service.cc:1511] Processing CreateTablet for tablet 8458b7f6b80643488fd4bb86f4b52f20 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20260709 12:29:14.177982 17588 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8458b7f6b80643488fd4bb86f4b52f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.177107 17670 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8458b7f6b80643488fd4bb86f4b52f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.187263 17592 tablet_service.cc:1511] Processing CreateTablet for tablet dfcd1f37558f4559bf9af2b0f6768600 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:14.188685 17592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfcd1f37558f4559bf9af2b0f6768600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.191500 17664 tablet_service.cc:1511] Processing CreateTablet for tablet dfcd1f37558f4559bf9af2b0f6768600 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:14.195494 17515 tablet_service.cc:1511] Processing CreateTablet for tablet dfcd1f37558f4559bf9af2b0f6768600 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20260709 12:29:14.196703 17664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfcd1f37558f4559bf9af2b0f6768600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.199594 17514 tablet_service.cc:1511] Processing CreateTablet for tablet a7851836951b47fd84e1e04bb97aa015 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:14.175634 17517 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8458b7f6b80643488fd4bb86f4b52f20. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.201328 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7851836951b47fd84e1e04bb97aa015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.203047 17515 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet dfcd1f37558f4559bf9af2b0f6768600. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.218019 17590 tablet_service.cc:1511] Processing CreateTablet for tablet a7851836951b47fd84e1e04bb97aa015 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:14.219532 17590 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7851836951b47fd84e1e04bb97aa015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.227320 17830 tablet_bootstrap.cc:492] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:14.231779 17827 tablet_bootstrap.cc:492] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:14.232430 17827 ts_tablet_manager.cc:1403] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.135s	user 0.005s	sys 0.011s
I20260709 12:29:14.233489 17663 tablet_service.cc:1511] Processing CreateTablet for tablet a7851836951b47fd84e1e04bb97aa015 (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20260709 12:29:14.234977 17663 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a7851836951b47fd84e1e04bb97aa015. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.240664 17827 raft_consensus.cc:359] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.241572 17827 raft_consensus.cc:385] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.241909 17827 raft_consensus.cc:740] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.245651 17827 consensus_queue.cc:260] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.252454 17827 ts_tablet_manager.cc:1434] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.020s	user 0.008s	sys 0.001s
I20260709 12:29:14.253593 17827 tablet_bootstrap.cc:492] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:14.261121 17827 tablet_bootstrap.cc:654] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.263986 17592 tablet_service.cc:1511] Processing CreateTablet for tablet 018c076072bb42608d8414d6ec91f80f (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:14.267602 17592 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018c076072bb42608d8414d6ec91f80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.266232 17664 tablet_service.cc:1511] Processing CreateTablet for tablet 018c076072bb42608d8414d6ec91f80f (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:14.272599 17664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018c076072bb42608d8414d6ec91f80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.274353 17514 tablet_service.cc:1511] Processing CreateTablet for tablet 018c076072bb42608d8414d6ec91f80f (DEFAULT_TABLE table=soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20260709 12:29:14.275040 17828 tablet_bootstrap.cc:492] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:14.275584 17828 ts_tablet_manager.cc:1403] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.174s	user 0.009s	sys 0.021s
I20260709 12:29:14.272993 17830 tablet_bootstrap.cc:654] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.273481 17827 tablet_bootstrap.cc:492] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:14.278148 17827 ts_tablet_manager.cc:1403] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.025s	user 0.010s	sys 0.009s
I20260709 12:29:14.278584 17828 raft_consensus.cc:359] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.279366 17828 raft_consensus.cc:385] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.279651 17828 raft_consensus.cc:740] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.280402 17828 consensus_queue.cc:260] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.275713 17514 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 018c076072bb42608d8414d6ec91f80f. 1 dirs total, 0 dirs full, 0 dirs failed
I20260709 12:29:14.281886 17827 raft_consensus.cc:359] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.282711 17827 raft_consensus.cc:385] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.283053 17827 raft_consensus.cc:740] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.283983 17827 consensus_queue.cc:260] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.289479 17827 ts_tablet_manager.cc:1434] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.011s	user 0.006s	sys 0.000s
I20260709 12:29:14.291719 17830 tablet_bootstrap.cc:492] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:14.292281 17830 ts_tablet_manager.cc:1403] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.065s	user 0.012s	sys 0.002s
I20260709 12:29:14.295864 17830 raft_consensus.cc:359] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.296646 17830 raft_consensus.cc:385] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.296962 17830 raft_consensus.cc:740] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.297773 17830 consensus_queue.cc:260] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.309387 17828 ts_tablet_manager.cc:1434] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.033s	user 0.003s	sys 0.004s
I20260709 12:29:14.310513 17828 tablet_bootstrap.cc:492] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:14.311250 17830 ts_tablet_manager.cc:1434] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.019s	user 0.007s	sys 0.000s
I20260709 12:29:14.312400 17830 tablet_bootstrap.cc:492] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:14.317528 17827 tablet_bootstrap.cc:492] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:14.324236 17828 tablet_bootstrap.cc:654] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.324381 17830 tablet_bootstrap.cc:654] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.325348 17827 tablet_bootstrap.cc:654] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.335754 17827 tablet_bootstrap.cc:492] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:14.335948 17830 tablet_bootstrap.cc:492] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:14.336305 17827 ts_tablet_manager.cc:1403] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.019s	user 0.013s	sys 0.000s
I20260709 12:29:14.336488 17830 ts_tablet_manager.cc:1403] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.024s	user 0.015s	sys 0.001s
I20260709 12:29:14.336771 17828 tablet_bootstrap.cc:492] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:14.337334 17828 ts_tablet_manager.cc:1403] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.027s	user 0.008s	sys 0.008s
I20260709 12:29:14.339149 17830 raft_consensus.cc:359] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.339785 17830 raft_consensus.cc:385] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.340221 17830 raft_consensus.cc:740] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.339668 17827 raft_consensus.cc:359] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.340783 17827 raft_consensus.cc:385] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.340500 17828 raft_consensus.cc:359] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.341271 17827 raft_consensus.cc:740] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.341554 17828 raft_consensus.cc:385] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.341907 17828 raft_consensus.cc:740] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.341024 17830 consensus_queue.cc:260] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.342276 17827 consensus_queue.cc:260] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.342789 17828 consensus_queue.cc:260] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.344998 17827 ts_tablet_manager.cc:1434] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.003s
I20260709 12:29:14.345093 17830 ts_tablet_manager.cc:1434] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:14.346050 17827 tablet_bootstrap.cc:492] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:14.346184 17830 tablet_bootstrap.cc:492] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:14.352596 17830 tablet_bootstrap.cc:654] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.353125 17827 tablet_bootstrap.cc:654] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.354396 17828 ts_tablet_manager.cc:1434] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.017s	user 0.006s	sys 0.003s
I20260709 12:29:14.355620 17828 tablet_bootstrap.cc:492] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:14.362630 17828 tablet_bootstrap.cc:654] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.380445 17827 tablet_bootstrap.cc:492] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:14.380560 17828 tablet_bootstrap.cc:492] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:14.380730 17830 tablet_bootstrap.cc:492] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:14.381186 17828 ts_tablet_manager.cc:1403] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.026s	user 0.004s	sys 0.021s
I20260709 12:29:14.381309 17830 ts_tablet_manager.cc:1403] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.035s	user 0.014s	sys 0.019s
I20260709 12:29:14.381197 17827 ts_tablet_manager.cc:1403] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.035s	user 0.012s	sys 0.012s
I20260709 12:29:14.384673 17828 raft_consensus.cc:359] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.384856 17830 raft_consensus.cc:359] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.385470 17828 raft_consensus.cc:385] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.385280 17827 raft_consensus.cc:359] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.385558 17830 raft_consensus.cc:385] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.385910 17828 raft_consensus.cc:740] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.386032 17827 raft_consensus.cc:385] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.386082 17830 raft_consensus.cc:740] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.386556 17827 raft_consensus.cc:740] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.386826 17828 consensus_queue.cc:260] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.387184 17830 consensus_queue.cc:260] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.387495 17827 consensus_queue.cc:260] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.389307 17828 ts_tablet_manager.cc:1434] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:29:14.389648 17830 ts_tablet_manager.cc:1434] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.008s	user 0.005s	sys 0.000s
I20260709 12:29:14.398876 17830 tablet_bootstrap.cc:492] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:14.399655 17827 ts_tablet_manager.cc:1434] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.000s
I20260709 12:29:14.400804 17827 tablet_bootstrap.cc:492] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:14.401417 17828 tablet_bootstrap.cc:492] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:14.405992 17830 tablet_bootstrap.cc:654] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.408183 17827 tablet_bootstrap.cc:654] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.411755 17828 tablet_bootstrap.cc:654] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.419205 17830 tablet_bootstrap.cc:492] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:14.419450 17827 tablet_bootstrap.cc:492] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:14.419809 17830 ts_tablet_manager.cc:1403] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.021s	user 0.015s	sys 0.005s
I20260709 12:29:14.420017 17827 ts_tablet_manager.cc:1403] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.019s	user 0.009s	sys 0.006s
I20260709 12:29:14.423455 17830 raft_consensus.cc:359] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.424410 17830 raft_consensus.cc:385] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.424738 17830 raft_consensus.cc:740] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.425626 17830 consensus_queue.cc:260] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.428064 17830 ts_tablet_manager.cc:1434] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.008s	user 0.002s	sys 0.004s
I20260709 12:29:14.428201 17828 tablet_bootstrap.cc:492] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:14.428814 17828 ts_tablet_manager.cc:1403] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.028s	user 0.014s	sys 0.005s
I20260709 12:29:14.429143 17830 tablet_bootstrap.cc:492] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:14.431679 17828 raft_consensus.cc:359] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.432521 17828 raft_consensus.cc:385] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.432864 17828 raft_consensus.cc:740] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.433878 17828 consensus_queue.cc:260] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.434248 17827 raft_consensus.cc:359] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.435132 17827 raft_consensus.cc:385] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.435442 17827 raft_consensus.cc:740] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.436221 17827 consensus_queue.cc:260] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.436710 17830 tablet_bootstrap.cc:654] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.436882 17828 ts_tablet_manager.cc:1434] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.008s	user 0.006s	sys 0.000s
I20260709 12:29:14.438621 17827 ts_tablet_manager.cc:1434] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.018s	user 0.006s	sys 0.003s
I20260709 12:29:14.439960 17827 tablet_bootstrap.cc:492] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:14.441239 17828 tablet_bootstrap.cc:492] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:14.442921 17812 raft_consensus.cc:493] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:14.443452 17812 raft_consensus.cc:515] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.445674 17812 leader_election.cc:290] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:14.447337 17827 tablet_bootstrap.cc:654] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.447906 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfc9d2b1d24a4790f57b14ba39c1c4" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:14.448628 17530 raft_consensus.cc:2468] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 0.
I20260709 12:29:14.450057 17568 leader_election.cc:304] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:14.450994 17812 raft_consensus.cc:2804] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:14.451407 17812 raft_consensus.cc:493] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:14.451818 17812 raft_consensus.cc:3060] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.460675 17827 tablet_bootstrap.cc:492] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:14.461416 17827 ts_tablet_manager.cc:1403] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.022s	user 0.006s	sys 0.012s
I20260709 12:29:14.464056 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfc9d2b1d24a4790f57b14ba39c1c4" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
I20260709 12:29:14.464756 17827 raft_consensus.cc:359] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.465644 17827 raft_consensus.cc:385] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.465976 17827 raft_consensus.cc:740] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.466879 17827 consensus_queue.cc:260] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.470500 17812 raft_consensus.cc:515] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.479524 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfc9d2b1d24a4790f57b14ba39c1c4" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:14.480156 17530 raft_consensus.cc:3060] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.483081 17827 ts_tablet_manager.cc:1434] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.021s	user 0.007s	sys 0.004s
I20260709 12:29:14.484272 17827 tablet_bootstrap.cc:492] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:14.485525 17830 tablet_bootstrap.cc:492] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:14.486133 17830 ts_tablet_manager.cc:1403] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.057s	user 0.037s	sys 0.017s
I20260709 12:29:14.489567 17830 raft_consensus.cc:359] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.490288 17830 raft_consensus.cc:385] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.490603 17830 raft_consensus.cc:740] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.491386 17827 tablet_bootstrap.cc:654] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.491343 17830 consensus_queue.cc:260] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.492475 17807 raft_consensus.cc:493] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:14.492964 17807 raft_consensus.cc:515] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.495642 17807 leader_election.cc:290] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:14.497422 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384a1b6765dd4606b086be68b7a0e8b0" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:14.498172 17529 raft_consensus.cc:2468] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 0.
I20260709 12:29:14.499787 17643 leader_election.cc:304] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:14.500793 17807 raft_consensus.cc:2804] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:14.501269 17807 raft_consensus.cc:493] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:14.501686 17807 raft_consensus.cc:3060] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.502099 17830 ts_tablet_manager.cc:1434] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.016s	user 0.008s	sys 0.000s
I20260709 12:29:14.503413 17830 tablet_bootstrap.cc:492] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:14.508481 17530 raft_consensus.cc:2468] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 1.
I20260709 12:29:14.511268 17830 tablet_bootstrap.cc:654] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.513564 17807 raft_consensus.cc:515] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.523861 17830 tablet_bootstrap.cc:492] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:14.523973 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384a1b6765dd4606b086be68b7a0e8b0" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:14.524538 17830 ts_tablet_manager.cc:1403] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.021s	user 0.005s	sys 0.012s
I20260709 12:29:14.524986 17530 raft_consensus.cc:3060] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.527900 17830 raft_consensus.cc:359] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.528717 17830 raft_consensus.cc:385] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.529050 17830 raft_consensus.cc:740] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.530148 17812 leader_election.cc:290] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:14.519986 17605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384a1b6765dd4606b086be68b7a0e8b0" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
I20260709 12:29:14.529909 17830 consensus_queue.cc:260] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.530884 17605 raft_consensus.cc:2468] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 0.
W20260709 12:29:14.520829 17571 leader_election.cc:343] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:14.533332 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dbbfc9d2b1d24a4790f57b14ba39c1c4" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:14.533923 17679 raft_consensus.cc:3060] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.534088 17568 leader_election.cc:304] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:14.536094 17830 ts_tablet_manager.cc:1434] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.011s	user 0.008s	sys 0.000s
I20260709 12:29:14.537320 17830 tablet_bootstrap.cc:492] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:14.539156 17843 raft_consensus.cc:493] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:14.539742 17843 raft_consensus.cc:515] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.541913 17843 leader_election.cc:290] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:14.544184 17830 tablet_bootstrap.cc:654] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.544651 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fe7fbeab8346e6851bdf62eee362cf" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:14.545338 17529 raft_consensus.cc:2468] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 0.
I20260709 12:29:14.548239 17643 leader_election.cc:304] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:14.551046 17850 raft_consensus.cc:2804] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:14.551594 17843 raft_consensus.cc:2804] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:14.552057 17843 raft_consensus.cc:493] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:14.552424 17843 raft_consensus.cc:3060] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.554277 17850 raft_consensus.cc:697] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Becoming Leader. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Running, Role: LEADER
I20260709 12:29:14.555322 17850 consensus_queue.cc:237] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.556134 17830 tablet_bootstrap.cc:492] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:14.556722 17830 ts_tablet_manager.cc:1403] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.020s	user 0.013s	sys 0.004s
I20260709 12:29:14.560236 17815 raft_consensus.cc:493] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:14.559983 17830 raft_consensus.cc:359] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.560870 17815 raft_consensus.cc:515] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.561304 17830 raft_consensus.cc:385] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.561658 17830 raft_consensus.cc:740] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.562927 17830 consensus_queue.cc:260] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.565637 17815 leader_election.cc:290] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:14.572357 17604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fe7fbeab8346e6851bdf62eee362cf" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
I20260709 12:29:14.572909 17830 ts_tablet_manager.cc:1434] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.016s	user 0.007s	sys 0.005s
I20260709 12:29:14.573247 17604 raft_consensus.cc:2468] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 0.
I20260709 12:29:14.573401 17605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0230111cda042999f62a185104bf907" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
I20260709 12:29:14.574025 17605 raft_consensus.cc:2468] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 0.
I20260709 12:29:14.574148 17830 tablet_bootstrap.cc:492] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:14.575435 17495 leader_election.cc:304] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:14.566005 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0230111cda042999f62a185104bf907" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
I20260709 12:29:14.576426 17680 raft_consensus.cc:2468] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 0.
I20260709 12:29:14.516067 17828 tablet_bootstrap.cc:654] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.572822 17427 catalog_manager.cc:5697] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66). New cstate: current_term: 1 leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:14.578711 17679 raft_consensus.cc:2468] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 1.
I20260709 12:29:14.582258 17830 tablet_bootstrap.cc:654] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.585458 17843 raft_consensus.cc:515] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.589614 17807 leader_election.cc:290] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:14.597412 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fe7fbeab8346e6851bdf62eee362cf" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:14.598171 17528 raft_consensus.cc:3060] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.590299 17605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384a1b6765dd4606b086be68b7a0e8b0" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:14.594369 17830 tablet_bootstrap.cc:492] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:14.602505 17605 raft_consensus.cc:3060] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.602705 17830 ts_tablet_manager.cc:1403] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.029s	user 0.014s	sys 0.005s
I20260709 12:29:14.605631 17830 raft_consensus.cc:359] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.606319 17830 raft_consensus.cc:385] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.606633 17830 raft_consensus.cc:740] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.606432 17528 raft_consensus.cc:2468] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 1.
I20260709 12:29:14.606976 17827 tablet_bootstrap.cc:492] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:14.607661 17827 ts_tablet_manager.cc:1403] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.124s	user 0.048s	sys 0.062s
I20260709 12:29:14.608068 17643 leader_election.cc:304] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:14.609226 17807 raft_consensus.cc:2804] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:14.609686 17604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fe7fbeab8346e6851bdf62eee362cf" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:14.609866 17807 raft_consensus.cc:697] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Becoming Leader. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Running, Role: LEADER
I20260709 12:29:14.610397 17604 raft_consensus.cc:3060] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.610945 17807 consensus_queue.cc:237] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.576444 17847 raft_consensus.cc:2804] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:14.612890 17830 consensus_queue.cc:260] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.615556 17830 ts_tablet_manager.cc:1434] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.012s	user 0.009s	sys 0.000s
I20260709 12:29:14.616802 17830 tablet_bootstrap.cc:492] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd: Bootstrap starting.
I20260709 12:29:14.612955 17847 raft_consensus.cc:493] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:14.617463 17847 raft_consensus.cc:3060] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.618516 17604 raft_consensus.cc:2468] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 1.
I20260709 12:29:14.625226 17827 raft_consensus.cc:359] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.626124 17827 raft_consensus.cc:385] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.626430 17827 raft_consensus.cc:740] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.627545 17855 raft_consensus.cc:493] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20260709 12:29:14.628082 17496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:41275, user_credentials={real_user=slave}} blocked reactor thread for 62776.1us
I20260709 12:29:14.628192 17855 raft_consensus.cc:515] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.629750 17605 raft_consensus.cc:2468] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 1.
I20260709 12:29:14.608526 17843 leader_election.cc:290] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:14.628571 17854 raft_consensus.cc:493] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:14.632251 17854 raft_consensus.cc:515] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.633539 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e9753b18a14698a48b2634cbb6735d" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:14.634310 17528 raft_consensus.cc:2468] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 0.
I20260709 12:29:14.634680 17854 leader_election.cc:290] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:14.636015 17828 tablet_bootstrap.cc:492] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:14.627372 17827 consensus_queue.cc:260] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.636560 17828 ts_tablet_manager.cc:1403] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.196s	user 0.012s	sys 0.002s
I20260709 12:29:14.637686 17645 leader_election.cc:304] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd; no voters: 
I20260709 12:29:14.638891 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7851836951b47fd84e1e04bb97aa015" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
I20260709 12:29:14.639663 17680 raft_consensus.cc:2468] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 0.
I20260709 12:29:14.640051 17843 raft_consensus.cc:2804] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:14.640919 17827 ts_tablet_manager.cc:1434] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.033s	user 0.002s	sys 0.005s
I20260709 12:29:14.642516 17496 leader_election.cc:304] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:14.641940 17855 leader_election.cc:290] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:14.636263 17643 leader_election.cc:304] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:14.643960 17604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7851836951b47fd84e1e04bb97aa015" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
I20260709 12:29:14.644158 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e9753b18a14698a48b2634cbb6735d" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
I20260709 12:29:14.642997 17827 tablet_bootstrap.cc:492] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:14.633625 17530 raft_consensus.cc:2468] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 1.
I20260709 12:29:14.647197 17855 raft_consensus.cc:2804] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:14.647689 17855 raft_consensus.cc:493] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20260709 12:29:14.647893 17645 leader_election.cc:343] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:14.648073 17855 raft_consensus.cc:3060] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
W20260709 12:29:14.649776 17495 leader_election.cc:343] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:14.652180 17861 raft_consensus.cc:2804] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:14.652912 17861 raft_consensus.cc:493] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:14.653322 17861 raft_consensus.cc:3060] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.653970 17827 tablet_bootstrap.cc:654] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.655512 17828 raft_consensus.cc:359] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.656319 17828 raft_consensus.cc:385] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.656603 17828 raft_consensus.cc:740] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.657444 17828 consensus_queue.cc:260] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.660338 17830 tablet_bootstrap.cc:654] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.641952 17847 raft_consensus.cc:515] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.663483 17604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0230111cda042999f62a185104bf907" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:14.663715 17843 raft_consensus.cc:697] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Becoming Leader. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Running, Role: LEADER
I20260709 12:29:14.664189 17604 raft_consensus.cc:3060] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.664866 17843 consensus_queue.cc:237] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.671882 17604 raft_consensus.cc:2468] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 1.
I20260709 12:29:14.677126 17847 leader_election.cc:290] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Requested vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:14.676434 17861 raft_consensus.cc:515] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.696036 17495 leader_election.cc:304] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:14.697167 17855 raft_consensus.cc:515] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.699216 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7851836951b47fd84e1e04bb97aa015" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:14.699620 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7851836951b47fd84e1e04bb97aa015" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:14.700064 17680 raft_consensus.cc:3060] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.701112 17855 leader_election.cc:290] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:14.680236 17828 ts_tablet_manager.cc:1434] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.043s	user 0.006s	sys 0.002s
W20260709 12:29:14.702193 17495 leader_election.cc:343] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:14.703569 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e9753b18a14698a48b2634cbb6735d" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:14.703953 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e9753b18a14698a48b2634cbb6735d" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:14.704154 17530 raft_consensus.cc:3060] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.704552 17603 raft_consensus.cc:3060] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.705996 17828 tablet_bootstrap.cc:492] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:14.708020 17680 raft_consensus.cc:2468] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 1.
I20260709 12:29:14.709619 17496 leader_election.cc:304] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 1bdf878b9c63415bb5225d18d95f32f3
I20260709 12:29:14.710901 17830 tablet_bootstrap.cc:492] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd: No bootstrap required, opened a new log
I20260709 12:29:14.714962 17830 ts_tablet_manager.cc:1403] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd: Time spent bootstrapping tablet: real 0.098s	user 0.010s	sys 0.004s
I20260709 12:29:14.715073 17854 raft_consensus.cc:2804] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:14.715874 17815 raft_consensus.cc:2804] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:14.717846 17830 raft_consensus.cc:359] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.718765 17830 raft_consensus.cc:385] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.718878 17854 raft_consensus.cc:697] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Becoming Leader. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:14.720431 17854 consensus_queue.cc:237] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.721387 17828 tablet_bootstrap.cc:654] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.714016 17603 raft_consensus.cc:2468] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 1.
I20260709 12:29:14.719101 17830 raft_consensus.cc:740] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.728840 17815 raft_consensus.cc:697] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Becoming Leader. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:14.722278 17426 catalog_manager.cc:5697] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67). New cstate: current_term: 1 leader_uuid: "81441d21f9f442cdbb8b7db3765484fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:14.745697 17815 consensus_queue.cc:237] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.743436 17530 raft_consensus.cc:2468] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 1.
I20260709 12:29:14.746615 17827 tablet_bootstrap.cc:492] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:14.749306 17827 ts_tablet_manager.cc:1403] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.107s	user 0.023s	sys 0.031s
I20260709 12:29:14.737659 17861 leader_election.cc:290] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Requested vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:14.746634 17426 catalog_manager.cc:5697] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67). New cstate: current_term: 1 leader_uuid: "81441d21f9f442cdbb8b7db3765484fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:14.747339 17645 leader_election.cc:304] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd; no voters: 
I20260709 12:29:14.752338 17827 raft_consensus.cc:359] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.753180 17827 raft_consensus.cc:385] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.753434 17827 raft_consensus.cc:740] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.754558 17843 raft_consensus.cc:2804] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:14.754307 17827 consensus_queue.cc:260] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.755124 17843 raft_consensus.cc:697] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Becoming Leader. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Running, Role: LEADER
I20260709 12:29:14.756567 17827 ts_tablet_manager.cc:1434] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:29:14.747256 17830 consensus_queue.cc:260] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.678655 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e0230111cda042999f62a185104bf907" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:14.757246 17679 raft_consensus.cc:3060] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.756136 17843 consensus_queue.cc:237] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.758486 17830 ts_tablet_manager.cc:1434] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd: Time spent starting tablet: real 0.043s	user 0.009s	sys 0.002s
I20260709 12:29:14.760005 17827 tablet_bootstrap.cc:492] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b: Bootstrap starting.
I20260709 12:29:14.732179 17847 raft_consensus.cc:493] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:14.761281 17847 raft_consensus.cc:515] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.764328 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8458b7f6b80643488fd4bb86f4b52f20" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
I20260709 12:29:14.764525 17679 raft_consensus.cc:2468] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 1.
I20260709 12:29:14.765872 17827 tablet_bootstrap.cc:654] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:14.766736 17495 leader_election.cc:343] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:14.770136 17847 leader_election.cc:290] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:14.751330 17828 tablet_bootstrap.cc:492] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:14.771664 17828 ts_tablet_manager.cc:1403] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.066s	user 0.009s	sys 0.007s
I20260709 12:29:14.771494 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8458b7f6b80643488fd4bb86f4b52f20" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
I20260709 12:29:14.772372 17679 raft_consensus.cc:2468] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 0.
I20260709 12:29:14.773658 17496 leader_election.cc:304] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 1bdf878b9c63415bb5225d18d95f32f3
I20260709 12:29:14.775142 17828 raft_consensus.cc:359] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.775590 17847 raft_consensus.cc:2804] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:14.776024 17828 raft_consensus.cc:385] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.776165 17847 raft_consensus.cc:493] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:14.776472 17828 raft_consensus.cc:740] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.776695 17847 raft_consensus.cc:3060] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.777413 17828 consensus_queue.cc:260] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.785856 17827 tablet_bootstrap.cc:492] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b: No bootstrap required, opened a new log
I20260709 12:29:14.786513 17827 ts_tablet_manager.cc:1403] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b: Time spent bootstrapping tablet: real 0.027s	user 0.019s	sys 0.007s
I20260709 12:29:14.786365 17847 raft_consensus.cc:515] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.789431 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8458b7f6b80643488fd4bb86f4b52f20" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:14.789582 17827 raft_consensus.cc:359] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.790316 17827 raft_consensus.cc:385] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.790591 17827 raft_consensus.cc:740] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.791288 17827 consensus_queue.cc:260] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.791942 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8458b7f6b80643488fd4bb86f4b52f20" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
W20260709 12:29:14.792212 17495 leader_election.cc:343] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:14.792549 17679 raft_consensus.cc:3060] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.793322 17827 ts_tablet_manager.cc:1434] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b: Time spent starting tablet: real 0.006s	user 0.006s	sys 0.000s
I20260709 12:29:14.793390 17428 catalog_manager.cc:5697] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67). New cstate: current_term: 1 leader_uuid: "81441d21f9f442cdbb8b7db3765484fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:14.794588 17847 leader_election.cc:290] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Requested vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:14.797883 17679 raft_consensus.cc:2468] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 1.
I20260709 12:29:14.799201 17496 leader_election.cc:304] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 1bdf878b9c63415bb5225d18d95f32f3
I20260709 12:29:14.799960 17847 raft_consensus.cc:2804] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:14.800498 17847 raft_consensus.cc:697] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Becoming Leader. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:14.801636 17847 consensus_queue.cc:237] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.802253 17427 catalog_manager.cc:5697] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b reported cstate change: term changed from 0 to 1, leader changed from <none> to e8f68305d8674b5c825afab76ae8090b (127.4.181.65). New cstate: current_term: 1 leader_uuid: "e8f68305d8674b5c825afab76ae8090b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:14.804247 17828 ts_tablet_manager.cc:1434] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.032s	user 0.008s	sys 0.000s
I20260709 12:29:14.805523 17828 tablet_bootstrap.cc:492] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:14.803923 17427 catalog_manager.cc:5697] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b reported cstate change: term changed from 0 to 1, leader changed from <none> to e8f68305d8674b5c825afab76ae8090b (127.4.181.65). New cstate: current_term: 1 leader_uuid: "e8f68305d8674b5c825afab76ae8090b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:14.813156 17828 tablet_bootstrap.cc:654] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.817941 17828 tablet_bootstrap.cc:492] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:14.818348 17828 ts_tablet_manager.cc:1403] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.013s	user 0.004s	sys 0.007s
I20260709 12:29:14.820529 17828 raft_consensus.cc:359] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.821076 17828 raft_consensus.cc:385] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.821308 17828 raft_consensus.cc:740] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.821923 17828 consensus_queue.cc:260] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.823966 17828 ts_tablet_manager.cc:1434] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.005s	user 0.004s	sys 0.000s
I20260709 12:29:14.824437 17427 catalog_manager.cc:5697] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b reported cstate change: term changed from 0 to 1, leader changed from <none> to e8f68305d8674b5c825afab76ae8090b (127.4.181.65). New cstate: current_term: 1 leader_uuid: "e8f68305d8674b5c825afab76ae8090b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:14.825052 17828 tablet_bootstrap.cc:492] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:14.826331 17843 raft_consensus.cc:493] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:14.827032 17843 raft_consensus.cc:515] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.831111 17843 leader_election.cc:290] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:14.831967 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c076072bb42608d8414d6ec91f80f" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
I20260709 12:29:14.832604 17828 tablet_bootstrap.cc:654] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
I20260709 12:29:14.833793 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c076072bb42608d8414d6ec91f80f" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
W20260709 12:29:14.834419 17645 leader_election.cc:343] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:14.834519 17530 raft_consensus.cc:2468] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 0.
I20260709 12:29:14.837836 17828 tablet_bootstrap.cc:492] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:14.838330 17828 ts_tablet_manager.cc:1403] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.013s	user 0.011s	sys 0.000s
I20260709 12:29:14.838394 17643 leader_election.cc:304] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 1bdf878b9c63415bb5225d18d95f32f3
I20260709 12:29:14.839216 17843 raft_consensus.cc:2804] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:14.839599 17843 raft_consensus.cc:493] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:14.839910 17843 raft_consensus.cc:3060] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.841194 17828 raft_consensus.cc:359] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.842008 17828 raft_consensus.cc:385] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.842283 17828 raft_consensus.cc:740] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.843044 17828 consensus_queue.cc:260] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.845389 17828 ts_tablet_manager.cc:1434] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.007s	user 0.005s	sys 0.000s
I20260709 12:29:14.846396 17828 tablet_bootstrap.cc:492] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3: Bootstrap starting.
I20260709 12:29:14.847549 17843 raft_consensus.cc:515] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.850574 17843 leader_election.cc:290] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:14.850595 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c076072bb42608d8414d6ec91f80f" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:14.851258 17530 raft_consensus.cc:3060] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.851085 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c076072bb42608d8414d6ec91f80f" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:14.852347 17828 tablet_bootstrap.cc:654] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3: Neither blocks nor log segments found. Creating new log.
W20260709 12:29:14.852424 17645 leader_election.cc:343] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Illegal state: must be running to vote when last-logged opid is not known
I20260709 12:29:14.856338 17828 tablet_bootstrap.cc:492] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3: No bootstrap required, opened a new log
I20260709 12:29:14.856720 17828 ts_tablet_manager.cc:1403] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3: Time spent bootstrapping tablet: real 0.011s	user 0.005s	sys 0.004s
I20260709 12:29:14.857053 17530 raft_consensus.cc:2468] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 1.
I20260709 12:29:14.858069 17643 leader_election.cc:304] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 1bdf878b9c63415bb5225d18d95f32f3
I20260709 12:29:14.858886 17843 raft_consensus.cc:2804] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:14.859145 17828 raft_consensus.cc:359] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.859972 17828 raft_consensus.cc:385] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260709 12:29:14.860247 17828 raft_consensus.cc:740] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Initialized, Role: FOLLOWER
I20260709 12:29:14.860649 17843 raft_consensus.cc:697] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Becoming Leader. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Running, Role: LEADER
I20260709 12:29:14.860823 17828 consensus_queue.cc:260] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.861591 17843 consensus_queue.cc:237] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.862699 17828 ts_tablet_manager.cc:1434] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3: Time spent starting tablet: real 0.006s	user 0.005s	sys 0.002s
I20260709 12:29:14.869952 17427 catalog_manager.cc:5697] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd reported cstate change: term changed from 0 to 1, leader changed from <none> to 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67). New cstate: current_term: 1 leader_uuid: "81441d21f9f442cdbb8b7db3765484fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:14.921855 17847 raft_consensus.cc:493] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:14.922334 17847 raft_consensus.cc:515] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.924052 17847 leader_election.cc:290] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:14.924855 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcd1f37558f4559bf9af2b0f6768600" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3" is_pre_election: true
I20260709 12:29:14.925184 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcd1f37558f4559bf9af2b0f6768600" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
I20260709 12:29:14.925592 17603 raft_consensus.cc:2468] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 0.
I20260709 12:29:14.925779 17679 raft_consensus.cc:2468] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 0.
I20260709 12:29:14.926700 17495 leader_election.cc:304] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:14.927376 17847 raft_consensus.cc:2804] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260709 12:29:14.927717 17847 raft_consensus.cc:493] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260709 12:29:14.928090 17847 raft_consensus.cc:3060] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.933475 17847 raft_consensus.cc:515] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.935098 17847 leader_election.cc:290] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Requested vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:14.935906 17603 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcd1f37558f4559bf9af2b0f6768600" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:14.936087 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcd1f37558f4559bf9af2b0f6768600" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:14.936479 17603 raft_consensus.cc:3060] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.936589 17679 raft_consensus.cc:3060] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:14.941977 17603 raft_consensus.cc:2468] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 1.
I20260709 12:29:14.942319 17679 raft_consensus.cc:2468] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 1.
I20260709 12:29:14.943148 17495 leader_election.cc:304] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:14.944032 17847 raft_consensus.cc:2804] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader election won for term 1
I20260709 12:29:14.944440 17847 raft_consensus.cc:697] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Becoming Leader. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:14.945158 17847 consensus_queue.cc:237] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:14.952435 17428 catalog_manager.cc:5697] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b reported cstate change: term changed from 0 to 1, leader changed from <none> to e8f68305d8674b5c825afab76ae8090b (127.4.181.65). New cstate: current_term: 1 leader_uuid: "e8f68305d8674b5c825afab76ae8090b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:15.037446 17679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "c0fe7fbeab8346e6851bdf62eee362cf"
dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
mode: GRACEFUL
new_leader_uuid: "e8f68305d8674b5c825afab76ae8090b"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:29:15.037921 17679 raft_consensus.cc:606] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Received request to transfer leadership to TS e8f68305d8674b5c825afab76ae8090b
I20260709 12:29:15.041469 17846 consensus_queue.cc:1048] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:15.047058 17679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "384a1b6765dd4606b086be68b7a0e8b0"
dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
mode: GRACEFUL
new_leader_uuid: "e8f68305d8674b5c825afab76ae8090b"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:29:15.047672 17679 raft_consensus.cc:606] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Received request to transfer leadership to TS e8f68305d8674b5c825afab76ae8090b
I20260709 12:29:15.054940 17679 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a1e9753b18a14698a48b2634cbb6735d"
dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
mode: GRACEFUL
new_leader_uuid: "e8f68305d8674b5c825afab76ae8090b"
 from {username='slave'} at 127.0.0.1:42442
I20260709 12:29:15.055430 17679 raft_consensus.cc:606] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Received request to transfer leadership to TS e8f68305d8674b5c825afab76ae8090b
I20260709 12:29:15.056773 17852 consensus_queue.cc:1048] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:15.075407 17530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "8458b7f6b80643488fd4bb86f4b52f20"
dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
mode: GRACEFUL
new_leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
 from {username='slave'} at 127.0.0.1:33540
I20260709 12:29:15.076041 17530 raft_consensus.cc:606] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Received request to transfer leadership to TS 1bdf878b9c63415bb5225d18d95f32f3
I20260709 12:29:15.082525 17530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "dfcd1f37558f4559bf9af2b0f6768600"
dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
mode: GRACEFUL
new_leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
 from {username='slave'} at 127.0.0.1:33540
I20260709 12:29:15.083189 17530 raft_consensus.cc:606] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Received request to transfer leadership to TS 1bdf878b9c63415bb5225d18d95f32f3
I20260709 12:29:15.086719 17843 consensus_queue.cc:1048] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:15.090116 17530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "a7851836951b47fd84e1e04bb97aa015"
dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
mode: GRACEFUL
new_leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
 from {username='slave'} at 127.0.0.1:33540
I20260709 12:29:15.090835 17530 raft_consensus.cc:606] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Received request to transfer leadership to TS 1bdf878b9c63415bb5225d18d95f32f3
I20260709 12:29:15.101459 17843 consensus_queue.cc:1048] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:15.110644 17862 raft_consensus.cc:993] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd: : Instructing follower e8f68305d8674b5c825afab76ae8090b to start an election
I20260709 12:29:15.111148 17862 raft_consensus.cc:1081] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Signalling peer e8f68305d8674b5c825afab76ae8090b to start an election
I20260709 12:29:15.112847 17530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "c0fe7fbeab8346e6851bdf62eee362cf"
dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
 from {username='slave'} at 127.0.0.1:33528
I20260709 12:29:15.113431 17530 raft_consensus.cc:493] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:15.113783 17530 raft_consensus.cc:3060] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.118997 17530 raft_consensus.cc:515] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.120585 17530 leader_election.cc:290] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 2 election: Requested vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:15.121758 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fe7fbeab8346e6851bdf62eee362cf" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:15.121903 17604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "c0fe7fbeab8346e6851bdf62eee362cf" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:15.122606 17679 raft_consensus.cc:3055] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:15.123183 17679 raft_consensus.cc:740] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Running, Role: LEADER
I20260709 12:29:15.124104 17679 consensus_queue.cc:260] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.125401 17679 raft_consensus.cc:3060] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.122658 17604 raft_consensus.cc:3060] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.130728 17846 raft_consensus.cc:493] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:15.131356 17846 raft_consensus.cc:515] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.134405 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8458b7f6b80643488fd4bb86f4b52f20" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:15.134855 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8458b7f6b80643488fd4bb86f4b52f20" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
I20260709 12:29:15.135525 17604 raft_consensus.cc:2468] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 2.
I20260709 12:29:15.135690 17680 raft_consensus.cc:2393] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1bdf878b9c63415bb5225d18d95f32f3 in current term 1: Already voted for candidate e8f68305d8674b5c825afab76ae8090b in this term.
I20260709 12:29:15.136026 17846 leader_election.cc:290] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:15.133673 17679 raft_consensus.cc:2468] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 2.
I20260709 12:29:15.137161 17568 leader_election.cc:304] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3; no voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b
I20260709 12:29:15.137701 17495 leader_election.cc:304] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:15.137930 17852 raft_consensus.cc:3060] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:15.138857 17854 raft_consensus.cc:2804] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:15.139583 17854 raft_consensus.cc:697] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [term 2 LEADER]: Becoming Leader. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:15.141570 17854 consensus_queue.cc:237] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.145165 17852 raft_consensus.cc:2749] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:15.149520 17428 catalog_manager.cc:5697] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b reported cstate change: term changed from 1 to 2, leader changed from 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67) to e8f68305d8674b5c825afab76ae8090b (127.4.181.65). New cstate: current_term: 2 leader_uuid: "e8f68305d8674b5c825afab76ae8090b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:15.176862 17843 consensus_queue.cc:1048] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:15.189126 17862 consensus_queue.cc:1048] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:15.197783 17843 raft_consensus.cc:993] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd: : Instructing follower e8f68305d8674b5c825afab76ae8090b to start an election
I20260709 12:29:15.198290 17862 raft_consensus.cc:1081] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Signalling peer e8f68305d8674b5c825afab76ae8090b to start an election
I20260709 12:29:15.200480 17530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a1e9753b18a14698a48b2634cbb6735d"
dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
 from {username='slave'} at 127.0.0.1:33528
I20260709 12:29:15.201287 17530 raft_consensus.cc:493] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:15.201745 17530 raft_consensus.cc:3060] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.208487 17530 raft_consensus.cc:515] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.211952 17604 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e9753b18a14698a48b2634cbb6735d" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:15.212689 17604 raft_consensus.cc:3060] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.212968 17530 leader_election.cc:290] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 2 election: Requested vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:15.216208 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a1e9753b18a14698a48b2634cbb6735d" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:15.216430 17854 consensus_queue.cc:1048] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:15.216917 17680 raft_consensus.cc:3055] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:15.217307 17680 raft_consensus.cc:740] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Running, Role: LEADER
I20260709 12:29:15.218284 17680 consensus_queue.cc:260] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.219664 17680 raft_consensus.cc:3060] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.220799 17603 raft_consensus.cc:3060] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:15.226738 17604 raft_consensus.cc:2468] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 2.
I20260709 12:29:15.228180 17495 leader_election.cc:304] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:15.229205 17815 raft_consensus.cc:2804] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:15.228837 17680 raft_consensus.cc:2468] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 2.
I20260709 12:29:15.229852 17815 raft_consensus.cc:697] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [term 2 LEADER]: Becoming Leader. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:15.230676 17854 consensus_queue.cc:1048] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:15.230803 17815 consensus_queue.cc:237] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.240497 17862 consensus_queue.cc:1048] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:15.242254 17854 consensus_queue.cc:1048] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:15.252436 17852 raft_consensus.cc:493] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260709 12:29:15.253283 17852 raft_consensus.cc:515] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.253350 17428 catalog_manager.cc:5697] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b reported cstate change: term changed from 1 to 2, leader changed from 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67) to e8f68305d8674b5c825afab76ae8090b (127.4.181.65). New cstate: current_term: 2 leader_uuid: "e8f68305d8674b5c825afab76ae8090b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:15.256738 17852 leader_election.cc:290] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:15.256955 17528 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c076072bb42608d8414d6ec91f80f" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e8f68305d8674b5c825afab76ae8090b" is_pre_election: true
I20260709 12:29:15.257807 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "018c076072bb42608d8414d6ec91f80f" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "81441d21f9f442cdbb8b7db3765484fd" is_pre_election: true
I20260709 12:29:15.257866 17528 raft_consensus.cc:2393] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1bdf878b9c63415bb5225d18d95f32f3 in current term 1: Already voted for candidate 81441d21f9f442cdbb8b7db3765484fd in this term.
I20260709 12:29:15.260003 17862 consensus_queue.cc:1048] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:15.262738 17568 leader_election.cc:304] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3; no voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b
I20260709 12:29:15.265118 17852 raft_consensus.cc:3060] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3 [term 0 FOLLOWER]: Advancing to term 1
I20260709 12:29:15.273453 17852 raft_consensus.cc:2749] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260709 12:29:15.277792 17843 raft_consensus.cc:993] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd: : Instructing follower e8f68305d8674b5c825afab76ae8090b to start an election
I20260709 12:29:15.279563 17843 raft_consensus.cc:1081] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Signalling peer e8f68305d8674b5c825afab76ae8090b to start an election
I20260709 12:29:15.281517 17847 consensus_queue.cc:1048] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:15.284655 17530 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "384a1b6765dd4606b086be68b7a0e8b0"
dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
 from {username='slave'} at 127.0.0.1:33528
I20260709 12:29:15.285292 17530 raft_consensus.cc:493] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:15.285655 17530 raft_consensus.cc:3060] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.297243 17815 raft_consensus.cc:993] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b: : Instructing follower 1bdf878b9c63415bb5225d18d95f32f3 to start an election
I20260709 12:29:15.297832 17815 raft_consensus.cc:1081] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Signalling peer 1bdf878b9c63415bb5225d18d95f32f3 to start an election
I20260709 12:29:15.299449 17861 consensus_queue.cc:1048] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:15.302778 17530 raft_consensus.cc:515] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.303041 17602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "a7851836951b47fd84e1e04bb97aa015"
dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
 from {username='slave'} at 127.0.0.1:47826
I20260709 12:29:15.307293 17529 raft_consensus.cc:1240] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Rejecting Update request from peer 81441d21f9f442cdbb8b7db3765484fd for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:15.311299 17807 consensus_queue.cc:1059] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:15.312536 17605 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384a1b6765dd4606b086be68b7a0e8b0" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:15.313319 17605 raft_consensus.cc:3060] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.313872 17530 leader_election.cc:290] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 2 election: Requested vote from peers 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:15.315112 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "384a1b6765dd4606b086be68b7a0e8b0" candidate_uuid: "e8f68305d8674b5c825afab76ae8090b" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:15.316531 17679 raft_consensus.cc:3055] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:15.316864 17679 raft_consensus.cc:740] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Running, Role: LEADER
I20260709 12:29:15.317649 17679 consensus_queue.cc:260] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.318571 17679 raft_consensus.cc:3060] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.322844 17602 raft_consensus.cc:493] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:15.323344 17602 raft_consensus.cc:3060] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.324378 17855 consensus_queue.cc:1048] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:15.327533 17605 raft_consensus.cc:2468] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 2.
I20260709 12:29:15.328862 17495 leader_election.cc:304] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:15.329188 17679 raft_consensus.cc:2468] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e8f68305d8674b5c825afab76ae8090b in term 2.
I20260709 12:29:15.331202 17847 raft_consensus.cc:2804] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:15.331712 17847 raft_consensus.cc:697] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [term 2 LEADER]: Becoming Leader. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:15.331847 17602 raft_consensus.cc:515] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.332685 17847 consensus_queue.cc:237] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.337999 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7851836951b47fd84e1e04bb97aa015" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:15.338726 17529 raft_consensus.cc:3055] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:15.339066 17529 raft_consensus.cc:740] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:15.339910 17529 consensus_queue.cc:260] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.341068 17529 raft_consensus.cc:3060] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.343489 17602 leader_election.cc:290] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 2 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:15.344319 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "a7851836951b47fd84e1e04bb97aa015" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:15.344936 17679 raft_consensus.cc:3060] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.349820 17807 consensus_queue.cc:1048] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:15.354430 17679 raft_consensus.cc:2468] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 2.
I20260709 12:29:15.355702 17854 consensus_queue.cc:1048] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:15.356007 17571 leader_election.cc:304] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd; no voters: 
I20260709 12:29:15.356892 17812 raft_consensus.cc:2804] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:15.357371 17812 raft_consensus.cc:697] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 LEADER]: Becoming Leader. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Running, Role: LEADER
I20260709 12:29:15.358201 17529 raft_consensus.cc:2468] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 2.
I20260709 12:29:15.358155 17812 consensus_queue.cc:237] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.361960 17426 catalog_manager.cc:5697] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b reported cstate change: term changed from 1 to 2, leader changed from 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67) to e8f68305d8674b5c825afab76ae8090b (127.4.181.65). New cstate: current_term: 2 leader_uuid: "e8f68305d8674b5c825afab76ae8090b" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:15.373191 17815 raft_consensus.cc:993] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b: : Instructing follower 1bdf878b9c63415bb5225d18d95f32f3 to start an election
I20260709 12:29:15.373760 17854 raft_consensus.cc:1081] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Signalling peer 1bdf878b9c63415bb5225d18d95f32f3 to start an election
I20260709 12:29:15.374380 17815 consensus_queue.cc:1048] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20260709 12:29:15.375684 17605 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "8458b7f6b80643488fd4bb86f4b52f20"
dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
 from {username='slave'} at 127.0.0.1:47826
I20260709 12:29:15.376736 17605 raft_consensus.cc:493] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:15.378106 17605 raft_consensus.cc:3060] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.376904 17427 catalog_manager.cc:5697] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 reported cstate change: term changed from 1 to 2, leader changed from e8f68305d8674b5c825afab76ae8090b (127.4.181.65) to 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:15.387243 17605 raft_consensus.cc:515] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.390751 17680 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8458b7f6b80643488fd4bb86f4b52f20" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:15.391395 17680 raft_consensus.cc:3060] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.392009 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "8458b7f6b80643488fd4bb86f4b52f20" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:15.392831 17529 raft_consensus.cc:3055] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:15.393188 17529 raft_consensus.cc:740] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:15.394034 17529 consensus_queue.cc:260] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.395298 17529 raft_consensus.cc:3060] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.397517 17680 raft_consensus.cc:2468] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 2.
I20260709 12:29:15.398835 17571 leader_election.cc:304] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd; no voters: 
I20260709 12:29:15.399873 17812 raft_consensus.cc:2804] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:15.400450 17812 raft_consensus.cc:697] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 LEADER]: Becoming Leader. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Running, Role: LEADER
I20260709 12:29:15.401688 17605 leader_election.cc:290] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 2 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:15.401337 17812 consensus_queue.cc:237] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.403087 17854 raft_consensus.cc:993] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b: : Instructing follower 1bdf878b9c63415bb5225d18d95f32f3 to start an election
I20260709 12:29:15.403298 17529 raft_consensus.cc:2468] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 2.
I20260709 12:29:15.405944 17854 raft_consensus.cc:1081] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Signalling peer 1bdf878b9c63415bb5225d18d95f32f3 to start an election
I20260709 12:29:15.408864 17602 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "dfcd1f37558f4559bf9af2b0f6768600"
dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
 from {username='slave'} at 127.0.0.1:47826
I20260709 12:29:15.409495 17602 raft_consensus.cc:493] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:15.409786 17602 raft_consensus.cc:3060] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.411230 17854 consensus_queue.cc:1048] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:15.418071 17602 raft_consensus.cc:515] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.419155 17604 raft_consensus.cc:1240] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Rejecting Update request from peer e8f68305d8674b5c825afab76ae8090b for earlier term 1. Current term is 2. Ops: []
I20260709 12:29:15.421192 17529 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcd1f37558f4559bf9af2b0f6768600" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:15.421824 17815 consensus_queue.cc:1059] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20260709 12:29:15.424424 17679 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "dfcd1f37558f4559bf9af2b0f6768600" candidate_uuid: "1bdf878b9c63415bb5225d18d95f32f3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
I20260709 12:29:15.425230 17602 leader_election.cc:290] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 2 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67:41275)
I20260709 12:29:15.428491 17428 catalog_manager.cc:5697] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 reported cstate change: term changed from 1 to 2, leader changed from e8f68305d8674b5c825afab76ae8090b (127.4.181.65) to 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:15.429365 17529 raft_consensus.cc:3055] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:15.430107 17529 raft_consensus.cc:740] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:15.431109 17529 consensus_queue.cc:260] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.432153 17529 raft_consensus.cc:3060] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.439123 17529 raft_consensus.cc:2468] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1bdf878b9c63415bb5225d18d95f32f3 in term 2.
W20260709 12:29:15.439579 17854 raft_consensus.cc:936] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20260709 12:29:15.440621 17568 leader_election.cc:304] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, e8f68305d8674b5c825afab76ae8090b; no voters: 81441d21f9f442cdbb8b7db3765484fd
I20260709 12:29:15.441560 17812 raft_consensus.cc:2804] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:15.442018 17812 raft_consensus.cc:697] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 LEADER]: Becoming Leader. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Running, Role: LEADER
I20260709 12:29:15.442816 17812 consensus_queue.cc:237] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:15.452644 17428 catalog_manager.cc:5697] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 reported cstate change: term changed from 1 to 2, leader changed from e8f68305d8674b5c825afab76ae8090b (127.4.181.65) to 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66). New cstate: current_term: 2 leader_uuid: "1bdf878b9c63415bb5225d18d95f32f3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: UNKNOWN } } }
I20260709 12:29:15.602661 17602 raft_consensus.cc:1275] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Refusing update from remote peer e8f68305d8674b5c825afab76ae8090b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.604166 17854 consensus_queue.cc:1048] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:15.612069 17680 raft_consensus.cc:1275] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Refusing update from remote peer e8f68305d8674b5c825afab76ae8090b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.613902 17854 consensus_queue.cc:1048] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:15.757843 17680 raft_consensus.cc:1275] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Refusing update from remote peer 1bdf878b9c63415bb5225d18d95f32f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.759230 17812 consensus_queue.cc:1048] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:15.770751 17529 raft_consensus.cc:1275] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Refusing update from remote peer 1bdf878b9c63415bb5225d18d95f32f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.771450 17602 raft_consensus.cc:1275] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Refusing update from remote peer e8f68305d8674b5c825afab76ae8090b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.772351 17852 consensus_queue.cc:1048] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:15.774709 17815 consensus_queue.cc:1048] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:15.789970 17680 raft_consensus.cc:1275] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Refusing update from remote peer e8f68305d8674b5c825afab76ae8090b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.793000 17815 consensus_queue.cc:1048] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:15.793500 17602 raft_consensus.cc:1275] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Refusing update from remote peer e8f68305d8674b5c825afab76ae8090b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.795053 17854 consensus_queue.cc:1048] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:15.804008 17679 raft_consensus.cc:1275] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Refusing update from remote peer e8f68305d8674b5c825afab76ae8090b: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.806082 17815 consensus_queue.cc:1048] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:15.831948 17680 raft_consensus.cc:1275] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Refusing update from remote peer 1bdf878b9c63415bb5225d18d95f32f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.833045 17852 consensus_queue.cc:1048] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:15.841300 17530 raft_consensus.cc:1275] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Refusing update from remote peer 1bdf878b9c63415bb5225d18d95f32f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.842643 17846 consensus_queue.cc:1048] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:15.847218 17529 raft_consensus.cc:1275] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Refusing update from remote peer 1bdf878b9c63415bb5225d18d95f32f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.848753 17846 consensus_queue.cc:1048] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:15.861027 17680 raft_consensus.cc:3060] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:15.866410 17680 raft_consensus.cc:1275] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Refusing update from remote peer 1bdf878b9c63415bb5225d18d95f32f3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:15.867751 17846 consensus_queue.cc:1048] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:18.099471 17427 catalog_manager.cc:2533] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:56574:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20260709 12:29:18.120466 17427 catalog_manager.cc:3570] Servicing AlterTable request from {username='slave'} at 127.0.0.1:56574:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20260709 12:29:18.147943  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:18.335517 17940 tablet.cc:1724] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.413276 17948 tablet.cc:1724] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:29:18.426754 17495 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.66:44585, user_credentials={real_user=slave}} blocked reactor thread for 87958.5us
W20260709 12:29:18.440160 17930 log.cc:927] Time spent T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3: Append to log took a long time: real 0.055s	user 0.003s	sys 0.000s
I20260709 12:29:18.459408 17604 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "e73a457ec8c74b5481defe532b6ba268"
dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
mode: GRACEFUL
new_leader_uuid: "81441d21f9f442cdbb8b7db3765484fd"
 from {username='slave'} at 127.0.0.1:57064
I20260709 12:29:18.462581 17604 raft_consensus.cc:606] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 LEADER]: Received request to transfer leadership to TS 81441d21f9f442cdbb8b7db3765484fd
I20260709 12:29:18.508353 17964 tablet.cc:1724] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:29:18.504441 17942 log.cc:927] Time spent T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd: Append to log took a long time: real 0.117s	user 0.003s	sys 0.000s
W20260709 12:29:18.509163 17955 log.cc:927] Time spent T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b: Append to log took a long time: real 0.073s	user 0.002s	sys 0.000s
W20260709 12:29:18.533603 17496 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.4.181.67:41275, user_credentials={real_user=slave}} blocked reactor thread for 104828us
I20260709 12:29:18.535277 17967 tablet.cc:1724] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.539366 17966 tablet.cc:1724] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.488246 17940 tablet.cc:1724] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.520443 17962 tablet.cc:1724] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.601433 17973 tablet.cc:1724] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.600888 17972 tablet.cc:1724] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.602939 17975 tablet.cc:1724] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.522368 17965 tablet.cc:1724] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
W20260709 12:29:18.614720 17953 log.cc:927] Time spent T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd: Append to log took a long time: real 0.182s	user 0.002s	sys 0.000s
I20260709 12:29:18.619900 17948 tablet.cc:1724] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.645074 17966 tablet.cc:1724] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.637789 17964 tablet.cc:1724] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.655748 17966 tablet.cc:1724] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.670292 17965 tablet.cc:1724] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.667697 17967 tablet.cc:1724] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.667534 17972 tablet.cc:1724] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.668466 17940 tablet.cc:1724] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.678375 17970 raft_consensus.cc:993] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3: : Instructing follower 81441d21f9f442cdbb8b7db3765484fd to start an election
I20260709 12:29:18.678903 17970 raft_consensus.cc:1081] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 LEADER]: Signalling peer 81441d21f9f442cdbb8b7db3765484fd to start an election
I20260709 12:29:18.681046 17677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "e73a457ec8c74b5481defe532b6ba268"
dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
 from {username='slave'} at 127.0.0.1:42434
I20260709 12:29:18.681599 17677 raft_consensus.cc:493] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:18.681943 17677 raft_consensus.cc:3060] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:18.682514 17966 tablet.cc:1724] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.626425 17976 tablet.cc:1724] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.693820 17967 tablet.cc:1724] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.698868 17677 raft_consensus.cc:515] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:18.674664 17973 tablet.cc:1724] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.705857 17530 tablet_service.cc:2072] Received LeaderStepDown RPC: tablet_id: "ff6c5abfd4014f9385d4d326823caa63"
dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
mode: GRACEFUL
new_leader_uuid: "81441d21f9f442cdbb8b7db3765484fd"
 from {username='slave'} at 127.0.0.1:57048
I20260709 12:29:18.708890 17530 raft_consensus.cc:606] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Received request to transfer leadership to TS 81441d21f9f442cdbb8b7db3765484fd
I20260709 12:29:18.704237 17948 tablet.cc:1724] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.710621  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 2
I20260709 12:29:18.711309  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:18.712960 17677 leader_election.cc:290] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 3 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:18.713182 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e73a457ec8c74b5481defe532b6ba268" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:18.713788 17530 raft_consensus.cc:3060] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:18.715583 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "e73a457ec8c74b5481defe532b6ba268" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:18.716279 17602 raft_consensus.cc:3055] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 LEADER]: Stepping down as leader of term 2
I20260709 12:29:18.716620 17602 raft_consensus.cc:740] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1bdf878b9c63415bb5225d18d95f32f3, State: Running, Role: LEADER
I20260709 12:29:18.717437 17602 consensus_queue.cc:260] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:18.718736 17602 raft_consensus.cc:3060] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Advancing to term 3
I20260709 12:29:18.649290 17979 tablet.cc:1724] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.725733 17948 tablet.cc:1724] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.728924 17530 raft_consensus.cc:2468] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 3.
I20260709 12:29:18.730355 17643 leader_election.cc:304] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 81441d21f9f442cdbb8b7db3765484fd, e8f68305d8674b5c825afab76ae8090b; no voters: 
I20260709 12:29:18.731508 17938 raft_consensus.cc:2804] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 3 FOLLOWER]: Leader election won for term 3
I20260709 12:29:18.732002 17938 raft_consensus.cc:697] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 3 LEADER]: Becoming Leader. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Running, Role: LEADER
I20260709 12:29:18.732793 17938 consensus_queue.cc:237] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:18.744603 17602 raft_consensus.cc:2468] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 3.
I20260709 12:29:18.744241 17976 tablet.cc:1724] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd: Alter schema from (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 0 to (
    10:key INT32 NOT NULL,
    11:int_val INT32 NOT NULL,
    12:string_val STRING NULLABLE,
    PRIMARY KEY (key)
) version 1
I20260709 12:29:18.758383 17426 catalog_manager.cc:6242] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382: soft_deleted_table [id=ce238087c053438bad50a1ee0d5eae9e] alter complete (version 1)
I20260709 12:29:18.768850 17428 catalog_manager.cc:5697] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd reported cstate change: term changed from 2 to 3, leader changed from 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66) to 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67). New cstate: current_term: 3 leader_uuid: "81441d21f9f442cdbb8b7db3765484fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:18.942307 17958 raft_consensus.cc:993] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b: : Instructing follower 81441d21f9f442cdbb8b7db3765484fd to start an election
I20260709 12:29:18.942797 17861 raft_consensus.cc:1081] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Signalling peer 81441d21f9f442cdbb8b7db3765484fd to start an election
I20260709 12:29:18.944237 17677 tablet_service.cc:2044] Received Run Leader Election RPC: tablet_id: "ff6c5abfd4014f9385d4d326823caa63"
dest_uuid: "81441d21f9f442cdbb8b7db3765484fd"
 from {username='slave'} at 127.0.0.1:42428
I20260709 12:29:18.944749 17677 raft_consensus.cc:493] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20260709 12:29:18.945158 17677 raft_consensus.cc:3060] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.950346 17677 raft_consensus.cc:515] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:18.951965 17677 leader_election.cc:290] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 2 election: Requested vote from peers e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015), 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585)
I20260709 12:29:18.952879 17530 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6c5abfd4014f9385d4d326823caa63" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e8f68305d8674b5c825afab76ae8090b"
I20260709 12:29:18.953131 17602 tablet_service.cc:1917] Received RequestConsensusVote() RPC: tablet_id: "ff6c5abfd4014f9385d4d326823caa63" candidate_uuid: "81441d21f9f442cdbb8b7db3765484fd" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1bdf878b9c63415bb5225d18d95f32f3"
I20260709 12:29:18.953478 17530 raft_consensus.cc:3055] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Stepping down as leader of term 1
I20260709 12:29:18.953806 17602 raft_consensus.cc:3060] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.953871 17530 raft_consensus.cc:740] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e8f68305d8674b5c825afab76ae8090b, State: Running, Role: LEADER
I20260709 12:29:18.954727 17530 consensus_queue.cc:260] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:18.955624 17530 raft_consensus.cc:3060] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Advancing to term 2
I20260709 12:29:18.959249 17602 raft_consensus.cc:2468] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 2.
I20260709 12:29:18.960520 17645 leader_election.cc:304] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1bdf878b9c63415bb5225d18d95f32f3, 81441d21f9f442cdbb8b7db3765484fd; no voters: 
I20260709 12:29:18.960534 17530 raft_consensus.cc:2468] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 81441d21f9f442cdbb8b7db3765484fd in term 2.
I20260709 12:29:18.961308 17938 raft_consensus.cc:2804] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Leader election won for term 2
I20260709 12:29:18.961781 17938 raft_consensus.cc:697] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [term 2 LEADER]: Becoming Leader. State: Replica: 81441d21f9f442cdbb8b7db3765484fd, State: Running, Role: LEADER
I20260709 12:29:18.962509 17938 consensus_queue.cc:237] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } }
I20260709 12:29:18.970691 17428 catalog_manager.cc:5697] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd reported cstate change: term changed from 1 to 2, leader changed from e8f68305d8674b5c825afab76ae8090b (127.4.181.65) to 81441d21f9f442cdbb8b7db3765484fd (127.4.181.67). New cstate: current_term: 2 leader_uuid: "81441d21f9f442cdbb8b7db3765484fd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "81441d21f9f442cdbb8b7db3765484fd" member_type: VOTER last_known_addr { host: "127.4.181.67" port: 41275 } health_report { overall_health: HEALTHY } } }
I20260709 12:29:19.344048 17602 raft_consensus.cc:1275] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 3 FOLLOWER]: Refusing update from remote peer 81441d21f9f442cdbb8b7db3765484fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:19.346361 17938 consensus_queue.cc:1048] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:19.356715 17530 raft_consensus.cc:1275] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [term 3 FOLLOWER]: Refusing update from remote peer 81441d21f9f442cdbb8b7db3765484fd: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20260709 12:29:19.358922 17902 consensus_queue.cc:1048] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20260709 12:29:19.456336 17602 raft_consensus.cc:1275] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Refusing update from remote peer 81441d21f9f442cdbb8b7db3765484fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:19.457619 17938 consensus_queue.cc:1048] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "1bdf878b9c63415bb5225d18d95f32f3" member_type: VOTER last_known_addr { host: "127.4.181.66" port: 44585 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20260709 12:29:19.470562 17530 raft_consensus.cc:1275] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Refusing update from remote peer 81441d21f9f442cdbb8b7db3765484fd: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20260709 12:29:19.472669 17987 consensus_queue.cc:1048] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [LEADER]: Connected to new peer: Peer: permanent_uuid: "e8f68305d8674b5c825afab76ae8090b" member_type: VOTER last_known_addr { host: "127.4.181.65" port: 42015 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20260709 12:29:19.712786  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:19.719211  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:19.719578  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:20.720829  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:20.726205  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:20.726652  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:21.727612  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:21.733547  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:21.734053  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:22.735003  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:22.740134  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:22.740562  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:23.741441  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:23.747789  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:23.748222  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:24.749212  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:24.755765  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:24.756309  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:25.757409  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:25.762435  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:25.762892  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:26.763801  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:26.768787  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:26.769323  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:27.770357  4821 auto_leader_rebalancer.cc:141] leader rebalance for table test-workload
I20260709 12:29:27.775761  4821 auto_leader_rebalancer.cc:440] table: test-workload, leader rebalance finish, leader transfer count: 0
I20260709 12:29:27.776227  4821 auto_leader_rebalancer.cc:515] All tables' leader rebalancing finished this round
I20260709 12:29:28.832674  4821 tablet_server.cc:179] TabletServer@127.4.181.65:0 shutting down...
W20260709 12:29:28.844244 17643 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 13 similar messages]
W20260709 12:29:28.851568 17643 consensus_peers.cc:597] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd -> Peer e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015): Couldn't send request to peer e8f68305d8674b5c825afab76ae8090b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:28.854568 17643 consensus_peers.cc:597] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd -> Peer e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015): Couldn't send request to peer e8f68305d8674b5c825afab76ae8090b. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:28.870572  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:28.871491  4821 tablet_replica.cc:333] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.872309  4821 raft_consensus.cc:2243] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:28.872922  4821 raft_consensus.cc:2272] T dfcd1f37558f4559bf9af2b0f6768600 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.875593  4821 tablet_replica.cc:333] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.876317  4821 raft_consensus.cc:2243] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:28.877014  4821 raft_consensus.cc:2272] T 018c076072bb42608d8414d6ec91f80f P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.879714  4821 tablet_replica.cc:333] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.880388  4821 raft_consensus.cc:2243] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:28.880978  4821 raft_consensus.cc:2272] T a7851836951b47fd84e1e04bb97aa015 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.883606  4821 tablet_replica.cc:333] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.884227  4821 raft_consensus.cc:2243] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:28.884765  4821 raft_consensus.cc:2272] T 8458b7f6b80643488fd4bb86f4b52f20 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.887460  4821 tablet_replica.cc:333] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.888084  4821 raft_consensus.cc:2243] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:28.888936  4821 raft_consensus.cc:2272] T a1e9753b18a14698a48b2634cbb6735d P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.891577  4821 tablet_replica.cc:333] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.892274  4821 raft_consensus.cc:2243] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:28.893486  4821 raft_consensus.cc:2272] T e0230111cda042999f62a185104bf907 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.896242  4821 tablet_replica.cc:333] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.896802  4821 raft_consensus.cc:2243] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:28.897306  4821 raft_consensus.cc:2272] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.899858  4821 tablet_replica.cc:333] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.900604  4821 raft_consensus.cc:2243] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:28.901870  4821 raft_consensus.cc:2272] T c0fe7fbeab8346e6851bdf62eee362cf P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.905308  4821 tablet_replica.cc:333] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.905834  4821 raft_consensus.cc:2243] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:28.906342  4821 raft_consensus.cc:2272] T 8c3dc8230bed4a4a9ee2087323af1274 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.908823  4821 tablet_replica.cc:333] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.909464  4821 raft_consensus.cc:2243] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:28.910331  4821 raft_consensus.cc:2272] T f67d18d64f1f4e62adaaf5463889c313 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.912576  4821 tablet_replica.cc:333] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.913122  4821 raft_consensus.cc:2243] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:28.913540  4821 raft_consensus.cc:2272] T ff6c5abfd4014f9385d4d326823caa63 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.915611  4821 tablet_replica.cc:333] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.916132  4821 raft_consensus.cc:2243] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:28.916958  4821 raft_consensus.cc:2272] T 384a1b6765dd4606b086be68b7a0e8b0 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.919292  4821 tablet_replica.cc:333] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.919824  4821 raft_consensus.cc:2243] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:28.920241  4821 raft_consensus.cc:2272] T e4ffbcfb8f514f94b30298d803ff4479 P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.922482  4821 tablet_replica.cc:333] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.922974  4821 raft_consensus.cc:2243] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:28.923439  4821 raft_consensus.cc:2272] T 6d428813b51b45acac6923de43089a2d P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.925858  4821 tablet_replica.cc:333] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.926374  4821 raft_consensus.cc:2243] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:28.926795  4821 raft_consensus.cc:2272] T e73a457ec8c74b5481defe532b6ba268 P e8f68305d8674b5c825afab76ae8090b [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.929090  4821 tablet_replica.cc:333] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.929636  4821 raft_consensus.cc:2243] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:28.930725  4821 raft_consensus.cc:2272] T 936d28e6956b49a3afaea2f695aec47a P e8f68305d8674b5c825afab76ae8090b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.932886  4821 tablet_replica.cc:333] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.933373  4821 raft_consensus.cc:2243] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:28.933820  4821 raft_consensus.cc:2272] T 19bcdba75ad0445ca47283e77797e7fa P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.936089  4821 tablet_replica.cc:333] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b: stopping tablet replica
I20260709 12:29:28.936561  4821 raft_consensus.cc:2243] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:28.937397  4821 raft_consensus.cc:2272] T b442e5d870aa4a52a5b258bb8c78a626 P e8f68305d8674b5c825afab76ae8090b [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:28.983669  4821 tablet_server.cc:196] TabletServer@127.4.181.65:0 shutdown complete.
W20260709 12:29:29.002769 17568 consensus_peers.cc:597] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 -> Peer e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015): Couldn't send request to peer e8f68305d8674b5c825afab76ae8090b. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:29.032671  4821 tablet_server.cc:179] TabletServer@127.4.181.66:0 shutting down...
I20260709 12:29:29.060021  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:29.060920  4821 tablet_replica.cc:333] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.061760  4821 raft_consensus.cc:2243] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.062296  4821 raft_consensus.cc:2272] T 018c076072bb42608d8414d6ec91f80f P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.064755  4821 tablet_replica.cc:333] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.065639  4821 raft_consensus.cc:2243] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:29.066829  4821 raft_consensus.cc:2272] T a7851836951b47fd84e1e04bb97aa015 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:29.070586 17568 consensus_peers.cc:597] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 -> Peer e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015): Couldn't send request to peer e8f68305d8674b5c825afab76ae8090b. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:29.070807  4821 tablet_replica.cc:333] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
W20260709 12:29:29.071110 17568 consensus_peers.cc:597] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 -> Peer e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015): Couldn't send request to peer e8f68305d8674b5c825afab76ae8090b. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:29.071658  4821 raft_consensus.cc:2243] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:29.072593  4821 raft_consensus.cc:2272] T dfcd1f37558f4559bf9af2b0f6768600 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.074890  4821 tablet_replica.cc:333] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.075573  4821 raft_consensus.cc:2243] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:29.076588  4821 raft_consensus.cc:2272] T 8458b7f6b80643488fd4bb86f4b52f20 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.079670  4821 tablet_replica.cc:333] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.080276  4821 raft_consensus.cc:2243] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.080878  4821 raft_consensus.cc:2272] T a1e9753b18a14698a48b2634cbb6735d P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.083307  4821 tablet_replica.cc:333] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.083945  4821 raft_consensus.cc:2243] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.084646  4821 raft_consensus.cc:2272] T e0230111cda042999f62a185104bf907 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.087149  4821 tablet_replica.cc:333] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.087800  4821 raft_consensus.cc:2243] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.088433  4821 raft_consensus.cc:2272] T ff6c5abfd4014f9385d4d326823caa63 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.091351  4821 tablet_replica.cc:333] T f67d18d64f1f4e62adaaf5463889c313 P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.092041  4821 raft_consensus.cc:2243] T f67d18d64f1f4e62adaaf5463889c313 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.092690  4821 raft_consensus.cc:2272] T f67d18d64f1f4e62adaaf5463889c313 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.095214  4821 tablet_replica.cc:333] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.096038  4821 raft_consensus.cc:2243] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:29.097028  4821 raft_consensus.cc:2272] T 6d428813b51b45acac6923de43089a2d P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.099500  4821 tablet_replica.cc:333] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.100119  4821 raft_consensus.cc:2243] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:29.102588  4821 raft_consensus.cc:2272] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.104874  4821 tablet_replica.cc:333] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.105497  4821 raft_consensus.cc:2243] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.106024  4821 raft_consensus.cc:2272] T c0fe7fbeab8346e6851bdf62eee362cf P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.108358  4821 tablet_replica.cc:333] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.108958  4821 raft_consensus.cc:2243] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:29.109797  4821 raft_consensus.cc:2272] T 8c3dc8230bed4a4a9ee2087323af1274 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.112044  4821 tablet_replica.cc:333] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.112588  4821 raft_consensus.cc:2243] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.113059  4821 raft_consensus.cc:2272] T e73a457ec8c74b5481defe532b6ba268 P 1bdf878b9c63415bb5225d18d95f32f3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.115309  4821 tablet_replica.cc:333] T 936d28e6956b49a3afaea2f695aec47a P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.115936  4821 raft_consensus.cc:2243] T 936d28e6956b49a3afaea2f695aec47a P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.116518  4821 raft_consensus.cc:2272] T 936d28e6956b49a3afaea2f695aec47a P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.118945  4821 tablet_replica.cc:333] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.119642  4821 raft_consensus.cc:2243] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.120388  4821 raft_consensus.cc:2272] T 384a1b6765dd4606b086be68b7a0e8b0 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.122934  4821 tablet_replica.cc:333] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.123488  4821 raft_consensus.cc:2243] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:29.124430  4821 raft_consensus.cc:2272] T e4ffbcfb8f514f94b30298d803ff4479 P 1bdf878b9c63415bb5225d18d95f32f3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.126711  4821 tablet_replica.cc:333] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.127226  4821 raft_consensus.cc:2243] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.127795  4821 raft_consensus.cc:2272] T 19bcdba75ad0445ca47283e77797e7fa P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.130337  4821 tablet_replica.cc:333] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3: stopping tablet replica
I20260709 12:29:29.130894  4821 raft_consensus.cc:2243] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.131501  4821 raft_consensus.cc:2272] T b442e5d870aa4a52a5b258bb8c78a626 P 1bdf878b9c63415bb5225d18d95f32f3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20260709 12:29:29.155781 17645 consensus_peers.cc:597] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd -> Peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Couldn't send request to peer 1bdf878b9c63415bb5225d18d95f32f3. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:29.178787  4821 tablet_server.cc:196] TabletServer@127.4.181.66:0 shutdown complete.
W20260709 12:29:29.184192 17643 consensus_peers.cc:597] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd -> Peer e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015): Couldn't send request to peer e8f68305d8674b5c825afab76ae8090b. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:29.212155 17643 consensus_peers.cc:597] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd -> Peer e8f68305d8674b5c825afab76ae8090b (127.4.181.65:42015): Couldn't send request to peer e8f68305d8674b5c825afab76ae8090b. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.65:42015: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20260709 12:29:29.219998 17645 consensus_peers.cc:597] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd -> Peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Couldn't send request to peer 1bdf878b9c63415bb5225d18d95f32f3. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:44585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:29.225018  4821 tablet_server.cc:179] TabletServer@127.4.181.67:0 shutting down...
W20260709 12:29:29.254511 17645 consensus_peers.cc:597] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd -> Peer 1bdf878b9c63415bb5225d18d95f32f3 (127.4.181.66:44585): Couldn't send request to peer 1bdf878b9c63415bb5225d18d95f32f3. Status: Network error: Client connection negotiation failed: client connection to 127.4.181.66:44585: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260709 12:29:29.256615  4821 ts_tablet_manager.cc:1507] Shutting down tablet manager...
I20260709 12:29:29.257484  4821 tablet_replica.cc:333] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.258437  4821 raft_consensus.cc:2243] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:29.259719  4821 raft_consensus.cc:2272] T 018c076072bb42608d8414d6ec91f80f P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.263063  4821 tablet_replica.cc:333] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.263748  4821 raft_consensus.cc:2243] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.264343  4821 raft_consensus.cc:2272] T a7851836951b47fd84e1e04bb97aa015 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.267098  4821 tablet_replica.cc:333] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.268121  4821 raft_consensus.cc:2243] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.269040  4821 raft_consensus.cc:2272] T dfcd1f37558f4559bf9af2b0f6768600 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.272747  4821 tablet_replica.cc:333] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.273811  4821 raft_consensus.cc:2243] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.274722  4821 raft_consensus.cc:2272] T a1e9753b18a14698a48b2634cbb6735d P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.278398  4821 tablet_replica.cc:333] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.279095  4821 raft_consensus.cc:2243] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.279621  4821 raft_consensus.cc:2272] T 8458b7f6b80643488fd4bb86f4b52f20 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.281761  4821 tablet_replica.cc:333] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.282305  4821 raft_consensus.cc:2243] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.282840  4821 raft_consensus.cc:2272] T e0230111cda042999f62a185104bf907 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.285082  4821 tablet_replica.cc:333] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.285611  4821 raft_consensus.cc:2243] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:29.286525  4821 raft_consensus.cc:2272] T 19bcdba75ad0445ca47283e77797e7fa P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.288865  4821 tablet_replica.cc:333] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.289402  4821 raft_consensus.cc:2243] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.289996  4821 raft_consensus.cc:2272] T b442e5d870aa4a52a5b258bb8c78a626 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.292402  4821 tablet_replica.cc:333] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.292973  4821 raft_consensus.cc:2243] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.293466  4821 raft_consensus.cc:2272] T 384a1b6765dd4606b086be68b7a0e8b0 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.295627  4821 tablet_replica.cc:333] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.296240  4821 raft_consensus.cc:2243] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.296687  4821 raft_consensus.cc:2272] T e4ffbcfb8f514f94b30298d803ff4479 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.298945  4821 tablet_replica.cc:333] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.299537  4821 raft_consensus.cc:2243] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.300001  4821 raft_consensus.cc:2272] T f67d18d64f1f4e62adaaf5463889c313 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.302120  4821 tablet_replica.cc:333] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.302660  4821 raft_consensus.cc:2243] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [term 2 LEADER]: Raft consensus shutting down.
I20260709 12:29:29.303463  4821 raft_consensus.cc:2272] T ff6c5abfd4014f9385d4d326823caa63 P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.305667  4821 tablet_replica.cc:333] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.306211  4821 raft_consensus.cc:2243] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.306696  4821 raft_consensus.cc:2272] T dbbfc9d2b1d24a4790f57b14ba39c1c4 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.308940  4821 tablet_replica.cc:333] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.309757  4821 raft_consensus.cc:2243] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.310323  4821 raft_consensus.cc:2272] T c0fe7fbeab8346e6851bdf62eee362cf P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.312463  4821 tablet_replica.cc:333] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.313011  4821 raft_consensus.cc:2243] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.313467  4821 raft_consensus.cc:2272] T 8c3dc8230bed4a4a9ee2087323af1274 P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.315500  4821 tablet_replica.cc:333] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.316008  4821 raft_consensus.cc:2243] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 3 LEADER]: Raft consensus shutting down.
I20260709 12:29:29.316817  4821 raft_consensus.cc:2272] T e73a457ec8c74b5481defe532b6ba268 P 81441d21f9f442cdbb8b7db3765484fd [term 3 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.319157  4821 tablet_replica.cc:333] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.319842  4821 raft_consensus.cc:2243] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.320315  4821 raft_consensus.cc:2272] T 936d28e6956b49a3afaea2f695aec47a P 81441d21f9f442cdbb8b7db3765484fd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.322531  4821 tablet_replica.cc:333] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd: stopping tablet replica
I20260709 12:29:29.323015  4821 raft_consensus.cc:2243] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus shutting down.
I20260709 12:29:29.323424  4821 raft_consensus.cc:2272] T 6d428813b51b45acac6923de43089a2d P 81441d21f9f442cdbb8b7db3765484fd [term 2 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.381232  4821 tablet_server.cc:196] TabletServer@127.4.181.67:0 shutdown complete.
I20260709 12:29:29.444789  4821 master.cc:562] Master@127.4.181.126:45421 shutting down...
I20260709 12:29:29.467662  4821 raft_consensus.cc:2243] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [term 1 LEADER]: Raft consensus shutting down.
I20260709 12:29:29.468498  4821 raft_consensus.cc:2272] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260709 12:29:29.468861  4821 tablet_replica.cc:333] T 00000000000000000000000000000000 P ec937a54e65544069ba5518ec239d382: stopping tablet replica
I20260709 12:29:29.490243  4821 master.cc:584] Master@127.4.181.126:45421 shutdown complete.
[       OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20746 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (45243 ms total)

[----------] Global test environment tear-down
[==========] 8 tests from 2 test suites ran. (411109 ms total)
[  PASSED  ] 7 tests.
[  FAILED  ] 1 test, listed below:
[  FAILED  ] LeaderRebalancerTest.AddTserver

 1 FAILED TEST
I20260709 12:29:29.553037  4821 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2239 messages since previous log ~35 seconds ago
I20260709 12:29:29.553283  4821 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2239 messages since previous log ~35 seconds ago
I20260709 12:29:29.553457  4821 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2238 messages since previous log ~35 seconds ago
I20260709 12:29:29.553658  4821 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:600: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:29:29.553861  4821 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/ts_tablet_manager.cc:548: suppressed but not reported on 9 messages since previous log ~54 seconds ago
I20260709 12:29:29.554054  4821 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tserver/heartbeater.cc:646: suppressed but not reported on 4 messages since previous log ~198 seconds ago
I20260709 12:29:29.554219  4821 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/consensus/raft_consensus.cc:670: suppressed but not reported on 3 messages since previous log ~277 seconds ago
I20260709 12:29:29.554399  4821 logging.cc:436] LogThrottler Service Queue Overflow: suppressed but not reported on 1 messages since previous log ~285 seconds ago
I20260709 12:29:29.554597  4821 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/service_pool.cc:136: suppressed but not reported on 1 messages since previous log ~285 seconds ago
I20260709 12:29:29.554805  4821 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/master/catalog_manager.cc:5227: suppressed but not reported on 2 messages since previous log ~247 seconds ago
I20260709 12:29:29.555116  4821 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 10 messages since previous log ~0 seconds ago
I20260709 12:29:29.555442  4821 logging.cc:436] LogThrottler /apache/dev/git/kudu/src/kudu/tablet/tablet.cc:2406: suppressed but not reported on 53 messages since previous log ~19 seconds ago
